Multidimensional Levels of Language Writing Measures in Grades Four to Six

Gary A. Troia Michigan State University ; Mei Shen Michigan State University ; Diana L. Brandon Charleston Southern University

Abstract

This study examined multiple measures of written expression as predictors of narrative writing performance for 362 students in grades 4 through 6. Each student wrote a fictional narrative in response to a title prompt that was evaluated using a levels of language framework targeting productivity, accuracy, and complexity at the word, sentence, and discourse levels. Grade-related differences were found for all of the word-level and most of the discourse-level variables examined, but for only one sentence-level variable (punctuation accuracy). The discourse-level variables of text productivity, narrativity, and process use, the sentence-level variables of grammatical correctness and punctuation accuracy, and the word-level variables of spelling/capitalization accuracy, lexical productivity, and handwriting style were significant predictors of narrative quality. Most of the same variables that predicted story quality differentiated good and poor narrative writers, except punctuation accuracy and narrativity, and variables associated with word and sentence complexity also helped distinguish narrative writing ability. The findings imply that a combination of indices from across all levels of language production are most useful for differentiating writers and their writing. The authors suggest researchers and educators consider levels of language measures such as those used in this study in their evaluations of writing performance, as a number of them are fairly easy to calculate and are not plagued by subjective judgments endemic to most writing quality rubrics.

Journal
Written Communication
Published
2019-04-01
DOI
10.1177/0741088318819473
CompPile
Open Access
Closed
Topics
Export

Citation context

References (88) · 8 in this index

  1. 10.1037/a0019318
     ↗
  2. 10.1037/a0035692
     ↗
  3. 10.1007/s11145-013-9481-0
     ↗
  4. 10.1007/s11145-007-9107-5
     ↗
  5. Assessing Writing
Show all 88 →
  1. The psychology of written composition
  2. 10.1097/00011363-200020040-00007
     ↗
  3. 10.1080/1057356940100307
     ↗
  4. 10.1037/0022-0663.94.2.291
     ↗
  5. 10.1177/0265532214542994
     ↗
  6. Handbook of automated essay scoring: Current applications and future directions
  7. 10.1037/a0022824
     ↗
  8. Writing pathways: Performance assessments and learning progressions, grades K-8
  9. 10.1017/S0142716400007293
     ↗
  10. 10.5070/L4112005035
     ↗
  11. Proceedings of the Corpus Linguistics 2001 Conference
  12. Common Core State Standards. (2010). Preparing America’s students for success. National Governors Association…
  13. Written Communication
  14. 6 + 1 traits of writing: The complete guide grades 3 and up
  15. 10.1037/a0012656
     ↗
  16. Assessing Writing
  17. 10.1177/001440298204800417
     ↗
  18. Relationships among simple measures of written expression and performance on standardized…
  19. 10.1177/001440290907500403
     ↗
  20. 10.1044/1092-4388(2004/098)
     ↗
  21. 10.1207/s1532690xci0401_1
     ↗
  22. Handbook of automated essay scoring: Current applications and future directions
  23. 10.1207/SLDRP1502_4
     ↗
  24. 10.1080/02796015.2006.12087977
     ↗
  25. 10.1086/651193
     ↗
  26. 10.3102/0013189X11413260
     ↗
  27. 10.3758/BF03195564
     ↗
  28. Want to improve children’s writing?
    American Educator
  29. 10.1037/0022-0663.89.1.170
     ↗
  30. 10.1007/s11145-013-9495-7
     ↗
  31. 10.17161/foec.v44i4.6687
     ↗
  32. 10.1007/s11145-007-9064-z
     ↗
  33. 10.1037/0022-0663.87.2.230
     ↗
  34. 10.17161/foec.v13i2.7428
     ↗
  35. 10.1177/1525740112465001
     ↗
  36. 10.1044/2015_LSHSS-14-0043
     ↗
  37. Test of written language
  38. 10.2307/377723
     ↗
  39. 10.1093/acprof:oso/9780199827282.003.0001
     ↗
  40. 10.1080/01638538309544557
     ↗
  41. 10.1111/emip.12036
     ↗
  42. Grammatical structures written at three grade levels
  43. 10.1080/02796015.2007.12087919
     ↗
  44. 10.1044/1058-0360(2006/017)
     ↗
  45. Research in the Teaching of English
  46. 10.1044/2016_JSLHR-L-15-0133
     ↗
  47. 10.1086/697510
     ↗
  48. 10.1044/0161-1461(2012/11-0018)
     ↗
  49. 10.1111/1460-6984.12306
     ↗
  50. Analytic scoring of TOEFL CBT essays: Scores from humans and E-rater
  51. 10.1177/00224669060400020301
     ↗
  52. MacArthur C. A. Jennings A. Philippakos Z. A. (2018). Which linguistic features predict quality of argumentat…
     ↗
  53. 10.1177/093889829100600403
     ↗
  54. 10.1044/1092-4388(2004/109)
     ↗
  55. The reliability of simple, direct measures of written expression
  56. McCarthy P. M. (2005). An assessment of the range and usefulness of lexical diversity measures and the potent…
  57. McCarthy P. M. Jarvis S. (2010). MTLD vocd-D and HD-D: A validation study of sophisticated approaches to lexi…
     ↗
  58. Written Communication
  59. 10.4018/978-1-60960-741-8.ch011
     ↗
  60. 10.1017/CBO9780511894664
     ↗
  61. McNamara D. S. Louwerse M. M. Cai Z. Graesser A. (2005). Coh-Metrix version 3.0. Retrieved from http://cohmet…
  62. Assessing Writing
  63. 10.20360/G21S3V
     ↗
  64. 10.1080/10573560701277807
     ↗
  65. Using a writing assessment framework to explore the validity of writing test results
  66. Research in the Teaching of English
  67. Proceedings of the second international Tampere conference in statistics
  68. 10.1044/1058-0360(2008/012)
     ↗
  69. 10.2307/25474635
     ↗
  70. 10.1207/S15326950dp2901_3
     ↗
  71. Handbook of automated essay scoring: Current applications and future directions
  72. 10.1044/jslhr.4302.324
     ↗
  73. 10.1086/683135
     ↗
  74. 10.1044/0161-1461(2011/10-0099)
     ↗
  75. 10.1016/j.sbspro.2013.10.668
     ↗
  76. 10.3200/JOER.102.5.323-332
     ↗
  77. 10.1177/00222194020350040101
     ↗
  78. 10.1007/s11145-012-9379-2
     ↗
  79. 10.1007/s11145-010-9266-7
     ↗
  80. 10.1044/jshr.3806.1349
     ↗
  81. 10.1016/S0022-5371(78)90110-X
     ↗
  82. Assessing Writing
  83. 10.1044/jslhr.4306.1322
     ↗