Written Communication Jul 2011

The Development of Writing Proficiency as a Function of Grade Level: A Linguistic Analysis

Scott A. Crossley Georgia State University ; Jennifer L. Weston University of Memphis ; Susan T. McLain Sullivan Oakton Community College ; Danielle S. McNamara University of Memphis

Abstract

In this study, a corpus of essays stratified by level (9th grade, 11th grade, and college freshman) are analyzed computationally to discriminate differences between the linguistic features produced in essays by adolescents and young adults. The automated tool Coh-Metrix is used to examine to what degree essays written at various grade levels can be distinguished from one another using a number of linguistic features related to lexical sophistication (i.e., word frequency, word concreteness), syntactic complexity (i.e., the number of modifiers per noun phrase), and cohesion (i.e., word overlap, incidence of connectives). The analysis demonstrates that high school and college writers develop linguistic strategies as a function of grade level. Primarily, these writers produce more sophisticated words and more complex sentence structure as grade level increases. In contrast, these writers produce fewer cohesive features in text as a function of grade level. This analysis supports the notion that linguistic development occurs in the later stages of writing development and that this development is primarily related to producing texts that are less cohesive and more elaborate.

Journal
Written Communication
Published
2011-07-01
DOI
10.1177/0741088311410188
CompPile
Open Access
Closed
Topics
Export
BibTeX RIS

Citation context

Cited by in this index (23)

  1. Oğuz (2025)
    Can generative AI figure out figurative language? The influence of idioms on es…
    Assessing Writing
  2. Hwang (2025)
    The Impact of Subordination Type and Finiteness on Second Language Development …
    Written Communication
  3. Chung et al. (2025)
    Examining the use of academic vocabulary in first-year ESL undergraduates’ writ…
    Assessing Writing
  4. Wang et al. (2025)
    A meta-analysis of relationships between syntactic features and writing perform…
    Assessing Writing
  5. Zappoli et al. (2024)
    A Synchronic and Diachronic Study of Students’ Essays in Italian High Schools: …
    Written Communication
Show all 23 →
  1. Harsch et al. (2024)
    Validating an integrated reading-into-writing scale with trained university students
    Assessing Writing
  2. Tate et al. (2024)
    Linguistic Features of Secondary School Writing: Can Natural Language Processin…
    Written Communication
  3. Wang et al. (2023)
    Writing Quality Predictive Modeling: Integrating Register-Related Factors
    Written Communication
  4. Tabari et al. (2023)
    Exploring new insights into the role of cohesive devices in written academic genres
    Assessing Writing
  5. Uccelli (2023)
    The Language Demands of Analytical Reading and Writing at School
    Written Communication
  6. Black (2022)
    Variation in Linguistic Stance: A Person-Centered Analysis of Student Writing
    Written Communication
  7. Huang et al. (2022)
    The trajectory of syntactic complexity development in L1 Chinese narrative writ…
    Assessing Writing
  8. Crossley et al. (2022)
    Linguistic Features of Writing Quality and Development: A Longitudinal Approach
    Journal of Writing Analytics
  9. McDonough et al. (2021)
    Instructor Evaluation of Business Student Writing: Does Language Play a Role?
    Business and Professional Communication Quarterly
  10. Jo (2021)
    Exploring General Versus Academic English Proficiency as Predictors of Adolesce…
    Written Communication
  11. Troia et al. (2019)
    Multidimensional Levels of Language Writing Measures in Grades Four to Six
    Written Communication
  12. Barkaoui et al. (2018)
    The effects of writing mode and computer ability on L2 test-takers' essay chara…
    Assessing Writing
  13. Wilson et al. (2017)
    Automated formative writing assessment using a levels of language framework
    Assessing Writing
  14. Isbell (2017)
    Assessing C2 writing ability on the Certificate of English Language Proficiency…
    Assessing Writing
  15. Staples et al. (2016)
    Academic Writing Development at the University Level: Phrasal and Clausal Compl…
    Written Communication
  16. Banerjee et al. (2015)
    Keeping up with the times: Revising and refreshing a rating scale
    Assessing Writing
  17. McNamara et al. (2015)
    A hierarchical classification approach to automated essay scoring
    Assessing Writing
  18. Crossley et al. (2014)
    What Is Successful Writing? An Investigation Into the Multiple Ways Writers Can…
    Written Communication

References (67) · 8 in this index

  1. 10.1037/0022-0663.85.3.478
     ↗
  2. 10.1037/a0019318
     ↗
  3. Akiguet et al. (1996)
    Insertion of connectives by 9- to 11-year-old children in an argumentative text
    Argumentation
  4. Baayen, R.H. (1995)
    The CELEX lexical database (release 2) [CD]
  5. 10.1044/0161-1461(2009/08-0002)
     ↗
Show all 67 →
  1. 10.1207/s1532799xssr1002_3
     ↗
  2. 10.1007/BF01026911
     ↗
  3. Berninger, V. (1991)
    10.1016/0022-4405(91)90016-K
    Journal of School Psychology  ↗
  4. 10.1007/BF01027151
     ↗
  5. Brace, N. (2006)
    SPSS for psychologists
  6. Costerman, J. (1997)
    Processing interclausal relationships: Studies in production and comprehension of text
  7. CRISMORE et al. (1993)
    Metadiscourse in Persuasive Writing: A Study of Texts Written by American and F…
    Written Communication
  8. 10.1002/j.1545-7249.2008.tb00142.x
     ↗
  9. Crossley, S.A.
    Proceedings of the 32nd annual conference of the Cognitive Science Society
  10. Crossley, S.A.
    Journal of Research in Reading
  11. Douglas, D. ( 1981). An exploratory study of bilingual reading proficiency . In S. Hudelson (Ed.), Learning t…
  12. Durst, R.K. ( 1984). The development of analytic writing. In A. N. Applebee (Ed.), Contexts for learning to w…
  13. 10.7551/mitpress/7287.001.0001
     ↗
  14. Field, A. (2005)
    Discovering statistics using SPSS
  15. 10.2307/356491
     ↗
  16. 10.1111/j.1467-9817.2009.01431.x
     ↗
  17. 10.3758/BF03195564
     ↗
  18. 10.1037/0096-3445.114.3.357
     ↗
  19. Halliday, M.A.K. (1976)
    Cohesion in English
  20. Haswell, R.H. (1986)
    Change in undergraduate and post-graduate writing performance: Quantified findings (Techn…
  21. 10.2307/377723
     ↗
  22. HASWELL (2000)
    Documenting Improvement in College Writing: A Longitudinal Approach
    Written Communication
  23. Hayes, J. & Flower, L. ( 1980). Identifying the organization of the writing process. In L. W. Gregg & E. R. S…
  24. Hillocks, G. (2002)
    The testing nap: How state writing assessments control learning
  25. Hunt, K.W. (1965)
    Grammatical structures written at three grade levels (NCTE Research Report Number 3)
  26. 10.3102/00346543060002237
     ↗
  27. Institute of Education Sciences. (2003)
    NCES
  28. 10.1037/0033-295X.87.4.329
     ↗
  29. 10.1037/0033-295X.99.1.122
     ↗
  30. Kellogg (2008)
    Training writing skills: A cognitive developmental perspective
    Journal of Writing Research
  31. King et al. (1979)
    Toward a Theory of Early Writing Development
    Research in the Teaching of English
  32. 10.1037/0033-295X.85.5.363
     ↗
  33. 10.4324/9780203936399
     ↗
  34. Loban, W.D. (1976)
    Language development: Kindergarten through grade twelve (Research Report Number 18)
  35. Longo, B. (1994)
    Technical Communication
  36. Louwerse, M.M. (2001)
    10.1515/cogl.2002.005
    Cognitive Linguistics  ↗
  37. 10.1057/9780230511804
     ↗
  38. 10.3758/BRM.42.2.381
     ↗
  39. 10.1016/0749-596X(86)90036-7
     ↗
  40. 10.1207/S15326985EP3501_3
     ↗
  41. 10.1515/text.1.1982.2.1-3.113
     ↗
  42. 10.1037/h0087352
     ↗
  43. McNamara et al. (2010)
    Linguistic Features of Writing Quality
    Written Communication
  44. McNamara, D.S.
    Coh-Metrix
     ↗
  45. 10.1207/s1532690xci1401_1
     ↗
  46. Miller, G.A. (1990)
    Five papers on WordNet
  47. O’Donnell, R.C. (1967)
    NCTE Research Report Number
  48. Oliver (1995)
    The Writing Quality of Seventh, Ninth, and Eleventh Graders, and College Freshm…
    Research in the Teaching of English
  49. 10.1080/01638530709336895
     ↗
  50. 10.2307/747180
     ↗
  51. 10.1002/9780470757642.ch13
     ↗
  52. Perfetti, C. & McCutchen, D. ( 1987). Schooled language competence: Linguistic abilities in reading and writi…
  53. 10.1598/RRQ.20.2.4
     ↗
  54. Rayner, K. (1994)
    The psychology of reading
  55. Stewart (1978)
    Syntactic Maturity from High School to University: A First Look
    Research in the Teaching of English
  56. 10.1006/jecp.1996.0054
     ↗
  57. Tabachnick, B.G. (2001)
    Using multivariate statistics
  58. 10.2307/357609
     ↗
  59. Weston, J.L.
    Proceedings of the 24th International Florida Artificial Intelligence Research Society
  60. 10.3758/BF03202594
     ↗
  61. Witten, I.H. (2005)
    Data mining: Practical machine learning tools and techniques
  62. 10.2307/356693
     ↗
CrossRef global citation count: 119 View in citation network → Build reading path →

Related articles

  1. Assessing Writing Jul 2026
    From keystrokes to scores: Toward a multidimensional predictive model of writing evaluation by humans and large language models across linguistic, cognitive, and social dimensions ↗
    Qiao Gan; Benjamin Adams
    assessment artificial intelligence grammar and mechanics race and writing gender and writing
  2. Journal of Technical Writing and Communication Jun 2026
    The Sonic Aesthetics of Science Communication Podcasts ↗
    Caroline Koons; Amelia Chesley
    argument technical communication scientific writing artificial intelligence grammar and mechanics
  3. Assessing Writing Apr 2026
    From spelling to content: The influence of spelling quality on text assessment ↗
    Frederike Strahl; Jörg Kilian; Jens Möller
    assessment grammar and mechanics
  4. Assessing Writing Apr 2026
    How do L2 writing subskills interact hierarchically? Insights from diagnostic classification models ↗
    Farshad Effatpanah; Hamdollah Ravand; Mahmoud Abdi Tabari; Yi-Hsin Chen; Olga Kunina-Habenicht
    assessment multilingual writers grammar and mechanics
  5. Assessing Writing Apr 2026
    Pursuing fair writing assessment: Halo effects in primary school foreign language writing in grade six ↗
    Ruth Trüb; Julian Lohmann; Jens Möller; Stefan D. Keller
    assessment multilingual writers grammar and mechanics