Assessing Writing Apr 2026

Generative artificial intelligence for automated writing evaluation: A systematic review of trends, efficacy, and challenges

Shadi I. Abudalfa King Fahd University of Petroleum and Minerals ; Jessie S. Barrot National University
Journal
Assessing Writing
Published
2026-04-01
DOI
10.1016/j.asw.2026.101041
CompPile
Open Access
Closed
Topics
Export
BibTeX RIS

Citation context

Cited by in this index (0)

No articles in this index cite this work.

References (91) · 4 in this index

  1. Alghannam (2025)
    Artificial intelligence as a provider of feedback on EFL student compositions
    World Journal of English Language  ↗
  2. Aljalahma (2022)
    An updated systematic review of business accelerators: Functions, operation, and gaps in …
    Journal of Open Innovation: Technology, Market, and Complexity  ↗
  3. Alyasiri (2024)
    ChatGPT revisited: Using ChatGPT-4 for finding references and editing language in medical…
    Journal of Stomatology, Oral and Maxillofacial Surgery  ↗
  4. Aperstein (2025)
    GenAI-based platform for deliberate teaching practice: A review and a suggested framework
    Education Sciences  ↗
  5. Asadi (2025)
    The impact of integrating ChatGPT with teachers’ feedback on EFL writing skills
    Thinking Skills and Creativity  ↗
Show all 91 →
  1. Atasoy (2025)
    Chatgpt: A reliable assistant for the evaluation of students’ written texts?
    Education and Information Technologies  ↗
  2. Awidi (2024)
    Comparing expert tutor evaluation of reflective essays with marking by generative artific…
    Computers and Education: Artificial Intelligence
  3. Baas (2020)
    Scopus as a curated, high-quality bibliometric data source for academic research in quant…
    Quantitative Science Studies  ↗
  4. Banihashem (2024)
    Feedback sources in essay writing: Peer-generated or AI-generated feedback?
    International Journal of Educational Technology in Higher Education  ↗
  5. Barrot (2023)
    Using ChatGPT for second language writing: Pitfalls and potentials
    Assessing Writing
  6. Barrot (2024)
    Trends in automated writing evaluation systems research for teaching, learning, and asses…
    Education and Information Technologies  ↗
  7. Behzad (2024)
    Assessing online writing feedback resources: GenAI vs. good samaritans
    Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)
  8. Binhammad (2024)
    Investigating how GenAI can create personalized learning materials tailored to individual…
    Creative Education  ↗
  9. Bittle (2025)
    GenAI and academic integrity in higher education: A systematic review and research agenda
    Information  ↗
  10. Bouziane (2024)
    Ai versus human effectiveness in essay evaluation
    Discover Education  ↗
  11. Braun (2006)
    Using thematic analysis in psychology
    Qualitative Research in Psychology  ↗
  12. Broadfoot (2025)
    GenAI and the social functions of educational assessment
    Oxford Review of Education  ↗
  13. Bucol (2025)
    Exploring ChatGPT as a writing assessment tool
    Innovations in Education and Teaching International  ↗
  14. Bui (2025)
    ChatGPT as an automated essay scoring tool in the writing classrooms: How it compares wit…
    Education and Information Technologies  ↗
  15. Chen (2025)
    Unpacking the rejection of L2 students toward ChatGPT-generated feedback: An explanatory …
    ECNU Review of Education.
  16. Crisan (2021)
    A systematic literature review of quality management initiatives in dental clinics
    International Journal of Environmental Research and Public Health  ↗
  17. Dai (2024)
    Assessing the proficiency of large language models in automatic feedback generation: an e…
    Computers and Education: Artificial Intelligence
  18. Daniel (2025)
    Can GenAI revolutionise academic skills development in higher education? A systematic lit…
    European Journal of Education  ↗
  19. Denyer (2008)
    Developing design propositions through research synthesis
    Organization Studies  ↗
  20. Escalante (2023)
    AI-generated feedback on writing: Insights into efficacy and ENL student preference
    International Journal of Educational Technology in Higher Education  ↗
  21. Feuerriegel (2024)
    Generative AI
    Business & Information Systems Engineering  ↗
  22. Fokides (2025)
    Comparing ChatGPT's correction and feedback comments with that of educators in the contex…
    Education and Information Technologies  ↗
  23. Fu (2024)
    A review of AWE feedback: Types, learning outcomes, and implications
    Computer Assisted Language Learning  ↗
  24. Gao (2024)
    Automatic assessment of text-based responses in post-secondary education: A systematic review
    Computers and Education: Artificial Intelligence
  25. Gough (2017)
    An Introduction to Systematic Reviews
  26. Guo (2024)
    To resist it or to embrace it? examining chatgpt’s potential to support teacher feedback …
    Education and Information Technologies  ↗
  27. Guo (2025)
    Facilitator or thinking inhibitor: Understanding the role of ChatGPT-generated written co…
    Interactive Learning Environments  ↗
  28. Hattie (2007)
    The power of feedback
    Review of Educational Research  ↗
  29. Huang (2025)
    An early review of generative language models in automated writing evaluation: Advancemen…
    Chinese/English Journal of Educational Measurement and Evaluation
  30. Huawei (2023)
    A systematic review of automated writing evaluation systems
    Education and Information Technologies  ↗
  31. Hwang (2025)
    Generative AI is useful for second language writing, but when, why, and for how long do l…
    Journal of Second Language Writing  ↗
  32. Imran (2023)
    Analyzing the role of ChatGPT as a writing assistant at higher education level: A systema…
    Contemporary Educational Technology  ↗
  33. Ivankova (2018)
    Applying mixed methods in action research: Methodological potentials and advantages
    American Behavioral Scientist  ↗
  34. Jiang (2022)
    Appropriating automated feedback in L2 writing: Experiences of Chinese EFL student writers
    Computer Assisted Language Learning  ↗
  35. Khlaif (2025)
    Redesigning assessments for AI-enhanced learning: A framework for educators in the GenAI era
    Education Sciences  ↗
  36. Kinder (2025)
    Effects of adaptive feedback generated by a large language model: A case study in teacher…
    Computers and Education: Artificial Intelligence
  37. Koltovskaia (2020)
    Student engagement with automated written corrective feedback (AWCF) provided b…
    Assessing Writing
  38. Latif (2024)
    Fine-tuning ChatGPT for automatic scoring
    Computers and Education: Artificial Intelligence
  39. Law (2024)
    Application of generative artificial intelligence (GenAI) in language teaching and learni…
    Computers and Education Open  ↗
  40. Le (2024)
    Assessment reform in higher education: An ethical approach to harness the power of genera…
    Education Research and Perspectives  ↗
  41. Lee (2024)
    Harnessing generative AI (GenAI) for automated feedback in higher education: A systematic…
    Online Learning  ↗
  42. Li (2024)
    AI-assisted marking: Functionality and limitations of ChatGPT in written assessment evaluation
    Australasian Journal of Educational Technology
  43. Li (2024)
    Applying large language models for automated essay scoring for non-native Japanese
    Humanities and Social Sciences Communications  ↗
  44. Lingard (2023)
    Will ChatGPT’s free language editing service level the playing field in science communica…
    Perspectives on Medical Education  ↗
  45. Link (2022)
    Impact of automated writing evaluation on teacher feedback, student revision, and writing…
    Computer Assisted Language Learning  ↗
  46. Lu (2024)
    Can ChatGPT effectively complement teacher assessment of undergraduate students’ academic…
    Assessment & Evaluation in Higher Education  ↗
  47. Malina (2011)
    Lessons learned: advantages and disadvantages of mixed method research
    Qualitative Research in Accounting & Management  ↗
  48. Mao (2024)
    Generative artificial intelligence in education and its implications for assessment
    TechTrends  ↗
  49. Methley (2014)
    PICO, PICOS and SPIDER: A comparison study of specificity and sensitivity in three search…
    BMC Health Services Research  ↗
  50. Meyer (2024)
    Using LLMs to bring evidence-based feedback into the classroom: AI-generated feedback inc…
    Computers and Education: Artificial Intelligence
  51. Mizumoto (2023)
    Exploring the potential of using an AI language model for automated essay scoring
    Research Methods in Applied Linguistics  ↗
  52. Ogunleye (2024)
    A systematic review of GenAI for teaching and learning practice
    Education Sciences  ↗
  53. Pack (2024)
    Large language models and automated essay scoring of English language learner writing: In…
    Computers and Education: Artificial Intelligence
  54. Page (2003)
    Project essay grade: PEG
    Automated essay scoring: a cross-disciplinary perspective
  55. Ranalli (2018)
    Automated written corrective feedback: How well can students make use of it?
    Computer Assisted Language Learning  ↗
  56. Ronge (2025)
    Towards a definition of generative artificial intelligence
    Philosophy & Technology  ↗
  57. Seßler (2025)
    Can AI grade your essays? A comparative analysis of large language models and teacher rat…
    Proceedings of the 15th International Learning Analytics and Knowledge Conference  ↗
  58. Shi (2025)
    Comparing the effects of ChatGPT and automated writing evaluation on students’ writing an…
    Computer Assisted Language Learning
  59. Shin (2024)
    Exploratory study on the potential of ChatGPT as a rater of second language writing
    Education and Information Technologies  ↗
  60. Song (2025)
    Exploring AI-assistance in L2 Chinese writing with standardized assessment tasks
    Language Learning & Technology  ↗
  61. Song (2024)
    Automated essay scoring and revising based on open-source large language models
    IEEE Transactions on Learning Technologies  ↗
  62. Steiss (2024)
    Comparing the quality of human and ChatGPT feedback of students’ writing
    Learning and Instruction  ↗
  63. Stevenson (2016)
    A Critical Interpretative Synthesis: The Integration of Automated Writing Evalu…
    Computers and Composition
  64. Tang (2024)
    Harnessing LLMs for multi-dimensional writing assessment: Reliability and alignment with …
    Heliyon  ↗
  65. Tate (2024)
    Can AI provide useful holistic essay scoring?
    Computers and Education: Artificial Intelligence
  66. Tay, A. (2022). Creating search strategies in Scopus to match results from a list of selected journal titles …
  67. Teng (2024)
    ChatGPT is the companion, not enemies”: EFL learners’ perceptions and experiences in usin…
    Computers and Education: Artificial Intelligence
  68. Tordjman (2025)
    Comparative benchmarking of the DeepSeek large language model on medical tasks and clinic…
    Nature Medicine  ↗
  69. van Niekerk (2025)
    Addressing the use of GenAI in academic writing
    Computers and Education: Artificial Intelligence
  70. Waer (2023)
    The effect of integrating automated writing evaluation on EFL writing apprehension and gr…
    Innovation in Language Learning and Teaching  ↗
  71. Wang (2024)
    Effectiveness of large language models in automated evaluation of argumentative essays: f…
    Computer Assisted Language Learning
  72. Wang et al. (2020)
    eRevis(ing): Students’ revision of text evidence use in an automated writing ev…
    Assessing Writing
  73. Wang (2024)
    Critical analysis of the technological affordances, challenges and future directions of G…
    Asia Pacific Journal of Education  ↗
  74. Wangdi (2025)
    Using ChatGPT as an assessment tool in education: A systematic literature review of pract…
    Issues in Educational Research
  75. Wetzler (2024)
    Grading the graders: Comparing generative AI and human assessment in essay evaluation
    Teaching of Psychology
  76. Wiboolyasarin (2024)
    Synergizing collaborative writing and AI feedback: An investigation into enhancing L2 wri…
    Computers and Education: Artificial Intelligence
  77. Wilson (2021)
    Elementary teachers’ perceptions of automated feedback and automated scoring: Transformin…
    Computers & Education  ↗
  78. Xia (2024)
    A scoping review on how generative artificial intelligence transforms assessment in highe…
    International Journal of Educational Technology in Higher Education  ↗
  79. Yamashita (2024)
    An application of many-facet Rasch measurement to evaluate automated essay scoring: A cas…
    Research Methods in Applied Linguistics  ↗
  80. Yang (2024)
    Rhetor: Providing LLM-based feedback for students’ argumentative essays
    Technology Enhanced Learning for Inclusive and Equitable Quality Education
  81. Yavuz (2025)
    Utilizing large language models for EFL essay grading: An examination of reliability and …
    British Journal of Educational Technology  ↗
  82. Yenduri (2024)
    GPT (generative pre-trained transformer)—A comprehensive review on enabling technologies,…
    IEEE Access  ↗
  83. Yeung (2025)
    University students’ engagement with generative AI-supported automated writing evaluation…
    Journal of Second Language Writing  ↗
  84. Zhang (2024)
    A systematic review of ChatGPT use in K-12 education
    European Journal of Education  ↗
  85. Zhang (2021)
    Review of automated writing evaluation systems
    Journal of China Computer-Assisted Language Learning  ↗
  86. Zhao (2024)
    GenAI and educational assessments: A systematic review
    Education Research and Perspectives  ↗
CrossRef global citation count: 0 View in citation network → Build reading path →

Related articles

  1. Journal of Technical Writing and Communication Oct 2024
    Generative AI in Technical Communication: A Review of Research from 2023 to 2024 ↗
    Carol Reeves; J.J. Sylvia
    teacher development assessment technical communication empirical research artificial intelligence book reviews
  2. Journal of Writing Analytics Jan 2018
    De-Identification of Laboratory Reports in STEM ↗
    Alex Rudniy
    modern rhetorical theory composition theory discourse analysis graduate education teacher development assessment scientific writing artificial intelligence book reviews
  3. Rhetorica Jan 2000
    Critiques of Knowing: Situated Textualities in Science, Computing, and the Arts by Lynette Hunter ↗
    C. Jan Swearingen
    rhetorical criticism discourse analysis argument assessment digital rhetoric artificial intelligence race and writing gender and writing book reviews
  4. Assessing Writing Oct 2026
    Modeling the reading-to-writing pipeline: Knowledge graph and LLM-based assessment framework for source-based writing ↗
    Byungyeon Yun; Miranda Moe; Lauren E. Flynn; Püren Öncel; Laura K. Allen
    assessment artificial intelligence
  5. Assessing Writing Oct 2026
    Replicating and expanding a validity argument for eRevise as a formative assessment: Empirical support for theories of conceptual change ↗
    Richard Correnti; Lindsay Clare Matsumura; Elaine Lin Wang; Diane Litman; Zhexiong Liu; Haoran Zhang; Tianwen Li
    argument threshold concepts assessment artificial intelligence