Assessing Writing Jan 2026 Open Access

How reliable and valid is peer evaluation in adolescents’ L2 argumentative writing?

Albert W. Li University of California, Irvine ; Steve Graham Arizona State University

Abstract

Peer evaluation is widely recognized for its educational benefits; however, its reliability and validity, particularly among adolescent second-language (L2) writers at the early stages of English language and literacy development, remain insufficiently explored. This explanatory sequential mixed-methods study investigated the reliability and validity of peer evaluation in English argumentative writing among 35 Grade 10 and 37 Grade 12 students from a public high school in Beijing, China. Twelve of the participating students (six at each grade) were interviewed about the validity, reliability, and value of peer evaluation. The findings indicated that peer evaluations demonstrated high levels of reliability and validity, with peer-assessed writing scores closely aligning with inter-teacher assessments. Notably, variations were observed among Grade 10 students, particularly in the evaluation of lower-order writing skills, such as grammar and vocabulary, which exhibited reduced validity. These results underscore the potential of peer evaluation in assessing higher-order content-level writing across varying levels of L2 English writing proficiency. The study also highlights areas where adolescent L2 writers may require additional support to enhance the effectiveness of peer evaluation practices in English argumentative writing. Implications for improving English argumentative writing instruction and refining peer evaluation strategies in high school L2 English classrooms are discussed. • Peer evaluation shows high reliability, similar to inter-teacher rating. • Peer evaluation works well for higher-order skills in L2 argumentative writing. • 10th graders struggled with evaluating lower-order skills like grammar. • 12th graders evaluate lower- and higher-order skills with greater validity than 10th graders.

Journal
Assessing Writing
Published
2026-01-01
DOI
10.1016/j.asw.2025.100992
CompPile
Open Access
OA PDF Hybrid
Topics
Export
BibTeX RIS

Citation context

Cited by in this index (1)

  1. Wu et al. (2026)
    Using DeepSeek’s reasoning-based AI model to support written feedback practices
    Assessing Writing

References (49) · 4 in this index

  1. Azarnoosh (2013)
    Peer assessment in an EFL context: Attitudes and friendship bias
    Language Testing in Asia  ↗
  2. Boyatzis (1998)
    Transforming qualitative information: Thematic analysis and code development
  3. Bryant (2010)
    Peer assessment in a test-dominated setting: Empowering, boring or facilitating examinati…
    Educational Research for Policy and Practice  ↗
  4. Cheng (2008)
    The key to success: English language testing in China
    Language Testing  ↗
  5. Cho (2010)
    Student revision with peer and expert reviewing
    Learning and Instruction  ↗
Show all 49 →
  1. Cho (2011)
    Learning by reviewing
    Journal of Educational Psychology  ↗
  2. Cho (2006)
    Validity and reliability of scaffolded peer assessment of writing from instructor and stu…
    Journal of Educational Psychology  ↗
  3. Corbin (2008)
    Basics of qualitative research: Techniques and procedures for developing grounded theory
  4. Falchikov (2000)
    Student peer assessment in higher education: A meta-analysis comparing peer and teacher marks
    Review of Educational Research  ↗
  5. Ferris (2023)
    Teaching L2 composition: Purpose, process, and practice
  6. Graham (2018)
    Instructional feedback in writing
    The Cambridge handbook of instructional feedback
  7. Graham (2025)
    What do meta-analyses tell us about the teaching of writing?
    Handbook of writing research
  8. Graham (2015)
    Formative assessment and writing
    The Elementary School Journal  ↗
  9. Graham (2007)
    A meta-analysis of writing instruction for adolescent students
    Journal of Educational Psychology  ↗
  10. Graham (2011)
    The process writing approach: A meta-analysis
    The Journal of Educational Research  ↗
  11. Hyland (2019)
    Second language writing
  12. Lee (2017)
    Classroom writing assessment and feedback in L2 school contexts
  13. Li (2022)
    Scoring rubric reliability and internal validity in peer-mediated EFL writing assessment:…
    Reading and Writing  ↗
  14. Li (2023)
    Using Peerceptiv to support AI-based online writing assessment across the disciplines
    Assessing Writing
  15. Li (2025)
    Self-Regulated Strategy Development With and Without Peer Interaction: Improvin…
    Written Communication
  16. Li (2024)
    Unpacking an online peer-mediated and self-reflective revision process in second-language…
    Reading and Writing  ↗
  17. Li (2012)
    Give and take: A re-analysis of assessor and assessee’s roles in technology-facilitated p…
    British Journal of Educational Technology  ↗
  18. Li (2016)
    Peer assessment in the digital age: A meta-analysis comparing peer and teacher ratings
    Assessment Evaluation in Higher Education  ↗
  19. Lundstrom (2009)
    To give is better than to receive: The benefits of peer review to the reviewer’s own writing
    Journal of Second Language Writing  ↗
  20. Min (2006)
    The effects of trained peer review on EFL students’ revision types and writing quality
    Journal of Second Language Writing  ↗
  21. Mowl (1995)
    Using self and peer assessment to improve students’ essay writing: A case study from geography
    Innovations in Education and Training International  ↗
  22. Newell (2011)
    Teaching and learning argumentative reading and writing: A review of research
    Reading Research Quarterly  ↗
  23. Olson et al. (2023)
    Examining the Impact of a Cognitive Strategies Approach on the Argument Writing…
    Written Communication
  24. Paré (2008)
    Peering into large lectures: Examining peer and expert mark agreement using PeerScholar, …
    Journal of Computer Assisted Learning  ↗
  25. Patchan (2015)
    Understanding the benefits of providing peer feedback: How students respond to peers’ tex…
    Instructional Science  ↗
  26. Sadler (2006)
    The impact of self- and peer-grading on student learning
    Educational Assessment  ↗
  27. Saito (2008)
    EFL classroom peer assessment: Training effects on rating and commenting
    Language Testing  ↗
  28. Saito (2004)
    Characteristics and user acceptance of peer rating in EFL writing classrooms
    Language Teaching Research  ↗
  29. Schunn (2016)
    The reliability and validity of peer review of writing in high school AP English classes
    Journal of Adolescent Adult Literacy  ↗
  30. Shao (2009)
    A study of peer assessment in EFL instruction
    Foreign Language Learning and Practice
  31. Shrout (1979)
    Intraclass correlations: Uses in assessing rater reliability
    Psychological Bulletin  ↗
  32. Silva (1993)
    Toward an understanding of the distinct nature of L2 writing: The ESL research and its im…
    TESOL Quarterly  ↗
  33. Simmons (2003)
    Responders are taught, not born
    Journal of Adolescent Adult Literacy
  34. Stapleton (2015)
    Assessing the quality of arguments in students’ persuasive writing: A case study analyzin…
    Journal of English for Academic Purposes  ↗
  35. Stemler (2004)
    A comparison of consensus, consistency, and measurement approaches to estimating interrat…
    Practical Assessment, Research Evaluation
  36. Topping (2010)
    Methodological quandaries in studying process and outcomes in peer assessment
    Learning and Instruction  ↗
  37. Ward (2002)
    Measuring self-assessment: Current state of the art
    Advances in Health Sciences Education  ↗
  38. Weigle (1998)
    Using facets to model rater training effects
    Language Testing  ↗
  39. Wingate (2012)
    Argument!’ helping students understand what essay writing is about
    Journal of English for Academic Purposes  ↗
  40. Wu (2023)
    Peer feedback and Chinese medical students’English academic writing development: A longit…
    BMC Medical Education  ↗
  41. Zhang (2023)
    EFL student engagement with peer feedback in academic writing: A longitudinal study
    Journal of English for Academic Purposes  ↗
  42. Zhang (2020)
    Changes in the reliability and validity of peer assessment across the college years
    Assessment & Evaluation in Higher Education  ↗
  43. Zhao (2010)
    Investigating learners’ use and understanding of peer and teacher feedback on w…
    Assessing Writing
  44. Zou (2017)
    Student attitudes that predict participation in peer assessment
    Assessment Evaluation in Higher Education  ↗
CrossRef global citation count: 1 View in citation network → Build reading path →

Related articles

  1. Pedagogy Oct 2024
    Contributors ↗
    rhetorical criticism first-year composition writing pedagogy basic writing writing across the curriculum graduate education two-year college service learning teacher development revision argument collaborative writing assessment writing program administration multimodality multilingual writers literacy studies race and writing disability studies community literacy editorial matter
  2. Pedagogy Jan 2022
    Contributors ↗
    modern rhetorical theory rhetorical criticism genre theory discourse analysis african american rhetorics decolonial rhetorics first-year composition writing pedagogy basic writing writing across the curriculum graduate education teacher development argument collaborative writing transfer assessment portfolios writing program administration writing centers peer tutoring technical communication professional writing archival research digital rhetoric social media grammar and mechanics literacy studies race and writing gender and writing disability studies public rhetoric community literacy literary studies editorial matter
  3. Written Communication Jul 2026
    The Dynamics Between the Biographical Factors, Professional Identities, and Teaching Practices of Second Language Writing Instructors ↗
    Young Wha Lee
    first-year composition writing pedagogy graduate education teacher development assessment qualitative research multilingual writers grammar and mechanics
  4. Journal of Response to Writing Apr 2026
    Examining Automated Writing Evaluation Error Coverage in Relation to Uptake and Retention ↗
    Mehrzad, Mohaddeseh; Rahimi, Mohammad; Link, Stephanie
    genre theory writing pedagogy teacher development revision assessment artificial intelligence multilingual writers grammar and mechanics
  5. Written Communication Jul 2025
    Synthesizing Professional Knowledge and Racial Literacy Content Through Explicit Composing Instruction: A Discourse Synthesis Study ↗
    Jenifer Jasinski Schneider; James R. King; Gretchen Dodson
    discourse analysis writing pedagogy teacher development argument assessment literacy studies race and writing