Assessing Writing Jul 2017

Evaluating rater accuracy and perception for integrated writing assessments using a mixed-methods approach

Jue Wang University of Georgia ; George Engelhard University of Georgia ; Kevin Raczynski University of Georgia ; Tian Song Pearson (United States) ; Edward W. Wolfe Educational Testing Service
Journal
Assessing Writing
Published
2017-07-01
DOI
10.1016/j.asw.2017.03.003
CompPile
Open Access
Closed
Topics
Export
BibTeX RIS

Citation context

Cited by in this index (5)

  1. Harsch et al. (2024)
    Validating an integrated reading-into-writing scale with trained university students
    Assessing Writing
  2. Zhao et al. (2022)
    Perceptions of authorial voice: Why discrepancies exist
    Assessing Writing
  3. Mumford et al. (2021)
    Teachers’ perspectives on the causes of rater discrepancy in an English for Aca…
    Assessing Writing
  4. Lim (2019)
    An investigation of the text features of discrepantly-scored ESL essays: A mixe…
    Assessing Writing
  5. Ohta et al. (2018)
    Integrated writing scores based on holistic and multi-trait scales: A generaliz…
    Assessing Writing

References (30) · 3 in this index

  1. Abasi (2008)
    Are we encouraging patch writing? Reconsidering the role of the pedagogical context in ES…
    English for Specific Purposes  ↗
  2. Abasi (2008)
    Academic literacy and plagiarism: Conversations with international graduate students and …
    Journal of English for Academic Purposes  ↗
  3. Andrich (1988)
    Rasch models for measurement
  4. Bernardin (1981)
    Strategies in rater training
    Academy of Management Review
  5. Campbell (1990)
    Modeling the performance prediction problem in industrial and organizational psychology
Show all 30 →
  1. Chan et al. (2015)
    Developing rubrics to assess the reading-into-writing skills: A case study
    Assessing Writing
  2. Cumming (2013)
    Assessing integrated writing tasks for academic purposes: Promises and perils
    Language Assessment Quarterly  ↗
  3. Engelhard (1996)
    Evaluating rater accuracy in performance assessments
    Journal of Educational Measurement  ↗
  4. Engelhard (2013)
    Invariant measurement: Using Rasch models in the social, behavioral, and health sciences
  5. Fraenkel (1993)
  6. Glaser (1967)
    The discovery grounded theory: Strategies for qualitative inquiry
  7. Glaser (1965)
    The constant comparative method of qualitative analysis
    Social Problems  ↗
  8. Gu (2008)
    Beyond the accusation of plagiarism
    System  ↗
  9. Johnson (2009)
    Assessing performance: Developing, scoring, and validating performance tasks
  10. Keck (2006)
    The use of paraphrase in summary writing: A comparison of L1 and L2 writers
    Journal of Second Language Writing  ↗
  11. Linacre (1989)
    Many facet rasch measurement
  12. Linacre (2014)
    Facets computer program for many-facet Rasch measurement, version 3.71.4
  13. Pennycook (2008)
    English as a language always in translation
    European Journal of English Studies  ↗
  14. Plakans (2016)
    Shaping a score: Complexity, accuracy, and fluency in integrated writing performances
    Language Testing  ↗
  15. Plakans (2015)
    Integrated second language writing assessment: Why? What? How?
    Language and Linguistics Compass  ↗
  16. Plake (1991)
    Factors influencing intrajudge consistency during standard-setting
    Educational Measurement: Issues and Practice  ↗
  17. Rasch (1980)
    Probabilistic models for intelligence and attainment tests Chicago
  18. Raczynski (2015)
    Comparing the effectiveness of self-paced and collaborative frame-of-reference training o…
    Journal of Educational Measurement  ↗
  19. Roch (2012)
    Rater training revisited: An updated meta-analytic review of frame-of-reference training
    Journal of Occupational and Organizational Psychology  ↗
  20. Shi (2004)
    Textual Borrowing in Second-Language Writing
    Written Communication
  21. Sulsky (1988)
    Meaning and measurement of performance rating accuracy: Some methodological and theoretic…
    Journal of Applied Psychology  ↗
  22. Weigle (2012)
    Raters’ perceptions of textual borrowing in integrated writing tasks
    Studies in Writing
  23. Wolfe (2014)
    A family of rater accuracy models
    Journal of Applied Measurement
  24. Wolfe et al. (2016)
    Features of difficult-to-score essays
    Assessing Writing
  25. Wright (1982)
    Rating scale analysis
    Rasch measurement
CrossRef global citation count: 35 View in citation network → Build reading path →

Related articles

  1. Assessing Writing Oct 2026
    Replicating and expanding a validity argument for eRevise as a formative assessment: Empirical support for theories of conceptual change ↗
    Richard Correnti; Lindsay Clare Matsumura; Elaine Lin Wang; Diane Litman; Zhexiong Liu; Haoran Zhang; Tianwen Li
    argument threshold concepts assessment artificial intelligence
  2. Assessing Writing Oct 2026
    Effects of varying time constraints on quality, linguistic features, and fluency behaviors in L2 writing ↗
    Jongbong Lee; Charlene Polio
    argument assessment empirical research multilingual writers affect and writing
  3. Philosophy & Rhetoric Dec 2024
    Sophisms and Contempt for Autonomy ↗
    Katharina Stevens
    argument assessment
  4. Assessing Writing Jul 2024
    Examining the direct and indirect impacts of verbatim source use on linguistic complexity in integrated argumentative writing assessment ↗
    Huiying Cai; Xun Yan
    argument assessment
  5. Written Communication Apr 2024
    A Direct Functional Measure of Text Quality: Did the Reader Understand? ↗
    Joachim Grabowski; Moti Mathiebe
    assessment