Assessing Writing Apr 2021

Teachers’ perspectives on the causes of rater discrepancy in an English for Academic Purposes context

Simon Mumford ; Derin Atay Bahçeşehir University
Journal
Assessing Writing
Published
2021-04-01
DOI
10.1016/j.asw.2021.100527
CompPile
Open Access
Closed
Topics
Export
BibTeX RIS

Citation context

Cited by in this index (1)

  1. Golparvar et al. (2022)
    Unpacking the contribution of linguistic features to graph writing quality: An …
    Assessing Writing

References (46) · 13 in this index

  1. American Educational Research Association, American Psychological Association, National Council on Measurement in Education (2014)
    Standards for educational and psychological testing
  2. Baker (2012)
    Individual differences in rater decision-making style: An exploratory mixed-methods study
    Language Assessment Quarterly  ↗
  3. Ball (1995)
    Text design patterns in the writing of Urban African American students: Teaching to the c…
    Urban Education  ↗
  4. Ball (2008)
    Content knowledge for teaching: What makes it special?
    Journal of Teacher Education  ↗
  5. Ballock (2019)
    An exploration of professional knowledge needed for reading and responding to student writing
    Journal of Teacher Education  ↗
Show all 46 →
  1. Becker (2018)
    Not to scale? An argument-based inquiry into the validity of an L2 writing rati…
    Assessing Writing
  2. Bonk (2003)
    A many-facet Rasch analysis of the second language group oral discussion task
    Language Testing  ↗
  3. Corbin (2003)
    The unstructured interactive interview: Issues of reciprocity and risks when dealing with…
    Qualitative Inquiry  ↗
  4. Crusan et al. (2016)
    Writing assessment literacy: Surveying second language teachers’ knowledge, bel…
    Assessing Writing
  5. Cumming (2002)
    Assessing L2 writing: Alternative constructs and ethical dilemmas
    Assessing Writing
  6. Cumming (2001)
    ESL/EFL instructors’ practices for writing assessment: Specific purposes or general purposes?
    Language Testing  ↗
  7. East (2009)
    Evaluating the reliability of a detailed analytic scoring rubric for foreign la…
    Assessing Writing
  8. Eckes (2012)
    Operational rater types in writing assessment: Linking rater cognition to rater behavior,…
    Assessment Quarterly  ↗
  9. Eckes (2008)
    Rater types in writing performance assessments: A classification approach to rater variability
    Language Testing  ↗
  10. Elder (2007)
    Evaluating rater responses to an online training program for L2 writing assessment
    Language Testing  ↗
  11. Hamp-Lyons (1995)
    Rating non-native writing: The trouble with holistic scoring
    TESOL Quarterly  ↗
  12. Hamp-Lyons (1990)
    Second language writing: Assessment issues
    Second language writing
  13. Kaiser (2012)
    Protecting confidentiality
    The sage handbook of interview research
  14. Kleinsasser (2000)
    Researchers, reflexivity, and good data: Writing to unlearn
    Theory into Practice  ↗
  15. LeCompte (2000)
    Analyzing qualitative data
    Theory into Practice  ↗
  16. Lee (2009)
    Native and nonnative rater behavior in grading Korean students’ English essays
    Asia Pacific Education Review  ↗
  17. Li et al. (2015)
    Understanding variations between student and teacher application of rubrics
    Assessing Writing
  18. Lim (2019)
    An investigation of the text features of discrepantly-scored ESL essays: A mixe…
    Assessing Writing
  19. Looney (2018)
    Reconceptualising the role of teachers as assessors: Teacher assessment identity. Assessm…
    Policy & Practice
  20. Lovorn (2011)
    Assessing the assessment
    Practical Assessment, Research & Evaluation
  21. Lumley (1995)
    Rater characteristics and rater bias: Implications for training
    Language Testing  ↗
  22. Meier (2006)
    Teachers’ use of rubrics to score non‐traditional tasks: Factors related to discrepancies…
    Assessment in Education
  23. Merriam (1998)
    Qualitative research and case study applications in education
  24. Poe et al. (2019)
    Evidence of fairness: Twenty-five years of research in Assessing Writing
    Assessing Writing
  25. Pope (2009)
    Examining teacher ethical dilemmas in classroom assessment
    Teaching and Teacher Education  ↗
  26. Raczynski (2015)
    Comparing the effectiveness of self-paced and collaborative frame-of-reference training o…
    Journal of Educational Measurement  ↗
  27. Ramanathan (1999)
    Ethnographic approaches and methods in L2 writing research: A critical guide and review
    Applied Linguistics  ↗
  28. Rezaei et al. (2010)
    Reliability and validity of rubrics for assessment through writing
    Assessing Writing
  29. Scarino (2013)
    Language assessment literacy as self-awareness: Understanding the role of interpretation …
    Language Testing  ↗
  30. Seidman (2006)
    Interviewing as qualitative research: A guide for researchers in education and the social sciences
  31. Shi (2001)
    Native- and non-native-speaking EFL teachers’ evaluation of Chinese students’ English writing
    Language Testing
  32. Shkedi (2005)
    Multiple case narrative: A qualitative approach to studying multiple populations
  33. Stake (1995)
    The art of case study research
  34. Tolich (2004)
    Internal confidentiality: When confidentiality assurances fail relational informants
    Qualitative Sociology  ↗
  35. Trace et al. (2016)
    “I can see that”: Developing shared rubric category interpretations through sco…
    Assessing Writing
  36. Vögelin et al. (2019)
    The influence of lexical features on teacher judgements of ESL argumentative essays
    Assessing Writing
  37. Wang et al. (2017)
    Evaluating rater accuracy and perception for integrated writing assessments usi…
    Assessing Writing
  38. White (2019)
    (Re)visiting twenty-five years of writing assessment
    Assessing Writing
  39. Wolfe et al. (2016)
    Features of difficult-to-score essays
    Assessing Writing
  40. Xi (2010)
    How do we go about investigating test fairness?
    Language Testing  ↗
  41. Xu (2016)
    Teacher assessment literacy in practice: A reconceptualization
    Teaching and Teacher Education  ↗
CrossRef global citation count: 7 View in citation network → Build reading path →