Rater effects: Ego engagement in rater decision-making

Cynthia S. Wiseman City University of New York
Journal
Assessing Writing
Published
2012-07-01
DOI
10.1016/j.asw.2011.12.001
CompPile
Open Access
Closed
Topics
Export

Citation context

References (51) · 2 in this index

  1. The architecture of cognition
  2. Investigating variability in asks and rater judgments in a performance test of foreign la…
    Language Testing  ↗
  3. Language testing in practice: Designing and developing useful language tests
  4. Variability in ESL essay rating processes: The role of the rating scale and rater experience
    Language Assessment Quarterly  ↗
  5. Breland, H., Bridgeman, B., & Fowles, M. E. (1999). Writing assessment in admission to higher education: Revi…
Show all 51 →
  1. Generalizability analyses of work key listening and writing tests
    Educational and Psychological Measurement  ↗
  2. Do English and ESL faculties rate writing samples differently?
    TESOL Quarterly  ↗
  3. Data analysis strategies for mixed-method evaluation designs
    Educational Evaluation and Policy Analysis  ↗
  4. The interpretation of tasks by writers and readers in holistically rated direct assessmen…
    Reading in the composition classroom
  5. Designing and conducting mixed methods research
  6. Essentials of psychological testing
  7. Expertise in evaluating second language compositions
    Language Testing  ↗
  8. Assessing Writing
  9. Cumming, A., Kantor, R., Powers, D., Santos, T., & Taylor, C. (2000). TOEFL 2000 writing framework: A working…
  10. Assessing Writing
  11. Examining rater errors in the assessment of written composition with a many-faceted Rasch model
    Journal of Educational Measurement  ↗
  12. Protocol analysis: Verbal reports as data
  13. Testing second language speaking
  14. Psychometric methods
  15. Examining expert judgments of task difficulty on essay tests
    Journal of Second Language Writing  ↗
  16. Accounting for nonsystematic error in performance ratings
    Language Testing  ↗
  17. The influence of holistic scoring procedures on reading and rating student essays
    Validating holistic scoring for writing assessment
  18. The influence of rater language background on writing performance assessment
    Language Testing  ↗
  19. An investigation into native and non-native teachers’ judgments of oral English performan…
    Language Testing  ↗
  20. Native and nonnative reactions to ESL compositions
    TESOL Quarterly  ↗
  21. A FACETS analysis of rater bias in measuring Japanese second language writing performance
    Language Testing  ↗
  22. Linacre, J. M. (2005). A user's guide to FACETS: Rasch measurement computer program. Version 3.57. Chicago, IL.
  23. Assessing second language writing: The rater's perspective
  24. Using G-theory and many-facet Rasch measurement in the development of performance assessm…
    Language Testing  ↗
  25. Measuring second language performance
  26. Professors’ ratings of language use and rhetorical organizations in ESL compositions
    TESL Canada Journal  ↗
  27. A study of the decision-making behavior of composition markers
    Studies in language testing, Vol. 3: Performance testing, cognition and assessment
  28. Myford, C., & Wolfe, E. (2000). Monitoring sources of variability within the Test of Spoken English assessmen…
  29. Detecting and measuring Edward effects using many-facet Rasch measurement: Part 1
    Introduction to Rasch measurement
  30. The FCE speaking test: Using rater reports to help interpret test scores
    System  ↗
  31. Rating the ratings: Assessing the psychometric quality of rating data
    Psychological Bulletin  ↗
  32. Validation of holistic scoring for ESL writing assessment: How raters evaluate ESL compositions
    Fairness and validation in language assessment
  33. Professors’ reactions to the academic writing of non-native speaking students
    TESOL Quarterly
  34. The effect of raters’ background and training on the reliability of direct writing tests
    The Modern Language Journal  ↗
  35. Rater judgments in the direct assessment of competency-based second language writing ability
    Studies in immigrant English language assessment
  36. Training programs for observers of behaviors: A review
    Personnel Psychology  ↗
  37. A long-term research agenda for the Test of Written English
    Language Testing  ↗
  38. Taking on testing: Teachers as testers researchers
    English Education
  39. ESL essay evaluation: The influences of sentence-level and rhetorical features
    Journal of Second Language Writing  ↗
  40. Testing pronunciation: An application of generablizability theory
    Language Learning  ↗
  41. Error gravity: Faculty response to errors in the written discourse of nonnative speakers …
    Assessing second language writing in academic contexts
  42. Holistic assessment: What goes on in the raters’ minds?
    Assessing second language writing in academic contexts
  43. Effects of training on raters of ESL compositions
    Language Testing  ↗
  44. Using FACETS to model rater training effects
    Language Testing  ↗
  45. Language testing and validation: An evidence-based approach
  46. Wiseman, C. (2005). A validation study comparing an analytic scoring rubric and a holistic scoring rubric in …