Individualized feedback to raters in language assessment: Impacts on rater effects

Jing Huang Education University of Hong Kong ; Gaowei Chen University of Hong Kong
Journal
Assessing Writing
Published
2022-04-01
DOI
10.1016/j.asw.2022.100623
CompPile
Open Access
Closed
Topics
Export

Citation context

Cited by in this index (1)

  1. Assessing Writing

References (87) · 3 in this index

  1. Performance management
  2. A rating formulation for ordered response categories
    Psychometrika  ↗
  3. Feedback and human behaviour
  4. Automated essay scoring with e-rater V. 2.0
    The Journal of Technology, Learning, and Assessment
  5. A critical, objective review of performance feedback
    Journal of Organizational Behavior Management  ↗
Show all 87 →
  1. Effects of cognitive feedback on performance
    Psychological Bulletin  ↗
  2. Social cognitive theory of self regulation
    Organizational Behavior and Human Decision Processes  ↗
  3. Applied psychology in personnel management
  4. A field study of the effect of feedback frequency on performance
    Journal of Applied Psychology  ↗
  5. Statistical power analysis for the behavioural sciences
  6. The effect of frequency of feedback on attitudes and performance
    Journal of Accounting Research  ↗
  7. Educational research: Planning, conducting, and evaluating quantitative and qualitative research
  8. An analysis of the external validity and applied relevance of three rating formats
    Organizational Behavior and Human Performance  ↗
  9. A contingency approach to appraisal satisfaction: An initial investigation of the joint e…
    Journal of Management  ↗
  10. Introduction to many-facet Rasch measurement: Analyzing and evaluating ratermediated assessments
  11. Many-facet Rasch measurement: Implications for rater-mediated language assessment
    Quantitative Data Analysis for Language Assessment Volume I: Fundamental Techniques
  12. Evaluating rater responses to an online training program for L2 writing assessment
    Language Testing  ↗
  13. Individual feedback to enhance rater training: Does it work?
    Language Assessment Quarterly  ↗
  14. Invariant measurement: Using Rasch models in the social, behavioral, and health sciences
  15. Invariant measurement with raters and rating scales: Rasch Models for rater-mediated assessments
  16. Employee perceptions of performance appraisal fairness in two organizations
    Canadian Journal of Administrative Sciences
  17. Neutralizing inequalities in ratings
    Personnel Journal
  18. ANOVA: Repeated measures
  19. Statistics for the behavioral sciences
  20. Goals, feedback, and self-regulation: Control theory as a natural framework for executive…
    Journal: Practice and Research
  21. Development of a model of the feedback process within executive coaching. Consulting Psychology
    Journal: Practice and Research
  22. Psychometric methods
  23. Teachers’ perceptions of on-line rater training and monitoring
    System  ↗
  24. The power of feedback
    Review of Educational Research  ↗
  25. Behavior change: Models, methods, and a review of the evidence
  26. Consequences of individual feedback on behavior in organizations
    Journal of Applied Psychology  ↗
  27. Goal regulation across time: The effects of feedback and affect
    Journal of Applied Psychology  ↗
  28. Motivation and cognitive abilities: An integrative/aptitude-treatment interaction approac…
    Journal of Applied Psychology  ↗
  29. Halo in a multidimensional forced-choice performance evaluation scale
    Journal of Applied Psychology  ↗
  30. A covariance structure analysis of employees’ response to performance feedback
    Journal of Applied Psychology  ↗
  31. The effects of feedback interventions of performance: A historical review, a meta-analysi…
    Psychological Bulletin  ↗
  32. That lenient tendency in rating
    Personnel Journal
  33. Investigating the effectiveness of individualized feedback to rating behavior: A longitud…
    Language Testing  ↗
  34. Assessing Writing
  35. Differentiation of illusory and true halo in writing scores
    Educational and Psychological Measurement  ↗
  36. The impact of feedback frequency on learning and task performance: Challenging the “more …
    Organizational Behavior and Human Decision Processes  ↗
  37. Correlates of perceived fairness and accuracy of performance appraisals
    Journal of Applied Psychology  ↗
  38. The measurement of work performance: Methods, theory, and applications
  39. Many-facet Rasch measurement
  40. Facets (Version 3.80.0) [Computer software]
  41. The social psychology of procedural justice
  42. A theory of goal setting and task performance
  43. Job feedback: giving, seeking, and using feedback for performance improvement
  44. Rater characteristics and rater bias: Implications for training
    Language Testing  ↗
  45. Measuring the impact of judge severity on examination scores
    Applied Measurement in Education  ↗
  46. Is timely information always better? The effect of feedback frequency on decision making
    Organizational Behavior and Human Decision Processes  ↗
  47. Using G-theory and many-facet Rasch measurement in the development of performance assessm…
    Language Testing  ↗
  48. Measuring second language performance
  49. How attributes of the feedback message affect subsequent feedback seeking: The interactiv…
    Psychologica Belgica  ↗
  50. Human learned helplessness: a coping perspective
  51. Nature and consequences of halo error: A critical analysis
    Journal of Applied Psychology  ↗
  52. Monitoring sources of variability within the test of spoken english assessment system
  53. Detecting and measuring rater effects using many-facet Rasch measurement: Part I
    Journal of Applied Measurement
  54. Detecting and measuring rater effects using many-facet Rasch measurement: Part II
    Journal of Applied Measurement
  55. Assessing the value of bias analysis feedback to raters for the IELTS writing module
    IELTS Collected Papers
  56. Imagery and verbal processes
  57. Dual coding theory: Retrospect and current status
    Canadian Journal of Psychology  ↗
  58. Effects of feedback sign and credibility on goal setting and task performance
    Organizational Behavior and Human Decision Processes  ↗
  59. Why is performance management broken?
    Industrial and Organizational Psychology  ↗
  60. Probabilistic Models for Some Intelligence and Attainment Tests
  61. Eta squared and partial eta squared as measures of effect size in educational research
    Educational Research Review  ↗
  62. Organizational behavior
  63. Rating the ratings: Assessing the psychometric quality of rating data
    Psychological Bulletin  ↗
  64. Knowledge of results and motor learning: A review and critical reappraisal
    Psychological Bulletin  ↗
  65. Evaluating preference for graphic feedback on correct versus incorrect performance
    Journal of Organizational Behavior Management  ↗
  66. A constant error in psychological ratings
    Journal of Applied Psychology  ↗
  67. Measurement and evaluation in psychology and education
  68. The effect of feedback sign on task performance depends on self-concept discrepancies
    Journal of Applied Psychology  ↗
  69. Vantage Learning (2006). Research summary: IntellimetricTM scoring accuracy across genres and grade levels. R…
  70. Effects of training on raters of ESL compositions
    Language Testing  ↗
  71. Using FACETS to model rater training effects
    Language Testing  ↗
  72. Language testing and validation: an evidence-based approach
  73. Rater analyses in music performance assessment: Application of the Many Facet Rasch Model
    Connecting practice, measurement, and evaluation: Selected papers from the 5th International Symposium on Assessment in Music Education
  74. Exploring bias analysis as a tool for improving rater consistency in assessing oral interaction
    Language Testing  ↗
  75. Examining the impacts of rater effects in performance assessments
    Applied psychological Measurement  ↗
  76. Assessing Writing
  77. ). Exploring the effects of rater linking designs and rater fit on achievement estimates …
    Educational Assessment  ↗
  78. Not just generalizability: A case for multifaceted latent trait models in teacher observa…
    Educational Researcher  ↗
  79. A systematic review of methods for evaluating rating quality in language assessment
    Language Testing  ↗
  80. Written Communication
  81. Rating scale analysis: Rasch measurement
  82. Personnel management and industrial relations