Establishing analytic score profiles for large-scale L2 writing assessment: The case of the CET-4 writing test

Shaoyan Zou ; Xun Yan University of Illinois Urbana-Champaign ; Jason Fan The University of Melbourne
Journal
Assessing Writing
Published
2024-04-01
DOI
10.1016/j.asw.2024.100826
CompPile
Open Access
Closed
Topics
Export

Citation context

Cited by in this index (0)

No articles in this index cite this work.

References (81) · 9 in this index

  1. Using an analytic dichotomous evaluation checklist to increase inter-and intra-rater reli…
    Iranian Journal of Applied Linguistics (IJAL)
  2. American Educational Research Association, American Psychological Association, National Council on Measuremen…
  3. Writing evaluation: what can analytic versus holistic essay scoring tell us?
    System  ↗
  4. The dynamic development of English⁃L2 writing competence
    Modern Foreign Languages
  5. Assessing Writing
Show all 81 →
  1. Variability in ESL essay rating processes: The role of the rating scale and rater experience
    Language Assessment Quarterly  ↗
  2. Effects of marking method and rater experience on ESL essay scores and rater performance
    Assessment in Education: Principles, Policy & Practice
  3. Assessing Writing
  4. Bond, T.G., & Fox, C.M. (2015). Applying the Rasch model: Fundamental measurement in the human sciences (3rd …
     ↗
  5. Chapelle, C.A., Enright, M.K., & Jamieson, J.M.. (Eds.). (2008). Building a validity argument for the Test of…
  6. Empirical profiles of academic oral English proficiency from an international teaching as…
    Language Testing  ↗
  7. Comparing L2 learners’ writing against parallel machine-translated texts: Raters’ assessm…
    System  ↗
  8. Determining the scoring validity of a co-constructed CEFR-based rating scale. Language
    Testing  ↗
  9. Frankfurt
    Introduction to many-facet Rasch measurement
  10. At the intersection of language testing policy, practice, and research: An interview with…
    Language Assessment Quarterly  ↗
  11. Local english testing in China’s tertiary education: Contexts, policies, and practices
    Language Testing  ↗
  12. A many-facet rasch model to detect halo effect in three types of raters
    Theory & Practice in Language Studies  ↗
  13. Fei, Q. & Zhao, Y.Q. (2008). Problems in CET-4 writing rubric and scoring method. Foreign Language Teaching T…
  14. Revisiting multiple profiles of learner compositions: A comparison of highly rated NS and…
    Journal of Second Language Writing  ↗
  15. Fulcher, G. (1993). The construction and validation of rating scales for oral tests in English as a foreign l…
  16. Does thick description lead to smart tests? A data-based approach to rating scale construction
    Language Testing  ↗
  17. Interpreting the relationships between TOEFL iBT scores and GPA: Language proficiency, po…
    Language Testing  ↗
  18. Learning-oriented Language Test Preparation Materials: A contradiction in terms?
    Papers in Language Testing and Assessment
  19. Rating nonnative writing: The trouble with holistic scoring
    TESOL Quarterly  ↗
  20. Assessing Writing
  21. Hamp-Lyons, L. (1991). Scoring Procedures for ESL Contexts. In L. Hamp-Lyons (Eds.), Assessing second languag…
  22. Assessing Writing
  23. Cognitive diagnostic assessment of L2 reading comprehension ability: Validity arguments f…
    Language Testing  ↗
  24. Assessing Writing
  25. Exploring multiple profiles of highly rated learner compositions
    Journal of Second Language Writing  ↗
  26. Powerful tests, powerless test designers? — Challenges facing the College English test
    CELEA Journal
  27. Jin, Y. (2019). Testing tertiary-level English language learners: The College English Test in China. In Su, L…
     ↗
  28. Jones, N., Saville, N., & Salamoura, A. (2016). Learning oriented assessment (Vol. 45). Cambridge University Press.
  29. Kassambara, A. (2017). A practical guide to cluster analysis in R: Unsupervised machine learning. Sthda.
  30. Exploring ways to provide diagnostic feedback with an ESL placement test: Cognitive diagn…
    Language Testing  ↗
  31. Diagnosing EAP writing ability using the reduced Reparameterized Unified Model
    Language Testing  ↗
  32. Diagnostic writing assessment: The development and validation of a rating scale
  33. Assessing Writing
  34. Differentiation of illusory and true halo in writing scores
    Educational and Psychological Measurement  ↗
  35. Assessing Writing
  36. Toward automated multi-trait scoring of essays: Investigating links among holistic, analy…
    Applied Linguistics  ↗
  37. Leighton, J., & Gierl, M. (Eds.). (2007). Cognitive diagnostic assessment for education: Theory and applicati…
     ↗
  38. A comparison of EFL raters’ essay-rating processes across two types of rating scales
    Language Assessment Quarterly  ↗
  39. Are teachers teaching to the test? A case study of the College English Test (CET) in China
    International Journal of Pedagogies and Learning  ↗
  40. Constructing and validating a Q-matrix for cognitive diagnostic analyses of a reading test
    Educational Assessment  ↗
  41. Assessing Writing
  42. Optimizing rating scale category effectiveness
    Journal of Applied Measurement
  43. Linacre, J.M. (2013). Facets Rasch measurement computer program (version 3.80.0). Chicago: Winsteps.com.
  44. The teaching of college English writing based on Chinese and foreign language learning co…
    Foreign Language World
  45. The quality assurance of a national English writing assessment: Policy implications for q…
    Evaluation
  46. Masters, G.N., & Wright, B.D. (1997). The partial credit model. In Handbook of Modern Item Response Theory (p…
     ↗
  47. McNamara, T., Knoch, U., & Fan, J. (2019). Fairness, justice, and language assessment: The role of measuremen…
  48. Milanovic, M., Saville, N., Pollitt, A., & Cook, A. (1995). Developing rating scales for CASE: Theoretical co…
  49. Developing individualized feedback for listening assessment: Combining standard setting a…
    Language Testing  ↗
  50. Scaling descriptors for language proficiency scales
    Language Testing  ↗
  51. O’Sullivan, B. (2016a). Adapting tests to the local context. New Directions in Language Assessment, special e…
  52. Foreword: Localization
    In Su, Weir & Wu (Eds.), English Language Proficiency Testing in Asia (pp. xiii-xxviii)
  53. O’Sullivan, B. (2016b). Validity: What is it and who is it for? In Y.N. Leung (Ed.), Epoch making in English …
  54. Oon, P.T., & Subramaniam, R. (2011). Rasch modeling of a scale that explores the take-up of physics among sch…
     ↗
  55. An investigation into rater performance with a holistic scale and a binary, analytic scal…
    Papers in Language Testing and Assessment
  56. Rasch, G. (1960). Probabilistic Models for Some Intelligence and Attainment Tests. Copenhagen: Danish Institu…
  57. Using the bootstrap method to evaluate the critical range of misfit for polytomous rasch …
    Psychological Reports  ↗
  58. Examining writing: Research and practice in assessing second language writing
  59. Shermis, M.D., Burstein, J., Elliot, N., Miel, S., & Foltz, P.W.. (2017). Automated writing evaluation: An ex…
  60. Staples, S., & Biber, D. (2015). Cluster analysis. In L. Plonsky (Ed.), Advancing quantitative methods in sec…
     ↗
  61. Critical factors to consider in evaluating standard-setting studies to map language test …
    Language Assessment Quarterly  ↗
  62. Locality, re-localization, structure-to-structure localism and the TOEIC test: Implicatio…
    Measuring up in Education
  63. Assessing Writing
  64. Cambridge
    Assessing writing
  65. A systematic review of methods for evaluating rating quality in language assessment
    Language Testing  ↗
  66. Wiseman, C. (2008). Investigating selected facets in measuring second language writing ability using holistic…
  67. A bootstrap approach to evaluating person and item fit to the Rasch model
    Journal of Applied Measurement
  68. The general english proficiency test in Taiwan: Past, present, and future
    English Language Proficiency Testing in Asia
  69. Diagnosing university students’ academic writing in English: Is cognitive diagnostic mode…
    Educational Psychology  ↗
  70. Development of a Profile-Based Writing Scale: How collaboration with teachers enhanced as…
    Challenges in language testing around the world
  71. A longitudinal study of the CET washback on college English classroom teaching and learni…
  72. The impact of the scoring system of a large-scale standardized EFL writing assessment on …
    Evaluation
  73. On the dynamic development of syntactic variability in second language writing
    Foreign Language Education
  74. The impact of rating scales on the CET-4 writing: A mixed-methods study
    Assessing the English Language Writing of Chinese Learners’ of English
  75. A preliminary examination of the rating scale validity of the CET-4 writing
    Foreign Language and Literature
  76. Pinpointing analytic rating criteria for EFL writing assessment: Rater’s perspectives
    Contemporary Foreign Language Studies