Jaeyoon Choi

1 article
University of California, Irvine

Loading profile…

Publication timeline

Co-author network

Research topics

Who reads Choi

Jaeyoon Choi's work travels primarily in Composition & Writing Studies (100% of indexed citations) · 1 indexed citations.

By cluster

  • Composition & Writing Studies — 1

Top citing journals

Counts include only citations from indexed journals that deposit reference lists with CrossRef. Authors whose readers publish primarily in venues without reference deposits will appear less central than they are. See coverage notes →

  1. Anchor is the key: Toward accessible automated essay scoring with large language model through prompting ↗
    Abstract

    Automated Essay Scoring (AES) offers a scalable solution to the time-intensive and inconsistent nature of human scoring. While traditional AES systems require large sets of prompt-specific scored essays, large language models (LLMs) provide a powerful, adaptable alternative, capable of evaluating essays holistically without an extensive amount of pre-scored essays. However, most research on LLM-based AES focuses on resource-intensive optimization methods that are impractical for educators. In this study, we examine prompting – the most practical and accessible way for teachers to interact with LLMs – and its impact on holistic essay scoring. Using argumentative essays from secondary school students, we evaluate the effectiveness of incorporating grading rubrics, source materials, and anchor papers into prompts. Our results show that providing anchor papers significantly improves LLM-human agreement, bringing it closer to human-human scoring reliability. Moreover, while GPT-4o outperforms other models, GPT-4o mini achieves comparable results at a substantially lower cost. These findings highlight the potential of structured prompting strategies in enhancing the accuracy and accessibility of LLM-based AES in education. • Anchored prompts improve scoring reliability, nearing human-human reliability. • Rubric and exemplar prompts offer a low-resource alternative to AES. • GPT-4o is strongest; but GPT-4o mini gives similar accuracy at lower cost.

    doi:10.1016/j.asw.2026.101053