Abstract

As ChatGPT is increasingly used in second language (L2) writing practice and research, its potential to provide feedback and revision has attracted much scholarly attention. However, it remains largely unknown whether and how ChatGPT revision can influence rhetorical move-steps. This study investigates the effects of ChatGPT revision on rhetorical move-steps in English personal statements (PSs) written by L2 English undergraduate students, using a combination of corpus data and stimulated recall interviews. Based on an unstructured prompt, our analysis revealed significant reductions in the rhetorical efforts devoted to five rhetorical steps. Students’ responses highlighted both benefits and concerns regarding these revisions, illustrating how AI-generated changes can alter textual features and affect writer-reader communication from the writers’ perspective. The findings highlight the importance of students’ critical evaluation of AI-generated revisions and iterative engagement with them.

Journal
Written Communication
Published
2026-07-17
DOI
10.1177/07410883261461562
CompPile
Open Access
Closed
Topics
Export

Citation context

Cited by in this index (0)

No articles in this index cite this work.

References (73) · 9 in this index

  1. Abdi Tabari M. Kushki A. Wang Y. (2025). Comparing the effects of teacher- and AI-mediated corrective feedbac…
     ↗
  2. Bai L. Wei Y. (2024). Exploring EFL learners’ integration and perceptions of ChatGPT’s text revisions: A thre…
     ↗
  3. Bansal G. Chamola V. Hussain A. Guizani M. Niyato D. (2024). Transforming conversations with AI—A comprehensi…
     ↗
  4. Assessing Writing
  5. The personal statement in medical school applications: Rhetorical structure in a diverse …
    Issues in Writing
Show all 73 →
  1. Analyzing genre: Language use in professional settings
  2. Written Communication
  3. Brown R. M. (2005). The rhetoric of self-promotion in personal statements [Doctoral dissertation University o…
  4. Casal J. E. Kessler M. (2020). Form and rhetorical function of phrase-frames in promotional writing: A corpus…
     ↗
  5. Assessing Writing
  6. Chen Y. (2025). Evaluating the potential of ChatGPT-reformulated essays as written feedback in L2 writing. Co…
     ↗
  7. Chen Z. Zhu X. Lu Q. Wei W. (2024). L2 students’ barriers in engaging with form and content-focused AI-genera…
     ↗
  8. Chiu Y. L. T. (2015). Personal statement in PhD applications: Gatekeepers’ evaluative perspectives. Journal o…
     ↗
  9. 10.1016/j.jeap.2015.11.001
     ↗
  10. Statistical power analysis for the behavioral sciences
  11. 10.1016/j.esp.2017.01.001
     ↗
  12. 10.1558/cj.v33i1.27047
     ↗
  13. Journal of Writing Research
  14. Ding H. (2007). Genre analysis of personal statements: Analysis of moves in application essays to medical and…
     ↗
  15. Escalante J. Pack A. Barrett A. (2023). AI-generated feedback on writing: Insights into efficacy and ENL stud…
     ↗
  16. Guo K. Li D. (2024). Understanding EFL students’ use of self-made AI chatbots as personalized writing assista…
     ↗
  17. Han J. Li M. (2024). Exploring ChatGPT-supported teacher feedback in the EFL context. System 126 103502. http…
     ↗
  18. Herbold S. Hautli-Janisz A. Heuer U. Kikteva Z. Trautsch A. (2023). A large-scale comparison of human-written…
     ↗
  19. 10.3998/mpub.23927
     ↗
  20. 10.1016/j.jslw.2007.07.005
     ↗
  21. 10.1017/9781009406512
     ↗
  22. Jiang F. Hyland K. (2025a). Does ChatGPT argue like students? Bundles in argumentative essays. Applied Lingui…
     ↗
  23. Jiang F. Hyland K. (2025b). Rhetorical distinctions: Comparing metadiscourse in essays by ChatGPT and student…
     ↗
  24. 10.1016/j.esp.2020.07.003
     ↗
  25. Kim M. Lu X. (2024). Exploring the potential of using ChatGPT for rhetorical move-step analysis: The impact o…
     ↗
  26. Kim M. Qiu X. Wang Y. A. (2024). Interrater agreement in genre analysis: A methodological review and a compar…
     ↗
  27. 10.1177/00336882231162868
     ↗
  28. Koltovskaia S. Rahmati P. Saeli H. (2024). Graduate students’ use of ChatGPT for academic text revision: Beha…
     ↗
  29. Li Y. Deng L. (2019). I am what I have written: A case study of identity construction in and through personal…
     ↗
  30. Li Y. Deng L. (2021). Disciplinarily capable and personally unique: Voicing disciplinary identity in personal…
     ↗
  31. Li Y. Deng L. Gao X. (2023). From out-group to in-group: Exercising agency for gaining membership through sta…
     ↗
  32. 10.1016/j.esp.2022.11.005
     ↗
  33. Assessing Writing
  34. Liu Y. Qi H. Lu X. (2025b). Enhancing GPT-based automated essay scoring: The impact of fine-tuning and lingui…
     ↗
  35. López-Ferrero C. Bach C. (2016). Discourse analysis of statements of purpose: Connecting academic and profess…
     ↗
  36. Lu X. Yoon J. Kisselev O. (2021). Matching phrase-frames to rhetorical moves in social science research artic…
     ↗
  37. 10.1016/j.acorp.2024.100106
     ↗
  38. 10.1016/j.esp.2024.04.004
     ↗
  39. 10.1016/j.esp.2017.11.006
     ↗
  40. From ‘nativelike’ to practical: Comparing human and AI reformulation as written feedback
    RELC Journal
  41. 10.54855/ijli.23231
     ↗
  42. Written Communication
  43. Rhetoric Society Quarterly
  44. OpenAI. (2025 September 5). Why language models hallucinate. https://openai.com/index/why-language-models-hal…
  45. OpenAI. (n.d.). How ChatGPT and our foundation models are developed. https://help.openai.com/en/articles/7842…
  46. SPSS survival manual: A step-by-step guide to data analysis using SPSS for Windows
  47. 10.1177/07356331251365189
     ↗
  48. Rau G. Shih Y. S. (2021). Evaluation of Cohen’s kappa and other measures of inter-rater agreement for genre a…
     ↗
  49. The handbook of research synthesis
  50. Roumeliotis K. I. Tselikas N. D. (2023). ChatGPT and Open-AI models: A preliminary review. Future Internet 15…
     ↗
  51. Samraj B. Monk L. (2008). The statement of purpose in graduate program applications: Genre structure and disc…
     ↗
  52. Shi H. Chai C. S. Zhou S. Aubrey S. (2025). Comparing the effects of ChatGPT and automated writing evaluation…
     ↗
  53. Assessing Writing
  54. Genre analysis: English in academic and research settings
  55. 10.1075/pbns.41.06swa
     ↗
  56. 10.1017/CBO9781139524827
     ↗
  57. 10.37514/PER-B.2009.2324.2.01
     ↗
  58. Teng L. S. Zhang L. J. (2020). Empowering learners in the second/foreign language classroom: Can self-regulat…
     ↗
  59. Tsai C. Y. Lin Y. T. Brown I. K. (2024). Impacts of ChatGPT-assisted writing for EFL English majors: Feasibil…
     ↗
  60. Writing and Pedagogy
  61. “We improved presenting voice in our writing”: The role of teacher feedback in revising p…
    Spanish Journal of Applied Linguistics
  62. Wang Y. A. (2023). Demystifying academic promotional genre: A rhetorical move-step analysis of teaching philo…
     ↗
  63. Wang Y. A. (2024). Unpacking the rhetoric of diversity equity and inclusion statements for academic job appli…
     ↗
  64. Wang Y. A. (2025). “These are my ‘selling points’”: Disciplinary variation in rhetorical features of graduate…
     ↗
  65. 10.1016/j.system.2014.09.020
     ↗
  66. Yoon J. Casal J. E. (2020). Rhetorical structure sequence and variation: A step-driven move analysis of appli…
     ↗
  67. Zou M. Huang L. (2024). The impact of ChatGPT on L2 writing and expected responses: Voice from doctoral stude…
     ↗
  68. Zou S. Guo K. Wang J. Liu Y. (2025). Investigating students’ uptake of teacher- and ChatGPT-generated feedbac…
     ↗