Assessing Writing Oct 2026 Open Access

Generative artificial intelligence in writing assessment: University professors’ perspectives and recommendations

Chenze Wu Hong Kong Baptist University ; Ricky Lam Hong Kong Baptist University

Abstract

Research has recognized the potential of Generative AI (GenAI) to support writing assessment. However, the responsible and effective application of GenAI in writing assessment remains underexplored, and consequently, university instructors are uncertain about how to integrate these tools into their assessment practices. Drawing on Mills et al.’s (2024) three-dimensional GenAI literacy framework, this qualitative study examined professors’ beliefs about incorporating GenAI into L2 writing assessment and their recommendations for responsible and effective integration. Twenty-four professors from universities in Chinese Mainland, Hong Kong, Macau, and Singapore were recruited. Data were collected through semi-structured interviews and stimulated recall tasks. The findings revealed that while professors recognized benefits of incorporating GenAI in writing assessment, they expressed concerns about certain critical issues. They emphasized the essential role of human agency and offered practical recommendations for effective, responsible, and supportive use. Based on these findings, the study proposes seven evidence-based and actionable recommendations, including enhancing instructors’ GenAI literacy, adopting multiple sources of feedback, prioritizing teacher judgment and modification for reliability, validity, and discriminative power, ensuring transparent and ethical use of GenAI, foster socio-emotional awareness, as well as establishing and implementing institutional policies and training for GenAI adoption in writing assessment. These recommendations help guide the development of institutional policies and enable university instructors of L2 writing and other disciplines to integrate GenAI into assessment practices with responsibility, ethics, and effectiveness.

Journal
Assessing Writing
Published
2026-10-01
DOI
10.1016/j.asw.2026.101125
CompPile
Open Access
OA PDF Hybrid
Topics
Export
BibTeX RIS

Citation context

Cited by in this index (0)

No articles in this index cite this work.

References (71) · 3 in this index

  1. Aad (2025)
    Generative AI: Hopes, controversies and the future of faculty roles in education
    Quality Assurance in Education  ↗
  2. Aljasser (2025)
    Investigating EFL students’ perceptions of feedback: A comparative study of instructor an…
    Education and Information Technologies,  ↗
  3. Almatrafi (2024)
    A systematic review of AI literacy conceptualization, constructs, and implementation and …
    Computers and Education Open  ↗
  4. An (2025)
    Generative AI integration in K-12 settings: Teachers’ perceptions and levels of integration
    TechTrends  ↗
  5. Avci (2025)
    Exploring STEM educators’ perspectives on the integration of AI-enabled technologies in t…
    Computers and Education Open  ↗
Show all 71 →
  1. Barrot (2023)
    Using ChatGPT for second language writing: Pitfalls and potentials
    Assessing Writing
  2. Braun (2006)
    Using thematic analysis in psychology
    Qualitative Research in Psychology  ↗
  3. Broussard (2023)
    More than a glitch: Confronting race, gender, and ability bias in tech
  4. Bucol (2025)
    Exploring ChatGPT as a writing assessment tool
    Innovations in Education and Teaching International  ↗
  5. Bui (2025)
    ChatGPT as an automated essay scoring tool in the writing classrooms: how it compares wit…
    Education and Information Technologies  ↗
  6. Buolamwini (2023)
    Unmasking AI: My mission to protect what is human in a world of machines
  7. Calderhead (1981)
    Stimulated recall: A method for research on teaching
    British Journal of Educational Psychology  ↗
  8. Chen (2025)
    Exploring generative AI literacy in higher education: Student adoption, interaction, eval…
    Information and Learning Sciences  ↗
  9. Chen et al. (2026)
    Assessing EFL students’ GenAI-assisted writing: Teachers’ pains, perceptions an…
    Assessing Writing
  10. Chiu (2024)
    Define, foster, and assess student and teacher AI literacy and competency for all: Curren…
    Computers and Education Open  ↗
  11. Choi (2025)
    Exploring the use of Generative Artificial Intelligence (GenAI) in English language teach…
    Technology in Language Teaching & Learning  ↗
  12. Cohen (2018)
    Research methods in education
  13. Cunningham (2026)
    Integrating generative artificial intelligence into chemical engineering education: Staff…
    Education for Chemical Engineers  ↗
  14. Dai (2025)
    University policies on generative AI in Asia: Promising practices, gaps, and future directions
    Journal of Asian Public Policy  ↗
  15. Eacersall (2025)
    Navigating ethical challenges in generative AI-enhanced research: The ETHICAL framework f…
    Journal of Applied Learning & Teaching  ↗
  16. EdSAFE AI Alliance. (2024). S.A.F.E. benchmarks framework. https://www.edsafeai.org/safe.
  17. Farrokhnia (2026)
    Generative AI offers more, but students revise less: comparing the effects of teacher and…
    International Journal of Educational Technology in Higher Education  ↗
  18. Fereday (2006)
    Demonstrating rigor using thematic analysis: A hybrid approach of inductive and deductive…
    International Journal of Qualitative Methods  ↗
  19. Gan (2026)
    Language assessment literacy development: An ethnographic case study on university English instructors in China
  20. Gao (2025)
    Assessing the reliability and relevance of DeepSeek in EFL writing evaluation: A generali…
    Language Testing in Asia  ↗
  21. Gass (2013)
    Stimulated recall methodology in second language research
  22. Gjorevski (2025)
    Exploring the potential of ChatGPT for evaluating English essays in a criterion-based ass…
    TESOL Quarterly  ↗
  23. Huang (2026)
    Effects of integrating generative AI, teacher, and peer feedback on Middle school student…
    Educational Psychology
  24. Huang (2025)
    Developing pre-service language teachers’ GenAI literacy: an interventional study in an E…
    Discover Artificial Intelligence  ↗
  25. Jin (2025)
    Generative AI in higher education: A global perspective of institutional adoption policie…
    Computers and Education: Artificial Intelligence
  26. Kim (2025)
    Examining Faculty and Student Perceptions of Generative AI in University Courses
    Innovative Higher Education  ↗
  27. Kim (2025)
    Exploring students’ perspectives on Generative AI-assisted academic writing
    Education and Information Technologies  ↗
  28. Kinder (2025)
    Effects of adaptive feedback generated by a large language model: A case study in teacher…
    Computers and Education: Artificial Intelligence
  29. Kong (2024)
    Developing an artificial intelligence literacy framework: Evaluation of a literacy course…
    Computers and Education: Artificial Intelligence
  30. Lam (2020)
    Writing portfolio assessment in practice: individual, institutional, and systemic issues
    Pedagogies: An International Journal  ↗
  31. Lee (2024)
    Development and validation of ChatGPT literacy scale
    Current Psychology  ↗
  32. Li (2026)
    Formative feedback across sources: Student perceptions and writing outcomes with instruct…
    Reading and Writing  ↗
  33. Li (2024)
    AI-assisted marking: Functionality and limitations of ChatGPT in written assessment evaluation
    Australasian Journal of Educational Technology
  34. Long (2020)
    What is AI Literacy? Competencies and Design Considerations
    Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
  35. Lu (2024)
    Can ChatGPT effectively complement teacher assessment of undergraduate students’ academic…
    Assessment and Evaluation in Higher Education  ↗
  36. Ma (2024)
    Exploring ChatGPT literacy in language education: A global perspective and comprehensive …
    Computers and Education: Artificial Intelligence
  37. Meyasa (2024)
    EFL teachers’ perspectives on the integration of ChatGPT in writing assessment
    Jurnal Pendidikan Bahasa Inggris Undiksha  ↗
  38. Mills (2024)
    AI literacy: A framework to understand, evaluate, and use emerging technology
    Digital Promise
  39. Mizumoto (2024)
    Testing the viability of ChatGPT as a companion in L2 writing accuracy assessment
    Research Methods in Applied Linguistics  ↗
  40. Moorhouse (2025)
    Pre-service Language Teachers’ Task-specific Large Language Model Prompting Practices
    RELC Journal  ↗
  41. Moorhouse (2024)
    Developing language teachers’ professional generative AI competence: An intervention stud…
    System  ↗
  42. Moorhouse (2024)
    The effects of generative AI on initial language teacher education: The perceptions of te…
    System  ↗
  43. Moorhouse (2025)
    Generative artificial intelligence and language teaching
  44. Ng (2021)
    Conceptualizing AI literacy: An exploratory review
    Computers and Education: Artificial Intelligence
  45. Nguyen (2025)
    Teachers’ and Students’ Perspectives on AI Application in Translation Studies: A Leap or …
    Computer-Assisted Language Learning Electronic Journal
  46. Park (2025)
    A systematic literature review of generative artificial intelligence (GenAI) literacy in …
    Computers and Education: Artificial Intelligence
  47. Pretorius (2023)
    Fostering AI literacy: A teaching practice reflection
    Journal of Academic Language and Learning
  48. Pretorius, L., & Cahusac de Caux, B. (2025). The AI literacy framework for higher education: A grounded theor…
     ↗
  49. Saricaoglu (2025)
    The capacity of ChatGPT-4 for L2 writing assessment: A closer look at accuracy, specifici…
    Annual Review of Applied Linguistics  ↗
  50. Shenton (2004)
    Strategies for ensuring trustworthiness in qualitative research projects
    Education for Information  ↗
  51. Slomp (2016)
    Ethical considerations and writing assessment
    Journal of Writing Assessment
  52. Sun (2025)
    The socio-emotional dangers of using artificial intelligence (AI) technologies in second …
    Acta Psychologica  ↗
  53. Suri (2011)
    Purposeful sampling in qualitative research synthesis
    Qualitative Research Journal  ↗
  54. The London School of Economics and Political Science (2025, November 7). LSE Principles and Guidance for AI-a…
  55. Wang (2023)
    Measuring user competence in using artificial intelligence: Validity and reliability of a…
    Behaviour & Information Technology  ↗
  56. White (2024)
    Responsible AI and tech justice: A guide for K-12 education
  57. Woo (2026)
    Effects of a prompt engineering intervention on undergraduate students’AI self-efficacy, …
    British Educational Research Journal  ↗
  58. Wu et al. (2026)
    Using DeepSeek’s reasoning-based AI model to support written feedback practices
    Assessing Writing
  59. Wu (2026)
    Exploring PhD students’ utilization of generative AI in academic writing for publication …
    Journal of English for Academic Purposes  ↗
  60. Yan (2025)
    Beyond tool use: Tracking the evolution of generative AI literacy among university studen…
    Computers and Education: Artificial Intelligence
  61. Yu (2026)
    Peer feedback in second-language writing: A critical review of recent research (2015-2024)
    Language Teaching
  62. Yu (2025)
    “It’s very well written!”: Revisiting praise in teacher written feedback from the perspec…
    Applied Linguistics  ↗
  63. Zacharis (2025)
    Can AI grade like a human? Validity, reliability, and fairness in university coursework a…
    Educational Process: International Journal
  64. Zeevy-Solovey (2024)
    Comparing peer, ChatGPT, and teacher corrective feedback in EFL writing: Students’ percep…
    Technology in Language Teaching & Learning  ↗
  65. Zhang (2025)
    Integrating various types of feedback in L2 writing instruction: Teachers’ and students’ …
    International Journal of Applied Linguistics  ↗
  66. Zhang (2025)
    University students’ perceptions of using generative AI in translation practices
    Instructional Science  ↗
CrossRef global citation count: 0 View in citation network → Build reading path →

Related articles

  1. Assessing Writing Oct 2026
    Student-AI collaboration in peer feedback: Effects on perceived feedback quality, emotional responses, and feedback literacy development ↗
    Hua Wang; Kai Guo
    writing pedagogy graduate education collaborative writing assessment empirical research artificial intelligence multilingual writers literacy studies affect and writing
  2. Journal of Academic Writing Sep 2018
    ‘It’s Hard to Define Good Writing, but I Recognise it when I See it’: Can Consensus-Based Assessment Evaluate the Teaching of Writing? ↗
    Ursula Canton
    writing pedagogy teacher development assessment empirical research qualitative research literacy studies
  3. Research in the Teaching of English Aug 2011
    Subjectivity, Intentionality, and Manufactured Moves: Teachers’ Perceptions of Voice in the Evaluation of Secondary Students’ Writing ↗
    Jill V. Jeffery
    genre theory writing pedagogy teacher development assessment empirical research qualitative research multilingual writers affect and writing
  4. Computers and Composition Sep 2026
    Navigating ethical collaboration with machine translation: An exploratory study on the role of L2 development in GenAI writing ↗
    Bronwen Dyson; Benjamin Miller; Susan Thomas
    collaborative writing assessment artificial intelligence multilingual writers literacy studies
  5. Written Communication Jul 2026
    The Dynamics Between the Biographical Factors, Professional Identities, and Teaching Practices of Second Language Writing Instructors ↗
    Young Wha Lee
    first-year composition writing pedagogy graduate education teacher development assessment qualitative research multilingual writers grammar and mechanics