Abstract

This study explores how prompting techniques, especially those integrated with rhetorical analysis results, may improve the effectiveness of artificial intelligence (AI)-generated business communication messages. I conducted an experiment to assess the effectiveness of these prompting techniques in the context of crafting a negative message generated with ChatGPT 3.5 ( n = 85). A multiple regression was calculated to explore prompting techniques’ impact on the negative message grades and how each technique influences the message grade. The results ( F(4, 80) = 31.84, p < .001), with an adjusted R2 = .595, indicate a positive relationship between prompting techniques and the effectiveness of AI-generated messages. This study also identified challenges related to students’ AI literacy. I conclude the study by recommending practical measures on how to incorporate AI into business and professional writing classrooms.

Journal
Journal of Technical Writing and Communication
Published
2024-10-01
DOI
10.1177/00472816241260033
CompPile
Open Access
Closed
Topics
Export

Citation context

Cited by in this index (2)

  1. Technical Communication Quarterly
  2. Technical Communication Quarterly

References (43) · 4 in this index

  1. 10.1057/s41599-023-02269-7
     ↗
  2. Genre: An introduction to history, theory, research, and pedagogy
  3. 10.1007/s11528-023-00896-0
     ↗
  4. Chenault C. (n.d.). Beginner’s guide: How to incorporate feedback loops in ChatGPT …
  5. The complete obsolete guide to generative AI
Show all 43 →
  1. Cohen A. (n.d.). Prompt engineering: Automatic application idea to code generator …
  2. Writing genres
  3. Dhaduk H. (2023). Reinforcement Learning from Human Feedback (RLHF): Benefits, challeng…
  4. 10.1016/j.ijinfomgt.2023.102642
     ↗
  5. 10.1016/j.jrt.2023.100060
     ↗
  6. 10.36227/techrxiv.22683919.v2
     ↗
  7. Business communication: Process & product
  8. Hu K. (2023). ChatGPT sets record for fastest-growing user base. Reuters …
  9. Kong A., Zhao S., Chen H., Li Q., Qin Y., Sun R., Zhou X. (2023). Better zero-shot reasoning with role-play p…
     ↗
  10. 10.15678/EBER.2023.110302
     ↗
  11. TextGenEd: Teaching with text generation technologies
  12. 10.26615/978-954-452-092-2_069
     ↗
  13. Li Z., Yang Z., Wang M. (2023). Reinforcement learning with human feedback: Learning dynamic choices via pess…
  14. 10.1016/j.ijme.2023.100790
     ↗
  15. Business and administrative communication
  16. Long J. (2023). Large language model guided tree-of-thought. arXiv …
  17. 10.1080/00335638409383686
     ↗
  18. Rhetoric Society Quarterly
  19. 10.1016/j.chbah.2023.100027
     ↗
  20. 10.2139/ssrn.4300783
     ↗
  21. Business and Professional Communication Quarterly
  22. 10.1007/s10462-022-10246-w
     ↗
  23. 10.1016/j.metrad.2023.100022
     ↗
  24. 10.1609/hcomp.v8i1.7469
     ↗
  25. OpenAI. (n.d.). Prompt engineering . https://platform.openai.com/…
  26. Ouyang L., Wu J., Jiang X., Almeida D., Wainwright L., Mishkin P., Zhang C., Agarwal S., Slama K., Ray A.Schu…
  27. IEEE Transactions on Professional Communication
  28. Prompt Engineering Guide. (n.d.). Zero-shot prompting . https://w…
  29. 10.1016/j.iotcps.2023.04.003
     ↗
  30. Teaching business writing: Challenges, plans, pedagogy, research
  31. 10.1016/j.jbvi.2023.e00388
     ↗
  32. Genre studies around the globe: Beyond the three traditions
  33. Journal of Business and Technical Communication
  34. Finetuned language models are zero-shot learners
  35. Wei J., Wang X., Schuurmans D., Bosma M., Chi E., Le Q., Zhou D. (2022). Chain of thought prompting elicits r…
  36. White J., Fu Q., Hays S., Sandborn M., Olea C., Gilbert H., Elnashar A., Spencer-Smith J., Schmidt D. C. (202…
  37. Wolfram S. (2023). What is ChatGPT doing… and why does it work? S…
  38. Zhou Y., Muresanu A. I., Han Z., Paster K., Pitis S., Chan H., Ba J. (2023). Large language models are human-…