Journal of Writing Analytics Jan 2018 Open Access

Placing Writing Tasks in Local and Global Contexts: The Case of Argumentative Writing

Hannah Ringler Carnegie Mellon University

Abstract

Background: Current research in composition and writing studies is concerned with issues of writing program evaluation and how writing tasks and their sequences scaffold students toward learning outcomes. These issues are beginning to be addressed by writing analytics research, which can be useful for identifying recurring types of language in writing assignments and how those can inform task design and student outcomes. To address these issues, this study provides a three-step method of sequencing, comparison, and diagnosis to understand how specific writing tasks fit into a classroom sequence as well as compare to larger genres of writing outside of the immediate writing classroom environment. By doing so, we provide writing program administrators with tools for describing what skills students demonstrate in a sequence of writing tasks and diagnosing how these skills match with writing students will do in later contexts. Literature Review: Student writing that responds to classroom assignments can be understood as genres, insofar as they are constructed responses that exist in similar rhetorical situations and perform similar social actions. Previous work in corpus analysis has looked at these genres, which helps us as writing instructors understand what kind of constructed responses are required of students and to make those expectations explicit. Aull (2017) examined a corpus of first-year undergraduate writing assignments in two courses to create “sociocognitive profiles” of these assignments. We analyze student writing that responds to similar writing tasks, but use a different corpus method that allows us to understand the tasks in both local and global contexts. By doing so, we gain confidence and depth in our understanding of these tasks, analyze how they sequence together, and are able to compare argumentative writing across institutions and contexts. Research Questions: Two questions guided our study: What is the trajectory of skills targeted by the sequence of tasks in the two first-year writing courses, as evidenced by the rhetorical strategies employed by the writers in successive assignments? Focusing on the final argument assignments, how similar are they to argumentative writing in other contexts, in terms of rhetorical profiles? Methodology: We first conducted a local analysis, in which we used a dictionary-based corpus method to analyze the rhetorical strategies used by writers in the first-year writing courses to understand how they built on each other to form a sequence. Having understood what skills students are demonstrating in a course, we then conducted a global analysis which calculated a “distance” between the first-year argument writing and a corpus of argument writing drawn from other contexts. Recognizing that there was a non-trivial distance, we then identified and evaluated the sources of the distance so that the writing tasks could be assessed or modified. Results: The local analysis revealed eight key rhetorical strategies that student writing exhibits between the two first-year writing courses. With this understanding, we then placed the argument writing in global contexts to find that the assignments in both courses differ somewhat from argument writing in other contexts. Upon analyzing this difference, we found that the first-year writing primarily differs in its usage of academic language, the personal register, assertive language, and reasoning. We suggest that these differences stem primarily from the rhetorical situation and learning objectives associated with first-year writing, as well as the sequencing of the courses. Discussion: The three-step method presented provides a means for writing program administrators to describe and analyze writing that students produce in their writing programs. We intend these steps to be understood as an iterative process, whereby writing programs can use these results to evaluate what rhetorical skills their students are exhibiting and to benchmark those against the program’s goals and/or other similar writing programs. Conclusions: By presenting these analyses together, we ultimately provide a cohesive method by which to analyze a writing program and benchmark students’ use of rhetorical strategies in relation to other argumentative contexts. We believe this method to be useful not only to individual writing programs, but to assessment literature broadly. In future research, we anticipate learning how this process will practically feed back into pedagogy, as well as understanding what placing writing tasks into a global context can tell us about genre theory.

Journal
Journal of Writing Analytics
Published
2018-01-01
DOI
10.37514/jwa-j.2018.2.1.03
CompPile
Open Access
OA PDF Gold
Topics
Export
BibTeX RIS

Citation context

Cited by in this index (8)

  1. Potter et al. (2026)
    From words to components: Mapping linguistic features in source-based writing
    Assessing Writing
  2. Potter et al. (2026)
    Source integration in source-based writing: From theoretical modeling to predic…
    Assessing Writing
  3. Lang et al. (2023)
    Computer-Assisted Corpus Analysis: An Introduction to Concepts, Processes, and …
    IEEE Transactions on Professional Communication
  4. Oddis et al. (2022)
    A Framework for Analyzing Features of Writing Curriculum in Studies of Student …
    Journal of Writing Analytics
  5. McCaffrey et al. (2022)
    Across Performance Contexts: Using Automated Writing Evaluation to Explore Stud…
    Journal of Writing Analytics
Show all 8 →
  1. Pollak (2021)
    Legitimation and Textual Evidence: How the Snowden Leaks Reshaped the ACLU’s On…
    Written Communication
  2. Wetzel et al. (2021)
    Computer-Assisted Rhetorical Analysis: Instructional Design and Formative Asses…
    Journal of Writing Analytics
  3. Lang et al. (2019)
    A Taxonomy for Writing Analytics
    Journal of Writing Analytics

References (56) · 15 in this index

  1. Allen (2004)
    The Impact of Student Learning Outcomes Assessment on Technical and Professiona…
    Technical Communication Quarterly
  2. Aull, L. L. (2015). First-year university writing: A corpus-based study with implications for pedagogy. UK: P…
     ↗
  3. Aull (2017)
    Corpus Analysis of Argumentative Versus Explanatory Discourse in Writing Task Genres
    Journal of Writing Analytics
  4. Aull et al. (2014)
    Linguistic Markers of Stance in Early and Advanced Academic Writing: A Corpus-b…
    Written Communication
  5. Bakhtin, M. (1990). Mikhail Bakhtin. In P. Bizzell & B. Herzberg (Eds.), The rhetorical tradition: Readings f…
Show all 56 →
  1. Beck et al. (2007)
    Genres of high-stakes writing assessments and the construct of writing competence
    Assessing Writing
  2. Beigman Klebanov, B., Kaufer, D., Yeoh, P., Ishizaki, S., Holtzman, S. (2016). Argumentative writing in asses…
     ↗
  3. Beigman Klebanov, B., Ramineni, C., Kaufer, D., Yeoh, P., Ishizaki, S. (in press). Advancing the validity arg…
  4. Bennett, R. E. (1991). On the meanings of constructed response. ETS Research Report Series, 1991(2), i- 46. d…
     ↗
  5. Biber, D. (1988). Variation across speech and writing. Cambridge: Cambridge University Press.
     ↗
  6. Biber, D., Conrad, S., Reppen, R., Byrd, P., & Helt, M. (2002). Speaking and writing in the university: A mul…
     ↗
  7. Brown et al. (2017)
    Elaborated Specificity versus Emphatic Generality: A Corpus-Based Comparison of…
    Research in the Teaching of English
  8. Burrows, J. (2002). 'Delta': A measure of stylistic difference and a guide to likely authorship. Literary and…
     ↗
  9. Cotos, E., Huffman, S., & Link, S. (2015). Furthering and applying move/step constructs: Technology- driven m…
     ↗
  10. Crossley, S. A., Kyle, K., & McNamara, D. S. (2016). The tool for the automatic analysis of text cohesion (TA…
     ↗
  11. CWPA, NCTE, & NWP. (2011). Framework for success in postsecondary writing. Retrieved from http://wpacouncil.o…
  12. Devitt, A., & Reiff, M. J. (2014). Reproducing genres: Pattern-related writing. In E. Jakobs & D. Perrin (Eds…
     ↗
  13. Dryer, D. B., Bowden, D., Brunk-Chavez, B., Harrington, S., Halbritter, B., & Yancey, K. B. (2014). Revising …
  14. Ford et al. (1982)
    Research Paper Instruction in the Undergraduate Writing Program
    College English
  15. Geisler (2016)
    Current and emerging methods in the rhetorical analysis of texts - Introduction…
    Journal of Writing Research
  16. Geisler (2016)
    Current and emerging methods in the rhetorical analysis of texts - Closing: Tow…
    Journal of Writing Research
  17. Gray, B. (2015). Linguistic variation in research articles: When discipline tells only part of the story. Ams…
     ↗
  18. Hardy, J. A., & Römer, U. (2013). Revealing disciplinary variation in student writing: A multi- dimensional a…
     ↗
  19. Harrington et al. (2001)
    WPA Outcomes Statement for First-Year Composition1
    College English
  20. Hart, R. P. (2000). Campaign talk: Why elections are good for us. Princeton, NJ: Princeton University Press.
  21. Hood, C. L. (2010). Ways of research: The status of the traditional research paper assignment in first-year w…
  22. Hoover, D. L. (2004a). Testing Burrows's delta. Literary and Linguistic Computing, 19(4), 453-475. Retrieved …
     ↗
  23. Hoover, D. L. (2004b). Delta prime? Literary and Linguistic Computing, 19(4), 477-495. Retrieved from https:/…
     ↗
  24. Ishizaki, S. & Kaufer, D. (2011). The DocuScope text analysis and visualization environment. In P. McCarthy &…
  25. Jarvis, S., Grant, L., Bikowski, D., & Ferris, D. (2003). Exploring multiple profiles of highly rated learner…
     ↗
  26. Jenseth (1989)
    Understanding Hiroshima: An Assignment Sequence for Freshman English
    College Composition and Communication
  27. Kaufer, D. S., & Butler, B. S. (2000). Designing interactive worlds with words: Principles of writing as repr…
     ↗
  28. Kaufer et al. (2004)
    Teaching Language Awareness in Rhetorical Choice: Using IText and Visualization…
    Journal of Business and Technical Communication
  29. Kiniry et al. (1985)
    Sequencing Expository Writing: A Recursive Approach
    College Composition and Communication
  30. Kučera, H., & Francis, W. N. (1967). Computational analysis of present-day American English. Providence: Brow…
  31. Kullback, S., & Leibler, R. A. (1951). On information and sufficiency. The Annals of Mathematical Statistics,…
     ↗
  32. Lindemann, E. (2001). A rhetoric for writing teachers. Oxford: Oxford University Press.
  33. Manning (1961)
    The Present Status of the Research Paper in Freshman English: A National Survey
    College Composition and Communication
  34. McNamara, D. S., Graesser, A. C., McCarthy, P. M., & Cai, Z. (2014). Automated evaluation of text and discour…
     ↗
  35. Melzer (2009)
    Writing Assignments Across the Curriculum: A National Study of College Writing
    College Composition and Communication
  36. Michigan Corpus of Upper-level Student Papers. (2009). Ann Arbor, MI: The Regents of the University of Michigan.
  37. Miller, C. R. (1984). Genre as social action. Quarterly Journal of Speech, 70(2), 151-167. Retrieved from htt…
     ↗
  38. Moxley, J. (2013). Big data, learning analytics, and social assessment. The Journal of Writing Assessment, 6(…
  39. National Research Council. (2012). Education for Life and Work: Developing Transferable Knowledge and Skills …
  40. Rankin, E. (1990). From simple to complex: Ideas of order in assignment sequences. Journal of Advanced Compos…
  41. Sandhaus, E. (2008). The New York Times annotated corpus. Linguistic Data Consortium, Philadelphia, 6(12), e26752.
  42. Simons, H. W. (1978). 'Genre-alizing' about rhetoric: A scientific approach. In K. K. Campbell & K. H. Jamies…
  43. Soliday, M. (2011). Everyday genres: Writing assignments across the disciplines. Carbondale, IL: Southern Ill…
  44. Stein, S., & Argamon, S. (2006). A mathematical explanation of Burrows's Delta. In Proceedings of the Digital…
  45. Thomas, S., & McShane, B. J. (2007). Skills and literacies for the 21 st Century: Assessing an undergraduate …
  46. WAC Clearinghouse. (2001). Sequencing writing assignments. Fort Collins, CO: University of Delaware Writing Center.
  47. White, E. M., Elliot, N., & Peckham, I. (2015). Very like a whale: The assessment of writing programs. Logan,…
     ↗
  48. Widaman, K. (2007). Common factors version components: Principals and principles, errors and misconceptions. …
  49. Wolfe (2009)
    How Technical Communication Textbooks Fail Engineering Students
    Technical Communication Quarterly
  50. Yancey, K. B., & Morrison, B. M. (2006). Coming to terms: Vocabulary as a means of defining first-year compos…
  51. Zhu, W. (2004). Writing in business courses: An analysis of assignment types, their characteristics, and requ…
     ↗
CrossRef global citation count: 8 View in citation network → Build reading path →

Related articles

  1. Pedagogy Jan 2022
    Contributors ↗
    modern rhetorical theory rhetorical criticism genre theory discourse analysis african american rhetorics decolonial rhetorics first-year composition writing pedagogy basic writing writing across the curriculum graduate education teacher development argument collaborative writing transfer assessment portfolios writing program administration writing centers peer tutoring technical communication professional writing archival research digital rhetoric social media grammar and mechanics literacy studies race and writing gender and writing disability studies public rhetoric community literacy literary studies editorial matter
  2. Literacy in Composition Studies Dec 2024
    Review: Eli Golblatt, Alone with Each Other: Literature and Literacy Intertwined ↗
    Elizabeth Kimball
    rhetorical criticism composition theory genre theory first-year composition writing pedagogy argument writing program administration literacy studies community literacy literary studies book reviews
  3. Pedagogy Oct 2024
    Contributors ↗
    rhetorical criticism first-year composition writing pedagogy basic writing writing across the curriculum graduate education two-year college service learning teacher development revision argument collaborative writing assessment writing program administration multimodality multilingual writers literacy studies race and writing disability studies community literacy editorial matter
  4. Pedagogy Apr 2024
    To Reimagine . . . To Start Again ↗
    Zachary C. Beare; Jessica Masterson; Shari J. Stenberg
    rhetorical criticism first-year composition writing pedagogy graduate education teacher development argument assessment writing program administration professional writing labor and working conditions multimodality race and writing gender and writing affect and writing editorial matter
  5. Pedagogy Jan 2024
    The Radical Role of Student Writing in Composition ↗
    Jessica Masterson
    modern rhetorical theory rhetorical criticism genre theory discourse analysis cultural rhetorics first-year composition writing pedagogy graduate education teacher development argument collaborative writing professional writing grammar and mechanics literacy studies race and writing gender and writing