Validity Considerations in Complex Task Design

Richard Tannenbaum ; Irvin R. Katz Educational Testing Service
Journal
Journal of Writing Analytics
Published
2021-01-01
DOI
10.37514/jwa-j.2021.5.1.06
CompPile
Open Access
OA PDF Gold
Topics
Export

Citation context

Cited by in this index (3)

  1. Journal of Writing Analytics
  2. Journal of Writing Analytics
  3. Journal of Writing Analytics

References (74) · 6 in this index

  1. American Educational Research Association, American Psychological Association, & National Council on Measurem…
  2. Andrade, H. L., Bennett, R. E., & Cizek, G. J. (Eds.). (2019). Handbook of formative assessment in the discip…
     ↗
  3. Ark, T. A., Ark, N., & Zumbo, B. D. (2014). Validation practices of the Objective Structured Clinical Examina…
     ↗
  4. Bachman, L., & Palmer, A. (2010). Language assessment in practice: Developing language assessments and justif…
  5. Baker, E. L. (1998). Model-based performance assessment (CSE Technical Report #465). CRESST;
     ↗
Show all 74 →
  1. Baker, E. L., & O'Neill, H. F., Jr. (1996). Performance assessment and equity. In M. B. Kane & R. Mitchell (E…
  2. Baker, E. L., O'Neill, H. F., Jr., & Linn, R. L. (1993). Policy and validity prospects for performance- based…
     ↗
  3. Ball, D. L., Thames, M. H., & Phelps, G. (2008). Content knowledge for teaching: What makes it special? Journ…
     ↗
  4. Bennett, R. E. (2011). Formative assessment: A critical review. Assessment in Education: Principles, Policy &…
     ↗
  5. Black, P., & Wiliam, D. (2018). Classroom assessment and pedagogy. Assessment in Education: Principles, Polic…
     ↗
  6. Briggs, D. C. (2004). Comment: Making an argument for design validity before interpretive validity. Measureme…
  7. Journal of Writing Analytics
  8. Clark, I. (2012). Formative assessment: Assessment is for self-regulated learning. Educational Psychology Rev…
     ↗
  9. Conn, C. A., Bohan, K. J., Pieper, S. L., & Musumeci, M. (2020). Validity inquiry process: Practical guidance…
     ↗
  10. Journal of Writing Analytics
  11. Cronbach, L. (1971). Test validation. In R. L. Thorndike (Ed.), Educational measurement (2 nd ed., pp. 443-50…
  12. Darling-Hammond, L. (2014). Testing to, and beyond the Common Core. Principal, 93(3), 8-12.
  13. Darling-Hammond, L. (2017). Developing and measuring higher order skills: Models for state performance assess…
  14. DiCerbo, K. E. (2017). Building the evidentiary argument in game-based assessment. Journal of Applied Testing…
  15. DiCerbo, K. E., Shute, V., & Kim, Y. J. (2017). The future of assessment in technology rich environments: Psy…
  16. Dixson, D. D., & Worrell, F. C. (2016). Formative and summative assessment in the classroom. Theory Into Prac…
     ↗
  17. Ekkens, K., & Winke, P. (2009). Evaluating workplace English language programs. Language Assessment Quarterly…
     ↗
  18. Ercikan, K., & Pellegrino, J. W. (Eds.). (2017). Validation of score meaning for the next generation of asses…
     ↗
  19. Gorin, J. S., & Mislevy, R. J. (2013). Inherent measurement challenges in the next generation science standar…
  20. Guion, R. M. (1965). Personnel testing. McGraw Hill.
  21. Harsch, C., & Martin, G. (2013). Comparing holistic and analytic scoring methods: Issues of validity and reli…
     ↗
  22. Hoffman, B. J., Kennedy, C. L., LoPilato, A. C., Monahan, E. L., & Lance, C. E. (2015). A review of the conte…
     ↗
  23. Kane, M. (2006). Validation. In R. Brennan (Ed.), Educational measurement (4 th ed. pp. 17-64). American Coun…
  24. Kane, M. T. (2016). Explicating validity. Assessment in Education: Principles, Policy & Practice, 23, 198-211.
     ↗
  25. Kane, M., Crooks, T., & Cohen, A. (1999). Validating measures of performance. Educational Measurement: Issues…
     ↗
  26. Katz, I. R., Williamson, D. M., Nadelman, H. L., Kirsch, I., Almond, R. G., Cooper, P. L., Redman, M. L., & Z…
  27. Katz, I. R., & James, C. M. (1998). Toward assessment of design skills in engineering (ETS Rep. No. RR-97-16)…
  28. Katz, I. R., LaMar M. M., Spain, R., Zapata-Rivera, J. D., Baird, J.-A., & Greiff, S. (2017). Validity issues…
  29. Keehner, M., Gorin, J. S., Feng, G., & Katz, I. R. (2016). Developing and validating cognitive models in asse…
     ↗
  30. Klieger, D. M., Bridgeman, B., Tannenbaum, R. J., Cline, F. A., & Olivera-Aguilar, M. (2018). The validity of…
     ↗
  31. Kukulska-Hulme, A., & Viberg, O. (2018). Mobile collaborative language learning: State of the art. British Jo…
     ↗
  32. Lee, J., Connelly, B. S., Goff, M., & Hazucha, J. F. (2017). Are assessment center behaviors' meanings consis…
     ↗
  33. Leighton, J. P. (2017). Using think-aloud interviews and cognitive labs in educational research. Oxford Unive…
     ↗
  34. Written Communication
  35. Lyon, C. J., Nabors Oláh, L., & Wylie, E. C. (2019). Working toward integrated practice: Understanding the in…
     ↗
  36. Madnani, N., Loukina, A., von Davier, A., Burstein, J., & Cahill, A. (2017). Building better open-source tool…
     ↗
  37. Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement (3 rd ed., pp. 13-103). American C…
  38. Mislevy, R. J. (2016). How developments in psychology and technology challenge validity argumentation. Journa…
     ↗
  39. Mislevy, R. J., & Riconscente, M. M. (2006). Evidence-centered assessment design: Layers, concepts, and termi…
  40. National Research Council. (1996). National science education standards. National Academies Press.
  41. Nichols, P. D., & Williams, N. (2009). Consequences of test score use as validity evidence: Roles and respons…
     ↗
  42. Nickerson, C. (2005). English as a lingua franca in international business contexts. English for Specific Pur…
     ↗
  43. Norris, J. (2016). Current uses for task-based language assessment. Annual Review of Applied Linguistics, 36,…
     ↗
  44. Journal of Writing Analytics
  45. Oliveri, M. E., & Tannenbaum, R. J. (2019). Are we teaching and assessing the English skills needed to succee…
     ↗
  46. O'Sullivan, C. Y., Jerry, L., Ballator, N., & Herr, F. (1997). NAEP 1996 science state report for Tennessee. …
  47. Journal of Writing Analytics
  48. Peters, G. (2019). The role of standardized patient assessment forms in medical communication skills educatio…
     ↗
  49. Quellmalz, E. S., & Pellegrino, J. W. (2009). Technology and testing. Science, 323(5910), 75-79.
     ↗
  50. Ries, E. (2011). The lean startup. Crown Business.
  51. Rios, J., & Wells, C. (2014). Validity evidence based on internal structure. Psicothema, 26(1), 108-116.
     ↗
  52. Rogelberg, S. G. (2007). Encyclopedia of industrial and organizational psychology (Vol. 2), Sage Publications.
     ↗
  53. Rupp, A. A., Gushta, M., Mislevy, R. J., & Shaffer, D. W. (2010). Evidence-centered design of epistemic games…
  54. Rupp, A. A., Levy, R., DiCerbo, K. E., Sweet, S. J., Crawford, A. V., Caliço, T., Benson, M., Fay, D., Kunze,…
  55. Shavelson, R. J., Baxter, G. P., & Gao, X. (1993). Sampling variability of performance assessments. Journal o…
     ↗
  56. Shavelson, R. J., Baxter, G. P., & Pine, J. (1992). Performance assessments: Political rhetoric and measureme…
     ↗
  57. Shute, V. J. (2011). Stealth assessment in computer-based games to support learning. In S. Tobias & J. D. Fle…
     ↗
  58. Shute, V. J., Ventura, M., Bauer, M. I., & Zapata-Rivera, D. (2009). Melding the power of serious games and e…
  59. Siegel, A. I. (1986). Performance tests. In R. A. Berk (Ed.), Performance assessment: Methods & applications …
  60. Journal of Writing Analytics
  61. Stecher, B. (2010). Performance assessment in an era of standards-based educational accountability. Stanford …
  62. Stockwell, G., & Hubbard, P. (2013). Some emerging principles for mobile-assisted language learning. The Inte…
  63. Stosich, E. L., Snyder, J., & Wilczak, K. (2018). How do states integrate performance assessment in their sys…
     ↗
  64. Tannenbaum, R. J. (2019). Validity aspects of score reporting. In. D. Zapata-Rivera (Ed.), Score reporting: R…
     ↗
  65. Tannenbaum, R. J., & Kane, M. T. (2019). Stakes in testing: Not a simple dichotomy but a profile of consequen…
     ↗
  66. Wang, L., Shute, V., & Moore, G. R. (2015). Lessons learned and best practices of stealth assessment. Journal…
     ↗
  67. Whittaker, A., Pecheone, R., & Stansbury, K. (2018). Fulfilling our educative mission: A response to edTPA cr…
     ↗
  68. Wiggins, G. (1993). Assessment: Authenticity, context, and validity. Phi Delta Kappan, 75(3), 200-208, 210-214.
  69. Zieky, M. J. (2014). An introduction to the use of evidence-centered design in test development. Psicología E…
     ↗