Cochrane Review as a “Warranting Device” for Reasoning About Health

Sally Jackson University of Illinois Urbana-Champaign ; Jodi Schneider University of Illinois Urbana-Champaign

Abstract

Contemporary reasoning about health is infused with the work products of experts, and expert reasoning about health itself is an active site for invention and design. Building on Toulmin’s largely undeveloped ideas on field-dependence, we argue that expert fields can develop new inference rules that, together with the backing they require, become accepted ways of drawing and defending conclusions. The new inference rules themselves function as warrants, and we introduce the term “warranting device” to refer to an assembly of the rule plus whatever material, procedural, and institutional resources are required to assure its dependability. We present a case study on the Cochrane Review, a new method for synthesizing evidence across large numbers of scientific studies. After reviewing the evolution and current structure of the device, we discuss the distinctive kinds of critical questions that may be raised around Cochrane Reviews, both within the expert field and beyond. Although Toulmin’s theory of field-dependence is often criticized for its relativism, we find that, as a matter of practical fact, field-specific warrants do not enjoy immunity from external critique. On the contrary, they can be opened to evaluation and critique from any interested perspective.

Journal
Argumentation
Published
2018-06-01
DOI
10.1007/s10503-017-9440-z
CompPile
Open Access
OA PDF Hybrid
Topics
Export

Citation context

Cited by in this index (1)

  1. Argumentation

References (64) · 5 in this index

  1. Aagaard, Thomas, Hans Lund, and Carsten Juhl. 2016. Optimizing literature search in systematic reviews: Are M…
    BMC Medical Research Methodology  ↗
  2. Balshem, Howard, Mark Helfand, Holger J. Schünemann, Andrew D. Oxman, Regina Kunz, Jan Brozek, Gunn E. Vist, …
    Journal of Clinical Epidemiology  ↗
  3. Bermejo-Lugue, Lilian. 2006. Toulmin’s model of argument and the question of relativism. In Arguing on the To…
     ↗
  4. Bero, Lisa, and Drummond Rennie. 1995. The Cochrane Collaboration: Preparing, maintaining, and disseminating …
    Journal of the American Medical Association  ↗
  5. Boring, Edwin G. 1954. The nature and history of experimental control. The American Journal of Psychology 67(…
    The American Journal of Psychology  ↗
Show all 64 →
  1. Hill, Austin Bradford. 1965. The environment and disease: Association or causation? Proceedings of the Royal …
    Proceedings of the Royal Society of Medicine  ↗
  2. Effective care in pregnancy and childbirth: Pregnancy
  3. Chesñevar, Carlos, Sanjay Modgil, Iyad Rahwan, Chris Reed, Guillermo Simari, Matthew South, Gerard Vreeswijk,…
    The Knowledge Engineering Review  ↗
  4. Effectiveness and efficiency: Random reflections on health services
  5. Cochrane Crowd. n.d. http://crowd.cochrane.org/index.html …
  6. Cochrane Library. n.d. CENTRAL creation details. http://www.cochranelibrary.com/help…
  7. Contaxis, Nicole. 2016. Grateful Med: Personal computing and user-friendly design. Circulating Now [blog of t…
  8. Rethinking expertise
     ↗
  9. Cooper, Harris M., and Robert Rosenthal. 1980. Statistical versus traditional procedures for summarizing rese…
    Psychological Bulletin  ↗
  10. Demicheli, Vittorio, Alessandro Rivetti, Maria Grazia Debalini, and Carlo Di Pietrantonj. 2012. Vaccines for …
    Cochrane Database of Systematic Reviews  ↗
  11. Dickersin, Kay, Eric Manheimer, Susan Wieland, Karen A. Robinson, Carol Lefebvre, and Steve McDonald. 2002. D…
    Evaluation and the Health Professions  ↗
  12. Dickersin, Kay, Roberta Scherer, and Carol Lefebvre. 1994. Identifying relevant studies for systematic review…
    British Medical Journal  ↗
  13. Fawcett, Tom. 2015. Mining the quantified self: Personal knowledge discovery as a challenge for data science.…
    Big Data  ↗
  14. Argumentation
  15. Garritty, Chantelle, Adrienne Stevens, Gerald Gartlehner, Valerie King, Chris Kamel, and Cochrane Rapid Revie…
    Systematic Reviews  ↗
  16. Glass, Gene V. 1976. Primary, secondary, and meta-analysis of research. Educational Researcher 5(10): 3–8. do…
    Educational Researcher  ↗
  17. Grant, Maria J., and Andrew Booth. 2009. A typology of reviews: An analysis of 14 review types and associated…
    Health Information & Libraries Journal  ↗
  18. Guyatt, Gordon H., Andrew D. Oxman, Holger J. Schünemann, Peter Tugwell, and Andre Knottnerus. 2011. GRADE gu…
    Journal of Clinical Epidemiology  ↗
  19. Harlan, William D. 1993. An evidence based health care system: The case for clinical trials registries. Repor…
  20. Hedges, Larry V. 1986. Issues in meta-analysis. Review of Research in Education 13: 353–398. doi: …
    Review of Research in Education  ↗
  21. Higgins, Julian P. T., and Sally Green. 2011. Cochrane handbook for systematic reviews of interventions: The …
  22. Hitchcock, David. 2003. Toulmin’s warrants. In Anyone who has a view: Theoretical contributions to the study …
     ↗
  23. Argumentation
  24. Immunization safety review: Vaccines and autism
  25. Jackson, Sally. 2015a. Deference, distrust, and delegation: Three design hypotheses. In Reflections on theore…
     ↗
  26. Argumentation
  27. Jackson, Sally, and Natalie Lambert. 2016. A computational study of the vaccination controversy. In Argumenta…
  28. Kazmer, Michelle M., Liza A. Mia, Juliann Cortese Lustria, Gary Burnett, Ji-Hyun Kim, Jinxuan Ma, and Jeana F…
    Journal of the Association for Information Science and Technology  ↗
  29. Keith, William M., and David E. Beard. 2008. Toulmin’s rhetorical logic: What’s the warrant for warrants? Phi…
    Philosophy and Rhetoric  ↗
  30. Khangura, Sara, Kristin Konnyu, Rob Cushman, Jeremy Grimshaw, and David Moher. 2012. Evidence summaries: The …
    Systematic Reviews  ↗
  31. Lefebvre, Carol, L. Julie Glanville, Susan Wieland, Bernadette Coles, and Alison L. Weightman. 2013. Methodol…
    Systematic Reviews  ↗
  32. Lefebvre, Carol, Eric Manheimer, and Julie Glanville. 2011. Searching for studies. In Higgins, Julian P. T., …
  33. Lewandowsky, Stephan, and Dorothy Bishop. 2016. Research integrity: Don’t let transparency damage science. Na…
    Nature  ↗
  34. Medical Research Council. 1948. Streptomycin treatment of pulmonary tuberculosis. British Medical Journal 2(4…
    British Medical Journal  ↗
  35. Argumentation
  36. Mercier, Hugo, and Dan Sperber. 2011. Why do humans reason? Arguments for an argumentative theory. Behavioral…
    Behavioral and Brain Sciences  ↗
  37. Moher, David, Lesley Stewart, and Paul Shekelle. 2015. All in the family: Systematic reviews, rapid reviews, …
    Systematic Reviews  ↗
  38. Noel-Storr, Anna, Gordon Dooley, Julie Glanville, and Ruth Foxlee. 2015. The Embase project 2: Crowdsourcing …
  39. Office of Technology Assessment (US Congress). 1982. MEDLARS and heath information policy. Washington, DC: US…
  40. O’Keefe, Daniel J. 1999. Variability of persuasive message effects: Meta-analytic evidence and implications. …
    Document Design  ↗
  41. Oliver, J.Eric, and Thomas Wood. 2014. Medical conspiracy theories and health behaviors in the United States.…
    JAMA Internal Medicine  ↗
  42. Pinch, Trevor J., and Wiebe E. Bijker. 1984. The social construction of facts and artefacts: Or how the socio…
    Social Studies of Science  ↗
  43. Polisena, Julie, Chantelle Garritty, Chris Kamel, Adrienne Stevens, and Ahmed M. Abou-Setta. 2015. Rapid revi…
    Systematic Reviews  ↗
  44. Meta-analytic procedures for social research
  45. Synnot, Anneliese, Russell L. Gruen, David Menon, Ewout W. Steyerberg, Andras Buki, Wilco C. Peul, Julian H. …
    Journal of Neurotrauma  ↗
  46. An examination of the place of reason in ethics
  47. The uses of argument
  48. An introduction to reasoning
  49. Underhill, Kristen, Paul Montgomery, and Don Operario. 2007. Sexual abstinence only programmes to prevent HIV…
    BMJ (British Medical Journal)  ↗
  50. U.S. National Library of Medicine. MEDLINE FactSheet https://www.nlm.nih.gov/pubs/fa…
  51. Disturbing argument: Selected works from the 18th NCA/AFA Alta Conference on Argumentation
  52. Argumentation
  53. Wagemans, Jean H.M. 2016b. Constructing a periodic table of arguments. In OSSA Conference Proceedings 11, 106…
  54. Appeal to expert opinion: Arguments from authority
  55. Argumentation schemes
     ↗
  56. Willard, Charles Arthur. 1990. Authority. Informal Logic 12(1): 11–22.
    Informal Logic
  57. Young, Diony. 1990. Review of Effective Care in Pregnancy and Childbirth Edited by Iain Chalmers, Murray Enki…
     ↗
  58. Zarefsky, David. 1982. Persistent questions in the theory of argument fields. Journal of the American Forensi…
     ↗
  59. Zwahlen, Marcel, Andrew Renehan, and Matthias Egger. 2008. Meta-analysis in medical research: potentials and …
    Urologic Oncology: Seminars and Original Investigations  ↗