Baruch Fischhoff: the Importance of Testing Messages Why Governments Need to Test Their Messages on Novel Coronavirus Disease (COVID-19) Before Disseminating Them

Total Page:16

File Type:pdf, Size:1020Kb

Baruch Fischhoff: the Importance of Testing Messages Why Governments Need to Test Their Messages on Novel Coronavirus Disease (COVID-19) Before Disseminating Them News Baruch Fischhoff: the importance of testing messages Why governments need to test their messages on novel coronavirus disease (COVID-19) before disseminating them. Baruch Fischhoff talks to Fiona Fleck. Q: You started studying risk and human behaviour in the 1970s. What sparked Baruch Fischhoff is a psychologist and authority on that interest? the science of decision-making. His research addresses A: I majored in mathematics, with a judgment- and decision-making, with a particular focus secondary major in psychology and then on risk analysis, perception, and communication. He had the extraordinary good fortune to has authored or co-authored over 200 peer-reviewed study and work with pioneers in the field articles and co-authored or edited 11 books. He is the of decision-making, including Daniel Howard Heinz University Professor in the Department Kahneman, Amos Tversky, Paul Slovic, of Engineering and Public Policy and the Institute for and Sarah Lichtenstein. Eventually that Courtesy of Baruch Fischhoff led to the study of the psychology be- Baruch Fischhoff Politics and Strategy at Carnegie Mellon University, in hind judgments and preferences, risk the United States of America (USA). He is also a member analysis, and risk communication. My of the National Academy of Sciences and the National Academy of Medicine. professional entry into the field began He received a Bachelor of Science in mathematics and psychology from Wayne in the 1970s when my colleagues and I State University in 1967 and a master’s and doctorate in psychology from the were approached by technologists and Hebrew University of Jerusalem in 1972 and 1975. engineers trying to understand public resistance to emerging technologies. Initially, they included representatives sentially nothing. All you have to do is of companies promoting nuclear power to ask a diverse group of people to read and biotechnologies based on recombi- a draft message, telling you whatever nant DNA. They would say, “We have It’s a common comes into their minds. There are always this wonderful technology, but people “reaction when we surprises. Things that seemed clear to think it’s too risky because they don’t try to communicate you confuse them. Things that seem understand it. You’re psychologists, do and it doesn’t work: clear to them are being interpreted dif- something about it.” we blame our ferently than the way you intended. Not Q: What did they want you to do exactly? audience. testing messages before putting them out is a kind of public health malpractice. A: Help them make the audience understand the great benefits and low ” Q: How can the study of human behav- risks of their technologies. As they iour in relation to risk support health saw it, the public just didn’t get it. It’s risk communications and messaging a common reaction when people try Q: Can these lessons from the past help regarding preventive measures such as to communicate and it doesn’t work: us in the response to the COVID-19 social distancing, mask wearing and they blame their audience. Drawing on pandemic? handwashing? psychological theories and methods, A: Absolutely. Just as with the A: The discipline of risk commu- we studied how people perceived these technologists in the 1970s, public health nication is straightforward. Gather the new technologies. What we found communicators need to know how their evidence regarding the risk, analyse was that there was very little that the audience thinks about new issues, in- that evidence to determine what people public needed to know that couldn’t cluding the COVID-19 pandemic. One really need to know, draft messages be explained in comprehensible terms. of psychology’s strongest results is that focused on those critical facts, test the However, in order to discover those we exaggerate how well we understand draft messages, and repeat as necessary. terms, you needed to listen to the public one another. As a result, we think we In the United States of America, we have first and then test your draft messages. know what other people want to hear failed on all three fronts. We have not There has been a good deal of work on and we think we are making ourselves tested enough people to know the mag- risk communication since then and that abundantly clear. But we’re just guessing, nitude of the problem – and the risks it work has generated some important based on our intuitive theories about represents. We have not synthesized the insights. For example, the research has what other people know and want to evidence that people need to be aware of found that clearly presented quantitative know. It’s amazing how few messages in authoritative, comprehensible form, information can avoid the confusion are empirically tested, however great the so people are buffeted by social media created by vague quantifiers, such as health, economic, and political stakes. rumours and reports of individual stud- “likely,” “rare,” and “possible”. People with enormous responsibility ies, sometimes before they have been just write down something that looks peer reviewed. Our national academies right to them and send it out. Moreover, have a COVID-19 Committee that has the most basic message testing costs es- done a dozen authoritative and peer- 516 Bull World Health Organ 2020;98:516–517 | doi: http://dx.doi.org/10.2471/BLT.20.030820 News reviewed syntheses of the research Communication Advisory Commit- respect to, “How can I control things?”, on topics, such as the vulnerability of tee. We helped the FDA implement its my personal risk analysis is fairly simple: younger people and the effectiveness of strategic plan for risk communication, what can I most easily do to put a barrier handmade fabric face masks. However, proposed fast, efficient messages testing between myself and other people in case the academies cannot track and interpret procedures, and recommended policies they are shedding virus or I am without all of the studies of varying quality that for “emerging events.” I also helped knowing it? People will reach different are coming out. So, we don’t get the evi- the FDA to rework how it reports ap- conclusions, depending on their cir- dence in the form that we need it. Third, proval decisions for pharmaceuticals cumstances. However, they can all use our official communications have often and biologics. The FDA subsequently communications that present the basic been amateurish. created a Benefit-Risk Framework, facts, and uncertainties, in a simple, us- which is an excellent example of how to able, respectful way. Also, I would advise Q: How do you account for these short- communicate complicated decisions. governments to communicate in a way comings? The framework uses a standard format, that takes accounts of people’s beliefs. A: Basically, we know what to do, structured around key issues. It reports People, including experts, process new but haven’t done it. By ‘we’ I mean our evidence and uncertainties, and sets information in terms of their mental official sources, those responsible for out the rationale for its regulatory de- model, which is comprised of their formulating and communicating poli- cisions. It also identifies ways to make assumptions, beliefs, experiences, and cies and recommendations that would approved products even better. There biases about the world. Communica- help us get through crises like the pres- is no reason why we could not use that tors need to be aware of these models ent one. There has been an appreciation kind of framework to organize and com- in crafting their messages. of the need to communicate effectively municate the evidence regarding other during pandemics for some time and ef- health issues. It’s not expensive, it uses Q: How well has the World Health Orga- forts have been made to prepare. For ex- staff time efficiently, and it reduces the nization (WHO) communicated the risks ample, in 2016, our national academies health, economic, and political risks of relating to COVID-19? held a workshop on capacity building in failing to address the public’s concerns. A: WHO, as I see it, treats its audi- communication for pandemics. So, we ence as responsible individuals capable knew what preparations were needed, of understanding things and making but were caught unprepared. responsible choices. When I go to the Not testing WHO website – and I also send people Q: What could have been done differ- messages“ before there – I see pictures of diverse people ently? putting them out is a in settings that would be familiar to A: With a small investment, we kind of public health many. My sense is that someone who could have developed and tested generic malpractice. goes there would say, “The people who messages, ready to adapt to specific situ- put this together care about people like ations. For example, we could have been ” me. They know how we live. They are ready to explain the epidemiological trying to help us solve our problems.” models that are so essential for under- WHO has an advantage in having a very standing what’s happening. We could diverse workforce, and you can tell that have been ready to explain how diseases Q: What is your advice to governments people from different backgrounds have spread, and the risk of transmission, in- when preparing and communicating a hand in the crafting messages. cluding to people we may never even see. their guidance? We could have reduced the confusion A: Avoid long to-do lists with no Q: How has politics informed messaging over mask recommendations meant to organizing rationale. Also, focus on the around COVID-19? protect the people who wear them and decisions that people face in their daily A: As you might expect, it has in- the people who are near them.
Recommended publications
  • Acceptable Risk: a Conceptual Proposal
    RISK: Health, Safety & Environment (1990-2002) Volume 5 Number 1 Article 3 January 1994 Acceptable Risk: A Conceptual Proposal Baruch Fischhoff Follow this and additional works at: https://scholars.unh.edu/risk Part of the Risk Analysis Commons, Science and Technology Law Commons, and the Science and Technology Studies Commons Repository Citation Baruch Fischhoff, Acceptable Risk: A Conceptual Proposal , 5 RISK 1 (1994). This Article is brought to you for free and open access by the University of New Hampshire – Franklin Pierce School of Law at University of New Hampshire Scholars' Repository. It has been accepted for inclusion in RISK: Health, Safety & Environment (1990-2002) by an authorized editor of University of New Hampshire Scholars' Repository. For more information, please contact [email protected]. Acceptable Risk: A Conceptual Proposal* Baruch Fischhoff** Introduction The Search for Acceptability Perhaps the most widely sought quantity in the management of hazardous technologies is the acceptable level of risk.1 Technologies whose risks fall below that level could go about their business, without worrying further about the risks that they impose on others. Riskier technologies would face closure if they could not be brought into compliance. For designers and operators, having a well-defined acceptable level of risk would provide a clear target for managing their technology. For regulators, identifying an acceptable level of risk would mean resolving value issues at the time that standards are set, allowing an agency's technical staff to monitor compliance mechanically, without having to make case-specific political and ethical decisions. For * Support for this research was provided under National Science Foundation Grant SES-8715564.
    [Show full text]
  • Fischhoff Vita 190914
    BARUCH FISCHHOFF Howard Heinz University Professor Department of Engineering & Public Policy Institute for Politics and Strategy Carnegie Mellon University Pittsburgh, PA 15213-3890 [email protected] http://www.cmu.edu/epp/people/faculty/baruch-fischhoff.html Born: April 21, 1946, Detroit, Michigan Education 1967 B.Sc. (Mathematics, Psychology) magna cum laude, Wayne State University, 1967-1970 Kibbutz Gal-On and Kibbutz Lahav, Israel 1972 M.A. (Psychology) with distinction, The Hebrew University of Jerusalem 1975 Ph.D. (Psychology), The Hebrew University of Jerusalem Positions 1970-1974 Instructor, Department of Behavioral Sciences, University of the Negev 1971-1972 Research Assistant (to Daniel Kahneman), The Hebrew University of Jerusalem, Israel 1973-1974 Methodological Advisor and Instructor, Paul Baerwald School of Social Work, MSW Program in Social Work Research, The Hebrew University of Jerusalem 1974-1976 Research Associate, Oregon Research Institute, Eugene, Oregon 1975-1987 Visiting Assistant Professor, Dept. of Psychology, University of Oregon, 1975- 1980; Visiting Associate Professor, 1980-1987 1976-1987 Research Associate, Decision Research, a branch of Perceptronics, Eugene, Oregon 1981-1982 Visiting Scientist, Medical Research Council/Applied Psychology Unit, Cambridge, England 1982-1983 Visiting Scientist, Department of Psychology, University of Stockholm 1984-1990 Research Associate, Eugene Research Institute, Eugene, Oregon 1987- Howard Heinz University Professor of Engineering and Public Policy and of Social and Decision Sciences (until 2016) and of Strategy and Politics (since 2016), Carnegie Mellon University 2014- Visiting Professor, Leeds University School of Business Selected Awards and Honors 1964-1967 Wayne State University Undergraduate Scholarship 1966-1967 NSF Undergraduate Research Grant (under Samuel Komorita) 1967 Phi Beta Kappa 1969-1974 The Hebrew University of Jerusalem Graduate Fellowships 1980 American Psychological Association Distinguished Scientific Award for Early Career Contribution to Psychology 1985 Harold D.
    [Show full text]
  • Association for Consumer Research
    ASSOCIATION FOR CONSUMER RESEARCH Association for Consumer Research, University of Minnesota Duluth, 115 Chester Park, 31 West College Street Duluth, MN 55812 Emotion, Scientific Reasoning, and Judgments of Scientific Evidence Caitlin Drummond, University of Michigan, USA Baruch Fischhoff, Carnegie Mellon University, USA We examine how consumers’ ability to reason about and emotional reactions to scientific evidence relate to their judgments of it. In an online study, reasoning ability and emotional reactions to controversial research separately predicted understanding of it, judgments of its quality, and trust in the scientists who conducted it. [to cite]: Caitlin Drummond and Baruch Fischhoff (2018) ,"Emotion, Scientific Reasoning, and Judgments of Scientific Evidence", in NA - Advances in Consumer Research Volume 46, eds. Andrew Gershoff, Robert Kozinets, and Tiffany White, Duluth, MN : Association for Consumer Research, Pages: 115-120. [url]: http://www.acrwebsite.org/volumes/2412349/volumes/v46/NA-46 [copyright notice]: This work is copyrighted by The Association for Consumer Research. For permission to copy or use this work in whole or in part, please contact the Copyright Clearance Center at http://www.copyright.com/. Consuming Science: Knowledge, Acceptance, and Judgements of Scientific Information and Technology Chairs: Nicholas Light, University of Colorado Boulder, USA Philip Fernbach, University of Colorado Boulder, USA Paper #1: A Taxonomy of Opposition to Genetically Modified naturalness, or acceptability in Christian doctrine. These findings Foods suggest that attitudes are based on the moralization of GM foods. Philip Fernbach, University of Colorado Boulder, USA In the third paper, the authors examine how consumers’ ability Nicholas Light, University of Colorado Boulder, USA to reason about—and emotional reactions to—scientific evidence re- late to their judgments.
    [Show full text]
  • Communicating Risks and Benefits: an Evidence-Based User's Guide
    Acknowledgements We offer special thanks to Nancy Ostrove, recently retired from her position as Director, Risk Communication Staff, Office of Planning of the US Food and Drug Administration (FDA), and Lee Zwanziger, Designated Federal Official for FDA’s Risk Communication Advisory Committee. Without them, this guide, like so many of FDA’s initiatives, would not have happened. We also thank Nancy Derr and Elena Ketelhut for their thoughtful and patient help in seeing the guide through the production process. Finally, we thank the guide’s authors and reviewers. Each has either served on the Committee or supported its work. Each has also had a role in creating the field of risk communication, producing its research foundations or making communications work in ways that are faithful to the science being communicated and to the needs of those whom it serves. We also thank the following publishers for kind permission to reuse figures: Elsevier (Chapter 4, figure 1 and Chapter 8, figure 2), John Wiley and Sons (Chapter 4, figure 2 and Chapter 8, figure 1), Nature Publishing Group (Chapter 4, figure 3), Lawrence Erlbaum Associates (Chapter 15), and University of California Press (print) and Lisa M. Schwartz (electronic) (Chapter 6, figure 1). Other figures were obtained from open sources such as governmental publications, created by the authors for this volume, or were owned by the authors for purposes of reuse in their own works. Published by the Food and Drug Administration (FDA), US Department of Health and Human Services, August 2011. Contributors to this compilation are past or current members or consultants of the FDA’s Risk Communication Advisory Committee.
    [Show full text]
  • Cognitive Biases Potentially Affecting Judgment of Global Risks
    MIRI MACHINE INTELLIGENCE RESEARCH INSTITUTE Cognitive Biases Potentially Affecting Judgment of Global Risks Eliezer Yudkowsky Machine Intelligence Research Institute Yudkowsky, Eliezer. 2008. “Cognitive Biases Potentially Affecting Judgment of Global Risks.” In Global Catastrophic Risks, edited by Nick Bostrom and Milan M. Ćirković, 91–119. New York: Oxford University Press. This version contains minor changes. Eliezer Yudkowsky 1. Introduction All else being equal, not many people would prefer to destroy the world. Even faceless corporations, meddling governments, reckless scientists, and other agents of doom re- quire a world in which to achieve their goals of profit, order, tenure, or other villainies. If our extinction proceeds slowly enough to allow a moment of horrified realization, the doers of the deed will likely be quite taken aback on realizing that they have actually destroyed the world. Therefore I suggest that if the Earth is destroyed, it will probably be by mistake. The systematic experimental study of reproducible errors of human reasoning, and what these errors reveal about underlying mental processes, is known as the heuristics and biases program in cognitive psychology. This program has made discoveries highly relevant to assessors of global catastrophic risks. Suppose you’re worried about the risk of Substance P, an explosive of planet-wrecking potency which will detonate if exposed to a strong radio signal. Luckily there’s a famous expert who discovered Substance P, spent the last thirty years working with it, and knows it better than anyone else in the world. You call up the expert and ask how strong the radio signal has to be.
    [Show full text]
  • Judged Terror Risk and Proximity to the World Trade Center
    See discussions, stats, and author profiles for this publication at: http://www.researchgate.net/publication/5152353 Judged Terror Risk and Proximity to the World Trade Center. ARTICLE in JOURNAL OF RISK AND UNCERTAINTY · JANUARY 2003 Impact Factor: 1.53 · Source: RePEc CITATIONS READS 5 67 1 AUTHOR: Baruch Fischhoff Carnegie Mellon University 350 PUBLICATIONS 19,079 CITATIONS SEE PROFILE Available from: Baruch Fischhoff Retrieved on: 23 December 2015 The Journal of Risk and Uncertainty, 26:2/3; 137–151, 2003 c 2003 Kluwer Academic Publishers. Manufactured in The Netherlands. Judged Terror Risk and Proximity to the World Trade Center BARUCH FISCHHOFF∗ [email protected] ROXANA M. GONZALEZ DEBORAH A. SMALL JENNIFER S. LERNER Department of Social and Decision Sciences, Carnegie Mellon University, Pittsburgh, PA 15213 Abstract In November 2001, a nationally representative sample of Americans (N = 973, ages 13–88), queried via WebTVs at home, judged the probability of five terror-related events (e.g., being injured in an attack) and three “routine” risks (e.g., being a victim of other violent crime), in the following 12 months. Judgments of terror risks, but not routine risks, were related to whether respondents were within 100 mi of the World Trade Center. This relationship was found only in the following demographic groups, and not their complements: men, adults, whites, and Republicans. These differential responses to risk have both theoretical and policy implications. Keywords: risk perception, terrorism, gender, political affiliation, race, adolescents JEL Classification: C93, D78, D84, Z00 1. Introduction The terrorist attacks of 2001 injured or killed thousands of people in the United States.
    [Show full text]
  • Adolescent Decision Making: Implications for Prevention Programs
    DOCUMENT RESUME ED 441 185 CG 029 976 AUTHOR Fischhoff, Baruch, Ed.; Crowell, Nancy A., Ed.; Kipke, Michele, Ed. TITLE Adolescent Decision Making: Implications for Prevention Programs. Summary of a Workshop. INSTITUTION National Academy of Sciences, Washington, DC. SPONS AGENCY Department of Health and Human Services, Washington, DC. PUB DATE 1999-00-00 NOTE 31p. CONTRACT HHS-100-97-0028 AVAILABLE FROM National Academy Press, 2101 Constitution Ave., NW, Lockbox 285, Washington, DC 20055. Tel: 800-624-6242 (Toll Free); Tel: 202-334-3313; Web site: http://www.nap.edu. PUB TYPE Collected Works - Proceedings (021) EDRS PRICE MF01/PCO2 Plus Postage. DESCRIPTORS *Adolescents; At Risk Persons; Behavior Problems; *Decision Making; Mass Media Effects; Prevention; Programs; Workshops ABSTRACT Risk taking is a natural part of teenagers' lives. They need to take some risks in order to grow.However, they can also get into trouble with their risk taking when it involvesbehaviors such as sex, drinking, smoking, violence, and drug use. Interestin the role that decision making plays in adolescents' involvementin high-risk behaviors led the Office of the Assistant Secretary of Planningand Evaluation of the U.S. Department of Health and Human Services to request theBoard on Children, Youth, and Families to convene a workshop on adolescentdecision making. This booklet summarizes the workshop, held on January6-7, 1998, which was designed to pull together the diverse perspectivesthat researchers and practitioners have adopted in regard toadolescent decision making. It provides a brief overview of decision theory andhow decision theory might be applied to adolescent behavior. It nextconsiders cognitive, social, affective, and institutional factors that mayinfluence effective decision making.
    [Show full text]
  • Judgment Under Uncertainty: Heuristics and Biases
    Cambridge University Press 978-0-521-28414-1 — Judgment under Uncertainty Edited by Daniel Kahneman , Paul Slovic , Amos Tversky Frontmatter More Information Judgment under uncertainty: Heuristics and biases © in this web service Cambridge University Press www.cambridge.org Cambridge University Press 978-0-521-28414-1 — Judgment under Uncertainty Edited by Daniel Kahneman , Paul Slovic , Amos Tversky Frontmatter More Information Judgment under uncertainty: Heuristics and biases Edited by Daniel Kahneman University of British Columbia Paul Slovic Decision Research A Branch of Perceptronics, Inc. Eugene, Oregon Amos Tver sky Stanford University CAMBRIDGE UNIVERSITY PRESS © in this web service Cambridge University Press www.cambridge.org Cambridge University Press 978-0-521-28414-1 — Judgment under Uncertainty Edited by Daniel Kahneman , Paul Slovic , Amos Tversky Frontmatter More Information One Liberty Plaza, 20th Floor, New York, ny 10006, USA Cambridge University Press is part of the University of Cambridge. It furthers the University’s mission by disseminating knowledge in the pursuit of education, learning and research at the highest international levels of excellence. www.cambridge.org Information on this title: www.cambridge.org/9780521284141 © Cambridge University Press 1982 his publication is in copyright. Subject to statutory exception and to the provisions of relevant collective licensing agreements, no reproduction of any part may take place without the written permission of Cambridge University Press. First published 1982 26th printing 2017 Printed in the United Kingdom by Clays, St Ives plc A catalogue record for this publication is available from the British Library. Library of Congress Cataloging in Publication Data isbn 978-0-521-28414-1 Paperback Cambridge University Press has no responsibility for the persistence or accuracy of URLs for external or third–party internet websites referred to in this publication, and does not guarantee that any content on such websites is, or will remain, accurate or appropriate.
    [Show full text]
  • Vol. 4 of Understanding and Preventing Violence
    MEASUREMENT AND ANALYSIS OF CRIME AND JUSTICE Fear of Crime in the United States: Avenues for Research and Policy by Mark Warr Fear of crime affects far more people in the United States than crime A itself, and there are sound reasons for treating crime and fear of crime as distinct social problems. After assessing the state of knowledge on B fear, this chapter considers whether public fear of crime can and S ought to be controlled, and the moral and practical implications of doing so. The discussion draws on the literatures of risk perception T and risk communication, as well as research on the etiology of fear R and public beliefs about crime. A final objective of the chapter is to identify the most pressing unanswered questions about fear con- A fronting investigators today. C T 451 Mark Warr is a Professor in the Department of Sociology at the University of Texas at Austin. VOLUME 4 FEAR OF CRIME IN THE UNITED STATES riminal events capture the attention of the general public in a way that Cfew other events can (cf. Skogan and Maxfield 1981). One reason is that crimes receive extraordinary emphasis in the mass media, from news coverage to feature films to television dramas to crime fiction (Graber 1980; Skogan and Maxfield 1981; Warr 1994). But even without this sort of amplification, crimes are intrinsically interesting events. As condensed and emblematic accounts of human conflict, they raise profound questions about the nature and sources of human motivation, the misfortune of fellow humans, the ability of the state to maintain social order, and, ultimately, the presence or absence of justice in human affairs.
    [Show full text]
  • 1. Project Title Behaviorally Realistic
    Project Narrative ! 1. Project title Behaviorally realistic communications to improve the public's response to and preparedness for high impact storm events 2. Principal and Associate Investigators Gabrielle Wong-Parodi (PI) Research Scientist Department of Engineering and Public Policy Carnegie Mellon University Baruch Fischhoff (Co-PI) Howard Heinz University Professor Head, Decision Sciences Major Carnegie Mellon University Ben Strauss (Co-PI) VP for Climate Impacts and Director of the Program on Sea Level Rise Climate Central 3. Introduction/Background/Justification Climate forecasts indicate that high-impact coastal storm events may become more frequent and intense in the coming years (Grinsted, Moore, and Jevrejeva, 2013; Holland and Bruyère, 2013). In addition, sea level may rise in the vicinity of 1 meter over the next century (Pfeffer, Harper and O’Neel, 2008; Vermeer, 2009), even given moderate increases in greenhouse gas emissions (Vermeer, 2009). Residents of New York and New Jersey are predicted to be especially vulnerable to coastal flooding and storm surge due to the their unique topographical and demographic characteristics (Strauss et al., 2012; Weiss, Overpeck, and Strauss, 2011). As a result, residents there will be forced to respond to events whose frequency may fall outside their past experience, meaning that their intuitions will no longer provide a trustworthy guide for their decision making. A recent National Oceanic and Atmospheric Administration (NOAA) Service Assessment report “Hurricane/Post-Tropical Cyclone Sandy: October 22-29, 2012” found general confusion among the public about the meaning of ‘coastal flooding,’ and surprise at the extent to which water inundated normally dry inland areas due to storm surge (NOAA, 2013).
    [Show full text]
  • A1992hx83500001
    CC/NUMBER 26 JUNE 29, 1992 This Week's Citation Classic Fischhoff B. Hindsight ≠ foresight: the effect of outcome knowledge on judgment under uncertainty. J. Exp. Psychol.-Hum. Percep. Perf. 104:288-99, 1975. [Department of Social & Decision Sciences, Department of Engineering & Public Policy, Carnegie Mellon University, Pittsburgh, PA] Subjects read brief descriptions of obscure histori- was how to help kids care about their history cal events (e.g., a war between British and Gurka and draw useful lessons from it During the forces). Foresight subjects assessed the probability writing, I read a good deal of historiography, of four possible outcomes, without knowing what much of which could be construed as express- actually happened. Hindsight subjects were told ing theories of judgment—the ruminations of that one of the four outcomes had occurred. They historians on how to discipline one's mind, in were then asked to respond as they would had they order to avoid playing new tricks on the dead in not been told. Subjects consistently overestimated every generation. The most widely recognized how predictable the reported outcome would have threat is hindsight bias: being unable to recon- seemed. The article discusses how a relatively struct the situation facing historical figures, surprise-free past might lead to a surprise-full fu- knowing the outcomes of their actions. ture. [The SSCI® and the SCI® indicate that this One day at a research seminar, Danny Kahneman told an anecdote about psychiatrists' paper has been cited in more than 215 publications.] fluency at second-guessing the diagnoses made by their colleagues, once they knew how a case Hindsight: Thinking Backwards? had turned out Suddenly, I realized that hind- sight could be "my" bias.
    [Show full text]
  • Knowing with Certainty: the Appropriateness of Extreme Confidence
    Journal of Experimental Psychology: Human Perception and Performance 1977, Vol. 3, No. 4, 552-564 Knowing with Certainty: The Appropriateness of Extreme Confidence Baruch Fischhoff, Paul Slovic, and Sarah Lichtenstein Decision Research, A Branch of Perceptronics Eugene, Oregon How often are people wrong when they are certain that they know the answer to a question ? The studies reported here suggest that the answer is "too often." For a variety of general-knowledge questions (e.g., absinthe is [a] a liqueur or [b] a precious stone), subjects first chose the most likely answer and then indicated their degree of certainty that the answer they had selected was, in fact, correct. Across several different question and response formats, subjects were consistently overconfident. They had sufficient faith in their confidence judgments to be willing to stake money on their validity. The psychological bases for unwarranted certainty are discussed in terms of the inferential processes whereby knowledge is constructed from perceptions and memories. Two aspects of knowledge are what one One way to validate degrees of confidence is believes to be true and how confident one to look at the calibration of a set of such con- is in that belief. Both are represented in a fidence statements. An individual is well cali- statement like, "I am 70% certain that brated if, over the long run, for all proposi- Quito is the capital of Equador." While it tions assigned a given probability, the pro- is often not difficult to assess the veridicality portion that is true is equal to the probability of a belief (e.g., by looking in a definitive assigned.
    [Show full text]