Facts Versus Fallacy

Total Page:16

File Type:pdf, Size:1020Kb

Facts Versus Fallacy INSIGHTS | BOOKS D A T A S C I E N C E Truth or Truthiness Distinguishing Fact from Facts versus fallacy Fiction by Learning to Think Like a Data Scientist Howard Wainer A statistics-driven treatise teaches readers how to spot lies, Cambridge University Press, half-truths, and outright deception 2016. 228 pp. By Christopher J. Phillips ters under the headings of “thinking like a complex questions. Even when the data data scientist,” “communicating like a data are incomplete, we don’t have to settle for harles Dickens opened his 1854 novel scientist,” and “applying the tools of data sci- “truthiness,” he argues. Hard Times with the memorable fig- ence to education.” His chosen examples are Wainer spent 5 years on a school board, ure of Thomas Gradgrind admonish- thoughtful and touch on relevant and engag- and often the book reads as if he’s writing to ing a schoolmaster to “teach these ing problems, especially in medicine and edu- fellow board members: people who have ba- C boys and girls nothing but Facts. Facts cation. (Wainer is currently with the National sic statistical knowledge, who are often faced alone are wanted in life” (1). Prosely- Board of Medical Examiners and spent more with incomplete data, and who are ultimately tizing “men of facts and calculations” were than two decades with the Educational Test- responsible for making and justifying di cult ripe for Dickensian satire in the mid-19th ing Service.) decisions. His examples form a convincing century, thanks, in part, to the mathemati- Aside from brief case studies, Wainer’s argument that no matter how intractable a cal sciences, which had been established as book also functions as a popularization of the problem seems, careful use of data can help powerful, even definitive, ways of knowing work of his colleagues (primarily Paul Holland sort things out. about the world. and Don Rubin), an homage to well-designed Wainer is also intent on debunking the be- Since antiquity, mathematics had been an data displays (from college acceptance letters lief that more data is always better: “the mind- exemplar of certain knowledge. less gathering of truckloads of Reasoning like a mathematician data,” he writes, “is mooted by the on August 4, 2016 meant reasoning reliably from as- gathering of even a small amount sumptions to conclusions. Geom- of thoughtfully collected evidence.” etry, for example, was taught for The book is a fun read unless centuries as a model for reason- you happen to be a policy-maker ing in general. who leans to the right politi- Howard Wainer’s new book, cally. The only examples Wainer Truth or Truthiness: Distinguish- provides of people with such “an ing Fact from Fiction by Learning excessive dimness of mind” that to Think Like a Data Scientist, they won’t ever be capable of suggests that geometry’s role in “connecting the dots of evidence” the search for truth has been re- are congressional Republicans. http://science.sciencemag.org/ placed by data science. That is, This is a shame, because his ul- replaced by a “complex mixture timate message is that whatever of ideas and methods drawn one’s political background might from many related fi elds,” espe- be, policy decisions require care- cially statistics, that can be used ful analysis of available evidence. to evaluate and make inferences Of course, sometimes issues from numerical data. There’s a are inherently political. Good, re- Downloaded from bit of an irony here, given that liable evidence is important to statistics and probability were “Truthiness,” a term coined by Stephen Colbert in 2005, is defined as many of the debates that Wainer long considered sciences of un- “truth that comes from the gut, not books.” wades into—the value of teacher certainty, as distinguished from tenure, the measurement of surgi- geometry’s eternal truths. Nevertheless, at a to inside-out plots of baseball statistics), and cal outcomes, the achievement gap in public time when PolitiFact’s “Truth-O-Meter” pro- a repository for his favorite quotations (with schools, the possible seismic e ects of frack- vides an essential guide to politicians’ stump sources ranging from Blanche DuBois to the ing—but these are also issues that unavoid- speeches, Wainer’s book is welcome indeed. Roman philosopher Seneca). ably engage humanistic debates about rights, It is perhaps especially relevant in a divisive Books like this face the inevitable prob- priorities, and values. election year, when evidence, truth, and ex- lem of how to spread the gospel of data Wainer’s point, though, is that for the pertise seem under assault and yet desper- analysis to neophytes without reading like questions where evidence does exist, we ately needed. an introductory statistics textbook. There is should know what to do with it. He plausibly Truth or Truthiness consists of a series of certainly little here that will be new to pro- suggests that data science provides a good short, lively chapters that discuss how data fessional statisticians; at the other end of the toolbox for that task. Policy-makers and the scientists would approach various contem- spectrum, readers who have never taken a electorate would do well to follow his advice. porary quandaries. Wainer groups the chap- statistics course will fi nd few details about REFERENCES how to actually use most of the tools Wainer 1. Charles Dickens, Hard Times: For These Times (London, mentions. Rather, it seems that he’s writing The reviewer is at the Department of History, Carnegie Mellon Bradbury and Evans, 1854). University, 240 Baker Hall, 5000 Forbes Avenue, Pittsburgh, PA more to convince policy-makers that data 15213, USA. E-mail: [email protected] science provides reliable ways to approach 10.1126/science.aag2776 PHOTO STOCK ARCHIVE/ALAMY AF PHOTO: 550 5 AUGUST 2016 • VOL 353 ISSUE 6299 sciencemag.org SCIENCE Published by AAAS Facts versus fallacy Christopher J. Phillips (August 4, 2016) Science 353 (6299), 550. [doi: 10.1126/science.aag2776] Editor's Summary This copy is for your personal, non-commercial use only. Article Tools Visit the online version of this article to access the personalization and article tools: on August 4, 2016 http://science.sciencemag.org/content/353/6299/550 Permissions Obtain information about reproducing this article: http://www.sciencemag.org/about/permissions.dtl http://science.sciencemag.org/ Downloaded from Science (print ISSN 0036-8075; online ISSN 1095-9203) is published weekly, except the last week in December, by the American Association for the Advancement of Science, 1200 New York Avenue NW, Washington, DC 20005. Copyright 2016 by the American Association for the Advancement of Science; all rights reserved. The title Science is a registered trademark of AAAS. .
Recommended publications
  • THE EFFECTS of FACT-CHECKING THREAT Results from a Field Experiment in the States
    NEW AMERICA FOUNDATION Research Paper THE EFFECTS OF FACT-CHECKING THREAT Results from a field experiment in the states Brendan Nyhan and Jason Reifler* October 2013 Executive summary Politicians in the United States are coming under increasing scrutiny from fact-checkers like PolitiFact, Factcheck.org, and the Washington Post Fact Checker, who examine the accuracy of public statements that are often reported without challenge by traditional news organizations. However, we know little about the effects of this practice, especially on public officials. One possibility is that fact-checking might help to deter the dissemination of misinformation, especially for candidates and legislators at lower levels of government who receive relatively little scrutiny and are sensitive to potential threats to re-election. To test this hypothesis, we conducted a field experiment during the 2012 campaign evaluating the effects of reminding state legislators about the electoral and reputational threat posed by fact-checking. Our experimental sample consisted of nearly 1200 legislators in nine states with state PolitiFact affiliates. We found that legislators who were sent reminders that they are vulnerable to fact-checking were less likely to receive a negative PolitiFact rating or have the accuracy of their statements questioned publicly than legislators who were not sent reminders. These results suggest that the electoral and reputational threat posed by fact-checking can affect the behavior of elected officials. In this way, fact-checking could play an important role in improving political discourse and strengthening democratic accountability. * Brendan Nyhan ([email protected]) is an Assistant Professor in the Department of Government at Dartmouth College.
    [Show full text]
  • How White Supremacy Returned to Mainstream Politics
    GETTY CORUM IMAGES/SAMUEL How White Supremacy Returned to Mainstream Politics By Simon Clark July 2020 WWW.AMERICANPROGRESS.ORG How White Supremacy Returned to Mainstream Politics By Simon Clark July 2020 Contents 1 Introduction and summary 4 Tracing the origins of white supremacist ideas 13 How did this start, and how can it end? 16 Conclusion 17 About the author and acknowledgments 18 Endnotes Introduction and summary The United States is living through a moment of profound and positive change in attitudes toward race, with a large majority of citizens1 coming to grips with the deeply embedded historical legacy of racist structures and ideas. The recent protests and public reaction to George Floyd’s murder are a testament to many individu- als’ deep commitment to renewing the founding ideals of the republic. But there is another, more dangerous, side to this debate—one that seeks to rehabilitate toxic political notions of racial superiority, stokes fear of immigrants and minorities to inflame grievances for political ends, and attempts to build a notion of an embat- tled white majority which has to defend its power by any means necessary. These notions, once the preserve of fringe white nationalist groups, have increasingly infiltrated the mainstream of American political and cultural discussion, with poi- sonous results. For a starting point, one must look no further than President Donald Trump’s senior adviser for policy and chief speechwriter, Stephen Miller. In December 2019, the Southern Poverty Law Center’s Hatewatch published a cache of more than 900 emails2 Miller wrote to his contacts at Breitbart News before the 2016 presidential election.
    [Show full text]
  • Automated Tackling of Disinformation
    Automated tackling of disinformation STUDY Panel for the Future of Science and Technology European Science-Media Hub EPRS | European Parliamentary Research Service Scientific Foresight Unit (STOA) PE 624.278 – March 2019 EN Automated tackling of disinformation Major challenges ahead This study maps and analyses current and future threats from online misinformation, alongside currently adopted socio-technical and legal approaches. The challenges of evaluating their effectiveness and practical adoption are also discussed. Drawing on and complementing existing literature, the study summarises and analyses the findings of relevant journalistic and scientific studies and policy reports in relation to detecting, containing and countering online disinformation and propaganda campaigns. It traces recent developments and trends and identifies significant new or emerging challenges. It also addresses potential policy implications for the EU of current socio-technical solutions. ESMH | European Science-Media Hub AUTHORS This study was written by Alexandre Alaphilippe, Alexis Gizikis and Clara Hanot of EU DisinfoLab, and Kalina Bontcheva of The University of Sheffield, at the request of the Panel for the Future of Science and Technology (STOA). It has been financed under the European Science and Media Hub budget and managed by the Scientific Foresight Unit within the Directorate-General for Parliamentary Research Services (EPRS) of the Secretariat of the European Parliament. Acknowledgements The authors wish to thank all respondents to the online survey, as well as first draft, WeVerify, InVID, PHEME, REVEAL, and all other initiatives that contributed materials to the study. ADMINISTRATOR RESPONSIBLE Mihalis Kritikos, Scientific Foresight Unit To contact the publisher, please e-mail [email protected] LINGUISTIC VERSION Original: EN Manuscript completed in March 2019.
    [Show full text]
  • Climate Change in the Era of Post-Truth
    09_ARBOLEDA_EDITEDPROOF_KS (DO NOT DELETE) 11/8/2018 2:50 PM Climate Change in the Era of Post- Truth INTRODUCTION In The Madhouse Effect: How Climate Change Denial is Threatening our Planet, Destroying our Politics, and Driving us Crazy,1 climate scientist Michael Mann joins with Pulitzer Prize-winning cartoonist Tom Toles to take on climate change denialism. Mann, the Director of the Earth System Science Center at The Pennsylvania State University, augments his prose with cartoons from Toles, who normally draws for the editorial section of the Washington Post.2 Together, Mann and Toles set out to debunk the main arguments that special interest groups use to undermine climate change policy. The book begins with an introduction to the scientific method and its application to climate change science.3 It then describes the current and potential effects of climate change on everyday life.4 In its second half, the book transitions to the politics surrounding climate change in the United States.5 A major focus of the book is the “war on climate science,” the phrase Mann and Toles use to describe how the fossil fuel industry has created misinformation to discourage action on climate change.6 The Madhouse Effect was published in 2016, at a moment when the United States was choosing between Democratic and Republican presidential candidates whose climate change agendas differed wildly. The book’s publication failed to avert the election of President Donald Trump, a climate change denier who has referred to the phenomenon as a “hoax” created by China.7 Still, The Madhouse Effect presents a valuable depiction of the underground currents that influence DOI: https://doi.org/10.15779/Z38W669857 Copyright © 2018 Regents of the University of California 1.
    [Show full text]
  • IN AMERICAN POLITICS TODAY, EVEN FACT-CHECKERS ARE VIEWED THROUGH PARTISAN LENSES by David C
    IN AMERICAN POLITICS TODAY, EVEN FACT-CHECKERS ARE VIEWED THROUGH PARTISAN LENSES by David C. Barker, American University What can be done about the “post-truth” era in American politics? Many hope that beefed-up fact-checking by reputable nonpartisan organizations like Fact Checker, PolitiFact, FactCheck.org, and Snopes can equip citizens with the tools needed to identify lies, thus reducing the incentive politicians have to propagate untruths. Unfortunately, as revealed by research I have done with colleagues, fact-checking organizations have not provided a cure-all to misinformation. Fact-checkers cannot prevent the politicization of facts, because they themselves are evaluated through a partisan lens. Partisan Biases and Trust of Fact Checkers in the 2016 Election In May of 2016, just a couple of weeks before the California Democratic primary, my colleagues and I conducted an experiment that exposed a representative sample of Californians to the statement: “Nonpartisan fact-checking organizations like PolitiFact rate controversial candidate statements for truthfulness.” We also exposed one randomized half of the sample to the following statement and image: “Each presidential candidate's current PolitiFact average truthfulness score is placed on the scale below.” The Politifact image validated the mainstream narrative about Donald Trump’s disdain for facts, and also reinforced Bernie Sanders’s tell-it-like-it-is reputation. But it contradicted conventional wisdom by revealing that Clinton had been the most accurate candidate overall (though the difference between the Clinton and Sanders ratings was not statistically significant). What did we expect to find? Some observers presume that Republicans are the most impervious to professional fact-checking.
    [Show full text]
  • Analyzing Language in Fake News and Political Fact-Checking
    Truth of Varying Shades: Analyzing Language in Fake News and Political Fact-Checking Hannah Rashkin† Eunsol Choi† Jin Yea Jang‡ Svitlana Volkova‡ Yejin Choi† †Paul G. Allen School of Computer Science & Engineering, University of Washington {hrashkin,eunsol,yejin}@cs.washington.edu ‡Data Sciences and Analytics, Pacific Northwest National Laboratory {jinyea.jang,svitlana.volkova}@pnnl.gov Abstract “You cannot get ebola from just riding on a plane or a bus.” We present an analytic study on the lan- guage of news media in the context of po- True Mostly True False litical fact-checking and fake news detec- -Rated Mostly True by PolitiFact, (Oct. 2014) tion. We compare the language of real news with that of satire, hoaxes, and pro- paganda to find linguistic characteristics “Google search spike suggests many people of untrustworthy text. To probe the feasi- don’t know why they voted for Brexit.” bility of automatic political fact-checking, we also present a case study based on True Mostly False False PolitiFact.com using their factuality judg- ments on a 6-point scale. Experiments -Rated Mostly False by PolitiFact, (June 2016) show that while media fact-checking re- Figure 1: Example statements rated by PolitiFact mains to be an open research question, as mostly true and mostly false. Misleading phras- stylistic cues can help determine the truth- ing - bolded in green - was one reason for the in- fulness of text. between ratings. 1 Introduction Words in news media and political discourse have and Google search trends – are presented ambigu- a considerable power in shaping people’s beliefs ously as if they were directly linked.
    [Show full text]
  • Analyzing Language in Fake News and Political Fact-Checking
    Truth of Varying Shades: Analyzing Language in Fake News and Political Fact-Checking Hannah Rashkin† Eunsol Choi† Jin Yea Jang‡ Svitlana Volkova‡ Yejin Choi† †Paul G. Allen School of Computer Science &“There Engineering, are already more University American jobs of in Washington the solar industry hrashkin,eunsol,[email protected] in coal mining.” { } ‡Data Sciences and Analytics, Pacific Northwest National Laboratory True False jinyea.jang,svitlana.volkova @pnnl.gov { } -Rated True by PolitiFact, (May 2014) Abstract “You cannot get ebola from just riding on a plane or a bus.” We present an analytic study on the lan- guage of news media in the context of po- True Mostly True False litical fact-checking and fake news detec- -Rated Mostly True by PolitiFact, (Oct. 2014) tion. We compare the language of real news with that of satire, hoaxes, and pro- paganda to find linguistic characteristics “Google search spike suggests many people of untrustworthy text. To probe the feasi- don’t know why they voted for Brexit.” bility of automatic political fact-checking, we also present a case study based on True Mostly False False PolitiFact.com using their factuality judg- ments on a 6-point scale. Experiments -Rated Mostly False by PolitiFact, (June 2016) show that while media fact-checking re- Figure 1: Example statements rated by PolitiFact mains to be an open research question, as“Bymostly declaring true thatand Plutomostly was no longer false. a Misleading planet, the phras- stylistic cues can help determine the truth- (International Astronomical Union) put into place a planetary ingdefinition - bolded that would in green have even - was declassified one reason Earth for as a the in- fulness of text.
    [Show full text]
  • Understanding and Undermining Fake News from the Classroom Adam Rosenzweig1 Beyond 12
    Available online at http://escholarship.org/uc/ucbgse_bre Understanding and Undermining Fake News From the Classroom Adam Rosenzweig1 Beyond 12 Fake News and the Post-Truth Era It’s too soon to know what will define Donald Trump’s presidency, but one of the defining characteristics of his campaign was a near-total disregard for facts. According to PolitiFact (“Donald Trump’s file,” n.d.), about 70% of Trump’s statements have been either mostly false, completely false, or outright lies. Candidate Trump wasn’t the only one dealing in dishonesty, but the ubiquity of falsehood surrounding his election contributed to the Oxford Dictionaries naming post-truth its 2016 Word of the Year. Fake news (Drobnic Holan, 2016) might be the most pernicious form of post-truth. PolitiFact called fake news its Lie of the Year, pointing out that fake news is “the boldest sign of a post-truth society” (para. 12) and that it “found a willing enabler in Trump” (para. 8). Americans should perceive this phenomenon as an existential threat to democracy. What truths remain self-evident if truth itself becomes counterfeit? A post- truth society has no moral center, no basis for conversation, no shared future. If the Trump era is to be the era of post-truth, then schools will have a particularly critical role to play in teaching students to favor reason and evidence over sentiment and preconception. More simply, we need to get better at teaching what Carl Sagan (1995) called “the fine art of baloney detection” (p. 201). Educators must also help students explore and deliberate on political issues.
    [Show full text]
  • The Politicization and Polarization of Climate Change
    Claremont Colleges Scholarship @ Claremont CMC Senior Theses CMC Student Scholarship 2021 The Politicization and Polarization of Climate Change Williamson Grassle Follow this and additional works at: https://scholarship.claremont.edu/cmc_theses Part of the American Politics Commons, Environmental Law Commons, Environmental Studies Commons, and the Legislation Commons Recommended Citation Grassle, Williamson, "The Politicization and Polarization of Climate Change" (2021). CMC Senior Theses. 2663. https://scholarship.claremont.edu/cmc_theses/2663 This Open Access Senior Thesis is brought to you by Scholarship@Claremont. It has been accepted for inclusion in this collection by an authorized administrator. For more information, please contact [email protected]. Claremont McKenna College The Politicization and Polarization of Climate Change Submitted to Professor John J. Pitney, Jr. By Williamson Grassle For Senior Thesis Spring 2021 May 3rd 1 Table of Contents TITLE……………………………………………………………………………………..1 ACKNOWLEDGEMENTS……………………………………………………………….3 ABSTRACT………………………………………………………………………………4 INTRODUCTION………………………………………………………………………...5 CHAPTER 1 – LATE 20TH, EARLY 21ST CENTURY………………………………....12 CHAPTER 2 – RECENT………………………………………………………………...24 CHAPTER 3 – FUTURE………………………………………………………………...39 WORK CITED…………………………………………………………………………...52 2 Acknowledgements I would like to thank Professor John J. Pitney for his guidance and support on this thesis. Throughout my time at Claremont McKenna, you have helped foster my passion for politics and define my interest in environmental policy. Without your guidance and expertise, I would not have been able to complete this project. 3 Abstract In the mid to late 20th-century, climate change and other environmental issues were addressed on a bipartisan basis, with Republican politicians like President Richard Nixon and George H.W. Bush supporting and advancing measures to combat climate change. However, since the 1990s, climate change has become increasingly polarized, with significant polarization in the last decade.
    [Show full text]
  • Can Public Diplomacy Survive the Internet?
    D C CAN PUBLIC DIPLOMACY SURVIVE THE INTERNET? BOTS, ECHO CHAMBERS, AND DISINFORMATION Edited by Shawn Powers and Markos Kounalakis May 2017 TRANSMITTAL LETTER Tothe President, Congress, Secretary of State and the American People: Established in 1948, the U.S. Advisory Commission on Public Diplomacy (ACPD) is authorized pur­ suant to Public Law 114- 113 to appraise all U.S. government efforts to understand, inform and in­ fluence foreign publics. We achieve this goal in a variety of ways, including, among other efforts, offering policy recommendations, and through our Comprehensive Annual Report, which tracks how the roughly $1.8 billion in appropriated funds is spent on public diplomacy efforts throughout the world. Part of the Commission’s mandate is to help the State Department prepare for cutting edge and transformative changes, which have the potential to upend how we think about engaging with foreign publics. This report aims to achieve precisely that. In order to think carefully about public diplomacy in this ever and rapidly changing communications space, the Commission convened a group of private sector, government, and academic experts at Stanford University’s Hoover Insti­ tution to discuss the latest research and trends in strategic communication in digital spaces. The results of that workshop, refined by a number of follow-on interviews and discussions with other organizations interested in similar questions, are included in this report. Can Public Diplomacy Survive the Internet? features essays by workshop participants that focus on emergent and potentially transformative technology and communication patterns. The essays also highlight the potential challenges and opportunities these changes create for public diplomacy practitioners in particular and the U.S.
    [Show full text]
  • Conspiracy Theories: a Cultural Evolution Theory Approach
    1 Conspiracy Theories: A Cultural Evolution Theory approach 2 Joe Stubbersfield* 3 *Psychology Department, University of Winchester, UK 4 20th September 2021 5 For submission to the Oxford Handbook of Cultural Evolution 6 Edited by R. Kendal, J.J. Tehrani, & J. Kendal 7 8 Word count: 5927 (exc. Abstract, key words, and reference list) 9 10 11 12 13 14 15 16 17 1 18 Abstract 19 20 Conspiracy theories have been part of human culture for hundreds of years, if not millennia, 21 and have been the subject of research in academic fields such as Social Psychology, Political 22 Science and Cultural Studies. At present, there has been little research examining conspiracy 23 theories from a Cultural Evolution perspective. This chapter discusses the value of Cultural 24 Evolution approaches to understanding the diffusion of conspiracy theories. Focusing on the 25 role of biases in cultural transmission, it argues that a key advantage of applying a Cultural 26 Evolution approach to this phenomenon is that it provides a strong theoretical and 27 methodological framework to bridge the individual, inter-individual and population level 28 factors that explain the cultural success of conspiracy theories, with potential for producing 29 insights into how to limit their negative influence. 30 31 Keywords: cultural evolution; social transmission; social learning; conspiracy theories 32 33 34 35 36 37 38 1. Introduction 39 40 Unverified tales of malign groups or organisations secretly orchestrating disasters, controlling 41 others and acting against the interests of the majority are pervasive in contemporary society 42 and examples can be found across the world (West & Sanders, 2003; Butter & Knight, 43 2020a).
    [Show full text]
  • Perceived Truth of Statements and Simulated Social Media Postings
    Nadarevic et al. Cogn. Research (2020) 5:56 https://doi.org/10.1186/s41235-020-00251-4 Cognitive Research: Principles and Implications ORIGINAL ARTICLE Open Access Perceived truth of statements and simulated social media postings: an experimental investigation of source credibility, repeated exposure, and presentation format Lena Nadarevic1* , Rolf Reber2, Anne Josephine Helmecke1 and Dilara Köse1 Abstract To better understand the spread of fake news in the Internet age, it is important to uncover the variables that infu- ence the perceived truth of information. Although previous research identifed several reliable predictors of truth judgments—such as source credibility, repeated information exposure, and presentation format—little is known about their simultaneous efects. In a series of four experiments, we investigated how the abovementioned factors jointly afect the perceived truth of statements (Experiments 1 and 2) and simulated social media postings (Experi- ments 3 and 4). Experiment 1 explored the role of source credibility (high vs. low vs. no source information) and pres- entation format (with vs. without a picture). In Experiments 2 and 3, we additionally manipulated repeated exposure (yes vs. no). Finally, Experiment 4 examined the role of source credibility (high vs. low) and type of repetition (congru- ent vs. incongruent vs. no repetition) in further detail. In sum, we found no efect of presentation format on truth judgments, but strong, additive efects of source credibility and repetition. Truth judgments were higher for informa- tion presented by credible sources than non-credible sources and information without sources. Moreover, congruent (i.e., verbatim) repetition increased perceived truth whereas semantically incongruent repetition decreased perceived truth, irrespectively of the source.
    [Show full text]