Misinformation, Disinformation, and Malinformation During the COVID-19 / SARS-Cov-2 Pandemic

Total Page:16

File Type:pdf, Size:1020Kb

Misinformation, Disinformation, and Malinformation During the COVID-19 / SARS-Cov-2 Pandemic Misinformation, Disinformation, and Malinformation During the COVID-19 / SARS-CoV-2 Pandemic Submission to the Senate Select Committee on Foreign Interference through Social Media 19th June, 2019 Dr Carlo Kopp Biological versus Digital Pandemics Australia, like other democracies, has suffered from a deluge of misinformation, disinformation and malinformation related to the COVID-19 / SARS-CoV-2 pandemic1. Like other democracies, this deluge of falsehoods has produced social discord and adversely influenced public understanding of the pandemic, and how to deal with these unusual and challenging circumstances. Foreign nation states and non-state actors have been major producers of these falsehoods and therefore merit close attention. The best starting point for appreciating the potential and actual impacts of the digital COVID-19 / SARS-CoV-2 pandemic is to explore the remarkable similarities between the spread of deceptive content in digital media, and biological pandemics. Jointly with Drs Korb and Mills, the author2 published research in late 2018 that exposes both the sensitivity of a population to the effects of “fake news”, and the sensitivity of “fake news” to costs incurred, leading us to subsequently provide evidence to the UK Parliament’s DCMS Select Committee’s Inquiry on Disinformation and ‘Fake News’, and the JSCEM in Australia. Many observations in this submission are drawn from that evidence. An important finding from our 2017-2018 research effort was that deceptive messaging in social media can produce serious disruption in consensus forming behaviors in groups of users. Since democracies rely upon some degree of consensus to function, these disruptive effects can produce impacts out of all proportion to the effort invested in producing them. We found that even a remarkably small percentage of deceivers in a population, in our simulations less that 1%, could catastrophically disrupt cooperative behaviours in the simulated population. In the extreme case of cost-free deceptions, where “fake news” producers in the simulated population are unhindered in any way, cooperative behaviours vanished altogether. Put bluntly, almost everybody ended up deceiving everybody else. 1 We employ the EU definitions, where misinformation is unintentional, disinformation is intentional, and malinformation is the exclusion of critical facts to produce a misleading conclusion or false belief in the mind of the victim. The latter is a common feature of narrative driven hyper-partisan media coverage where facts are considered less important than the partisan narrative being promoted. 2 The author is a university computer science researcher with an interest in the problem of “fake news”, encompassing exactly the kind of misinformation, disinformation and malinformation observed during this pandemic. The author’s prior research in Information Warfare dealt in part specifically with the problem of modeling nation state propaganda deceptions and the underlying mechanisms of how they capture or disrupt their victim audiences. 3 A related observation is that the traditional view of propaganda being intended to “turn” an audience to the propagandist’s viewpoint is incomplete. In general deceptions can produce two impacts on a victim. One impact is a false belief, that represents the traditional intent of propaganda, and the other impact is uncertainty or confusion, that tends to cause decision paralysis in its victims. Contemporary propaganda deceptions often aim for no more than to create uncertainty or confusion in victim audiences, that might otherwise require significantly greater effort to “turn” to the propagandist’s asserted viewpoint. Confused consumers of such information will often withdraw from a social media engagement or public debate leaving the field to the propagandist uncontested. Another related observation is that empirical study of social media data and agent based modeling and simulation of deceptions in social media show that the spread of social media deceptions often exactly fits mathematical models originally developed for modelling the spread of biological pathogens. The main difference in the spreading of social media deceptions is the timescale and footprint, as a person infected with a biological pathogen might on average infect another five people, and this might take several days to happen. When deceptions are spread in social media, the “digital pathogen” can be spread to millions of people across a social media platform in almost as little time as it takes to read the message and hit the “share” button. The similarities between biological and digital pandemics extend well beyond identical spreading behaviours. A critical problem observed in the COVID-19 / SARS-CoV-2 pandemic is what epidemiologists term “cryptic transmission”, where the pathogen is being quietly spread by asymptomatic or pre-symptomatic patients. As no cases end up being detected, they cannot be identified and isolated to protect others. We observe a directly analogous problem with email and encrypted messenger tools such as WhatsApp, WickrMe and Telegram, which have become covert channels for the spread of COVID-19 / SARS-CoV-2 misinformation, disinformation and malinformation (a most notable example being a deceptive claim in Nigeria spread via WhatsApp about the use of hydroxychloroQuine that led to multiple cases of overdose and hospitalisation). The popularity of such encrypted messenger tools is because they frustrate intrusive surveillance by governments and platform providers – this eQually so frustrates provider efforts to locate and delete deceptive and especially dangerous messages. Since the onset of this pandemic the author has received multiple reQuests from friends and colleagues concerning such messages being spread by email –“is this a fake or not?” – and in all instances the messages were indeed fakes. Often these fake reports were artfully crafted so that only a subject matter expert would recognize that they were actually fakes. Another notable similarity between biological and digital pandemics is that both mutate and evolve over time, as they adapt to their victims to maximize their spread. 4 In social and mass media, these mutations clearly arise as a narrative or claim is misunderstood, or embellished while being spread. The rapidly evolution of false and misleading narratives and claims presents serious challenges in public communication and education, presenting the proverbial “moving target”3. The COVID-19 / SARS-CoV-2 “Deception Pandemic” The scope and scale of the misinformation, disinformation and malinformation being distributed globally during the COVID-19 / SARS-CoV-2 pandemic is unprecedented and without any doubt dwarfs the two previous benchmarks, the UK Brexit vote and the US 2016 Presidential Election. In part this reflects the global footprint of the viral pandemic, and in part it reflects nation state players concurrently targeting domestic and foreign audiences. A uniQue feature of the COVID-19 / SARS-CoV-2 “Deception Pandemic” is that much of the public and media debate is related to the scientific and medical effort in areas related to the biological pandemic, specifically epidemiology, virology, immunology, zoonosis, and the development of antiviral treatments, drugs and vaccines. Unlike politics where public and mass media tend to have good literacy and reasonable understanding, science does not enjoy that level of lay audience appreciation or understanding. As a result conscious and unconsciousness filters that might otherwise lead to the detection and rejection of false and misleading claims and narratives are far too often absent, and any nonsense will then be accepted as fact without Question, despite it being instantly recognized to be nonsense by scientists and medical practicioners. This problem is further compounded by the rapid evolution of scientific understanding of the pathogen and its epidemiological behaviour as data is collected and analysed, and experimental work performed to improve understanding. Scientific consensus on the nature of the pathogen, its possible origins, its effects on its victims, and its spreading behavior has evolved very strongly since the first atypical pneumonia cases were manifested in Italy last November, and in China prior to that. For media and public accustomed to political debates where facts tend to be fixed in time, the rapidly evolving scientific debate on the virus and pandemic presents as a bewildering and ever changing landscape of factoids, observations and opinions many of which appear to be contradictory, and may indeed be such as data excludes previously accepted hypotheses. 3 A practice attributed to Russian propagandists has been the spreading of large numbers of deceptive claims in social media to identify which of these are most effective in capturing the audience, and then deploying the most effective deceptions via other channels. This is a direct analogue to the selective natural amplification of more contagious mutations commonly observed in biological viruses. 5 A good instance are the agreed symptoms of the disease, which six months ago were seen to be atypical pneumonia and high temperatures, and now encompass at least nine major symptoms. Spreading behavior was initially thought to be only via expelled droplets during coughing and sneezing, and now includes exhaled aerosols, bodily fluids and droplets on surfaces. There is no current scientific consensus on immunity, viability of specific vaccines and effectiveness of treatments,
Recommended publications
  • The Srebrenica Genocide and the Denial Narrative
    DISCUSSION PAPER The Srebrenica Genocide and the Denial Narrative H. N. Keskin DISCUSSION PAPER The Srebrenica Genocide and the Denial Narrative H. N. Keskin The Srebrenica Genocide and the Denial Narrative © TRT WORLD RESEARCH CENTRE ALL RIGHTS RESERVED WRITTEN BY H. N. Keskin PUBLISHER TRT WORLD RESEARCH CENTRE July 2021 TRT WORLD İSTANBUL AHMET ADNAN SAYGUN STREET NO:83 34347 ULUS, BEŞİKTAŞ İSTANBUL / TURKEY TRT WORLD LONDON PORTLAND HOUSE 4 GREAT PORTLAND STREET NO:4 LONDON / UNITED KINGDOM TRT WORLD WASHINGTON D.C. 1819 L STREET NW SUITE 700 20036 WASHINGTON DC www.trtworld.com researchcentre.trtworld.com The opinions expressed in this discussion paper represent the views of the author(s) and do not necessarily reflect the views of the TRT World Research Centre. 4 The Srebrenica Genocide and the Denial Narrative Introduction he Srebrenica Genocide (also attribute genocidal intent to a particular official referred to as the Srebrenica within the Main Staff may have been motivated Massacre), in which Serbian by a desire not to assign individual culpability soldiers massacred more than to persons not on trial here. This, however, does eight thousand Bosniak civilians not undermine the conclusion that Bosnian Serb Tduring the Bosnian war (1992-1995), has been forces carried out genocide against the Bosnian affirmed as the worst incident of mass murder in Muslims. (United Nations, 2004:12) Europe since World War II. Furthermore, despite the UN’s “safe area” declaration prior to the Further prosecutions were pursued against the genocide in the region, the Bosnian Serb Army of Dutch state in the Dutch Supreme Court for not Republika Srpska (VRS) under the command of preventing the deaths of Bosniak men, women and Ratko Mladić executed more than 8,000 Bosniak children that took refuge in their zone located in 2 (Bosnian Muslims) men and boys and deported Potocari.
    [Show full text]
  • The Effectiveness of Influence Activities in Information Warfare
    The Effectiveness of Influence Activities in Information Warfare Cassandra Lee Brooker A thesis submitted in fulfilment of the requirements for the degree of Master of Research School of Business May 2020 Thesis/Dissertation Sheet Surname : BROOKER Given Name/s : CASSANDRA LEE Abbreviation for degree : MRes Faculty : UNSW Canberra School : School of Business Thesis Title : The Effectiveness of Influence Activities in Information Warfare Abstract Rapid, globalised power shifts, technological advances, and increasingly interconnected, ungoverned communications networks have resulted in the rise of asymmetric grey zone threats. The lines are now blurred between political, civil, and military information environments. The rise of influence activities is the new ‘sharp power’ in information warfare (the iWar). Western democracies are already at war in the information domain and are being out-communicated by their adversaries. Building on the commentary surrounding this contemporary threat, and based on a review of the literature across three academic disciplines of: Systems Thinking, Influence, and Cognitive Theory; this study aimed to investigate solutions for improving Australia’s influence effectiveness in the iWar. This study asked how systems thinking can offer an effective approach to holistically understanding complex social systems in the iWar; as well as asking why understanding both successful influencing strategies and psychological cognitive theories is central to analysing those system behaviours. To answer the aim, a systems thinking methodology was employed to compare two contrasting case studies to determine their respective influencing effectiveness. The successful case system comprising the terrorist group ISIS was compared and contrasted with the unsuccessful case system of Hillary Clinton’s 2016 election campaign – using a single stock of influence to determine relevant reinforcing and balancing feedback.
    [Show full text]
  • Memetics of Deception: Spreading Local Meme Hoaxes During COVID-19 1St Year
    future internet Article Memetics of Deception: Spreading Local Meme Hoaxes during COVID-19 1st Year Raúl Rodríguez-Ferrándiz 1,* , Cande Sánchez-Olmos 1,* , Tatiana Hidalgo-Marí 1 and Estela Saquete-Boro 2 1 Department of Communication and Social Psychology, University of Alicante, 03690 Alicante, Spain; [email protected] 2 Department of Software and Computing Systems, University of Alicante, 03690 Alicante, Spain; [email protected] * Correspondence: [email protected] (R.R.-F.); [email protected] (C.S.-O.) Abstract: The central thesis of this paper is that memetic practices can be crucial to understanding deception at present when hoaxes have increased globally due to COVID-19. Therefore, we employ existing memetic theory to describe the qualities and characteristics of meme hoaxes in terms of the way they are replicated by altering some aspects of the original, and then shared on social media platforms in order to connect global and local issues. Criteria for selecting the sample were hoaxes retrieved from and related to the local territory in the province of Alicante (Spain) during the first year of the pandemic (n = 35). Once typology, hoax topics and their memetic qualities were identified, we analysed their characteristics according to form in terms of Shifman (2014) and, secondly, their content and stance concordances both within and outside our sample (Spain and abroad). The results show, firstly, that hoaxes are mainly disinformation and they are related to the pandemic. Secondly, despite the notion that local hoaxes are linked to local circumstances that are difficult to extrapolate, our conclusions demonstrate their extraordinary memetic and “glocal” capacity: they rapidly adapt Citation: Rodríguez-Ferrándiz, R.; other hoaxes from other places to local areas, very often supplanting reliable sources, and thereby Sánchez-Olmos, C.; Hidalgo-Marí, T.; demonstrating consistency and opportunism.
    [Show full text]
  • Deception, Disinformation, and Strategic Communications: How One Interagency Group Made a Major Difference by Fletcher Schoen and Christopher J
    STRATEGIC PERSPECTIVES 11 Deception, Disinformation, and Strategic Communications: How One Interagency Group Made a Major Difference by Fletcher Schoen and Christopher J. Lamb Center for Strategic Research Institute for National Strategic Studies National Defense University Institute for National Strategic Studies National Defense University The Institute for National Strategic Studies (INSS) is National Defense University’s (NDU’s) dedicated research arm. INSS includes the Center for Strategic Research, Center for Complex Operations, Center for the Study of Chinese Military Affairs, Center for Technology and National Security Policy, Center for Transatlantic Security Studies, and Conflict Records Research Center. The military and civilian analysts and staff who comprise INSS and its subcomponents execute their mission by conducting research and analysis, publishing, and participating in conferences, policy support, and outreach. The mission of INSS is to conduct strategic studies for the Secretary of Defense, Chairman of the Joint Chiefs of Staff, and the Unified Combatant Commands in support of the academic programs at NDU and to perform outreach to other U.S. Government agencies and the broader national security community. Cover: Kathleen Bailey presents evidence of forgeries to the press corps. Credit: The Washington Times Deception, Disinformation, and Strategic Communications: How One Interagency Group Made a Major Difference Deception, Disinformation, and Strategic Communications: How One Interagency Group Made a Major Difference By Fletcher Schoen and Christopher J. Lamb Institute for National Strategic Studies Strategic Perspectives, No. 11 Series Editor: Nicholas Rostow National Defense University Press Washington, D.C. June 2012 Opinions, conclusions, and recommendations expressed or implied within are solely those of the contributors and do not necessarily represent the views of the Defense Department or any other agency of the Federal Government.
    [Show full text]
  • Psychological Operations (PSYOPS)
    Archived Content Information identified as archived on the Web is for reference, research or record-keeping purposes. It has not been altered or updated after the date of archiving. Web pages that are archived on the Web are not subject to the Government of Canada Web Standards. As per the Communications Policy of the Government of Canada, you can request alternate formats on the "Contact Us" page. Information archivée dans le Web Information archivée dans le Web à des fins de consultation, de recherche ou de tenue de documents. Cette dernière n’a aucunement été modifiée ni mise à jour depuis sa date de mise en archive. Les pages archivées dans le Web ne sont pas assujetties aux normes qui s’appliquent aux sites Web du gouvernement du Canada. Conformément à la Politique de communication du gouvernement du Canada, vous pouvez demander de recevoir cette information dans tout autre format de rechange à la page « Contactez-nous ». CANADIAN FORCES COLLEGE / COLLÈGE DES FORCES CANADIENNES JCSP 33 / PCEMJ 33 EXERCISE/EXERCICE New Horizons Core Requirements for the Successful Development of a Psychological Operations Capability for the Canadian Forces By /par LCol M. K. Purcell This paper was written by a student attending the Canadian Forces College in fulfilment of one of the requirements of the Course of Studies. The paper is a scholastic document, and thus contains facts and opinions, which the author alone considered appropriate and correct for the subject. It does not necessarily reflect the policy or the opinion of any agency, including the Government of Canada and the Canadian Department of National Defence.
    [Show full text]
  • Researching Soviet/Russian Intelligence in America: Bibliography (Last Updated: October 2018)
    Know Your FSB From Your KGB: Researching Soviet/Russian Intelligence in America: Bibliography (Last updated: October 2018) 1. Federal Government Sources A. The 2016 US Presidential Election Assessing Russian Activities and Intentions in Recent US Elections. Office of the Director of National intelligence, January 6, 2017. Committee Findings on the 2017 Intelligence Community Assessment. Senate Select Committee on Intelligence, July 3, 2018. Disinformation: Panel I, Panel II. A Primer in Russian Active Measures and Influence Campaigns: Hearing Before the Select Committee on Intelligence of the United States Senate, One Hundred Fifteenth Congress, First Session, Thursday, March 30, 2017. (Y 4.IN 8/19: S.HRG.115-40/) Link: http://purl.fdlp.gov/GPO/gpo86393 FACT SHEET: Actions in Response to Russian Malicious Cyber Activity and Harassment. White House Office of the Press Secretary, December 29, 2016. Grand Jury Indicts 12 Russian Intelligence Officers for Hacking Offenses Related to the 2016 Election. Department of Justice Office of Public Affairs, July 13, 2018. Grizzly Steppe: Russian Malicious Cyber Activity. U.S. Department of Homeland Security, and Federal Bureau of Investigation, December 29, 2016. Information Warfare: Issues for Congress. Congressional Research Service, March 5, 2018. Minority Views: The Minority Members of the House Permanent Select Committee on Intelligence on March 26, 2018, Submit the Following Minority Views to the Majority-Produced "Report on Russian active Measures, March 22, 2018." House Permanent Select Committee on Intelligence, March 26, 2018. Open Hearing: Social Media Influence in the 2016 U.S. Election: Hearing Before the Select Committee on Intelligence of the United States Senate, One Hundred Fifteenth Congress, First Session, Wednesday, November 1, 2017.
    [Show full text]
  • New Challenges to the Traditional Principles of the Law of War Presented by Information Operations in Outer Space
    Journal of Politics and Law March, 2009 New Challenges to the Traditional Principles of the Law of War Presented by Information Operations in Outer Space Jia Huang Graduates’ Team School of Humanities and Social Sciences National University of Defense Technology 47 Yan Wa Chi Street, Changsha 410073, China E-mail: [email protected] Abstract With the rapid development of space information technology and constant advancement of militarization of outer space, the legal aspects of information operations in outer space have aroused the attention of international community. Information operations in outer space have brand-new features and means, which are apparently different from those of traditional operations, thus challenging almost all major aspects of the traditional principles of the warfare law. This paper makes a pilot study on challenges to the traditional principles of the law of war against the background of information operations in outer space from the following three aspects of the regulations in the law of war: Jus ad Bellum, Jus in Bello and neutrality. Keywords: Information operations in outer space, The law of war 1. Introduction The law of war is a branch of international law. It is a combination of promissory principles, regulations and systems that adjust the relationship between each side of belligerents and between belligerents and nonbelligerents, regulate the conduct of operations during the process of war and armed conflict. The current principles and regulations of the law of war are mainly embodied in the system of “Hague Law”, “Geneva Law” and the U.N. Charter. The Hague Conventions and Geneva Conventions established the basic principles of the law of war such as military necessity, discrimination, proportionality, avoiding superfluous injury and unnecessary suffering, prohibition against indiscriminate weapons, prohibition against perfidy, and protecting the rights and interests of neutral powers and persons.
    [Show full text]
  • Never Again: International Intervention in Bosnia and Herzegovina1
    Never again: 1 International intervention in Bosnia and Herzegovina July 2017 David Harland2 1 This study is one of a series commissioned as part of an ongoing UK Government Stabilisation Unit project relating to elite bargains and political deals. The project is exploring how national and international interventions have and have not been effective in fostering and sustaining political deals and elite bargains; and whether or not these political deals and elite bargains have helped reduce violence, increased local, regional and national stability and contributed to the strengthening of the relevant political settlement. This is a 'working paper' and the views contained within do not necessarily represent those of HMG. 2 Dr David Harland is Executive Director of the Centre for Humanitarian Dialogue. He served as a witness for the Prosecution at the International Criminal Tribunal for the Former Yugoslavia in the cases of The Prosecutor versus Slobodan Milošević, The Prosecutor versus Radovan Karadžić, The Prosecutor versus Ratko Mladić, and others. Executive summary The war in Bosnia and Herzegovina was the most violent of the conflicts which accompanied the break- up of Yugoslavia, and this paper explores international engagement with that war, including the process that led to the signing of the Dayton Peace Agreement. Sarajevo and Srebrenica remain iconic symbols of international failure to prevent and end violent conflict, even in a small country in Europe. They are seen as monuments to the "humiliation" of Europe and the UN and the
    [Show full text]
  • Handbook of Research on Deception, Fake News, and Misinformation Online
    View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by University of Strathclyde Institutional Repository Handbook of Research on Deception, Fake News, and Misinformation Online Innocent E. Chiluwa Covenant University, Nigeria Sergei A. Samoilenko George Mason University, USA A volume in the Advances in Media, Entertainment, and the Arts (AMEA) Book Series Published in the United States of America by IGI Global Information Science Reference (an imprint of IGI Global) 701 E. Chocolate Avenue Hershey PA, USA 17033 Tel: 717-533-8845 Fax: 717-533-8661 E-mail: [email protected] Web site: http://www.igi-global.com Copyright © 2019 by IGI Global. All rights reserved. No part of this publication may be reproduced, stored or distributed in any form or by any means, electronic or mechanical, including photocopying, without written permission from the publisher. Product or company names used in this set are for identification purposes only. Inclusion of the names of the products or companies does not indicate a claim of ownership by IGI Global of the trademark or registered trademark. Library of Congress Cataloging-in-Publication Data Names: Chiluwa, Innocent, editor. | Samoilenko, Sergei A., 1976- editor. Title: Handbook of research on deception, fake news, and misinformation online / Innocent E. Chiluwa and Sergei A. Samoilenko, editors. Description: Hershey, PA : Information Science Reference, 2019. | Includes bibliographical references and index. Identifiers: LCCN 2018055436| ISBN 9781522585350 (hardcover) | ISBN 9781522585374 (ebook) | ISBN 9781522585367 (softcover) Subjects: LCSH: Fake news. | Deception. | Misinformation. | Social media. Classification: LCC PN4784.F27 H365 2019 | DDC 302.23/1--dc23 LC record available at https://lccn.loc.gov/2018055436 This book is published in the IGI Global book series Advances in Media, Entertainment, and the Arts (AMEA) (ISSN: 2475-6814; eISSN: 2475-6830) British Cataloguing in Publication Data A Cataloguing in Publication record for this book is available from the British Library.
    [Show full text]
  • Civilians in Cyberwarfare: Conscripts
    Civilians in Cyberwarfare: Conscripts Susan W. Brenner* with Leo L. Clarke** ABSTRACT Civilian-owned and -operated entities will almost certainly be a target in cyberwarfare because cyberattackers are likely to be more focused on undermining the viability of the targeted state than on invading its territory. Cyberattackers will probably target military computer systems, at least to some extent, but in a departure from traditional warfare, they will also target companies that operate aspects of the victim nation’s infrastructure. Cyberwarfare, in other words, will penetrate the territorial borders of the attacked state and target high-value civilian businesses. Nation-states will therefore need to integrate the civilian employees of these (and perhaps other) companies into their cyberwarfare response structures if a state is to be able to respond effectively to cyberattacks. While many companies may voluntarily elect to participate in such an effort, others may decline to do so, which creates a need, in effect, to conscript companies for this purpose. This Article explores how the U.S. government can go about compelling civilian cooperation in cyberwarfare without violating constitutional guarantees and limitations on the power of the Legislature and the Executive. * NCR Distinguished Professor of Law and Technology, University of Dayton School of Law. ** Associate, Drew, Cooper & Anding, P.C., Grand Rapids, Michigan. 1011 1012 Vanderbilt Journal of Transnational Law [Vol. 43:1011 TABLE OF CONTENTS I. INTRODUCTION .............................................................
    [Show full text]
  • Threat Report the State of Influence Operations 2017-2020
    May 2021 Threat Report The State of Influence Operations 2017-2020 The State of Influence Operations 2017-2020 2 TABLE OF CONTENTS Executive Summary 3 Introduction 9 Section 1: Defining IO 11 Section 2: The State of IO, 2017- 2020 15 Threat actors 15 Trends in IO 19 Section 3: Targeting the US Ahead of the 2020 Election 28 Section 4: Countering IO 34 Combination of automation and investigations 34 Product innovation and adversarial design 36 Partnerships with industry, government and civil society 38 Building deterrence 39 Section 5: Conclusion 41 Appendix: List of CIB Disruptions, 2017-May 2021 44 Authors 45 The State of Influence Operations 2017-2020 3 Executive Summary Over the past four years, industry, government and civil society have worked to build our collective response to influence operations (“IO”), which we define as “c oordinated efforts to manipulate or corrupt public debate for a strategic goal.” The security teams at Facebook have developed policies, automated detection tools, and enforcement frameworks to tackle deceptive actors — both foreign and domestic. Working with our industry peers, we’ve made progress against IO by making it less effective and by disrupting more campaigns early, before they could build an audience. These efforts have pressed threat actors to shift their tactics. They have — often without success — moved away from the major platforms and increased their operational security to stay under the radar. Historically, influence operations have manifested in different forms: from covert campaigns that rely on fake identities to overt, state-controlled media efforts that use authentic and influential voices to promote messages that may or may not be false.
    [Show full text]
  • The What and Why of Self-Deception
    Available online at www.sciencedirect.com ScienceDirect The what and why of self-deception 1 2 Zoe¨ Chance and Michael I Norton Scholars from many disciplines have investigated self- that these generalizations ignore many nuanced distinc- deception, but defining self-deception and establishing its tions). In the first definition — sometimes called ‘defla- possible benefits have been a matter of heated debate — a tionary’ [2] — self-deception is simply a motivated false debate impoverished by a relative lack of empirical research. belief [e.g. 5,6], and is indistinguishable from positive Drawing on recent research, we first classify three distinct illusions. In this view, self-deception can arise from, for definitions of self-deception, ranging from a view that self- example, selective attention, biased information search, or deception is synonymous with positive illusions to a more forgetting. In the second definition, self-deception is a stringent view that self-deception requires the presence of motivated false belief that persists in spite of disconfirming simultaneous conflicting beliefs. We then review recent evidence [e.g. 7,8]. In this view, not all positive illusions are research on the possible benefits of self-deception, identifying self-deceptive, and biased information search does not three adaptive functions: deceiving others, social status, and qualify as self-deception since disconfirming evidence is psychological benefits. We suggest potential directions for not encountered and ignored; however, self-deception can future research. still arise via selective attention or knowledge avoidance Addresses [9,10], where disconfirming evidence is present — but 1 Yale University, United States ignored or discounted. 2 Harvard University, United States In the final definition [e.g.
    [Show full text]