U.S. Media and Perceptions of Disinformation Risk
www.disinformationindex.org Table of contents
Executive Summary 4
Section 1: Positive and negative 6 perceptions of news sites
Section 2: Disinformation risk flags 8 and perceptions
Section 3: Readers’ profiles 10 and perceptions Author: Dr. Andrea Abel van Es
Research: GDI and YouGov Conclusion 17 Design: www.designbythink.co.za Annex 18 The Global Disinformation Index is a UK-based not-for-profit that operates on the three principles of neutrality, independence and transparency. Our vision is a world in which we can trust what we see in the media. Our mission is to restore trust in the media by Endnotes 21 providing real-time automated risk ratings of the world’s media sites through a Global Disinformation Index (GDI). The GDI is non-political. Our Advisory Panel consists of international experts in disinformation, indices and technology. For more information, visit www.disinformationindex.org
June 2021. Published under a Creative Commons License (CC BY-NC-SA 4.0)
www.disinformationindex.org 3 US Media and Perceptions of Disinformation Risk Executive Summary
Executive Summary
The following report is a The Global Disinformation Index (GDI) commissioned YouGov to conduct Across all news outlets, perceptions of a site’s Respondents trust different news publishers for look at informed online an independent survey of more than 1000 informed readers in the U.S.1 accuracy vary by political affiliation.5 different types of news. readers’ perceptions Respondents were asked to assess up to 10 news sites against a series of questions which served as proxies for understanding the perceived • There was zero overlap among the top five • The respondents turn to different sites for trusted of disinformation risks disinformation risks of news publishers.2 Respondents were also asked to news publishers which each political group news on politics, health, and the environment. for some of the most perceived as having accurate news coverage. self-identify politically (left, centre or right) and provide other demographic • These findings are a good proxy for popular media sites data. The sample of news sites was developed in partnership with the • On average, when more left-leaning respondents understanding which sites respondents trust in the United States. University of Washington and is based on some of America’s highest traffic perceived a news outlet to be accurate, then for news on U.S. elections, climate change 3 sites and those with the most followers on social media. The U.S. media fewer right-leaning respondents did. and COVID-19 coverage, and how these market sample also included key regional news outlets, national and cable information sources shape their policy views. television networks, and niche sites (for different political and demographic • The greatest left-right divide is found for groups).4 mainstream media outlets such as Fox • The lack of overlap in sites across the political News, CNN and The New York Times. spectrum signals the challenges ahead of building Based on this assessment, the key findings show that: policy consensus on these critical issues. Perceptions of a news publisher’s accuracy differ Readers’ trust in a news site is correlated with the site’s perceived between self-identified men and women. The study’s findings do much to support past disinformation risks. research on how political polarisation has • Among this sample of informed readers who influenced Americans’ perceptions,6 including their • There is a statistically significant correlation between a self-identified their gender, female respondents understanding of the disinformation discourse.7 respondent’s overall positive (or negative) perception of a news were slightly more likely to rate news publishers However, the study goes further to look at the outlet and the perceived disinformation risks for that site. in the sample as being accurate (56 percent) relationships that exist between perceptions • These risk factors include perceptions of a site’s overall accurate than male respondents (50 percent). of disinformation risk and trust in specific news news coverage, use of clickbait, the labelling of news versus • There was almost no overlap among the top five sites. This analysis considered disinformation risks opinion stories, and the correction of errors when found. news publishers rated as “accurate” by men and based on informed readers’ perceptions of a news women, with only one site cited by both groups. publisher’s credibility, reliability and reputation. These findings are covered in the sections that follow. While the analysis is based on U.S. respondents, the study offers potential insights into how politicisation and polarisation affect perceptions of a news publishers’ disinformation risk more generally. We hope that the findings are used in that spirit.
4 www.disinformationindex.org www.disinformationindex.org 5 US Media and Perceptions of Disinformation Risk Section 1: Positive and Negative Perceptions of News Sites
Section 1: Positive and negative Figure 1. Respondents’ opinions of sites: positive and negative Democracy Now! NPR perceptions of news sites The Boston Globe Judicial Watch The Root NBC News The New York Times The Washington Post Politico Occupy Democrats CNN Figure 1 shows the overall positive and negative perceptions of the 63 news The Atlantic The following study The Wall Street Journal 8 focuses on the factors outlets assessed in this study. Reuters CBS News which account for It shows the percentage of respondents who had an overall positive or negative Talking Points Memo how informed readers view of a news publisher. One key finding is that many news publishers have The Blaze both positive and negative reputations among the respondents. Bloomberg perceive disinformation Los Angeles Times risks and form their For example, 41 percent of respondents had an overall positive opinion of ABC News Fox News while 47 percent had an overall negative opinion. Vice News brand perception of Forbes a news publisher. Similarly CNBC’s ratings were fairly equally split among respondents who Reason had a positive (34 percent) and negative view (32 percent) of the site. Time HuffPost Across news publishers in the survey, ten have higher levels of overall negative RealClearPolitics 9 Fox News perceptions than positive perceptions (see Figure 1). These sites include Business Insider some news publishers that the GDI has previously flagged as peddling Newsweek disinformation related to electoral fraud, as well as COVID-19 conspiracies, Slate white supremacy and anti-Semitism.10 The Intercept Salon There are also four sites where the difference between the percentage of BuzzFeed News The Epoch Times respondents who held positive and negative opinions of the site is greater Vox than 45 percentage points (see Figure 1).11 Newsmax Wired The Hill Al Jazeera CNBC Breitbart The Gateway Pundit Chicago Tribune The Daily Beast The Philadelphia Inquirer National Review The New Republic USA Today The Atlanta Journal-Constitution Fortune Boston Herald Yahoo! News The Washington Times Washington Examiner Positive view The Washington Free Beacon Miami Herald Newsday Negative view Chicago Sun-Times New York Post The Daily Caller People Magazine New York Daily News InfoWars
6 www.disinformationindex.org www.disinformationindex.org 7 US Media and Perceptions of Disinformation Risk Section 2: Disinformation risk flags and perceptions
Section 2: Disinformation risk Figure 2. Correlation between respondents’ opinions of sites and perceived risks
Correlation flags and perceptions 1 Negative view
-1 -.75 -.5 -.25 -.1 0 .1 .25 .5 .75 1 1 0.94 Inaccurate **
Asterisks indicate a level 1 0.88 0.87 News vs opinion unclear of statistical significance: ** ** Within the scope of the study, the GDI asked an additional set of questions indicates P . which target specific disinformation risk flags: 1 0.85 0.93 0.93 Does not issue corrections indicates P . ** ** ** • The site’s level of accuracy in covering news events; 0.95 0.75 0.82 0.77 Always uses clickbait • How easy it is to differentiate between opinion and news 1 ** ** ** ** articles on the site; • How frequently a site employs clickbait headlines; and 1 0.45 0.47 0.45 0.56 0.43 Issues corrections ** ** ** ** ** • How often a news site issues corrections when a story is found to be inaccurate. 1 0.22 -0.52 -0.56 -0.53 -0.46 -0.55 News vs opinion clear ** ** ** ** **
Figure 2 shows the correlations between these risk flags and informed readers’ 1 0.79 0 -0.65 -0.71 -0.63 -0.62 -0.68 Accurate positive or negative opinions of the 63 news publishers. The higher the ** ** ** ** ** ** correlation coefficient (the number in the block), the stronger the relationship (negative or positive) between the risk factors. The findings show that there is 1 0.75 0.68 0.64 -0.23 -0.32 -0.28 -0.27 -0.37 Positive view a statistically significant correlation between a respondent’s overall positive ** ** ** * ** ** * ** (or negative) opinion of a news outlet and their perceptions of the site’s 1 0.47 0.71 0.57 0 -0.77 -0.71 -0.45 -0.56 -0.55 Never uses clickbait disinformation risks. ** ** ** ** ** ** ** ** Accurate Inaccurate Positive view Negative view Issues corrections Never uses clickbait Always uses clickbait News vs opinion clear News vs opinion unclear Does not issue corrections
There are some risk flags that show the strongest opinions of a news outlet are most strongly correlated relationships. The flag most strongly correlated with with their perceptions that the site covers news informed readers’ perceived positive opinions of a site inaccurately. The next strongest correlation is between is their perception that the site provides accurate news informed readers’ negative opinions of a site and their coverage. Conversely, respondents’ overall negative perception that an outlet rarely issues corrections.
8 www.disinformationindex.org www.disinformationindex.org 9 US Media and Perceptions of Disinformation Risk Section 3: Readers’ profiles and perceptions
When respondents’ political identification is taken into On average, the higher the proportion Section 3: Readers’ profiles account, there is a statistically significant negative of left-leaning respondents who find relationship between the news publishers which left- a news outlet accurate, the lower the leaning respondents find accurate and those which proportion of right-leaning respondents and perceptions right-leaning respondents find accurate, as shown in Figure 3. who perceive the site to be accurate.
Figure 3. Perceptions of accuracy: Share of left- vs. right-leaning respondents
100% Perceptions of accurate Within the scope of the study and survey questions, the findings show that perceptions of a news publisher’s accuracy differ based on respondents’ news coverage. Fox News self-identification in terms of politics and demographics.
Judicial Perceptions of accuracy differ by political affiliation across all news Watch outlets. 80% Respondents self-identifying as “left-leaning” were more likely to perceive Breitbart The media to be accurate than their “right-leaning” counterparts. On average, Blaze Business Insider 60 percent of left-leaning respondents found the news publishers in the The Epoch Washington Times sample accurate, nearly double the fraction of right-leaning respondents Examiner The Wall Street Journal (34 percent). Moreover, there was zero overlap among the top five news National publishers which each group perceived as accurate. Reason Review RealClearPolitics 60% Newsmax Perceptions of a news publisher’s accuracy differ between men Forbes Fortune and women. The Gateway Pundit Talking Points Memo Among this sample of informed readers, female respondents were slightly InfoWars The Daily The Washington Wired more likely to rate news publishers in the sample as being accurate than were Caller Times Boston male respondents (56 percent versus 50 percent, respectively). There was Herald The Root Bloomberg The Washington almost no overlap among the top five news publishers rated as “accurate” 40% Free Beacon 12 Yahoo! The Hill Chicago by men and women, with only one site cited by both groups. News Tribune New York The Intercept CNBC Table 1 shows the five news sites perceived to be most accurate, split by Daily News Reuters CBS BuzzFeed News The New News demographic and political affiliation. Republic The New York Boston Globe The Atlantic Post Chicago USA Sun-Times Time Today ABC LosAngeles News NPR Vice News Table 1. Five most accurate news sources by group 20% Times The Philadelphia Politico NBC News Newsday Inquirer Democracy Newsweek Miami Now! Herald The Women’s Men’s People Slate New York Times Magazine The Daily HuffPost Overall responses responses Left-leaning Right-leaning Center Beast The Washington Post
Percenta e of ri t eanin respondents percei in site as acc rate Occupy CNN The Wall Street Salon Vox Democrats The Atlanta The Boston Globe NPR NBC News Fox News NPR Journal- 1 Journal Al Jazeera Constitution
The Wall Street The Wall Street The Boston Globe The Boston Globe NPR Judicial Watch 2 Journal Journal 0% 20% 40% 60% 80% 100% The Atlanta Percenta e of eft eanin respondents percei in site as acc rate 3 NPR Politico Judicial Watch Journal- The Blaze The Boston Globe Constitution The New York Judicial Watch Forbes The Atlantic Breitbart Reuters 4 Times The greatest left-right divide in perceived accuracy lies that was either “extremely accurate” or “accurate,” not a around the “big-name” media outlets such as Fox News single left-leaning respondent found this to be the case. The New York NBC News NBC News Bloomberg Business Insider Reason and CNN. For example, while 93 percent of right-leaning Figure 4 highlights the greatest differences between 5 Times respondents found Fox News to have news coverage respondents.
10 www.disinformationindex.org www.disinformationindex.org 11 Section 3: Readers’ profiles and perceptions Section 3: Readers’ profiles and perceptions
Figure 4. Widest left-right divide on perceived news accuracy by site Table 2. Five most inaccurate news sources by group