Digital News Innovation Fund Impact Report Contents

Total Page:16

File Type:pdf, Size:1020Kb

Digital News Innovation Fund Impact Report Contents Digital News Innovation Fund Impact Report Contents Introduction 03 Report by numbers 04 Boosting Digital Revenues 08 Telling Local Stories 16 Battling Misinformation 19 Exploring New Technologies 21 DNI FUND IMPACT REPORT | 2 Introduction The only real, substantive guarantee It has laid the groundwork for the implementation of the independence of news media – of new business models and structures along the entire value chain – from content workflow which is critical for the well-being of processing, to digital distribution, to go-to- pluralist democracies – is their own market strategy for new news products and economic success, not government monetisation. Concepts such as user-generated subsidies or gifts from wealthy donors: content, audience development, real-time you never know when either one analytics, robot journalism and propensity-to- might run out. buy modelling have become part of everyday work in most media organisations. The DNI The offline news business, first print, then Fund was also able to stimulate networks the news wires, radio, then TV, had been a among publishers and tech companies. century-long success story. But over the past 20 years, many traditional news media have News will remain a tough business, but in suffered significant revenue and profit declines. Europe we are now well on our way to building Employment has become less plentiful, and business models which will be sustainable, sometimes precarious. hopefully facilitating the transformation of many revered legacy organisations – and also help a As a result, media companies are changing number of startups to develop their niches. how they do things. Which media company had research & development (R&D) units at the Thus, the DNI Fund has been time, effort, and beginning of this millennium, working on the $150 million well directed. It was an honour next big innovation? Which media companies for me to be part of, and then chair, the DNI had the skill sets in their organisations to Fund Council, which evaluated all of the larger manage rapid technological change and develop projects proposed. products and services fit for the evolving I would like to thank my colleagues on the consumer behaviour? The answer is too few. DNI Fund Council, the amazing project team In 2015, Google’s Digital News Innovation Fund and all others who made this journey possible (DNI Fund) was one of the initiatives which set and were part of it. out to help change that. The direct result of the And to the media companies of Europe: we need DNI Fund’s work is the realisation of numerous you to be successful. Godspeed. innovative projects – some of which you will read about in this report. But in my view, the biggest achievement of the DNI Fund goes beyond individual projects. Veit Valentin Dengler Its biggest achievement is to have helped to COO, Bauer Media Group kick-start the overdue development of an R&D Chairman of the DNI Fund Council culture in the European news ecosystem. Hamburg, October 2020 DNI FUND IMPACT REPORT | 3 Report by numbers DNI Fund €150M fund 662 projects 30 countries DNI FUND IMPACT REPORT | 4 Report by numbers Funding across Europe KEY PROJECTS FUNDING AUSTRIA FINLAND LITHUANIA SLOVAKIA 17 20 6 6 €3M €2.9M €910K €1.5M BELGIUM FRANCE LUXEMBOURG SLOVENIA 18 75 2 7 €5.3M €20.1M €770K €843K BULGARIA GERMANY MALTA SPAIN 6 93 1 47 €503K €21.5M €150K €12.1M CROATIA GREECE NETHERLANDS SWEDEN 3 11 32 15 €850K €2.3M €5.5M €2.8M CYPRUS HUNGARY NORWAY SWITZERLAND 1 18 21 15 €450K €2.6M €3.8M €3.4M CZECHIA IRELAND POLAND UNITED KINGDOM 12 10 33 78 €1.5M €1.9M €6.6M €14.9M DENMARK ITALY PORTUGAL 15 45 32 €2.5M €11.5M €7.8M 6% of the DNI Fund ESTONIA LATVIA ROMANIA went to knowledge 2 5 16 sharing, reporting €441K €250K €1.8M and overheads DNI FUND IMPACT REPORT | 5 Report by numbers Organisation types A breakdown of projects supported by organisational type 27.2% Regional & National Publishers 14.5% News Startups 14.2% News Agencies & Nonprofits 11.0% Local Publishers 10.4% Online Pure Players 6.5% Individuals & Sole Traders 4.8% Trade Associations 3.0% Academic Institutions 1.8% TV 1.8% Radio 1.7% B2B Publishers 1.7% Magazines 1.4% Publisher Collectives DNI FUND IMPACT REPORT | 6 Report by numbers Funding topics The DNI Fund has supported projects tackling four key industry challenges 12% Boosting Digital Revenues 15% Telling Local Stories 21% Battling Misinformation 52% Exploring New Technologies DNI FUND IMPACT REPORT | 7 Case studies Boosting Digital Revenues LoVer | Spain | €896K Funding | Local Publisher Single login for Spanish local news network Henneo has developed LoVer, Inspired by other DNI-funded experiences, a single sign-on (SSO) system, to the Spanish publisher Henneo built a coalition be the foundation for a paywall and called LoVer (Local and Vertical) to generate a single login for the Spanish press. programmatic advertising for a network of Spanish local publishers. For users, this means high-quality, personalised content across a wider network The problem to solve sounded simple: how to of publishers. For publishers, the data collected allow small and medium publishers to challenge improves programmatic advertising and larger organisations in the competitive digital monetisation. It allows publishers to connect, environment. The solution was collaboration. share tools and campaigns, and learn from each other. In the future, LoVer will serve as the basis for paywall payments. Project Highlights “We know that cookies used to identify the registered user will disappear soon and we need to create 500K users an environment in which as many people as possible will be signed in, so we can still of the Spanish segment our users,” says Miguel Madrid, 91% market reached Chief Digital Officer at Henneo. He predicts the company will diversify ways to monetise websites, 14 Spanish publishers the aggregate data from LoVer. “We will also 60 now participating soon be selling new products, such as video streaming and native advertising.” The funds helped us to grow to 500,000 registered users and reach over 91% of the Spanish market. Miguel Madrid, Henneo Chief Digital Officer DNI FUND IMPACT REPORT | 8 Case studies Boosting Digital Revenues Go Beyond Subscription | France | €400K Funding | National Publisher Smarter paywall optimises subscriber conversion Go Beyond Subscription, an initiative “We wanted to expand our subscribers, and by French newspaper Le Monde, drives reward their loyalty,” says Julien Laroche- and retains digital subscriptions. Its Joubert, Chief Digital Officer at Le Monde, three-tier system includes individual explaining the system’s development, “but also create opportunities to adapt the pricing of the logins and shared accounts. offer depending on the user’s needs.” Observing that subscribers often share logins led Le Monde to develop a smarter paywall system Project Highlights to prompt users registering simultaneous logins to upgrade to a shared account. of subscribers use couple 6.8% or group options As with many publishers, the company saw an increase in subscribers prompted by people subscriber growth looking for verifiable pandemic information 40% year-on-year, since 2020 from a trusted source, but that’s not the full story behind the improved metrics. The digital new subscribers in the subscribers increased from a 25%+ forecasted 14K paywall launch month gain to a 40% year-over-year gain due to both the new offers and the pandemic situation, to reach 335,000 in June 2020. “Creating those offers within a subscription management system was quite complex, but DNI funding allowed us to accelerate this project,” says Laroche-Joubert. The system has already proved a success – 6.8% of subscribers are now using couple or group plans, with the figure still trending upwards. The project helped to expand our subscribers, and reward their loyalty. Julien Laroche-Joubert, Le Monde Chief Digital Officer DNI FUND IMPACT REPORT | 9 Case studies Boosting Digital Revenues NZZ Companion App | Switzerland | €670K Funding | National Publisher Giving people news the way they want it NZZ Companion App, from Switzerland’s news they want, when they want it, morning, noon oldest newspaper Neue Zürcher or night, especially during these unstable times.” Zeitung, is a digital companion that Launched in spring 2017, the NZZ personalises through-the-day news Companion App has built both trust and delivery, creating tailored news loyalty. The centrepiece is personalised based on each user’s profile, location reading recommendations, generated through and situation. feedback (online surveys, one-to-one meetings and idea platforms) from a beta community. Head of Technology at NZZ Andreas Bossecker Getting those high-quality recommendations explains, “Personalisation is at the core of what we allowed the company to incorporate do. Readers want to know they are receiving the personalisation across digital products. Delivering a mobile-first approach also led to organisational changes in the teams. Project Highlights Since the app launch, NZZ has seen a 20% increase in its subscriber base – a total of increase in subscriber base 195,000. “It’s more than we expected, and really for NZZ since launch 20% confirmed our mobile-first focus,” says Bossecker. Beyond NZZ, he says, “a number of publisher of total traffic partners use our technology stack, including on mobile 65% a bigger regional newspaper in Switzerland.” more visits from logged- The software is also distributed to other 125% in traffic than in 2018 publishers and retailers looking to increase website engagement. Readers want to know they are receiving the news they want, when they want it, especially during these unstable times. Andreas Bossecker, NZZ Head of Technology DNI FUND IMPACT REPORT | 10 Case studies Boosting Digital Revenues Noteworthy | Ireland | €380K Funding | Online Pure Player Crowdfunding people’s investigations Noteworthy sees the public suggest Journal Media CEO Adrian Acosta – how to stories, and fund the cost of finance stories that aren’t sustainable with an investigating them to deliver stories advertising model, but impact people’s lives.
Recommended publications
  • Understanding the Challenges of Collaborative Evidence-Based
    Do you have a source for that? Understanding the Challenges of Collaborative Evidence-based Journalism Sheila O’Riordan Gaye Kiely Bill Emerson Joseph Feller Business Information Business Information Business Information Business Information Systems, University Systems, University Systems, University Systems, University College Cork, Ireland College Cork, Ireland College Cork, Ireland College Cork, Ireland [email protected] [email protected] [email protected] [email protected] ABSTRACT consumption has evolved [25]. There has been a move WikiTribune is a pilot news service, where evidence-based towards digital news with increasing user involvement as articles are co-created by professional journalists and a well as the use of social media platforms for accessing and community of volunteers using an open and collaborative discussing current affairs [14,39,43]. As such, the boundaries digital platform. The WikiTribune project is set within an are shifting between professional and amateur contributions. evolving and dynamic media landscape, operating under Traditional news organizations are adding interactive principles of openness and transparency. It combines a features as participatory journalism practices rise (see [8,42]) commercial for-profit business model with an open and the technologies that allow citizens to interact en masse collaborative mode of production with contributions from provide new avenues for engaging in democratic both paid professionals and unpaid volunteers. This deliberation [19]; the “process of reaching reasoned descriptive case study captures the first 12-months of agreement among free and equal citizens” [6:322]. WikiTribune’s operations to understand the challenges and opportunities within this hybrid model of production. We use With these changes, a number of challenges have arisen.
    [Show full text]
  • Articles & Reports
    1 Reading & Resource List on Information Literacy Articles & Reports Adegoke, Yemisi. "Like. Share. Kill.: Nigerian police say false information on Facebook is killing people." BBC News. Accessed November 21, 2018. https://www.bbc.co.uk/news/resources/idt- sh/nigeria_fake_news. See how Facebook posts are fueling ethnic violence. ALA Public Programs Office. “News: Fake News: A Library Resource Round-Up.” American Library Association. February 23, 2017. http://www.programminglibrarian.org/articles/fake-news-library-round. ALA Public Programs Office. “Post-Truth: Fake News and a New Era of Information Literacy.” American Library Association. Accessed March 2, 2017. http://www.programminglibrarian.org/learn/post-truth- fake-news-and-new-era-information-literacy. This has a 45-minute webinar by Dr. Nicole A. Cook, University of Illinois School of Information Sciences, which is intended for librarians but is an excellent introduction to fake news. Albright, Jonathan. “The Micro-Propaganda Machine.” Medium. November 4, 2018. https://medium.com/s/the-micro-propaganda-machine/. In a three-part series, Albright critically examines the role of Facebook in spreading lies and propaganda. Allen, Mike. “Machine learning can’g flag false news, new studies show.” Axios. October 15, 2019. ios.com/machine-learning-cant-flag-false-news-55aeb82e-bcbb-4d5c-bfda-1af84c77003b.html. Allsop, Jon. "After 10,000 'false or misleading claims,' are we any better at calling out Trump's lies?" Columbia Journalism Review. April 30, 2019. https://www.cjr.org/the_media_today/trump_fact- check_washington_post.php. Allsop, Jon. “Our polluted information ecosystem.” Columbia Journalism Review. December 11, 2019. https://www.cjr.org/the_media_today/cjr_disinformation_conference.php. Amazeen, Michelle A.
    [Show full text]
  • Wikipedia's Jimmy Wales Has Launched an Alternative to Facebook and Twitter 11/18/19, 8:11 PM
    Wikipedia's Jimmy Wales has launched an alternative to Facebook and Twitter 11/18/19, 8:11 PM Wikipedia's Jimmy Wales has launched an alternative to Facebook and Twitter In a nutshell: Hardly anyone would say that social media is good for you, yet billions use it in one form or another (often concurrently) every single day. These platforms make billions of dollars by addicting users and getting them to click ads. One Wikipedia co-founder wants to change that with a new social media site that is supported by the users rather than big advertisers. Wikipedia co-founder Jimmy Wales is launching a social-media website called WT: Social. The platform aims to compete with Facebook and Twitter, except instead of funding it using advertising, Wales is taking a page from the Wikipedia playbook and financing it through user donations. "The business model of social media companies, of pure advertising, is problematic," Wales told Financial Times. "It turns out the huge winner is low-quality content." WT: Social got its start as Wikitribune, a site that published original news stories with the community fact-checking and sub-editing articles. The venture never gained much traction, so Wales is moving it to the new platform with a more social networking focus. "Instead of optimizing our algorithm to addict you and keep you clicking, we will only make money if you voluntarily choose to support us – which means that our goal is not clicks but actually being meaningful to your life." The site will still post articles, but instead of giving priority to content with the most "Likes," its algorithms will list the newest stories first.
    [Show full text]
  • Response to Evan Williams–
    Email Interview on June 22, 2017 with Geert Lovink by Davide Nitrosi, Italian journalist with a group of daily papers such as Bologna’s Resto del Carlino, Florence’s Nazione and Milan’s Giorno. Davide Nitrosi: Once Twitter was viewed as a tool of liberation. During the Arab Spring uprisings in the Middle East and the Iran riots before that Twitter was the media of freedom. We thought Internet was against tyranny. Now we see the abuse of social networks. Twitter founder, Evan Williams, said to the New York Times that Twitter’s role in the Trump election was a very bad thing. What’s your response to this article? Geert Lovink: The phrase “The Internet is broken” than Evan has in fact circulated amongst geeks and engineers since 2013/14 in response to the revelations of Edward Snowden (the campaign used to have the http://internetisbroken.org/ website). The slogan refers to the widely felt loss of privacy, caused by what we now call ‘surveillance capitalism’, in which the industrial-surveillance apparatus around the NSA and affiliated secret services broke the collective dream of a public internet in which users were in charge. The inventor of the World Wide Web, Tim-Berners Lee, is playing an important role here, in the background. Or look at Wikitribune, crowdsourcing evidence-based journalism, the latest intiative of Jimmy Wales (Wikipedia). This issue has been a long one in the making. In that sense, the response of EV comes late. We’re now more than half year into the ‘fake news’ meme (that comes from elsewhere anyway, for instance Ukraine).
    [Show full text]
  • The Internet Broke the News Industry (And Can Fix It Too)
    The Internet Broke the News Industry (and Can Fix it Too) Jimmy Wales and Orit Kopel (2019) When pollsters ask Americans whether they trust the news they read, listen to, and watch, the answer is increasingly negative. This sentiment is in fact now common all over the world. Growing rates of global internet access have made countless sources of information readily available but with few checks and balances and widely varying levels of credibility. Unprecedented access to all kinds of media has not only increased competition among news providers, but it has also led to the extreme proliferation of low-quality yet plausible-looking sources of information—making it easier for political players to manipulate public opinion and to do so while denigrating established news brands. The world’s new, digital, and highly competitive media environment has created fundamental problems in the business models that journalism relies on. Print products are in terminal decline; television audiences are plummeting. Advertising around news is no longer attractive when internet giants like Google, Facebook, and Amazon offer far more effective ways to target consumers. These new financial realities have led many news organizations to adopt problematic techniques for survival: prioritizing quantity over quality and running so-called clickbait headlines. Each of these developments, combined with a lack of transparency within news organizations and the increased use of unfiltered social media platforms as news sources, contributes to a further drop in trust in the media. The decline of news organizations may seem unstoppable. But while the internet has permanently disrupted traditional media, it also presents several ways to fix it.
    [Show full text]
  • Bridging the Gap: Rebuilding Citizen Trust in Media
    Bridging the Gap Rebuilding Citizen Trust in Media Anya Schiffrin, Beatrice Santa-Wood, Susanna De Martino with Nicole Pope and Ellen Hume ABOUT THE AUTHORS Anya Schiffrin is the director of the Technology, Media, and Communications specialization at Columbia University’s School of International and Public Affairs, where she teaches courses on media development and innovation and social change. Among other topics, she writes on journalism and development as well as the media in Africa and the extractive sector. She served for nine years on the advisory board of the Open Society Foundations’ Program on Independent Journalism and is a member of the OSF Global board. Her most recent book is African Muckraking: 50 Years of African Investigative Journalism (Jacana: 2017). Beatrice Louise Santa-Wood recently earned her Master’s degree from the School of International and Public Affairs at Columbia University, where she specialized in human rights and was senior editor of the Journal of International Affairs. Susanna De Martino is a research assistant for Anya Schiffrin at Columbia University. She studies political science at Barnard College. Nicole Pope is a Swiss journalist and writer based in Berlin. She lived 30 years in Turkey and contributed to numerous publications, serving for 15 years as the Turkey correspondent for Le Monde. Ellen Hume is a teacher, journalist and founding member of International Media Development Advisers. She has served as White House correspondent for the Wall Street Journal, research director of the Center for Civic Media at MIT, executive director of Harvard’s Shorenstein Center on the Press, Politics and Public Policy, and as first executive director of the PBS Democracy Project.
    [Show full text]
  • Blind Trust Is Not Enough”: Considering Practical Verifiability and Open Referencing in Wikipedia
    View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by Journal of Critical Library and Information Studies Perspective “Blind Trust is Not Enough”: Considering Practical Verifiability and Open Referencing in Wikipedia Cal Murgu and Krisandra Ivings ABSTRACT This article draws attention to the often-unseen information inequalities that occur in the way that Wikipedia content is referenced. Drawing on digital information control and virtual gatekeeping scholarship, we contend that by not considering the degree to which references are practically accessible and verifiable, Wikipedia editors are implicitly promoting a control mechanism that is limiting the potential of Wikipedia to serve, as Willinsky puts it, “as a gateway to a larger world of knowledge.” We question the widespread practice of referencing peer-reviewed literature that is obscured by prohibitive paywalls. As we see it, two groups are disadvantaged by this practice. First, Wikipedia editors who lack access to the most current scholarly literature are unable to verify a reference or confirm the veracity of a fact or figure. Second, and perhaps most important, general readers are left with two unsatisfactory options in this scenario: they can either trust the authority of the citation or pay to access the article. Building on Don Fallis’ work on epistemic consequences of Wikipedia, this paper contends that promoting practically verifiable references would work to mitigate these inequalities and considers how relatively new initiatives could be used to improve the quality and utility of Wikipedia more generally. Murgu, Cal and Krisandra Ivings. “’Blind Trust is Not Enough’: Considering Practical Verifiability and Open Referencing in Wikipedia,” in “Information/Control: Control in the Age of Post-Truth,” eds.
    [Show full text]
  • London Roundtable
    2018 LONDON ROUNDTABLE Dr. Virginie Andre Understanding the Impact of Terrorist Event Reporting on Countering Violent Extremism: From A Practitioner’s Perspective PREFACE This report presents the key findings from the London Roundtable on “Understanding the Im- pact of Terrorist Event Reporting on Countering Violent Extremism”. The event was held at the Australian High Commission in London on 30-31 January 2018. The roundtable brought to- gether media practitioners, CVE and PVE front line practitioners, policy-makers and academics drawn from Australia, the United Kingdom, Belgium, France, Germany, Sweden, Norway, Fin- land and the United States of America. Other attendees included representatives from various Australian and British Government departments and New Scotland Yard. This report provides summaries of each of the panel discussions that were delivered at the roundtable, before drawing out the key themes, which emerged and policy recommendations. 1 2 ACKNOWLEDGEMENTS We would like to express our gratitude to the following for their support for this roundtable and associated activities: the Australian Department of Foreign Affairs and Trade; New Scot- land Yard; the Egmont Royal Institute for International Relations; the European Union Radicali- sation Awareness Network and Exit Sweden. A special thanks goes to roundtable co-convenors Bill Elischer and Abid Raja, roundtable facili- tator Benjamin Mols and research assistant Elena Pinot. 3 4 TABLE OF CONTENTS 01 Preface Session Two: Policing 44 Implications of Media Covered Terrorism
    [Show full text]
  • 1 Organization for Security and Co-Operation in Europe The
    Organization for Security and Co-operation in Europe The Representative on Freedom of the Media International Standards and Comparative National Approaches to Countering Disinformation in the Context of Freedom of the Media (on the request of the Russian Federation) Prepared by Dr. Andrey Rikhter, Senior Adviser, Office of the OSCE Representative on Freedom of the Media Vienna, March 2019 1 Contents I. INTRODUCTION .............................................................................................................................. 3 II. APPLICABLE INTERNATIONAL LAW AND STANDARDS ........................................................ 6 A. General Principles ........................................................................................................................... 6 B. Standards on disinformation and remedies thereof ......................................................................... 8 C. Regional Instruments .................................................................................................................... 13 D. Principles developed by international NGOs ................................................................................ 24 II. EXAMPLES OF NATIONAL LAW AND PRACTICE .................................................................. 27 1. Canada........................................................................................................................................... 27 2. Croatia ............................................................................................................................................
    [Show full text]
  • The Media System
    3.3 The media system The growth of ‘semi-democracies’ across the world, where elections are held but are rigged by state power-holders, has brought into ever-sharper focus how much a country’s media system conditions the quality of its democracy. Free elections without some form of media diversity and balance clearly cannot hope to deliver effective liberal democracy.Ros Taylor and the Democratic Audit team look at how well the UK’s media system operates to support or damage democratic politics, and to ensure a full and effective representation of citizens’ political views and interests. What does liberal democracy require of a media system? ✦ The media system should be diverse and pluralistic, including different media types, operating under varied systems of regulation, designed to foster free competition for audiences and attention, and a strong accountability of media producers to citizens and public opinion. ✦ Taken as a whole, the regulatory set-up should guard against the distortions of competition introduced by media monopolies or oligopolies (dominance of information/content ‘markets’ by two or three owners or firms), and against any state direction of the media. ✦ A free press is a key part of media pluralism – that is, privately owned newspapers, with free entry by competitors and only normal forms of business regulation (those common to any industry) by government and the law. ✦ Because of network effects, state control of bandwidth, and the salience of TV/radio for citizens’ political information, a degree of ‘special’ regulation of broadcasters to ensure bipartisan or neutral coverage and balance is desirable, especially in election campaign periods.
    [Show full text]
  • Platform Barriers to Entry and the Limits of Data Portability
    Michigan Technology Law Review Article 3 2021 Taking It With You: Platform Barriers to Entry and the Limits of Data Portability Gabriel Nicholas New York University School of Law Follow this and additional works at: https://repository.law.umich.edu/mtlr Part of the Antitrust and Trade Regulation Commons, Consumer Protection Law Commons, Internet Law Commons, and the Science and Technology Law Commons Recommended Citation Gabriel Nicholas, Taking It With You: Platform Barriers to Entry and the Limits of Data Portability, 27 MICH. TECH. L. REV. 263 (2021). Available at: https://repository.law.umich.edu/mtlr/vol27/iss2/3 This Article is brought to you for free and open access by the Journals at University of Michigan Law School Scholarship Repository. It has been accepted for inclusion in Michigan Technology Law Review by an authorized editor of University of Michigan Law School Scholarship Repository. For more information, please contact [email protected]. TAKING IT WITH YOU: PLATFORM BARRIERS TO ENTRY AND THE LIMITS OF DATA PORTABILITY Gabriel Nicholas* Abstract Policymakers are faced with a vexing problem: how to increase competition in a tech sector dominated by a few giants. One answer proposed and adopted by regulators in the United States and abroad is to require large platforms to allow consumers to move their data from one platform to another, an approach known as data portability. Facebook, Google, Apple, and other major tech companies have enthusiastically supported data portability through their own technical and political initiatives. Today, data portability has taken hold as one of the go-to solutions to address the tech industry’s competition concerns.
    [Show full text]
  • Investigating Differences in Crowdsourced News Credibility Assessment: Raters, Tasks, and Expert Criteria
    Investigating Differences in Crowdsourced News Credibility Assessment: Raters, Tasks, and Expert Criteria MD MOMEN BHUIYAN, Virginia Tech AMY X. ZHANG, University of Washington CONNIE MOON SEHAT, Hacks/Hackers TANUSHREE MITRA∗, University of Washington Misinformation about critical issues such as climate change and vaccine safety is oftentimes amplified on online social and search platforms. The crowdsourcing of content credibility assessment by laypeople has been proposed as one strategy to combat misinformation by attempting to replicate the assessments of experts at scale. In this work, we investigate news credibility assessments by crowds versus experts to understand when and how ratings between them differ. We gather a dataset of over 4,000 credibility assessments taken from 2 crowd groups—journalism students and Upwork workers—as well as 2 expert groups—journalists and scientists—on a varied set of 50 news articles related to climate science, a topic with widespread disconnect between public opinion and expert consensus. Examining the ratings, we find differences in performance due to the makeup of the crowd, such as rater demographics and political leaning, as well as the scope of the tasks that the crowd is assigned to rate, such as the genre of the article and partisanship of the publication. Finally, we find differences between expert assessments due to differing expert criteria that journalism versus science experts use—differences that may contribute to crowd discrepancies, but that also suggest a way toreduce the gap by designing crowd tasks tailored to specific expert criteria. From these findings, we outline future research directions to better design crowd processes that are tailored to specific crowds and types of content.
    [Show full text]