Ecrime Research Report N. 06
Total Page:16
File Type:pdf, Size:1020Kb
Andrea Di Nicola Daniela Andreatta Elisa Martini 06 With: Georgios A. Antonopoulos Gabriele Baratto eCRIME RESEARCH REPORTS Stefano Bonino Serena Bressan Shani Burke Francesca Cesarotti Parisa Diba Jérôme Ferret Marco Guerini Bill Howe Isis Koral Mario Laurent Giulia Pirozzi Jen Schradie Sara Tonelli HATEMETER Hate speech tool for monitoring, analysing and tackling Anti-Muslim hatred online Beneficiaries University of Trento, eCrime – Department ‘Faculty of Law’ and Department of Sociology and Social Research (Coordinator) Fondazione Bruno Kessler (Co-beneficiary) Universite Toulose 1 Capitole (Co-beneficiary) Teesside University (Co-beneficiary) Amnesty International Italy (Co-beneficiary) Collectif contre l’Islamophobie en France (Co-beneficiary) Stop Hate UK (Co-beneficiary) Project Hatemeter was funded by the European Union’s Rights, Equality and Citizenship Programme (2014-2020) eCrime Research Reports No. 06 HATEMETER Hate speech tool for monitoring, analysing and tackling Anti-Muslim hatred online Andrea Di Nicola Daniela Andreatta Elisa Martini With: Georgios A. Antonopoulos Gabriele Baratto Stefano Bonino Serena Bressan Shani Burke Francesca Cesarotti Parisa Diba Jérôme Ferret Marco Guerini Bill Howe Isis Koral Mario Laurent Giulia Pirozzi Jen Schradie Sara Tonelli Graphic design and layout by Damiano Salvetti ISSN 2284-3302 ISBN 978-88-8443-886-7 eCrime – ICT, Law & Criminology Department ‘Faculty of Law’ University of Trento Via G. Verdi 53, 38122 Trento, Italy +39 0461 282336 www.ecrime.unitn.it The information and views set out in this report are those of the authors and do not necessarily reflect the official opinion of the European Union. Neither the European Union institutions and bodies nor any person acting on their behalf may be held responsible for the use which may be made of the information contained therein. Trento, January 2020 © 2020 eCrime – Università di Trento Table of contents Acknowledgements 03 Assessment 57 of the Hatemeter Platform The project 05 5.1. Validation strategy and evaluation 57 methodology 5.2. Evaluation of the Hatemeter Platform 58 Background of Hatemeter project 07 2.1 Italy 07 Suggestions and insights 63 2.2 France 12 on the use of the Platform 2.3 United Kingdom 17 Bibliography 67 Development 27 of the Hatemeter platform 3.1. Explanation of method and data 27 necessary for the realization of the Platform 3.2. How does the Platform work 28 Using the Hatemeter Platform 37 to increase knowledge of online Islamophobia and support effective counter-strategies 4.1 Italy 37 4.2 France 43 4.3 United Kingdom 49 Acknowledgements Authors Under the supervision of Andrea Di Nicola, Daniela Andreatta, and Elisa Martini, authorship is as follows: Daniela Andreatta (2, 2.1.2, 4, 4.1, 5, 6), Georgios A. Antonopoulos (2.3, 4.3), Gabriele Baratto (4.1), Stefano Bonino (2.1.1), Serena Bressan (3), Shani Burke (2.3, 4.3), Francesca Cesarotti (4.1), Parisa Diba (2.3, 4.3), Andrea Di Nicola (1), Jérôme Ferret (2.2, 4.2), Marco Guerini (3.2, 5.2.1), Bill Howe (3.3), Isis Koral (3.2), Mario Laurent (2.2, 4.2), Elisa Martini (2.1.3, 4.1, 5.1, 5.2, 5.2.2), Giulia Pirozzi (4.1), Jen Schradie (2.2), Sara Tonelli (3.1, 5.2.3). 2 This report presents the results of project “Hatemeter - Teesside University team would like to thank Nigel Hate speech tool for monitoring, analysing and tackling Copsey, Shahda Khan and David Temple as well as the anti-Muslim hatred online” (hereinafter also referred participants to the study for their time and valuable to as “Hatemeter”, project reference: 764583). The insights. project has been coordinated by the University of Trento (Italy) and especially by eCrime, the research group Amnesty International – Sezione Italiana team included on ICT, law and criminology of the Department ‘Fac- Francesca Cesarotti, Mariangela Pantaleo, and Giulia ulty of Law’, with the cooperation of the Department Pirozzi, as well as all the volunteers of the Italian Hate of Sociology and Social Research, in partnership with Speech Task Force. Fondazione Bruno Kessler (Italy), University Toulouse 1 Capitole (France), Teesside University (United King- StophHate UK team included Rose Simpkins, Kylie dom), Amnesty International – Sezione Italiana (Italy), Read, Bill Howe, Joseph Sankar, Rebecca Parker, Erika StophHate UK (United Kingdom), and Collectif Contre Samenaite, and Catherine El Ashkar. l’Islamophobie en France (France). The project was funded by the European Commission - Directorate-Gen- Collectif Contre l’Islamophobie en France (CCIF) team eral Justice and Consumers under the Rights, Equality included Isis Koral, Chafika Attalai, and all the volu- and Citizenship Programme (2014-2020) and lasted 24 teers. months: from February 2018 to January 2020. We would like to acknowledge the 22nd edition of the The research project was coordinated by Andrea festival “Voci per la Libertà – Una canzone per Amnes- ty” held in Rosolina Mare (Rovigo, Italy) from the 18th Di Nicola, associate professor of criminology at the st Department ‘Faculty of Law’ of the University of Trento to the 21 of July 2019, which host Hatemeter project as partner of the event. Mostly, sincere thanks go to and scientific coordinator of eCrime, Department Roy Paci, Hatemeter Testimonial and Amnesty Interna- ‘Faculty of Law’, University of Trento. The eCrime team tional Italy Award 2019, who as a musician and artist included Daniela Andreatta, Gabriele Baratto, and is committed in preventing and combating any adverse Stefano Bonino. The Department of Sociology and human rights impacts. Social Research (University of Trento) team included Mario Diani, head of the Department, and Elisa Martini. We would like to address a special thanks to all the University of Trento would like to especially thank the academics, researchers and professionals members of Video Director Matteo Scotton for the realisation of vid- the Hatemeter Lab, who participated in the seminars eo of the Hatemeter awareness raising campaign, and held in Toulouse on the 17th and 18th of December the students Giulia Zantonello and Mohamad Baalbaki 2019. for the translations of the subtitles of the video. This research work would not have been feasible with- The Fondazione Bruno Kessler (FBK) team included out the help and assistance of a number of persons. Sara Tonelli, Stefano Menini, Alessio Palmero Aprosio, Especially, we would like to express our gratitude to the Rachele Sprugnoli and Elisa Leonardelli from the Digital administrative staff of the University of Trento and of all Humanities research group; Marco Guerini and Serra the Hatemeter partners, together with all the many oth- Sinem Tekiroglu from the Natural Language Processing er persons impossible to list here. Last but not least, research group; and Serena Bressan from the Project we would like to thank the Directorate-General Justice Management Group. Sara Tonelli was the technical and Consumers of the European Commission and the coordinator of Hatemeter. The FBK team would like Hatemeter Project Officers which, under the Rights, to express its gratitude to Giovanni Moretti and the Equality and Citizenship Programme, have supported students Mohamad Baalbaki and Y-Ling Chung, who both the project and the realisation of this publication. provided unevaluable support throughout the Platform development. University Toulouse 1 Capitole (UT1-C) team included Jérôme Ferret, professor of sociology, Mario Laurent, and for the first part of the project, Jen Schradie (currently professor assistant at the Observatoire du Changement of Sciences Po, Paris). Teesside University (TU) team included Georgios A. Antonopoulos, professor of criminology, Parisa Diba and, during the final stage of the project, Shani Burke. HATEMETER 3 The project 4 Project “Hatemeter - Hate speech tool for monitoring, building of the “EU laboratory on Internet and social analysing and tackling anti-Muslim hatred online” aims media for countering online anti-Muslim hate speech” at systematising, augmenting and sharing knowledge (i.e., Hatemeter Lab). of anti-Muslim hatred online, and at increasing the efficiency and effectiveness of NGOs in preventing and This document is the Final Report of Hatemeter Project tackling Islamophobia at the EU level, by developing and presents the results, standards and guidelines to and testing an ICT tool (i.e., Hatemeter Platform) that favour the transferability of the Hatemeter Platform automatically monitors and analyses Internet and among other non-governmental/civil society organisa- social media data on the phenomenon, and produces tions (NGO/CSOs) and stakeholders across the EU, and computer-assisted responses and hints to support for other forms of hate speech and intolerance, as to counter-narratives and awareness raising campaigns. augment the medium/long-term impact and sustaina- bility of the project. The Hatemeter Partnership con- More specifically, backed by a strong interdisciplinary siders sustainability and transferability of its results as effort (criminology, social sciences, computer scienc- crucial elements of its activities towards a successful es, statistics, and law), the Hatemeter Platform uses a project implementation. combination of natural language processing (NLP), ma- The first chapter gives an outline of the project and its chine learning, and big data analytics/visualization to: aims. A. identify and systematise in real-time actual “red The second chapter presents the background of the flags” of anti-Muslim hate speech and/or possible Hatemeter Project according to a subdivision