DOCSLIB.ORG

Download Paper

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Download Paper Lawless: the secret rules that govern our digital lives (and why we need new digital constitutions that protect our rights) Submitted version. Forthcoming 2019 Cambridge University Press. Nicolas P. Suzor Table of Contents Part I: a lawless internet Chapter 1. The hidden rules of the internet ............................................................................................. 6 Process matters ....................................................................................................................................................... 12 Chapter 2. Who makes the rules?.......................................................................................................... 17 Whose values apply? ............................................................................................................................................... 22 The moderation process .......................................................................................................................................... 25 Bias and accountability ........................................................................................................................................... 28 Chapter 3. The internet’s abuse problem ............................................................................................... 41 Abuse reflects and reinforces systemic inequalities ................................................................................................ 50 Dealing with abuse needs the involvement of platforms ........................................................................................ 53 No immune system .................................................................................................................................................. 64 Chapter 4. Legal immunity .................................................................................................................... 68 Revenge porn and the cracks in CDA 230 ................................................................................................................ 72 Local laws and global norms ................................................................................................................................... 78 The right to be forgotten ......................................................................................................................................... 81 Ongoing international pressure .............................................................................................................................. 83 Speech trade-offs and the problem with litigation ................................................................................................. 88 Chapter 5. How copyright shaped the internet ...................................................................................... 92 The trouble with filesharing: suing users is expensive, slow, and often counterproductive ................................... 95 Decentralized technologies are resilient ................................................................................................................. 98 Notice and takedown ............................................................................................................................................ 101 Automated enforcement ....................................................................................................................................... 109 Infrastructure companies as judge, jury, and executioner .................................................................................... 115 Baking enforcement into the network................................................................................................................... 121 Chapter 6. Censorship......................................................................................................................... 123 Content filtering and jurisdictional over-reach ..................................................................................................... 129 Chapter 7. Lawless.............................................................................................................................. 137 Internet intermediaries govern the internet ......................................................................................................... 140 Intermediaries are at the center of many different struggles for control ............................................................. 142 The internet has problems, and regulation is coming ........................................................................................... 147 Recap: some lessons for regulating the internet ................................................................................................... 151 Part II: a new social contract – constitutionalizing internet governance Chapter 8. Constitutionalizing internet governance ............................................................................. 161 Lawless: intermediaries govern in zones of broad discretion ............................................................................... 163 Old theories of regulation...................................................................................................................................... 168 A new constitutionalism: a Magna Carta for the ’net ........................................................................................... 172 Chapter 9. Constitutionalizing intermediaries ...................................................................................... 176 Intermediaries govern in a way that affects our fundamental rights ................................................................... 178 Protecting rights through constitutionalization .................................................................................................... 181 Coordinating social pressure ................................................................................................................................. 184 The future role for human rights ........................................................................................................................... 192 Chapter 10. What should we expect of intermediaries? ......................................................................... 195 Monitoring impact ................................................................................................................................................. 201 Informing policies and rules .................................................................................................................................. 204 Greater transparency ............................................................................................................................................ 207 Mitigating harm through design ........................................................................................................................... 214 Scalable due process.............................................................................................................................................. 220 Voluntarily embedding human rights .................................................................................................................... 225 Chapter 11. The role of states and binding law ...................................................................................... 228 Avoiding bad laws ................................................................................................................................................. 229 Creating laws that encourage good governance .................................................................................................. 235 Addressing human rights violations ...................................................................................................................... 246 Digital constitutionalism: monitoring and improving governance ....................................................................... 251 Chapter 12. Conclusion ......................................................................................................................... 256 Acknowledgements ...................................................................................................................................... 262 Index 264 References 268 Part 1: A lawless internet The hidden rules of the internet 6 Chapter 1. The hidden rules of the internet In August 2017, several hundred white nationalists marched on the small university town of Charlottesville, Virginia. The rally turned tragic when one of the protesters rammed his car into a crowd of counterprotesters, killing 32-year-old Heather Heyer. The Washington Post characterized the protesters as “a meticulously organized, well-coordinated and heavily armed company of white nationalists.”1 Heyer’s death was mourned across the United States, but to people on the Nazi website The Daily Stormer it was reason to celebrate. Stormer Editor Andrew Anglin wrote that Heyer was a “Fat, Childless 32-Year-Old Slut” and that ‘most people are glad she is dead’.2 On the site’s forums and in its private chat channels, participants spewed hateful memes and made plans to send armed Nazi agitators to Heyer’s funeral. Rampant abuse and hatred on digital networks is not new. The pressure to combat hate is strongest on such ubiquitous social media platforms as Facebook, Twitter, and Reddit. Governments and civil society organizations worldwide
Load more

Recommended publications
  • Gamergate and Digital Humanities
    Loyola University Chicago Loyola eCommons School of Communication: Faculty Publications and Other Works Faculty Publications 2-2019 Applying an Ethics of Care to Internet Research: Gamergate and Digital Humanities Todd Suomela Bucknell University Florence Chee [email protected] Bettina Berendt University of Kansas Geoffrey Rockwell University of Alberta Follow this and additional works at: https://ecommons.luc.edu/communication_facpubs Part of the Communication Commons, and the Digital Humanities Commons Recommended Citation Suomela, Todd; Chee, Florence; Berendt, Bettina; and Rockwell, Geoffrey. Applying an Ethics of Care to Internet Research: Gamergate and Digital Humanities. Digital Studies/ Le champ numérique, 9, 1: 1-28, 2019. Retrieved from Loyola eCommons, School of Communication: Faculty Publications and Other Works, http://dx.doi.org/10.16995/dscn.302 This Article is brought to you for free and open access by the Faculty Publications at Loyola eCommons. It has been accepted for inclusion in School of Communication: Faculty Publications and Other Works by an authorized administrator of Loyola eCommons. For more information, please contact [email protected]. This work is licensed under a Creative Commons Attribution 4.0 License. © 2019 The Author(s). Suomela, Todd, et al. 2019. “Applying an Ethics of Care to Internet Research: Gamergate and Digital Humanities.” Digital Studies/Le champ numérique 9(1): 4, pp. 1–28. DOI: https://doi.org/10.16995/dscn.302 RESEARCH Applying an Ethics of Care to Internet Research: Gamergate and Digital Humanities Todd Suomela1, Florence Chee2, Bettina Berendt3 and Geoffrey Rockwell4 1 Bucknell University Lewisburg, PA, US 2 Loyola University Chicago, US 3 KU Leuven, NL 4 University of Alberta Edmonton, AB, CA Corresponding author: Todd Suomela ([email protected]) This article examines key ethical issues that are continuing to emerge from the task of archiving data scraped from online sources such as social media sites, blogs, and forums, particularly pertaining to online harassment and hostile groups.
    [Show full text]
  • ``At the End of the Day Facebook Does What It Wants'': How Users
    “At the End of the Day Facebook Does What It Wants”: How Users Experience Contesting Algorithmic Content Moderation KRISTEN VACCARO, University of Illinois Urbana-Champaign CHRISTIAN SANDVIG, University of Michigan KARRIE KARAHALIOS, University of Illinois Urbana-Champaign Interest has grown in designing algorithmic decision making systems for contestability. In this work, we study how users experience contesting unfavorable social media content moderation decisions. A large-scale online experiment tests whether different forms of appeals can improve users’ experiences of automated decision making. We study the impact on users’ perceptions of the Fairness, Accountability, and Trustworthiness of algorithmic decisions, as well as their feelings of Control (FACT). Surprisingly, we find that none of the appeal designs improve FACT perceptions compared to a no appeal baseline. We qualitatively analyze how users write appeals, and find that they contest the decision itself, but also more fundamental issues like thegoalof moderating content, the idea of automation, and the inconsistency of the system as a whole. We conclude with suggestions for – as well as a discussion of the challenges of – designing for contestability. CCS Concepts: • Human-centered computing → Human computer interaction (HCI); Social media. Additional Key Words and Phrases: content moderation; algorithmic experience ACM Reference Format: Kristen Vaccaro, Christian Sandvig, and Karrie Karahalios. 2020. “At the End of the Day Facebook Does What It Wants”: How Users Experience Contesting Algorithmic Content Moderation. Proc. ACM Hum.-Comput. Interact. 4, CSCW2, Article 167 (October 2020), 22 pages. https://doi.org/10.1145/3415238 1 INTRODUCTION As algorithmic decision making systems become both more prevalent and more visible, interest has grown in how to design them to be trustworthy, understandable and fair.
    [Show full text]
  • Gamergate, Eine Retrospektive
    GamerGate Eine Retrospektive November 2020 @KeinenPixel_de [email protected] keinenpixel.de @KeinenPixel_de GAMERGATE, EINE RETROSPEKTIVE Abstract: GamerGate war eine 2014 beginnende anti-feministische und rechtsextreme Bewegung, die große Teile der Computer- und Videospielszene sowie angrenzende Bereiche der Popkultur erfasste und weitreichende politische Folgen nach sich zog. Anhand von Primär-, wie auch Sekundärquellen zeichnet diese Retrospektive die Entwicklung von GamerGate in drei Phasen nach: Wie sich 1.) aus persönlicher Rache und den unkoordinierten Angriffen auf Einzelpersonen eine 2.) breite, anti-feministische Bewegung herausbildete, die sich 3.) mit rechtsextremen Elementen zu einer politischen Bewegung vereint. Diese wurde maßgeblich von Steve Bannon initiiert, der damit den Wahlkampf von Donald Trump in den USA unterstützte. Wie der vierte und letzte Teil darstellt, nimmt GamerGate deshalb noch heute eine Schlüsselposition in der Entwicklung der neuen Rechten ein, die Popkultur mit rechtsextremer Politik verbindet. Bestehende Tendenzen und kleinere Strömungen haben sich in GamerGate vereinigt, weshalb die Bewegung einen neue Möglichkeit zur Rekrutierung und Radikalisierung am rechten Rand gebildet hat. Obwohl GamerGate bereits oft in Artikeln thematisiert wurde, gibt es nur wenige Gesamtüberblicke über die Entwicklung der Bewegung. Die Retrospektive will als ausführliche deutschsprachige Ressource zukünftige Arbeit mit dem Thema erleichtern. Hinweis: Aufgrund rechtsextremer Inhalte ist es vielfach nicht möglich auf Originalquellen zu verlinken. In diesen Fällen werden Sekundärquellen genutzt, die die kritischen Inhalte kontextualisiert wiedergeben. Über die Autor*innen: " ForschungskollektivenKeinen Pixel den Faschisten! und Entwicklerstudios ist eine Initiative aus der von Computerspielekultur, Webseiten, Medienschaffenden, die sich durch antifaschistische Arbeit für ein inklusives Klima in ihren Communitys stark machen wollen. Zum Statement mit mehr Informationen über das Netzwerk: Hier klicken.
    [Show full text]
  • “No Left, No Right – Only the Game”
    “No Left, No Right – Only the Game” A Netnographic Study of the Online Community r/KotakuInAction Master of Arts: Media and Communication Studies – Culture, Collaborative Media, and Creative Industries Master’s Thesis (Two-year) | 15 credits Student: Oskar Larsson Supervisor: Maria Brock Year: 2021 Word Count: 15,937 Abstract This thesis examines how 'othering' discourse can be used to construct and negotiate boundaries and shape collective identities within online spaces. Through a mixed-method approach of thematic analysis and a netnographic study, and by drawing on theoretical concepts of online othering and identity formation, this thesis explores how the Gamergate community r/KotakuInAction can be understood in relation to Gamergate, the Alt-Right and society at large. The results show that the community perceive and construct the SJW as a common adversary – a monstrous representation of feminism, progressiveness and political correctness. The analysis also revealed how racist rhetorics and white male anxieties characterize the communitys' othering discourse. Through an in-depth study of user-submitted comment, this thesis argues that r/KotakuInAction's collective identity is fluid and reactionary in nature, characterized by a discourse that is indicative of Alt-Right ideology and white male supremacy. Future research should further explore the network of communities that r/KotakuInAction is part of, as well as examine how the community transform over time. Keywords: Gamergate, Reddit, Alt-Right, Online Othering, Collective Identity,
    [Show full text]
  • Gamergate and Resistance to the Diversification of Gaming Culture
    64 COMMENTARY: GamerGate and resistance to the diversification of gaming culture CHERIE TODD It is reported that there are now over one billion people worldwide who play multimedia video games, and the typical ‘gamer’ stereotype (mid 20s, single, white male) no longer applies (Reilly, 2015). Games are growing increasingly more pervasive as well as more social, and are now available any time on multiple platforms (PC, Xbox and PlayStation) and devices such as smart phones and iPads. Within less than a decade, video games have gone from being a niche area of entertainment for a few, to a mass medium that appeals to people of all ages and genders. Research continues to show an increase in the number of women who are now gaming, with the genders almost reaching parity. These statistics, however, tend to focus on gaming as a whole, and ignore gender splits within particular games and/or countries, where in many online games women are often a minority. As a result of this gender imbalance, the culture of games continues to be heavily influenced by highly masculinist discourse. There is an increasing diversification of gaming culture that is occurring due to the growing popularity of games. While many perceive this to be a positive step, there are some who are resistant to these fundamental shifts and who do not want the culture of games to change. Users of the hashtag #GamerGate have been the most vocal in their resistance to these changes. In 2014 reports of GamerGate activities started to circulate more widely, becoming a topical issue in the USA where news outlets began to describe the emergence of a ‘culture war’ over the diversification of gaming culture.
    [Show full text]
  • Understanding Web Archiving Services and Their (Mis) Use On
    Understanding Web Archiving Services and Their (Mis)Use on Social Media∗ Savvas Zannettou?, Jeremy Blackburnz, Emiliano De Cristofaroy, Michael Sirivianos?, Gianluca Stringhiniy ?Cyprus University of Technology, yUniversity College London, zUniversity of Alabama at Birmingham [email protected], [email protected], fe.decristofaro,[email protected], [email protected] Abstract In this context, an important role is played by services like the Wayback Machine (archive.org), which proactively Web archiving services play an increasingly important role archives large portions of the Web, allowing users to search in today’s information ecosystem, by ensuring the continuing and retrieve the history of more than 300 billion pages. At the availability of information, or by deliberately caching content same time, on-demand archiving services like archive.is have that might get deleted or removed. Among these, the Way- also become popular: users can take a snapshot of a Web page back Machine has been proactively archiving, since 2001, ver- by entering its URL, which the system crawls and archives, re- sions of a large number of Web pages, while newer services turning a permanent short URL serving as a time capsule that like archive.is allow users to create on-demand snapshots of can be shared across the Web. specific Web pages, which serve as time capsules that can be shared across the Web. In this paper, we present a large-scale Archiving services serve a variety of purposes beyond ad- analysis of Web archiving services and their use on social me- dressing link rot. Platforms like archive.is are reportedly used dia, shedding light on the actors involved in this ecosystem, to preserve controversial blogs and tweets that the author may the content that gets archived, and how it is shared.
    [Show full text]
  • The Tragedy of the Gamer: a Dramatistic Study of Gamergate By
    The Tragedy of the Gamer: A Dramatistic Study of GamerGate by Mason Stephen Langenbach A thesis submitted to the Graduate Faculty of Auburn University in partial fulfillment of the requirements for the Degree of Master of Arts Auburn, Alabama May 5, 2019 Keywords: dramatism, scapegoat, mortification, GamerGate Copyright 2019 by Mason Stephen Langenbach Approved by Michael Milford, Chair, Professor of Communication Andrea Kelley, Professor of Media Studies Elizabeth Larson, Professor of Communication Abstract In August 2014, a small but active group of gamers began a relentless online harassment campaign against notable women in the videogame industry in a controversy known as GamerGate. In response, game journalists from several prominent gaming websites published op-eds condemning the incident and declared that “gamers are dead.” Using Burke’s dramatistic method, this thesis will examine these articles as operating within the genre of tragedy, outlining the journalists’ efforts to scapegoat the gamer. It will argue that game journalists simultaneously engaged in mortification not to purge the guilt within themselves but to further the scapegoating process. An extension of dramatistic theory will be offered which asserts that mortification can be appropriated by rhetors seeking to ascend within their social order’s hierarchy. ii Acknowledgments This project was long and arduous, and I would not have been able to complete it without the help of several individuals. First, I would like to thank all of my graduate professors who have given me the gift of education and knowledge throughout these past two years. To the members of my committee, Dr. Milford, Dr. Kelley, and Dr.
    [Show full text]
  • The Internet of Garbage
    1 The Internet of Garbage © 2015, 2018 by Sarah Jeong Cover and Illustrations by William Joel for The Verge, © 2018 Vox Media, Inc. All rights reserved. The Verge Edition 1.5 August 2018 Published by Vox Media, Inc. www.theverge.com ISBN: 978-0-692-18121-8 2 Table of Contents Preface ............................................... 4 Chapter One: The Internet Is Garbage .................. 6 A Theory of Garbage .......................................... 8 Spam as Garbage .............................................. 9 Chapter Two: On Harassment ........................... 12 Harassment in the News ...................................... 13 About That Media Narrative . ............................ 18 Is Harassment Gendered? ..................................... 20 Intersections of Harassment ................................. 21 On Doxing ................................................... 24 SWATting .................................................... 27 Doxing Women ................................................ 28 Concluding Thoughts on Doxing ............................... 30 A Taxonomy of Harassment .................................... 32 On Modern-Day Social Media Content Moderation ............... 35 What Happens Before: Setting Norms .......................... 38 Chapter Three: Lessons from Copyright Law ............ 40 The Intersection of Copyright and Harassment ................ 41 How the DMCA Taught Us All the Wrong Lessons ................ 44 Turning Hate Crimes into Copyright Crimes ................... 47 Chapter Four: A
    [Show full text]
  • Content Moderation
    Robert Lewington (Twitch) & The Fair Play Alliance Executive Steering Committee April 2021 Being ‘Targeted’ about Content Moderation: Strategies for consistent, scalable and effective response to Disruption & Harm 1 Content Moderation: Best Practices for Targeted Reporting & reactive UGC Management At Scale March 2021 Abstract This document provides replicable best practice information on how to moderate User-Generated Content (UGC) in social applications or services (including digital media and video games). Its focus is on reactive moderation, a central component of the growing content moderation toolkit where a service provider responds to reports submitted by users of its service regarding UGC that may violate its Terms of Service. Specifically, the document explores and advocates for a ‘targeted’ approach to the creation of reporting mechanisms. This allows users to closely identify the specific infraction, utilise evidence of the infraction—access to which is facilitated as part of the design of the reporting process—enabling consistent content moderation at scale. Note, however, that we will also make passing-reference to pre, post and proactive (see Appendix A) moderation approaches. Specifics of how best to tailor these best practices to a particular application or service will differ based on various parameters, including: type of service (social media, video game etc.); type of media (text, image, audio, video etc.); sharing mechanism (feed/gallery, avatar, communication etc.); persistence (ephemeral vs. static/umutable) and others, and therefore this document should be considered a set of high-level instructive principles rather than prescriptive guidelines. Contents i. Background ii. The Content Moderation Flywheel ○ Community Guidelines/Code of Conduct ○ Targeted reporting ■ Context ○ Scalable Content Moderation ○ Education ○ Technology iii.
    [Show full text]
  • Platforms, Content Moderation, and the Hidden Decisions That Shape Social Media
    See discussions, stats, and author profiles for this publication at: https://www.researchgate.net/publication/327186182 Custodians of the internet: Platforms, content moderation, and the hidden decisions that shape social media Book · January 2018 CITATIONS READS 268 6,850 1 author: Tarleton Gillespie Microsoft 37 PUBLICATIONS 3,116 CITATIONS SEE PROFILE All content following this page was uploaded by Tarleton Gillespie on 20 December 2019. The user has requested enhancement of the downloaded file. Custodians of the Internet platforms, content moderation, and the hidden decisions that shape social media Tarleton Gillespie CUSTODIANS OF THE INTERNET CUSTODIANS OF THE INTERNET platforms, content moderation, and the hidden decisions that shape social media tarleton gillespie Copyright © 2018 by Tarleton Gillespie. All rights reserved. Subject to the exception immediately following, this book may not be repro- duced, in whole or in part, including illustrations, in any form (beyond that copying permitted by Sections 107 and 108 of the U.S. Copyright Law and except by reviewers for the public press), without written permission from the publishers. The Author has made this work available under the Creative Commons Attribution- Noncommercial- ShareAlike 4.0 International Public License (CC BY- NC- SA 4.0) (see https://creativecommons.org/licenses/ by- nc- sa/4.0/). An online version of this work is available; it can be accessed through the author’s website at http://www.custodiansoftheinternet.org. Yale University Press books may be purchased in quantity for educational, business, or promotional use. For information, please e- mail sales.press@yale. edu (U.S. offi ce) or [email protected] (U.K.
    [Show full text]
  • Deplatforming Misogyny
    Copyright © 2021 Women’s Legal Education and Action Fund (LEAF) Published by Women’s Legal Education and Action Fund (LEAF) 180 Dundas Street West, Suite 1420 Toronto, Ontario, Canada M5G 1C7 www.leaf.ca LEAF is a national, charitable, non-profit organization, founded in 1985. LEAF works to advance the substantive equality rights of women and girls in Canada through litigation, law reform and public education using the Canadian Charter of Rights and Freedoms. This publication was created as part of LEAF's Technology-Facilitated Violence (TFV) Project. The TFV Project brings together feminist lawyers and academics to conduct research and produce publications imagining legal responses to TFV against women and gender-diverse people that are informed by equality principles. The project also supports and informs LEAF’s law reform efforts and potential upcoming interventions concerning TFV. Acknowledgements Deep gratitude and appreciation go to the many people whose efforts and support made this publication possible. This report was researched and written by Cynthia Khoo, a technology and human rights lawyer and researcher. Cynthia holds an LL.M. (Concentration in Law and Technology) from the University of Ottawa, where she worked on cases as junior counsel at the Samuelson-Glushko Canadian Internet Policy and Public Interest Clinic (CIPPIC). Her paper on platform liability for emergent systemic harm to historically marginalized groups received the inaugural Ian R. Kerr Robotnik Memorial Award for the Best Paper by an Emerging Scholar at We Robot 2020. She has managed a sole practice law firm, Tekhnos Law, and obtained her J.D. from the University of Victoria.
    [Show full text]
  • GOOGLE IS a MAFIA-LIKE POLITICAL CARTEL 1.2.Pdf
    INVESTIGATIONS REVEAL THAT GOOGLE IS OPERATED AS A MAFIA-LIKE CARTEL FBI 302 Form Background Information Draft FED-DOJCONG44-2018.C-GH 1.2 Investigation of Google/Alphabet/YouTube/Jigsaw, et al, Operating As An Organized Crime Entity President Donald Trump 1600 Pennsylvania Avenue, NW Washington, D.C. 20500 U.S. Christopher Wray – Director Federal Bureau Of Investigation 601 4th Street NW Washington, DC 20535 Jeff Sessions – Attorney General U.S. Department of Justice 950 Pennsylvania Avenue, NW Washington, DC 20530-0001 Erin Schneider - Senior Investigator, Regional Director - Enforcement Securities And Exchange Commission 44 Montgomery Street, Suite 2800 San Francisco, CA 94104 Copies To: Tamara (Tien-Jan) Jih Murray, Google Litigation Counsel Google, Inc. 15 Upper Lake Road Woodside, CA 94062 David Drummond, Google Litigation Counsel Google, Inc. #2 Quail Road Woodside, CA 94062 Kent Walker, Google Litigation Counsel Google LLC 1600 Amphitheatre Parkway Mountain View, CA 94043 1 INVESTIGATIONS REVEAL THAT GOOGLE IS OPERATED AS A MAFIA-LIKE CARTEL FBI 302 Form Background Information Google And It's Cartel Members have offices in the United States nationwide and are, at least, known to have offices in California at numerous locations. Google And It's Cartel Members attempted (And did, in fact, succeed) to “kill brands via Jigsaw AI attacks; decimate income via anti-trust violations; bribe politicians to acquire exclusive monopolistic advantages over competitors; steal technology; manipulate the stock market via “flash-boy”, “pump-and-dump”,
    [Show full text]