Digital Labour Platforms and the Future of Work Digital Labour Platforms and the Future of Work Towards Decent Work in the Online World Towards Decent Work

Total Page:16

File Type:pdf, Size:1020Kb

Digital Labour Platforms and the Future of Work Digital Labour Platforms and the Future of Work Towards Decent Work in the Online World Towards Decent Work Digital labour platforms and the future of work Digital labour platforms and the future of work Towards decent work in the online world Towards decent work The emergence of online digital labour platforms has been one of the major transformations in the world of work over the past decade. This report focuses on web-based platforms, wherein in the online world tasks can be outsourced by businesses and other clients through an open call to a large, flexible workforce (“crowd”), which is geographically dispersed around the world. The report provides one of the first comparative studies of working conditions on five major microtask platforms that operate globally. It is based on an ILO survey covering 3,500 workers living in 75 countries around the world and other qualitative surveys. It documents the charac- teristics of crowdworkers, the type of work they perform and their motivations and perceptions towards this work, and finds both commonalities and differences between workers from the global North and global South. The report analyses the working conditions on these micro-task platforms, which includes pay rates, work availability, work intensity, rejections and non-payment, worker communication with clients and platform operators, social protection coverage, work family-life balance and workers’ prospects for future career development. The report shows that while digital labour platforms provide a number of opportunities, there are also some drawbacks. In this context, the report reviews the different initiatives that have been put forth, including the Crowdsourcing code of conduct initiated by IG Metall and the German Towards decent work in the online world Towards crowdsourcing platforms to improve working conditions. The report recommends 18 principles towards ensuring decent work on digital labour platforms. Digital labour platforms and the future of work ISBN 978-92-2-031024-3 Janine Berg s Marianne Furrer s Ellie Harmon ILO Uma Rani s M Six Silberman 9 789220 310243 Digital labour platforms and the future of work Towards decent work in the online world International Labour Office • Geneva 2018 Digital labour platforms and the future of work Towards decent work in the online world Copyright © International Labour Organization 2018 First published 2018 Publications of the International Labour Office enjoy copyright under Protocol 2 of the Universal Copyright Convention. Nevertheless, short excerpts from them may be reproduced without authorization, on condi- tion that the source is indicated. For rights of reproduction or translation, application should be made to ILO Publications (Rights and Licensing), International Labour Office, CH-1211 Geneva 22, Switzerland, or by email: [email protected]. The International Labour Office welcomes such applications. Libraries, institutions and other users registered with a reproduction rights organization may make copies in accordance with the licences issued to them for this purpose. Visit www.ifrro.org to find the reproduction rights organization in your country. Digital labour platforms and the future of work: Towards decent work in the online world International Labour Office – Geneva, ILO, 2018 ISBN 978-92-2-031024-3 (print) ISBN 978-92-2-031025-0 (web pdf) ISBN 978-92-2-031026-7 (epub) ILO Cataloguing in Publication Data The designations employed in ILO publications, which are in conformity with United Nations practice, and the presentation of material therein do not imply the expression of any opinion whatsoever on the part of the International Labour Office concerning the legal status of any country, area or territory or of its authorities, or concerning the delimitation of its frontiers. The responsibility for opinions expressed in signed articles, studies and other contributions rests solely with their authors, and publication does not constitute an endorsement by the International Labour Office of the opinions expressed in them. Reference to names of firms and commercial products and processes does not imply their endorsement by the International Labour Office, and any failure to mention a particular firm, commercial product or process is not a sign of disapproval. Information on ILO publications and digital products can be found at: www.ilo.org/publns. Printed in Switzerland This publication was produced by the Document and Publications Production, Printing and Distribution Branch (PRODOC) of the ILO. Graphic and typographic design, manuscript preparation, copyediting, layout and composition, proof readings, printing, electronic publishing and distribution. PRODOC endeavours to use paper sourced from forests managed in an environmentally sustainable and socially responsible manner. Code: DTP-CHD-REP FOREWORD ne of the major transformations in the world of work over the past decade has been the emergence of online digital labour platforms. This new form of work has Onot only disrupted existing business models but also the employment model upon which these business models relied. Work on digital labour platforms provides work- ers the opportunity to work from any place, at any time and take up whatever jobs suits them. However, there are also some risks from engaging in such work with regard to their status of employment, whether they receive adequate income, social protection and other benefits. The opportunities and risks that the workers face raise questions about what motivates these workers to undertake this form of work. Do these motivations vary across different parts of the world? And what are the consequences for workers of engaging in this form of work? To investigate some of these questions the ILO Research Department along with the Inclusive Labour Markets, Labour Relations and Working Conditions Branch (INWORK) carried out two surveys in 2015 and 2017, covering 3, 500 workers liv- ing in 75 countries around the world and working on five major globally operating microtask platforms. This was supplemented with in-depth interviews and other qual- itative surveys undertaken by researchers at IG Metall. The survey focused on micro- task platforms, wherein businesses and other clients have access to a large, flexible workforce (“crowd”) who are geographically dispersed around the world to undertake short, simple and mostly clerical tasks and are remunerated on the basis of task or piece completed. Based on the survey findings, this report provides one of the first comparative studies of working conditions on microtask platforms. It presents the basic characteristics and motivations of workers to undertake these tasks, and finds both commonalities and dif- ferences between workers from the global North and global South. The report analyses the working conditions on these micro-task platforms and advances a series of princi- ples for improving working conditions on digital labour platforms. This report will be helpful to the ILO’s Future of Work Initiative and aims to support the work of the Global Commission on the Future of Work, an independent commission convened by the Director-General of the International Labour Organization in August 2017. The views expressed in this report are those of the authors and do not necessarily represent the views of the ILO. Damian Grimshaw Director, Research Department v CONTENTS FOREWORD . v ACKNOWLEDGEMENTS . xiii EXECUTIVE SUMMARY . xv CHAPTER 1. INTRODUCTION . 1 1 .1 What is crowdwork? . 3 1 .2 History and origins of crowdwork platforms . 3 1 .3 Is crowdwork a new form of work? . 6 1 .4 What are microtask platforms? . 7 1 .5 Structure of work: Treating workers algorithmically . 7 CHAPTER 2. MAIN MICROTASK PLATFORMS . 13 2 .1 Description of platforms . 13 2 .1 .1 Employment arrangements . 13 2 .1 .2 Business models . 14 2 .1 .3 Platform specializations . 15 2 .2 Description of work on the platforms . 16 2 .3 Platform terms of service . 22 2 .3 .1 Non-user-friendly adhesion contracts . 22 2 .3 .2 Terms of service documents as sites of intervention . 24 CHAPTER 3. WHO ARE THE CROWDWORKERS? . 29 3 .1 Geographical coverage . 31 3 .2 Basic demographics of crowdworkers . 33 3 .3 Reasons for undertaking crowdwork . 37 3 .4 Main source of income . 41 vii DIGITAL LABOUR PLATFORMS AND THE FUTURE OF WORK CHAPTER 4. HOW DO CROWDWORKERS FARE? . 49 4 .1 Remuneration . 49 4 .2 Access to social protection benefits . 59 4 .3 Insufficient availability of work . 62 4 .4 Working hours and work–life balance . 67 CHAPTER 5. WHAT ARE THE RISKS AND OPPORTUNITIES FOR CROWDWORKERS? . 73 5 .1 Rejections, opacity and non-payment of work . 73 5 .2 Lack of communication, responsiveness and representation . 79 5 .3 Content of work and skill mismatch . 82 5 .4 Is this the best use of developing countries’ skilled labour? . 88 CHAPTER 6. TOWARDS DECENT WORK IN THE ONLINE WORLD . 95 6 .1 Improving microtask platforms: Some initiatives . 96 6 .1 .1 Turkopticon . 96 6 .1 .2 The Dynamo Guidelines for academic requesters on Amazon Mechanical Turk 97 6 .1 .3 FairCrowdWork .org . 98 6 .1 .4 The Crowdsourcing Code of Conduct and its Ombuds office . 99 6 .1 .5 Engaging clients to improve pay and working conditions: An emerging strategy . 99 6 .2 Improving the platform terms of service . 100 6 .2 .1 Worker account and profile control . 100 6 .2 .2 Evaluation of work and payment . 101 6 .2 .3 Workers’ privacy, safety and well-being . 103 6 .2 .4 Workers’ legal rights . 104 6 .3 What can be done? 18 criteria for fairer microwork . 105 6 .4 Three additional criteria on adapting social protection for crowdwork . 109 viii CONTENTS BIBLIOGRAPHY . 115 APPENDIX I . 123 APPENDIX II . 129 FIGURES 1 .1 Categorization of digital labour platforms . 4 2 .1 Example of a task for content access . 17 2 .2 Example of a task for verification and validation . 18 2 .3 Example of a task for machine learning . 19 2 .4 Example of a transcription task . 20 2 .5 Example of a content creation task . 21 3 .1 Regional coverage of the two surveys and distribution of 2017 survey respondents . 31 3 .2 Regional distribution of crowdworkers, by platform .
Recommended publications
  • The Cultural Work of Microwork
    Article new media & society 0(0) 1–21 © THe AutHor(s) 2013 The cultural work of Reprints and permissions: sagepub.co.uK/journalsPermissions.nav microwork DOI: 10.1177/1461444813511926 nms.sagepub.com Lilly Irani UC San Diego, USA Abstract This paper focuses on Amazon MecHanical TurK as an emblematic case of microworK crowdsourcing. New media studies researcH on crowdsourcing Has focused on questions of fair treatment of worKers, creativity of microlabor, and the ethics of microwork. THis paper argues tHat tHe divisions of labors and mediations of software interfaces made possible by sociotecHnical systems of microworK also do cultural worK in new media production. This paper draws from infrastructure studies and feminist science and tecHnology studies to examine Amazon MecHanical TurK and tHe Kinds of worKers and employers produced througH the practices associated with the system. Crowdsourcing systems, we will show, are mechanisms not only for getting tasks done, but for producing difference between “innovative” laborers and menial laborers and ameliorating resulting tensions in cultures of new media production. Keywords cloud computing, crowdsourcing, entrepreneurialism, gender, infrastructure, invisible worK, labor, peer production, subjectivities Introduction You’ve heard of software-as-a-service. Well this is human-as-a-service. – Jeff Bezos announcing Amazon Mechanical Turk in 2006 Corresponding author[AQ: 1] Lilly Irani, Department of Communication, UC San Diego, 9500 Gilman Dr. La Jolla, CA 92093-0503, USA. Email: [email protected] 2 new media & society 0(0) In 2006, CEO of Amazon Jeff Bezos addressed an auditorium of technologists, reporters, and professors had assembled at MIT to hear “what’s next,” informing investments of capital and research agendas.
    [Show full text]
  • Microworkers’ Emerging Bonds of Attachment in A
    Paper accepted for publication in Work, Employment and Society, December 2019 ‘If he just knew who we were’: Microworkers’ emerging bonds of attachment in a fragmented employment relationship Niki Panteli Royal Holloway, University of London Andriana Rapti University of Nicosia, Cyprus Dora Scholarios University of Strathclyde, Glasgow 1 Abstract Using the lens of attachment, we explore microworkers’ views of their employment relationship. Microwork comprises short-term, task-focused exchanges with large numbers of end-users (requesters), implying transitory and transactional relationships. Other key parties, however, include the platform which digitally meditates worker-requester relationships and the online microworker community. We explore the nature of attachment with these parties and the implications for microworkers’ employment experiences. Using data from a workers’ campaign directed at Amazon Mechanical Turk and CEO Jeff Bezos, we demonstrate multiple, dynamic bonds, primarily, acquiescence and instrumental bonds towards requesters and the platform, and identification with the online community. Microworkers also expressed dedication towards the platform. We consider how attachment buffers the exploitative employment relationship and how community bonds mobilise collective worker voice. Keywords: attachment, bonds, digital labour, digital platform, employment relationship, gig economy, gig work, identification, microworkers, platform labour, work attachment, worker voice Corresponding Author: Dora Scholarios, Department of Work, Employment & Organisation, Strathclyde Business School, 199 Cathedral Street, Glasgow, G4 8QU. email: [email protected] 2 Introduction On-demand digital labour is a pervasive aspect of employment in today’s gig economy (Howcroft and Bergvall-Kareborn, 2018; Wood et al., 2018a). This article focuses on one type of digital labour – online task crowdwork - which involves paid micro-tasks, or Human Intelligence Tasks (HITs), disseminated through digital platforms and requested by either individuals or companies.
    [Show full text]
  • Subcontracting Microwork CHI 2017 Submission
    Subcontracting Microwork Meredith Ringel Morris1, Jeffrey P. Bigham2, Robin Brewer3, Jonathan Bragg4, Anand Kulkarni5, Jessie Li2, and Saiph Savage6 1Microsoft Research, Redmond, WA, USA 2Carnegie Mellon University, Pittsburgh, PA, USA 3Northwestern University, Evanston, IL, USA 4University of Washington, Seattle, WA, USA 5University of California, Berkeley, CA, USA 6West Virginia University, Morgantown, WV, USA [email protected], {bigham, jessieli}@cs.cmu.edu, [email protected], [email protected], [email protected], [email protected] ABSTRACT scientific enterprises [10, 11], and community or volunteer Mainstream crowdwork platforms treat microtasks as ventures [5]. Mainstream crowdwork platforms treat indivisible units; however, in this article, we propose that microtasks (also called human intelligence tasks or HITs) as there is value in re-examining this assumption. We argue that indivisible units; however, we propose that there is value in crowdwork platforms can improve their value proposition re-examining this assumption. We argue that crowdwork for all stakeholders by supporting subcontracting within platforms can improve their value proposition for all microtasks. After describing the value proposition of stakeholders by supporting subcontracting within subcontracting, we then define three models for microtask microtasks, i.e. outsourcing one or more aspects of a subcontracting: real-time assistance, task management, and microtask to additional workers. task improvement, and reflect on potential use cases
    [Show full text]
  • 2020 Annual Report Contents
    Real world AI 2020 Annual Report Contents 2 What we do 3 Why we do it 4 Making AI work in the real world 10 Capturing the market opportunity 12 2020 highlights 14 Chairman’s message 16 CEO’s message 18 Our competitive advantage 19 Our strategic priorities 20 How we create value 22 Global crowd Artificial 24 Appen employees 26 Technology, processes, systems 28 Customer and brand 30 Financial 32 Social and environment intelligence... 36 Identifying and managing risk 44 Our approach to governance 46 Board of Directors 48 Executive Team Appen makes AI work in the real world by 50 Directors’ report 58 Remuneration report delivering high-quality training data at scale. 72 Lead auditor’s independence declaration Training data is used to build and continuously 73 Financial report 128 Directors’ declaration improve the world’s most innovative AI 129 Independent auditor’s report enhanced systems and services. 133 Additional information 136 Corporate directory Our clients include the world’s largest technology companies, global leaders in automotive, financial services, retail and healthcare, and government agencies. ...informed by Appen. About this report We have used the International Integrated Reporting Council (IIRC) <IR> Framework and the Sustainability Accounting Standards Board (SASB) Standards to guide our disclosures on how Appen creates value and which topics are financially material to our business. Appen Limited ABN 60 138 878 298 Appen 2020 Annual Report 1 Contents 2 What we do 3 Why we do it 4 Making AI work in the real world 10 Capturing the market opportunity 12 2020 highlights 14 Chairman’s message 16 CEO’s message 18 Our competitive advantage 19 Our strategic priorities 20 How we create value 22 Global crowd Artificial 24 Appen employees 26 Technology, processes, systems 28 Customer and brand 30 Financial 32 Social and environment intelligence..
    [Show full text]
  • Design Activism for Minimum Wage Crowd Work
    Design Activism for Minimum Wage Crowd Work Akash Mankar Riddhi J. Shah Matthew Lease National Instruments Rackspace School of Information Austin, TX USA Austin, TX USA University of Texas at Austin [email protected] [email protected] [email protected] Abstract required to compensate workers according to local mini- mum wage laws. Would any Requesters support such a pol- Entry-level crowd work is often reported to pay less than min- icy? Would any workers support being blocked from tasks imum wage. While this may be appropriate or even necessary, due to various legal, economic, and pragmatic factors, some that did not meet this wage restriction in their local region? Requesters and workers continue to question this status quo. Would workers in different regions have different views? To promote further discussion on the issue, we survey Re- As inspiration, Turkopticon (Irani and Silberman 2013)’s questers and workers whether they would support restricting design activism both provided functional enhancements on tasks to require minimum wage pay. As a form of design ac- AMT, helping mitigate power disparities, but also provoked tivism, we confronted workers with this dilemma directly by discussion and disrupt common rhetoric of technocentric op- posting a dummy Mechanical Turk task which told them that timism surrounding crowd-powered systems. In this work, they could not work on it because it paid less than their local we survey workers and Requesters, and to be more provoca- minimum wage, and we invited their feedback. Strikingly, for tive, we created a dummy Mechanical Turk task in which those workers expressing an opinion, two-thirds of Indians workers were told after accepting the task that they could favored the policy while two-thirds of Americans opposed it.
    [Show full text]
  • How Many People Microwork in France? Estimating the Size of a New Labor Force Clément Le Ludec, Paola Tubaro, Antonio Casilli
    How many people microwork in France? Estimating the size of a new labor force Clément Le Ludec, Paola Tubaro, Antonio Casilli To cite this version: Clément Le Ludec, Paola Tubaro, Antonio Casilli. How many people microwork in France? Estimating the size of a new labor force. 2019. hal-02012731 HAL Id: hal-02012731 https://hal.archives-ouvertes.fr/hal-02012731 Preprint submitted on 16 Feb 2019 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. How many people microwork in France? Estimating the size of a new labor force CLÉMENT LE LUDEC, MSH Paris Saclay, France PAOLA TUBARO, National Center of Scientific Research (CNRS), France ANTONIO A. CASILLI, Telecom ParisTech, France Microwork platforms allocate fragmented tasks to crowds of providers with This novel organization of AI-driven automation in contemporary remunerations as low as few cents. Instrumental to the development of industries does not "replace" human jobs but makes human contri- today’s artificial intelligence, these micro-tasks push to the extreme the bution to productive processes largely inconspicuous. It supports logic of casualization already observed in "uberized" workers. The present technologies where they fail, and yet it is not a selling point that article uses the results of the DiPLab study to estimate the number of people companies leverage to attract and retain large userbases.
    [Show full text]
  • Labeling Parts of Speech Using Untrained Annotators on Mechanical Turk THESIS Presented in Partial Fulfillment of the Requiremen
    Labeling Parts of Speech Using Untrained Annotators on Mechanical Turk THESIS Presented in Partial Fulfillment of the Requirements for the Degree Master of Science in the Graduate School of The Ohio State University By Jacob Emil Mainzer Graduate Program in Computer Science and Engineering The Ohio State University 2011 Master's Examination Committee: Professor Eric Fosler-Lussier, Advisor Professor Mikhail Belkin Copyright by Jacob Emil Mainzer 2011 Abstract Supervised learning algorithms often require large amounts of labeled data. Creating this data can be time consuming and expensive. Recent work has used untrained annotators on Mechanical Turk to quickly and cheaply create data for NLP tasks, such as word sense disambiguation, word similarity, machine translation, and PP attachment. In this experiment, we test whether untrained annotators can accurately perform the task of POS tagging. We design a Java Applet, called the Interactive Tagging Guide (ITG) to assist untrained annotators in accurately and quickly POS tagging words using the Penn Treebank tagset. We test this Applet on a small corpus using Mechanical Turk, an online marketplace where users earn small payments for the completion of short tasks. Our results demonstrate that, given the proper assistance, untrained annotators are able to tag parts of speech with approximately 90% accuracy. Furthermore, we analyze the performance of expert annotators using the ITG and discover nearly identical levels of performance as compared to the untrained annotators. ii Vita 2009................................................................B.S. Physics, University of Rochester September 2009 – August 2010 .....................Distinguished University Fellowship, The Ohio State University September 2010 – June 2011 .........................Graduate Teaching Assistant, The Ohio State University Fields of Study Major Field: Computer Science and Engineering iii Table of Contents Abstract ..............................................................................................................................
    [Show full text]
  • Return of the Crowds: Mechanical Turk and Neoliberal States of Exception 79 Ayhan Aytes Vi Contents
    DIGITAL LABOR The Internet as Playground and Factory Edited by Trebor Scholz First published 2013 by Routledge 711 Third Avenue, New York, NY 10017 Simultaneously published in the UK by Routledge 2 Park Square, Milton Park, Abingdon, Oxon OX14 4RN Routledge is an imprint of the Taylor & Francis Group, an informa business © 2013 Taylor & Francis The right of the editor to be identifi ed as the author of the editorial material, and of the authors for their individual chapters, has been asserted in accordance with sections 77 and 78 of the Copyright, Designs and Patents Act 1988. All rights reserved. No part of this book may be reprinted or reproduced or utilised in any form or by any electronic, mechanical, or other means, now known or hereafter invented, including photocopying and recording, or in any information storage or retrieval system, without permission in writing from the publishers. Trademark notice: Product or corporate names may be trademarks or registered trademarks, and are used only for identifi cation and explanation without intent to infringe. Library of Congress Cataloging-in-Publication Data Digital labor : the Internet as playground and factory / edited by Trebor Scholz. p. cm. Includes bibliographical references and index. 1. Internet–Social aspects. 2. Information society. I. Scholz, Trebor. HM851.D538 2013 302.23'1–dc23 2012012133 ISBN: 978-0-415-89694-8 (hbk) ISBN: 978-0-415-89695-5 (pbk) ISBN: 978-0-203-14579-1 (ebk) Typeset in ApexBembo by Apex CoVantage, LLC CONTENTS Acknowledgments vii Introduction: Why Does Digital
    [Show full text]
  • I Found Work on an Amazon Website. I Made 97 Cents an Hour. - the New York Times Crossword Times Insider Newsletters the Learning Network
    11/15/2019 I Found Work on an Amazon Website. I Made 97 Cents an Hour. - The New York Times Crossword Times Insider Newsletters The Learning Network Multimedia Photography Podcasts NYT Store NYT Wine Club nytEducation Times Journeys Meal Kits Subscribe Manage Account Today's Paper Tools & Services Jobs Classifieds Corrections More Site Mobile Navigation 12 I Found Work on an Amazon Website. I Made 97 Cents an Hour. By ANDY NEWMAN NOV. 15, 2019 Inside the weird, wild, low-wage world of Mechanical Turk. https://www.nytimes.com/interactive/2019/11/15/nyregion/amazon-mechanical-turk.html 2/15 11/15/2019 I Found Work on an Amazon Website. I Made 97 Cents an Hour. - The New York Times After turking for eight hours, the author had earned $7.83. Dave Sanders for The New York Times The computer showed a photo of what looked like a school board meeting. My job was to rate it on a scale of 1 to 5 for 23 different qualities: “patriotic,” “elitist,” “reassuring” and so on. I did the same for a photo of a woman wearing headphones — I gave her a 4 for “competent” and a 1 for “threatening” — and another of five smiling women flanking a smiling man in a blue windbreaker. I submitted my answers. I checked the clock. Three minutes had passed. I had just earned another 5 cents on a digital work marketplace run by Amazon called Mechanical Turk. At least I thought I had. Weeks later, I’m still not sure. There are lots of ways to make a little money in this world.
    [Show full text]
  • Privacy Experiences on Amazon Mechanical Turk
    113 “Our Privacy Needs to be Protected at All Costs”: Crowd Workers’ Privacy Experiences on Amazon Mechanical Turk HUICHUAN XIA, Syracuse University YANG WANG, Syracuse University YUN HUANG, Syracuse University ANUJ SHAH, Carnegie Mellon University Crowdsourcing platforms such as Amazon Mechanical Turk (MTurk) are widely used by organizations, researchers, and individuals to outsource a broad range of tasks to crowd workers. Prior research has shown that crowdsourcing can pose privacy risks (e.g., de-anonymization) to crowd workers. However, little is known about the specific privacy issues crowd workers have experienced and how they perceive the state ofprivacy in crowdsourcing. In this paper, we present results from an online survey of 435 MTurk crowd workers from the US, India, and other countries and areas. Our respondents reported different types of privacy concerns (e.g., data aggregation, profiling, scams), experiences of privacy losses (e.g., phishing, malware, stalking, targeted ads), and privacy expectations on MTurk (e.g., screening tasks). Respondents from multiple countries and areas reported experiences with the same privacy issues, suggesting that these problems may be endemic to the whole MTurk platform. We discuss challenges, high-level principles and concrete suggestions in protecting crowd workers’ privacy on MTurk and in crowdsourcing more broadly. CCS Concepts: • Information systems → Crowdsourcing; • Security and privacy → Human and societal aspects of security and privacy; • Human-centered computing → Computer supported cooperative work; Additional Key Words and Phrases: Crowdsourcing; Privacy; Amazon Mechanical Turk (MTurk) ACM Reference format: Huichuan Xia, Yang Wang, Yun Huang, and Anuj Shah. 2017. “Our Privacy Needs to be Protected at All Costs”: Crowd Workers’ Privacy Experiences on Amazon Mechanical Turk.
    [Show full text]
  • Ethical and Practical Matters in the Academic Use of Crowdsourcing
    Understanding the Crowd: Ethical and Practical Matters in the Academic Use of Crowdsourcing B David Martin1, Sheelagh Carpendale2, Neha Gupta3( ), Tobias Hoßfeld4, Babak Naderi5, Judith Redi6, Ernestasia Siahaan6, and Ina Wechsung5 1 Xerox Research Centre Europe, Meylan, France 2 University of Calgary, Calgary, Canada 3 University of Nottingham, Nottingham, UK [email protected] 4 University of Duisburg-Essen, Duisburg, Germany 5 TU Berlin, Berlin, Germany 6 Delft University of Technology, Delft, The Netherlands 1 Introduction Take the fake novelty of a term like “crowdsourcing” – supposedly one of the chief attributes of the Internet era ... “Crowdsourcing” is certainly a very effective term; calling some of the practices it enables as “digitally distributed sweatshop labor” – for this seems like a much better description of what’s happening on crowdsource-for-money platforms like Amazon’s Mechanical Turk – wouldn’t accomplish half as much” [34]. In his recent book “To Save Everything, Click Here” [34] Evgeny Morozov pro- duces a sustained critique of what he calls technological solutionism.Hiskey argument is that modern day technology companies, often situated in Silicon Valley, are increasingly touting technological innovation as the quick route to solving complex and thus far relatively intractable social and societal problems. He documents how in many cases the technologies simply do not deliver the wished for result, meaning that this trend ends up as little more than a mar- keting exercise for new technologies and gadgets. A related phenomenon is one where a technology innovation, that may be of little or ambiguous social merit is presented in a way that it is value-washed – given a positive social-spin, and marketed as something inherently virtuous when, once again the situation is far from clear.
    [Show full text]
  • Rethinking Microwork: the Invisble Labour of the Platform Economy
    Rethinking Microwork: the Invisble Labour of the Platform Economy Phil Jones The rapid development of artificial intelligence over the last decade has not yet brought about the dystopian scenario of mass unemployment predicted by its critics. Paradoxically, on arriving at automation’s ‘last mile’ there has been a flourishing of new work – precarious and poorly paid – pushing the horizon of human redundancy ever-further into the future.1 Indeed, present AI innovations turn on an illusion. What so often appears as algorithmic power is in fact an ambient workforce, supervising Uber’s algorithms, rating Google’s search results and making sure our Facebook feeds are clear of violent imagery. These ‘ghost workers’ train the data for autonomous vehicles and facial recognition software; they transcribe audio for chatbots and power the cloud computing of companies like Microsoft. They are the workers that step in when the algorithm falls short, the workers that clean the data and, ultimately, make our digital lives legible.2 We find this hidden workforce of on-demand workers on microwork platforms such as Amazon Mechanical Turk, Appen and Clickworker. These platforms host short data tasks that are outsourced by requesters ranging from smaller start-ups to companies like Google, Amazon and Microsoft. The platforms act as intermediaries and take a cut from every transaction between the two parties.3 Tasks on the platforms might include labelling objects on a photo, transcribing audio of voices, copying or translating short pieces of writing and filling in surveys. These tasks fulfill the work that: 1. Algorithms are still unable to complete 2.
    [Show full text]