Mobile Phones As Cognitive Systems

Total Page:16

File Type:pdf, Size:1020Kb

Mobile Phones As Cognitive Systems Downloaded from orbit.dtu.dk on: Oct 10, 2021 Mobile Phones as Cognitive Systems Stopczynski, Arkadiusz Publication date: 2015 Document Version Publisher's PDF, also known as Version of record Link back to DTU Orbit Citation (APA): Stopczynski, A. (2015). Mobile Phones as Cognitive Systems. Technical University of Denmark. DTU Compute PHD-2014 No. 336 General rights Copyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright owners and it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights. Users may download and print one copy of any publication from the public portal for the purpose of private study or research. You may not further distribute the material or use it for any profit-making activity or commercial gain You may freely distribute the URL identifying the publication in the public portal If you believe that this document breaches copyright please contact us providing details, and we will remove access to the work immediately and investigate your claim. Mobile Phones as Cognitive Systems Arkadiusz Stopczynski Technical University of Denmark Applied Mathematics and Computer Science Building 324, DK-2800 Kongens Lyngby, Denmark Phone +45 45253031, Fax +45 45253031 [email protected] www.compute.dtu.dk PHD: ISSN 0909-3192 Summary (English) Driven by the ubiquitous availability of data and inexpensive data storage, our ability to sense human beings has increased dramatically. Big data has perme- ated the public discourse and led to surprising insights across the sciences and the humanities. This dissertation presents research on expanding our capabil- ities in collecting, handling, processing, and using data collected about human beings to create an integrated view of social systems. The goal of the thesis has been threefold. The first part of the thesis focuses on the need, design, and implementation of large-scale sensor-driven human data collection studies. Social networks can be measured with high resolution and on multiple channels, such as face-to- face meetings, social networks, or phone calls, in order to generate a more comprehensive picture of social systems. The largest study to date measur- ing large-scale social system—the Copenhagen Networks Study—is described, together with motivation and challenges of the deployment. Preliminary results are presented, indicating how a possibly biased and incomplete picture can be generated when data are collected from a single channel and with a low resolu- tion, thus emphasizing the importance of the proposed approach and deployed implementation. The second part of the thesis deals with expanding our capabilities to sense the cognitive and emotional state of the users through development of a sys- tem for mobile brain imaging—the Smartphone Brain Scanner. A developed framework allows for EEG data collection and processing. It also provides the ability to build end-user applications on top of raw data and extracted features using off-the-shelf and custom-built neuroheadsets and mobile devices, thereby ii potentially becoming another channel in integrated human sensing. The motiva- tion for creating such system is presented, advanced data processing—3D source reconstruction—is explained, and applications and use-cases are discussed. In the third part, the privacy issues surrounding the handling of such sensi- tive behavioral and biomedical data are investigated. A comprehensive review of best privacy practices in sensor-driven human data collection is presented and recommendations for practitioners are made. Based on this review and experiences with the Copenhagen Networks Study and the Smartphone Brain Scanner, the concept of Living Informed Consent is presented, which postulates larger participant control over collected data for the benefit of users, researchers, and society at large. The same privacy principles are applied to a personal neu- roinformatics context, resulting in a proposed new approach to sensitive EEG data handling. Resumé (Dansk) Drevet af den øgede tilgængelighed af data samt den lave pris på datalagring, er vores mulighed for at indsamle data om mennesker steget dramatisk. “Big data” har gennemsyret den offentlige diskurs og ført til overraskende indsigter på tværs af naturvidenskab og humaniora. Denne afhandling beskæftiger sig med data indsamlet om mennesket og præsenterer forskning der udvider vores kompetencer indenfor indsamling, håndtering, forarbejdning og anvendelse for at skabe et samlet billede af sociale systemer. Målet med denne afhandling er tredelt. Den første del af denne afhandling fokuserer på sensor-drevet indsamling af data og diskuterer behovet, designet, samt implementeringen af denne type studier. Sociale netværk kan måles med høj opløsning og via flere kanaler, såsom ansigt- til-ansigt møder, online netværk eller telefonopkald. For at få et fyldestgørende billede af mennesket skal man dække alle vore kommunikationskanaler. Udfor- dringer samt motivationen bag den til dato største indsamling af sensor-dreven data, med titlen Copenhagen Networks Study, bliver beskrevet og diskuteret. Foreløbige data bliver præsenteret og indikerer udfordringen i bias og mulighe- den for slutninger baseret på ufuldstændige data fra kun en kanal. Dette un- derstreger betydningen af den beskrevne fremgangsmåde. Den anden del af denne afhandling omhandler et nyt mobilt system, kaldet Smartphone Brain Scanner, der udvider vores nuværende rammer til mobilt at kunne registrere kognitive tilstande hos mennesker. Den udviklede metode gør det muligt at både indsamle og behandle EEG data dynamisk. Yderligere, åbner den muligheder for at brugere selv kan bygge og anvende nye applika- tioner på det indsamlede data. Metoden er både kompatibel med standard- iv komponenter, specialbyggede neuro-headset samt andre mobile enheder og kan dermed potentielt blive en ny kanal i indsamlingen af data om mennesket. Denne del beskriver motivationen bag skabelsen af systemet, forklarer de avancerede databehandlingsmetoder og giver eksempler på hvorledes et sådant system kan være nyttigt. I den tredje del undersøges og diskuteres hånderingen af disse følsomme data med henblik på beskyttelsen af privatlivets fred. En omfattende gennemgang belyser de nuværende fremgangsmåder og giver detaljerede anbefalinger til frem- tidige studier der omhandler anvendelse af denne slags personfølsomme data. Baseret på denne gennemgang og de to projekter: Copenhagen Networks Study og Smartphone Brain Scanner introduceres begrebet Living Informed Consent. Her postuleres at større individuel kontrol over data er til gavn for brugere, forskere og samfundet generelt. De samme principper om privatlivets fred an- vendes i sammenhængen med personlig neuroinformatik og resulterer i en ny tilgang til håndtering af følsomme EEG data. Preface This thesis was prepared at the Department of Applied Mathematics and Com- puter Science at the Technical University of Denmark (DTU) in partial fulfill- ment of the requirements for acquiring the Ph.D. degree in engineering. The thesis consists of a summary report and a collection of one book chap- ter, four published scientific papers, and four upcoming papers. The work was carried out between 2011 and 2014. Lyngby, 31-March-2014 Arkadiusz Stopczynski vi List of Publications Papers included in the thesis [A] Daniel Greenwood, Arkadiusz Stopczynski, Brian Sweatt, Thomas Hardjono, and Alex Pentland. Institutional Controls: The New Deal on Data (Book Chapter). Big Data, Privacy, and the Public Good: Frameworks for Engagement. Edited by Julia Lane, Victoria Stodden, Stefan Bender, and Helen Nissenbaum. Cambridge University Press, 2014. Hardback ISBN 9781107067356; paperback ISBN 9781107637689. [B] Arkadiusz Stopczynski, Vedran Sekara, Piotr Sapiezynski, Andrea Cuttone, Mette My Madsen, Jakob Eg Larsen, and Sune Lehmann. Measuring Large-Scale Social Networks with High Resolution. Under Review in PLOS ONE. arXiv preprint arXiv:1401.7233 (2014). [C] Yves-Alexandre de Montjoye, Arkadiusz Stopczynski, Erez Shmueli, Alex ‘Sandy’ Pent- land, and Sune Lehmann. The Strength of the Strongest Ties in Collaborative Problem Solv- ing. Under Review in Scientific Reports (2014). [D] Arkadiusz Stopczynski, Carsten Stahlhut, Michael Kai Petersen, Jakob Eg Larsen, Camilla Falk Jensen, Marieta Georgieva Ivanova, Tobias S. Andersen, and Lars Kai Hansen. Smartphones as pocketable labs: Visions for mobile brain imaging and neurofeedback. Inter- national Journal of Psychophysiology, Volume 91, Issue 1, January 2014, Pages 54-66, ISSN 0167-8760, doi:10.1016/j.ijpsycho.2013.08.007. [E] Michael Kai Petersen, Carsten Stahlhut, Arkadiusz Stopczynski, Jakob Eg Larsen, and Lars Kai Hansen. Smartphones get emotional: mind reading images and reconstructing the neural sources. In Affective Computing and Intelligent Interaction, pp. 578-587. Springer Berlin Heidelberg, 2011. [F] Arkadiusz Stopczynski, Carsten Stahlhut, Jakob Eg Larsen, Michael Kai Petersen, and Lars Kai Hansen. The Smartphone Brain Scanner: A Portable Real-time Neuroimaging System. PLoS ONE 9(2): e86733. doi:10.1371/journal.pone.0086733. viii [G] Carsten Stahlhut, Hagai Thomas Attias, Arkadiusz Stopczynski, Michael Kai Petersen, Jakob Eg Larsen, and Lars Kai Hansen. An evaluation of EEG scanner’s dependence on the imaging technique, forward model computation method, and array dimensionality. Engineer- ing in Medicine and Biology Society (EMBC), 2012 Annual International Conference
Recommended publications
  • Neuro Informatics 2020
    Neuro Informatics 2019 September 1-2 Warsaw, Poland PROGRAM BOOK What is INCF? About INCF INCF is an international organization launched in 2005, following a proposal from the Global Science Forum of the OECD to establish international coordination and collaborative informatics infrastructure for neuroscience. INCF is hosted by Karolinska Institutet and the Royal Institute of Technology in Stockholm, Sweden. INCF currently has Governing and Associate Nodes spanning 4 continents, with an extended network comprising organizations, individual researchers, industry, and publishers. INCF promotes the implementation of neuroinformatics and aims to advance data reuse and reproducibility in global brain research by: • developing and endorsing community standards and best practices • leading the development and provision of training and educational resources in neuroinformatics • promoting open science and the sharing of data and other resources • partnering with international stakeholders to promote neuroinformatics at global, national and local levels • engaging scientific, clinical, technical, industry, and funding partners in colla- borative, community-driven projects INCF supports the FAIR (Findable Accessible Interoperable Reusable) principles, and strives to implement them across all deliverables and activities. Learn more: incf.org neuroinformatics2019.org 2 Welcome Welcome to the 12th INCF Congress in Warsaw! It makes me very happy that a decade after the 2nd INCF Congress in Plzen, Czech Republic took place, for the second time in Central Europe, the meeting comes to Warsaw. The global neuroinformatics scenery has changed dramatically over these years. With the European Human Brain Project, the US BRAIN Initiative, Japanese Brain/ MINDS initiative, and many others world-wide, neuroinformatics is alive more than ever, responding to the demands set forth by the modern brain studies.
    [Show full text]
  • Three Directions for the Design of Human-Centered Machine Translation
    Three Directions for the Design of Human-Centered Machine Translation Samantha Robertson Wesley Hanwen Deng University of California, Berkeley University of California, Berkeley samantha [email protected] [email protected] Timnit Gebru Margaret Mitchell Daniel J. Liebling Black in AI [email protected] Google [email protected] [email protected] Michal Lahav Katherine Heller Mark D´ıaz Google Google Google [email protected] [email protected] [email protected] Samy Bengio Niloufar Salehi Google University of California, Berkeley [email protected] [email protected] Abstract As people all over the world adopt machine translation (MT) to communicate across lan- guages, there is increased need for affordances that aid users in understanding when to rely on automated translations. Identifying the in- formation and interactions that will most help users meet their translation needs is an open area of research at the intersection of Human- Computer Interaction (HCI) and Natural Lan- guage Processing (NLP). This paper advances Figure 1: TranslatorBot mediates interlingual dialog us- work in this area by drawing on a survey of ing machine translation. The system provides extra sup- users’ strategies in assessing translations. We port for users, for example, by suggesting simpler input identify three directions for the design of trans- text. lation systems that support more reliable and effective use of machine translation: helping users craft good inputs, helping users under- what kinds of information or interactions would stand translations, and expanding interactiv- best support user needs (Doshi-Velez and Kim, ity and adaptivity. We describe how these 2017; Miller, 2019). For instance, users may be can be introduced in current MT systems and more invested in knowing when they can rely on an highlight open questions for HCI and NLP re- AI system and when it may be making a mistake, search.
    [Show full text]
  • The MT Developer/Provider and the Global Corporation
    The MT developer/provider and the global corporation Terence Lewis1 & Rudolf M.Meier2 1 Hook & Hatton Ltd, 2 Siemens Nederland N.V. [email protected], [email protected] Abstract. This paper describes the collaboration between MT developer/service provider, Terence Lewis (Hook & Hatton Ltd) and the Translation Office of Siemens Nederland N.V. (Siemens Netherlands). It involves the use of the developer’s Dutch-English MT software to translate technical documentation for divisions of the Siemens Group and for external customers. The use of this language technology has resulted in significant cost savings for Siemens Netherlands. The authors note the evolution of an ‘MT culture’ among their regu- lar users. 1. Introduction 2. The Developer’s perspective In 2002 Siemens Netherlands and Hook & Hat- Under the current arrangement, the Developer ton Ltd signed an exclusive agreement on the (working from home in the United Kingdom) marketing of Dutch-English MT services in the currently acts as the sole operator of an Auto- Netherlands. This agreement set the seal on an matic Translation Environment (Trasy), process- informal partnership that had evolved over the ing documents forwarded by e-mail by the Trans- preceding six-seven years between Siemens and lation Office of Siemens Netherlands in The the Developer (Terence Lewis, trading through Hague. Ideally, these documents are in MS Word the private company Hook & Hatton Ltd). Un- or rtf format, but the Translation Office also re- der the contract, Siemens Netherlands under- ceives pdf files or OCR output files for automatic takes to market the MT Services provided by translation.
    [Show full text]
  • TAUS Speech-To-Speech Translation Technology Report March 2017
    TAUS Speech-to-Speech Translation Technology Report March 2017 1 Authors: Mark Seligman, Alex Waibel, and Andrew Joscelyne Contributor: Anne Stoker COPYRIGHT © TAUS 2017 All rights reserved. No part of this publication may be reproduced, stored in a retrieval system of any nature, or transmit- ted or made available in any form or by any means, electronic, mechanical, photocopying, recording or otherwise, without the prior written permission of TAUS. TAUS will pursue copyright infringements. In spite of careful preparation and editing, this publication may contain errors and imperfections. Au- thors, editors, and TAUS do not accept responsibility for the consequences that may result thereof. Design: Anne-Maj van der Meer Published by TAUS BV, De Rijp, The Netherlands For further information, please email [email protected] 2 Table of Contents Introduction 4 A Note on Terminology 5 Past 6 Orientation: Speech Translation Issues 6 Present 17 Interviews 19 Future 42 Development of Current Trends 43 New Technology: The Neural Paradigm 48 References 51 Appendix: Survey Results 55 About the Authors 56 3 Introduction The dream of automatic speech-to-speech devices enabling on-the-spot exchanges using translation (S2ST), like that of automated trans- voice or text via smartphones – has helped lation in general, goes back to the origins of promote the vision of natural communication computing in the 1950s. Portable speech trans- on a globally connected planet: the ability to lation devices have been variously imagined speak to someone (or to a robot/chatbot) in as Star Trek’s “universal translator” to negoti- your language and be immediately understood ate extraterrestrial tongues, Douglas Adams’ in a foreign language.
    [Show full text]
  • Translation Technology Landscape Report
    Translation Technology Landscape Report April 2013 Funded by LT-Innovate Copyright © TAUS 2013 1 Translation Technology Landscape Report COPYRIGHT © TAUS 2013 All rights reserved. No part of this publication may be reproduced, stored in a retrieval system of any nature, or transmitted or made available in any form or by any means, electronic, mechanical, photocopying, recording or otherwise, without the prior written permission of TAUS. TAUS will pursue copyright infringements. In spite of careful preparation and editing, this publication may contain errors and imperfections. Authors, editors, and TAUS do not accept responsibility for the consequences that may result thereof. Published by TAUS BV, De Rijp, The Netherlands. For further information, please email [email protected] 2 Copyright © TAUS 2013 Translation Technology Landscape Report Target Audience Any individual interested in the business of translation will gain from this report. The report will help beginners to understand the main uses for different types of translation technology, differentiate offerings and make informed decisions. For more experienced users and business decision-makers, the report shares insights on key trends, future prospects and areas of uncertainty. ,QYHVWRUVDQGSROLF\PDNHUVZLOOEHQH¿WIURPDQDO\VHVRIXQGHUO\LQJYDOXH propositions. Report Structure This report has been structured in discrete chapters and sections so that the reader can consume the information needed. The report does not need to be read from VWDUWWR¿QLVK7KHFRQYHQLHQFHDIIRUGHGIURPVXFKDVWUXFWXUHDOVRPHDQVWKHUHLV some repetition. Authors: Rahzeb Choudhury and Brian McConnell Reviewers - Jaap van der Meer and Rose Lockwood Our thanks to LT-Innovative for funding this report. Copyright © TAUS 2013 3 Translation Technology Landscape Report CONTENTS 1. Translation Technology Landscape in a Snapshot 8 2.
    [Show full text]
  • Download Your FREE Copy of the LT2013
    THE FORUM FOR EUROPE'S LANGUAGE TECHNOLOGY INDUSTRY Language Technologies LT2013: Status and Potential of the European Language Technology Markets March 2013 www.lt‐innovate.eu ‐ contact@lt‐innovate.eu www.lt‐innovate.eu ‐ contact@lt‐innovate.eu TABLE OF CONTENTS Table of Contents .....................................................................................................................................1 Executive Summary ..................................................................................................................................2 Key Extracts....................................................................................................................................3 1. A New ICT Ecosystem ...........................................................................................................................6 1.1 The deep transformation of the competitive landscape .........................................................6 1.2 A Mobile/Social/Global Ecosystem ..........................................................................................7 2. Markets for Language Technology ......................................................................................................11 2.1 The Market Context for LT ......................................................................................................11 2.2 The LT‐Innovate Market Model ...............................................................................................14 2.3 Trends & Growth by Segment.................................................................................................17
    [Show full text]
  • Problem Solving Activities in Post-Editing and Translation from Scratch a Multi-Method Study
    Problem solving activities in post-editing and translation from scratch A multi-method study Jean Nitzke language Translation and Multilingual Natural science press Language Processing 12 Translation and Multilingual Natural Language Processing Editors: Oliver Czulo (Universität Leipzig), Silvia Hansen-Schirra (Johannes Gutenberg-Universität Mainz), Reinhard Rapp (Johannes Gutenberg-Universität Mainz, Hochschule Magdeburg-Stendal) In this series: 1. Fantinuoli, Claudio & Federico Zanettin (eds.). New directions in corpus-based translation studies. 2. Hansen-Schirra, Silvia & Sambor Grucza (eds.). Eyetracking and Applied Linguistics. 3. Neumann, Stella, Oliver Čulo & Silvia Hansen-Schirra (eds.). Annotation, exploitation and evaluation of parallel corpora: TC3 I. 4. Czulo, Oliver & Silvia Hansen-Schirra (eds.). Crossroads between Contrastive Linguistics, Translation Studies and Machine Translation: TC3 II. 5. Rehm, Georg, Felix Sasaki, Daniel Stein & Andreas Witt (eds.). Language technologies for a multilingual Europe: TC3 III. 6. Menzel, Katrin, Ekaterina Lapshinova-Koltunski & Kerstin Anna Kunz (eds.). New perspectives on cohesion and coherence: Implications for translation. 7. Hansen-Schirra, Silvia, Oliver Czulo & Sascha Hofmann (eds). Empirical modelling of translation and interpreting. 8. Svoboda, Tomáš, Łucja Biel & Krzysztof Łoboda (eds.). Quality aspects in institutional translation. 9. Fox, Wendy. Can integrated titles improve the viewing experience? Investigating the impact of subtitling on the reception and enjoyment of film using eye tracking and questionnaire data. 10. Moran, Steven & Michael Cysouw. The Unicode cookbook for linguists: Managing writing systems using orthography profiles. 11. Fantinuoli, Claudio (ed.). Interpreting and technology. 12. Nitzke, Jean. Problem solving activities in post-editing and translation from scratch: A multi-method study. ISSN: 2364-8899 Problem solving activities in post-editing and translation from scratch A multi-method study Jean Nitzke language science press Nitzke, Jean.
    [Show full text]
  • A Retrospective and Prospective View Of
    A retrospective and prospective view of translation research from an empirical, experimental, and cognitive perspective: The International Journal for Translation & Interpreting Research the TREC network trans-int.org Amparo Hurtado Albir Universitat Autònoma de Barcelona [email protected] Fabio Alves Universidade Federal de Minas Gerais [email protected] Birgitta Englund Dimitrova Stockholms Universitet [email protected] Isabel Lacruz Kent State University [email protected] DOI: ti.106201.2015.a02 Abstract. The aim of this paper is to discuss some developments in empirical translation research with an experimental and cognitive perspective. The focus is on the activities and research of the network TREC (Translation, Research, Empiricism, Cognition). The network was formed in 2011, funded by the Spanish Ministry of Economy and Competitiveness and led by PACTE (Universitat Autònoma de Barcelona). It consists of translation scholars and research groups united by their common interest in empirical and experimental research, particularly in relation to the cognitive operations that underlie the task of translating. The paper first gives a short general overview of research on translation as a cognitive activity and outlines the objectives of the TREC network. The network members, representing universities from Argentina, Brazil, Denmark, Finland, Ireland, Norway, Spain, Sweden, Switzerland, the UK, and the USA, then present their most important contributions to cognitively oriented research (topics, methods, results). Finally, some conclusions are drawn and perspectives for future research are outlined. Keywords: translation, cognition, empirical-experimental research, process-oriented translation studies, networking 1. Research on translation as a cognitive activity Studies concerning translation as a cognitive activity date back to the late 1960s.
    [Show full text]
  • A Linguistics Study of New Trends in Translation As a Speech to Act
    International Journal of Science and Research (IJSR) ISSN (Online): 2319-7064 Index Copernicus Value (2013): 6.14 | Impact Factor (2013): 4.438 A Linguistics Study of New Trends in Translation as a Speech to Act Riyad Sarhan Jabbar Faculty of Education, University of Kufa, Najaf, Iraq, P. O. Box 21 Abstract: Machine translation is the only available alternative to human translation. Thus, evaluating machine translation software, is very important to improve the performance of these software. This study aims to highlight the difference between human translation and machine translation with reference to speech to text program . In this study , the approaches of translation are mentioned as direct approach , interlingua approach , and the transfer approach . The problem of this program is with the literary translation more than the other types of translation as scientific and idioms . The most accurate is the scientific one as this study proves . As a solution to overcome the problem of literary translation is that machine translation software should be modified and updated continuously , so that they can keep pace with the follow of literary terms . Also , the study shows the advantages and disadvantages of using machine translation. Moreover, the work illustrates the types of linguistic problems encountered in machine translation, and some solutions to overcome these problems. Keywords: Translation, Machine Translation, Translation software, speech, Text, Transfer approach, Interlingua approach 1. Introduction 1.2 The Aims of the Study 1.1 The Problems of the Study 1) The study will attempt to come out with some solutions to machine translation (MT) problem whenever possible The mechanization of translation it has been one of so as to come with highly quality automatic translation .
    [Show full text]
  • Automatic Text Extraction and Translation
    Image-Based Mobile Service: Automatic Text Extraction and Translation J´erˆome Berclaza, Nina Bhattib,StevenJ.Simskec and John C. Schettinob a CVLab, EPFL, Lausanne, Switzerland b HP Labs, Palo Alto, CA, USA c HP Labs, Fort Collins, CO, USA ABSTRACT We present a new mobile service for the translation of text from images taken by consumer-grade cell-phone cameras. Such capability represents a new paradigm for users where a simple image provides the basis for a service. The ubiquity and ease of use of cell-phone cameras enables acquisition and transmission of images anywhere and at any time a user wishes, delivering rapid and accurate translation over the phone’s MMS and SMS facilities. Target text is extracted com- pletely automatically, requiring no bounding box delineation or related user intervention. The service uses localization, binarization, text deskewing, and optical character recognition (OCR) in its analysis. Once the text is translated, an SMS message is sent to the user with the result. Further novelties include that no software installation is required on the handset, any service provider or camera phone can be used, and the entire service is implemented on the server side. Keywords: Scene text extraction, mobile phone camera, client / server, translation 1. INTRODUCTION Imagine a traveler dining in a restaurant in a country on the other side of the world and struggling with the menu. “Is it Beef Steak or Lizard Steak?” could be one of the more pressing questions as the traveler reads through the menu. What if this traveler could use her camera phone to get a translation simply by taking a picture of the menu, sending a MMS and promptly receiving an SMS with the answer? In this paper we describe such a system that uses any camera phone and any mobile service provider to accomplish this task quickly and easily.
    [Show full text]
  • Trkic G00gle: Why and How Users Game Translation Algorithms
    Trkic G00gle: Why and How Users Game Translation Algorithms SOOMIN KIM, Seoul National University, South Korea CHANGHOON OH, Boston College, USA WON IK CHO, Seoul National University, South Korea DONGHOON SHIN, Seoul National University, South Korea BONGWON SUH, Seoul National University, South Korea JOONHWAN LEE∗, Seoul National University, South Korea Individuals interact with algorithms in various ways. Users even game and circumvent algorithms so as to achieve favorable outcomes. This study aims to come to an understanding of how various stakeholders interact with each other in tricking algorithms, with a focus towards online review communities. We employed a mixed-method approach in order to explore how and why users write machine non-translatable reviews as well as how those encrypted messages are perceived by those receiving them. We found that users are able to find tactics to trick the algorithms in order to avoid censoring, to mitigate interpersonal burden, toprotect privacy, and to provide authentic information for enabling the formation of informative review communities. They apply several linguistic and social strategies in this regard. Furthermore, users perceive encrypted messages as both more trustworthy and authentic. Based on these findings, we discuss implications for online review community and content moderation algorithms. CCS Concepts: • Human-centered computing ! User studies. Additional Key Words and Phrases: Human-AI Interaction; algorithmic experience; gaming; translation algorithm; online review; recommendation algorithm; peer-to-peer platform ACM Reference Format: Soomin Kim, Changhoon Oh, Won Ik Cho, Donghoon Shin, Bongwon Suh, and Joonhwan Lee. 2021. Trkic G00gle: Why and How Users Game Translation Algorithms. Proc. ACM Hum.-Comput. Interact.
    [Show full text]
  • Unmet Needs and Opportunities for Mobile Translation AI Daniel J
    Unmet Needs and Opportunities for Mobile Translation AI Daniel J. Liebling, Abigail Evans Aaron Donsbach, Michal Lahav Northeastern University Jess Holbrook, Boris Smus, Google Seattle, WA Lindsey Boran Seattle, WA [email protected] Google dliebling,[email protected] Seattle, WA donsbach,jessh,smus,[email protected] ABSTRACT affordances including speech recognition and augmented real- Translation apps and devices are often presented in the con- ity [14]. text of providing assistance while traveling abroad. However, Access to translation, then, appears to be universally available. the spectrum of needs for cross-language communication is However, little public research exists that details people’s trans- much wider. To investigate these needs, we conducted three lation needs and examines how translation apps meet those studies with populations spanning socioeconomic status and needs. For what populations, in which scenarios, and what con- geographic regions: (1) United States-based travelers, (2) mi- tent is translated? How do translation apps succeed or fail at grant workers in India, and (3) immigrant populations in the these tasks? This paper sheds new light on these questions. We United States. We compare frequent travelers’ perception detail the language needs of, and use of translation technology and actual translation needs with those of the two migrant by, three different communities: English-speaking travelers communities. The latter two, with low language proficiency, based in the United States, Hindi-speaking intra-national mi- have the greatest translation needs to navigate their daily lives. grant workers who live in Tamil-speaking Chennai, India, and However, current mobile translation apps do not meet these immigrants with low English proficiency who live in Seattle, needs.
    [Show full text]