DOCSLIB.ORG

Real Time Implementation of Direction of Arrival Estimation on Android Platforms for Hearing Aid Applications

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Real Time Implementation of Direction of Arrival Estimation on Android Platforms for Hearing Aid Applications REAL TIME IMPLEMENTATION OF DIRECTION OF ARRIVAL ESTIMATION ON ANDROID PLATFORMS FOR HEARING AID APPLICATIONS by Abdullah Küçük APPROVED BY SUPERVISORY COMMITTEE: ___________________________________________ Dr. Issa M. S. Panahi, Chair ___________________________________________ Dr. Carlos Busso ___________________________________________ Dr. Mehrdad Nourani Copyright 2018 Abdullah Küçük All Rights Reserved To my wife, family and every person who had faith in me. REAL TIME IMPLEMENTATION OF DIRECTION OF ARRIVAL ESTIMATION ON ANDROID PLATFORMS FOR HEARING AID APPLICATIONS by Abdullah Küçük, BE THESIS Presented to the Faculty of The University of Texas at Dallas in Partial Fulfillment of the Requirements for the Degree of MASTER OF SCIENCE IN ELECTRICAL ENGINEERING THE UNIVERSITY OF TEXAS AT DALLAS AUGUST 2018 ACKNOWLEDGMENTS This thesis is the result of two years of research regarding speech source localization. I am grateful to finish my thesis thanks to valuable feedback from many people. I am thankful to all who encouraged and trusted my aspirations and endeavors. I would like to express my gratitude to my advisor, Dr. Issa Panahi for giving me the opportunity to work on this project at the Statistical Signal Processing Laboratory (SSPRL) / UT Acoustic Laboratory (UTAL) and for his valuable mentorship and guidance throughout my research. I also am thankful to Dr. Carlos Busso and Dr. Mehrdad Nourani for serving as committee members for my master thesis defense. I would like to thank my lab members for helping my research: Mr. Anshuman (for supervising me on my research topic), Mr. Yiya Hao (for helping me with real-time implementation of the algorithm), Mr. Chandan Reddy (for his help on DSP related doubts), Mr. Gautam Bhat, Mr. Nikhil Shankar, Mr. Parth Mishra, Mr. Serkan Tokgoz, Ms. Ziyan Zou (for useful discussions about our research and empathizing with difficulties of research). I am thankful to my wife, my parents, my parents-in-law, my siblings, my siblings-in-law, and my friends for being understanding and their moral support. Thank you for trusting and encouraging me. This thesis was supported by the National Institute of the Deafness and Other Communication Disorders (NIDCD) of the National Institutes of Health (NIH) under Award 1R01DC015430-01. The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH. April 2018 v REAL TIME IMPLEMENTATION OF DIRECTION OF ARRIVAL ESTIMATION ON ANDROID PLATFORMS FOR HEARING AID APPLICATIONS Abdullah Küçük, MSEE The University of Texas at Dallas, 2018 ABSTRACT Supervising Professor: Dr. Issa M.S. Panahi Sound Source Localization (SSL) is one of the vital areas in signal processing, especially in hearing aid applications. SSL (or Direction of Arrival) helps to determine the location of the speaker via multiple fixed microphones (also known as microphone array). Knowing of speaker Direction of Arrival (DOA) helps to improve the performance of the system. Another advantage of DOA is that it helps hearing-impaired people to locate talker because hearing aid users, especially those who are older than 60 years, have difficulties in determining the place of the speaker. Having requisite processing capabilities and at least two microphones makes smartphones a cost-effective solution for multi-channel audio signal processing. In this thesis, we propose a new stereo input/output framework for Android platforms for audio signal processing. This frame enables us to perform multi or single channel audio signal processing for real-time operations. We also propose a method for two microphones-based Direction of Arrival (DOA) estimation and real-time implementation of this method on the latest Android smartphones. vi TABLE OF CONTENTS ACKNOWLEDGEMENTS .............................................................................................................v ABSTRACT ................................................................................................................................... vi LIST OF FIGURES ....................................................................................................................... ix LIST OF TABLES ......................................................................................................................... xi CHAPTER 1 INTRODUCTION ...................................................................................................1 1.1. Motivation ................................................................................................................1 1.2. Contribution of the thesis .........................................................................................2 1.2.1 Stereo Channel Input and Output Framework for Android Platforms .........2 1.2.2 Speech Source Localization and Tracking ...................................................3 1.2.3 Real Time Implementation of Proposed DOA Estimation Method on Android Smartphone ................................................................................................4 1.3. Outline of the Thesis ................................................................................................5 CHAPTER 2 STEREO CHANNEL INPUT/OUTPUT FRAMEWORK FOR ANDROID PLATFORMS ..................................................................................................................................6 2.1 Motivation ................................................................................................................6 2.2 The Proposed Framework ........................................................................................7 2.2.1 Java Module of the Framework ....................................................................8 2.2.1.1 Graphical User Interface (GUI) .......................................................9 2.2.1.2 Wave Recorder Class .......................................................................9 2.2.1.3 Processing Class.............................................................................11 2.2.1.4 Java Native Interface (JNI) ............................................................11 2.2.2 C/C++ Module of the Framework ..............................................................12 2.2.2.1 Audio Main ....................................................................................13 2.2.2.2 Signal Processing C/C++ Class .....................................................13 2.3 Experiment and Results .........................................................................................14 2.4 Summary ................................................................................................................17 CHAPTER 3 TWO MICROPHONE BASED SPEECH SOURCE LOCALIZATION ..............18 3.1 Motivation ..............................................................................................................18 vii 3.2 Literature Review...................................................................................................19 3.2.1 Direction of Arrival Estimation using GCC ...............................................19 3.2.2 Direction of Arrival Estimation using Frequency Weighted GCC ............21 3.2.3 Direction of Arrival (DOA) Estimation on Smartphone/Tablet ................23 3.3 Proposed DOA Estimation Method .......................................................................25 3.3.1 Pre-Processing Module ..............................................................................25 3.3.2 DOA Estimation Module ...........................................................................28 3.3.3 Post-Processing Module .............................................................................29 3.3.4 Proposed DOA Estimation Method and Sound Source-Tracking ..............30 3.4 Experimental Evaluations ..........................................................................30 3.4.1 Noisy Dataset and Experimental Setup ......................................................30 3.4.2 Evaluation Metrics .....................................................................................33 3.4.3 Results and Discussions .............................................................................34 3.5 Summary ................................................................................................................45 CHAPTER 4 REAL TIME IMPLEMENTATION OF DOA ESTIMATION METHOD ON ANDROID PLATFORMS ............................................................................................................47 4.1 Motivation ..............................................................................................................47 4.2 Shortcomings of Real Time Implementation of SSL on Mobile Platforms...........47 4.3 Real-Time Implementation of Proposed SSL Algorithm ......................................48 4.3.1 DOA Estimation Application Version 1 ....................................................48 4.3.2 DOA Estimation Application Version 2 ....................................................50 4.3.3 DOA Estimation Application Version 3 ....................................................52 4.3.4 DOA Estimation Application Version 4 ....................................................54 4.4 Summary ................................................................................................................59 CHAPTER 5 CONCLUSION ......................................................................................................60 REFERENCES ..............................................................................................................................62
Load more

Recommended publications
  • The Android Animorphs #10 K.A
    THE ANDROID ANIMORPHS #10 K.A. Applegate Page set by Hebi no Me Chapter 1 Chapter 14 Chapter 2 Chapter 15 Chapter 3 Chapter 16 Chapter 4 Chapter 17 Chapter 5 Chapter 18 Chapter 6 Chapter 19 Chapter 7 Chapter 20 Chapter 8 Chapter 21 Chapter 9 Chapter 22 Chapter 10 Chapter 23 Chapter 11 Chapter 24 Chapter 12 Chapter 25 Chapter 13 Chapter 26 CHAPTER 1 My name is Marco. People call me Marco the Magnificent. Marvellous Marco. The Amazing Marco. And of course, all the girls just call me ... gorgeous. Okay, maybe I've never actually heard anyone call me gorgeous, but I am confident that someone, somewhere, must have called me gorgeous at some point. Or not. But definitely cute. I've heard "cute" with my own ears. And I'll soon be hearing it a lot more because I've made a major change. I've cut my hair. Or at least my stylist, Charise, cut it for me. That's right, Charise. And according to Charise, my cuteness quotient has risen from a nine to a definite ten. Anyway, where was I? Oh, yes. I was telling you that my name is Marco. I can't tell you my last name. I forgot it. No, not really, I'm kidding. I know my last name. I'm just not going to tell you. And I'm not going to tell you the complete names of my friends or where I live. What I will tell you is the truth. All except for that part about "magnificent" and "marvelous." Everything else I tell you will be true.
    [Show full text]
  • Customization for Mobile Ebook Readers
    CUSTOMIZATION FOR MOBILE EBOOK READERS _______________ A Thesis Presented to the Faculty of San Diego State University _______________ In Partial Fulfillment of the Requirements for the Degree Master of Science in Computer Science _______________ by Swathi R. Simmula Summer 2013 iii Copyright © 2013 by Swathi R. Simmula All Rights Reserved iv DEDICATION Dedicated to my Sai, Parents and Friends. v I climbed and climbed where is the peak my lord, I ploughed and ploughed where is the knowledge treasure my load, I sailed and sailed where is the island of peace my lord, almighty bless my nation with vision and sweat resulting into happiness -Dr. A. P. J. Kalam vi ABSTRACT OF THE THESIS Customization for Mobile EBook Readers by Swathi R. Simmula Master of Science in Computer Science San Diego State University, 2013 Today’s mobile phone users are often extensively dependent upon applications to accomplish their daily needs. Mobile applications help the users in the following ways: accessing email, navigation, chatting, reading e Books etc. All these purposes are fulfilled only when there is a framework, which provides a complete mobile platform to achieve these tasks. Android is one of the mobile application based platforms for providing a wide range of applications that are reliable. An electronic book (variously, e-book, eBook, digital book, or even e-editions) is a book-length publication in digital form, consisting of text, images, or both, and produced on, published through, and readable on computers, Mobiles or other electronic devices. E-book websites can include the ability to translate books into many different languages, making the works available to speakers of languages not covered by printed translations.
    [Show full text]
  • Holographic Reality Enhancing the Artificial Reality Experience Through Interactive 3D Holography MASTER DISSERTATION
    Holographic Reality Enhancing the artificial reality experience through interactive 3D holography MASTER DISSERTATION Miguel Alexandre Rodrigues Andrade MASTER IN INFORMATICS ENGINEERING December | 2020 Holographic Reality Enhancing the artificial reality experience through interactive 3D holography MASTER DISSERTATION Miguel Alexandre Rodrigues Andrade MASTER IN INFORMATICS ENGINEERING ORIENTATION Marko Radeta CO-ORIENTATION Filipe Magno de Gouveia Quintal Faculty of Exact Sciences and Engineering Master’s in Computer Engineering Holographic Reality: Enhancing the Artificial Reality Experience through Interactive 3D Holography Miguel Andrade supervised by Prof. Dr. Marko Radeta and Prof. Dr. Filipe Quintal April 1, 2021 Abstract Holography was made know by several science-fiction productions, however this technology dates back to the year 1940. Despite the considerable age of this discovery, this technology remains inaccessible to the average consumer. The main goal of this manuscript is to advance the state of the art in interactive holography, providing an accessible and low-cost solution. The final product intends to nudge the HCI com- munity to explore potential applications, in particular to be aquatic centric and environmentally friendly. Two main user studies are performed, in order to determine the impact of the proposed solution by a sample audience. Provided user studies include a first prototype as a Tangible User Interface - TUI for Holographic Reality - HR Second study included the Holographic Mounted Display - HMD for proposed HR interface, further analyzing the interactive holographic experience without hand-held devices. Both of these studies were further compared with an Augmented Reality setting. Obtained results demonstrate a significantly higher score for the HMD approach. This suggests it is the better solution, most likely due to the added simplicity and immersiveness features it has.
    [Show full text]
  • 124214015 Full.Pdf
    PLAGIAT MERUPAKAN TINDAKAN TIDAK TERPUJI DEFENSE MECHANISM ADOPTED BY THE PROTAGONISTS AGAINST THE TERROR OF DEATH IN K.A APPLEGATE’S ANIMORPHS AN UNDERGRADUATE THESIS Presented as Partial Fulfillment of the Requirements for the Degree of Sarjana Sastra in English Letters By MIKAEL ARI WIBISONO Student Number: 124214015 ENGLISH LETTERS STUDY PROGRAM DEPARTMENT OF ENGLISH LETTERS FACULTY OF LETTERS SANATA DHARMA UNIVERSITY YOGYAKARTA 2016 PLAGIAT MERUPAKAN TINDAKAN TIDAK TERPUJI DEFENSE MECHANISM ADOPTED BY THE PROTAGONISTS AGAINST THE TERROR OF DEATH IN K.A APPLEGATE’S ANIMORPHS AN UNDERGRADUATE THESIS Presented as Partial Fulfillment of the Requirements for the Degree of Sarjana Sastra in English Letters By MIKAEL ARI WIBISONO Student Number: 124214015 ENGLISH LETTERS STUDY PROGRAM DEPARTMENT OF ENGLISH LETTERS FACULTY OF LETTERS SANATA DHARMA UNIVERSITY YOGYAKARTA 2016 ii PLAGIAT MERUPAKAN TINDAKAN TIDAK TERPUJI PLAGIAT MERUPAKAN TINDAKAN TIDAK TERPUJI A SarjanaSastra Undergraduate Thesis DEFENSE MECIIAMSM ADOPTED BY TITE AGAINST PROTAGOMSTS THE TERROR OT OTATTT IN K.A APPLEGATE'S AAUMORPHS By Mikael Ari Wibisono Student Number: lz4ll4}ls Defended before the Board of Examiners On August 25,2A16 and Declared Acceptable BOARD OF EXAMINERS Name Chairperson Dr. F.X. Siswadi, M.A. Secretary Dra. Sri Mulyani, M.A., ph.D / Member I Dr. F.X. Siswadi, M.A. Member2 Drs. HirmawanW[ianarkq M.Hum. Member 3 Elisa DwiWardani, S.S., M.Hum Yogyakarta, August 31 z}rc Faculty of Letters fr'.arrr s41 Dharma University s" -_# 1,ffi QG*l(tls srst*\. \ tQrtnR<{l
    [Show full text]
  • The Android and the Human" (N.P.), (N.D.)
    Ken Lopez, Bookseller Catalog . DICK, Philip K. "The Android and the Human" (n.p.), (n.d.). First. Original manuscript for a speech given by Dick at the Vancouver SF Convention at the University of British Columbia, in March 1972. 42 ribbon-copy typewritten pages, with corrections and emendations throughout in Dick's hand. The speech was later published in SF Commentary in December, 1972 and then reprinted in Vector in March-April 1973. In a letter that accompanied its publication in SF Commentary, Dick wrote that "this speech [tried]... to sum up an entire lifetime of developing thought." He concluded that it contained, "I hope, the seed for my novels to come." An important piece of writing, which anticipated the themes and concerns of the novels of Dick's last decade. Manuscript material by Dick is very scarce, particularly of such significant content. The Android and The Human Philip K. Dick, 1972 It is the tendency of the so-called primitive mind to animate its environment. Modern depth psychology has requested us for years to withdraw these anthropomorphic projections from what is actually inanimate reality, to introject -- that is, to bring back into our own heads -- the living quality which we, in ignorance, cast out onto the inert things surrounding us. Such introjection is said to be the mark of true maturity in the individual, and the authentic mark of civilization in contrast to mere social culture, such as one find in a tribe. A native of Africa is said to view his surroundings as pulsing with a purpose, a life, which is actually within himself; once these childish projections are withdrawn, he sees that the world is dead, and that life resides solely within himself.
    [Show full text]
  • Species Panic Human Continuums, Trans Andys, and Cyberotic Triangles in Do Androids Dream of Electric Sheep?
    TSQ: Transgender Studies Quarterly Species Panic Human Continuums, Trans Andys, and Cyberotic Triangles in Do Androids Dream of Electric Sheep? DAVID HUEBERT Abstract Elaborating a concept of “species panic” and its intrinsic relation to interspecies desire, this article couples the concerns of animal studies and posthumanism with those of queer and transgender theory, synthesizing these positions through their shared commitment to unstable frameworks of gender, sexuality, and embodied identity. It argues that humans, androids, and electric and “genuine” animals do not exist in isolation in Philip K. Dick’s 1968 novel Do Androids Dream of Electric Sheep? On the contrary, they occupy shifting positions on a series of spectrums, where human, animal, and machine bleed into one another. If one accepts the novel’s invitation to think the androids as a species, the plot of Do Androids Dream becomes a dramatization of interspecies desire. After arguing that interspecies desire is, in multiple senses, queer and that Dick’s androids serve as exemplars of trans embodiment and offer models for reconceiving bodily existence, the author concludes that Dick’s portrayal of species-transgressive sexual explorations is not a priori radical. Keywords queer theory, interspecies desire, science fiction, erotic triangles, bestiality acques Derrida begins The Animal That Therefore I Am (2008) with a medi- J tation on what it might mean for a human and a cat to confront each other’s nakedness. The encounter is latently erotic and overtly panicked: a man stands naked in front of a cat, wondering about his potential “perversity” and feeling “a shame that is ashamed of itself” (7, 9).
    [Show full text]
  • A Comparison Study of AR Applications Versus Pseudo-Holographic
    Multimedia Systems https://doi.org/10.1007/s00530-019-00606-y REGULAR PAPER A comparison study of AR applications versus pseudo‑holographic systems as virtual exhibitors for luxury watch retail stores Pedro Morillo1 · Juan M. Orduña2 · Sergio Casas1 · Marcos Fernández1 Received: 29 December 2017 / Accepted: 19 February 2019 © Springer-Verlag GmbH Germany, part of Springer Nature 2019 Abstract The market of luxury watches has been continuously growing across the world, regardless of economic crisis. However, consumers can purchase online, on the web pages of the luxury watchmakers, the same product they can acquire in physi- cal retail stores, producing a significant reduction in the overall sales of the latter ones. To reduce this trend, retail stores should increase their added-value services, one of which could be the use of virtual exhibitors in the shop. In this paper, we have developed two multimedia solutions (an Augmented Reality application and a pseudo-holographic system) for the creation of virtual exhibitors, and we have carried out a comparative study (based on real users) to measure which system would produce the best impact on users when used in traditional luxury watch retail stores. Our primary hypothesis was that there would be significant differences between the use of the mobile AR application and the use of the pseudo-holographic system. Our secondary hypothesis was that user preference for the mobile AR application would be higher than for the pseudo-holographic system. Keywords AR applications · Pseudo-holographic systems · Performance evaluation 1 Introduction and expectations [28]. Just in the market of personal luxury goods, the billing from the online selling is expected to reach The market of luxury goods and services has been continu- 74 billion Euros, corresponding to 20% of the total sales ously growing across the world, regardless of economic cri- volume across the world [2, 15].
    [Show full text]
  • Shelf List Cosmopolis School Call Numbers from 'Fiction' to 'Fiction'
    Shelf List Cosmopolis School Call numbers from 'fiction' to 'fiction'. All circulations. Call Number Author Title Barcode Price Status Circs FICTION AMAZING MOTORCYCLES/AWESOME ATV'S. T 22850 $5.99 Available 5 fiction the Angel Tree T 23060 $5.99 Available 1 Fiction Baby Shark T 24159 $4.99 Available 3 Fiction Beauty and the Beast T 23472 $6.99 Available 7 Fiction Boo! A Book of Spooky Surprises. T 23254 $7.99 Available 6 fiction The Book Thief T 23089 $12.99 Available 1 Fiction Boy Tales of Choldhood T 23757 $5.99 Available 1 Fiction Cam Jansen and the birthday Mystery. T 561 Checked Out 1 Fiction Cat and mouse in a haunted house. T 18404 $5.99 Available 19 fiction chester the brave T 22833 Available 2 Fiction The Christmas toy factory. T 18409 $5.99 Available 29 Fiction Command Blocks T 23582 $7.99 Available 4 fiction Deep Blue T 23041 Available 9 Fiction Diary of Wimpy Kid: The Long Haul T 23350 $8.99 Available 20 fiction The Dirt Diary T 23975 $6.99 Available 9 Fiction Dive : Book Three: The Danger. T 8552 $4.50 Available 4 FICTION DOG WHISPERER, THE GHOST. T 22763 $4.99 Available 1 Fiction Doll Bones T 23976 $5.99 Available 12 Fiction Dolphin Tale 2: A Tale of Winter and Hope. T 23211 $3.99 Available 6 fiction Dragon Rider T 21240 Available 8 Fiction Eerie Elementary, The School is Alive T 23059 $4.99 Available 3 Fiction Esme The Emerald Fairy T 23539 $5.99 Available 4 Fiction Everest : Book Two: Tahe Summit.
    [Show full text]
  • Android™ Hacker's Handbook
    ffi rs.indd 01:50:14:PM 02/28/2014 Page ii Android™ Hacker’s Handbook ffi rs.indd 01:50:14:PM 02/28/2014 Page i ffi rs.indd 01:50:14:PM 02/28/2014 Page ii Android™ Hacker’s Handbook Joshua J. Drake Pau Oliva Fora Zach Lanier Collin Mulliner Stephen A. Ridley Georg Wicherski ffi rs.indd 01:50:14:PM 02/28/2014 Page iii Android™ Hacker’s Handbook Published by John Wiley & Sons, Inc. 10475 Crosspoint Boulevard Indianapolis, IN 46256 www.wiley.com Copyright © 2014 by John Wiley & Sons, Inc., Indianapolis, Indiana ISBN: 978-1-118-60864-7 ISBN: 978-1-118-60861-6 (ebk) ISBN: 978-1-118-92225-5 (ebk) Manufactured in the United States of America 10 9 8 7 6 5 4 3 2 1 No part of this publication may be reproduced, stored in a retrieval system or transmitted in any form or by any means, electronic, mechanical, photocopying, recording, scanning or otherwise, except as permitted under Sections 107 or 108 of the 1976 United States Copyright Act, without either the prior written permission of the Publisher, or autho- rization through payment of the appropriate per-copy fee to the Copyright Clearance Center, 222 Rosewood Drive, Danvers, MA 01923, (978) 750-8400, fax (978) 646-8600. Requests to the Publisher for permission should be addressed to the Permissions Department, John Wiley & Sons, Inc., 111 River Street, Hoboken, NJ 07030, (201) 748-6011, fax (201) 748-6008, or online at http://www.wiley.com/go/permissions. Limit of Liability/Disclaimer of Warranty: The publisher and the author make no representations or warranties with respect to the accuracy or completeness of the contents of this work and specifi cally disclaim all warranties, including without limitation warranties of fi tness for a particular purpose.
    [Show full text]
  • Entering the Posthuman Collective in Philip K. Dick's "Do
    SF-TH Inc Entering the Posthuman Collective in Philip K. Dick's "Do Androids Dream of Electric Sheep?" Author(s): Jill Galvan Reviewed work(s): Source: Science Fiction Studies, Vol. 24, No. 3 (Nov., 1997), pp. 413-429 Published by: SF-TH Inc Stable URL: http://www.jstor.org/stable/4240644 . Accessed: 19/08/2012 23:13 Your use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at . http://www.jstor.org/page/info/about/policies/terms.jsp . JSTOR is a not-for-profit service that helps scholars, researchers, and students discover, use, and build upon a wide range of content in a trusted digital archive. We use information technology and tools to increase productivity and facilitate new forms of scholarship. For more information about JSTOR, please contact [email protected]. SF-TH Inc is collaborating with JSTOR to digitize, preserve and extend access to Science Fiction Studies. http://www.jstor.org ENTERING THE POST-HUMAN COLLECTIVE 413 Jill Galvan Entering the Posthuman Collective in Philip K. Dick's Do AndroidsDream of ElectricSheep? "The morning air, spilling over with radioactivemotes, gray and sun-becloud- ing, belched about him, hauntinghis nose; he sniffed involuntarilythe taint of death."1 Such is the atmospherethat assails Rick Deckard, protagonistbounty hunter of Philip K. Dick's Do AndroidsDream of Electric Sheep?, as he sets out upon his most lucrative-yet final-day in the business. Insidious, strange- ly menacing, the air Rick breathesconfronts him with the perils of his world, a world increasingly transformedby nuclear fallout and the forces of entropy.
    [Show full text]
  • PVT -Touch: Adapting a Reaction Time Test for Touchscreen Devices
    2013 7th International Conference on Pervasive Computing Technologies for Healthcare and Workshops PVT -Touch: Adapting a Reaction Time Test for Touchscreen Devices Matthew Kay: Ky Ie Rector: Sunny Consolvo·� Ben Greenstein: Jacob 0.Wobbrock ! Nathaniel F. Watson� Julie A. Kientz'll ' i § f Computer Science & Engineering, 1nformation School, Neurology, 1Human-Centered Design & Engineering DUB Group, University of Washington Seattle, WA {mjskay, rectorky}@uw.edu, {sunnyin seattle, bengreenstein}@gmail.com, {wobbrock, nwatson, jkientz}@uw.edu Abstract-The Psychomotor Vigilance Task (PVT) is a vali­ dated reaction time (RT) test used to assess aspects of sleep loss including alertness and sleepiness. PVT typically requires a phys­ ical button to assess RT, which minimizes the effect of execution time (the time taken to perform a gesture) on RT. When translat­ ing this application to mobile devices, a touchscreen version is useful for widespread in situ sleepiness assessments to produce more ecologically valid data. We describe the Android-based implementation of a touchscreen version of PVT, called PVT ­ Touch. In an evaluation (N=20), we compared four different touchscreen input techniques to a physical button: touch down, finger lift,finger tilt, and goal crossing. We found that touch down was comparable to the physical button approach used in tradi­ tional PVT in execution time and in several measures associated Fig. I. PVT-Touch running on an Android phone,with stimulus visible. The with sleepiness, and was preferred by most participants. We also checkerboard pattern provides a high-contrast,obvious signal to participants. found that finger lift may be a more precise but less intuitive measure, which may warrant further study.
    [Show full text]
  • Futuristic Reflection on the Aftermath of Humanity: Pluto, a Graphic Novel
    Futuristic Reflection on the Aftermath of Humanity: Pluto, a Graphic Novel Jungman Park, Hankuk University of Foreign Studies, South Korea The Asian Conference on Arts and Humanities 2019 Official Conference Proceedings Abstract Urasawa Naoki’s graphic novel Pluto (2003-2009), set in a virtual post-human world in which human and robots neighbor each other, raises questions about humanity, both ontological and epistemological. Pluto is based on and adapted from legendary Japanese cartoonist Osamu Tezuka’s manga Astro Boy series. In Pluto, 5 out of 7 ‘greatest robots on earth’ are killed consecutively by ‘Pluto’ a mysterious robot villain. Gesicht, android robot detective and protagonist, tracks the murder case. The story attempts a critical reflection on the human and humanity through the life of artificial intelligence robots. Pluto tells about the end of humanity through the story in which the greatest robots on planet are being destroyed. A comforting point is that Pluto never gives up hope for humanity. Just as God leaves Noah and re-flourishes mankind in the face of peril, Pluto presents optimistic expectation on human existence and future through the existence of android robot detective Gesicht. Gesicht and Atom, the last two remaining greatest robots, are eventually killed by Pluto. After the death of Gesicht, his memory chip is used to awaken Atom, and the last moment of Gesicht right before the destruction is implanted into the memories of Atom. It was his words of “Nothing comes from hatred” and the human emotion of love and forgiveness. The existence of Gesicht tells that artificial intelligence has already evolved into a new humanity who is superior to human beings physically and ethically, and consequently post-human age has begun.
    [Show full text]