DOCSLIB.ORG

Robot-Based Haptic Perception and Telepresence for the Visually Impaired

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Robot-Based Haptic Perception and Telepresence for the Visually Impaired ROBOT-BASED HAPTIC PERCEPTION AND TELEPRESENCE FOR THE VISUALLY IMPAIRED A Thesis Presented to The Academic Faculty by Chung Hyuk Park In Partial Fulfillment of the Requirements for the Degree Doctor of Philosophy in the School of Electrical and Computer Engineering Georgia Institute of Technology August 2012 ROBOT-BASED HAPTIC PERCEPTION AND TELEPRESENCE FOR THE VISUALLY IMPAIRED Approved by: Professor Ayanna M. Howard, Advisor Professor Magnus Egerstedt School of Electrical and Computer School of Electrical and Computer Engineering Engineering Georgia Institute of Technology Georgia Institute of Technology Professor Anthony Yezzi Professor Wayne Book School of Electrical and Computer School of Mechanical Engineering Engineering Georgia Institute of Technology Georgia Institute of Technology Professor Maysam Ghovanloo Date Approved: June 13, 2012 School of Electrical and Computer Engineering Georgia Institute of Technology DEDICATION For my parents, my wife, and my son, who have filled my life with love, happiness, and inspiration. iii ACKNOWLEDGEMENTS This work was supported in part by the National Science Foundation under Grant No. 0940146. I would like to express my gratitude to my advisor, Dr. Ayanna Howard, for her guidance and advisement, the National Federation for the Blind and the Center for the Visually Impaired in Atlanta, for participation and support for my experiments, and Rayshun Dorsey of WizKids Science and Technology Center for managing the camp and logistics. I would also like to acknowledge each member of the Human Automation Systems (HumAnS) Lab. for their continued support and sharing of insights regarding the approaches presented here. iv TABLE OF CONTENTS DEDICATION ................................... iii ACKNOWLEDGEMENTS ............................ iv LIST OF TABLES................................. viii LIST OF FIGURES ................................ ix SUMMARY..................................... xiii I INTRODUCTION.............................. 1 1.1 Visual Impairments . .4 1.2 Assistive Technology for the Visually Impaired . .5 1.3 Assistive Robots for the Visually Impaired . .8 1.4 Haptic Modality for Assisting the Visually Impaired . 11 1.4.1 Haptic Interfaces . 12 1.4.2 Haptic-Based Research for Assisting the Visually Impaired . 14 II HAPTICS FOR NON-VISUAL ENVIRONMENTAL FEEDBACK . 17 2.1 System Overview . 18 2.1.1 Feedback Primitives . 18 2.1.2 Communication and System Architecture . 20 2.2 Multi-Modal Feedback Design . 21 2.2.1 Feedback Description . 21 2.3 Application of Multi-modal Feedback for Students with Visual Im- pairments . 25 2.4 Experiment Design . 28 2.5 Results . 29 2.5.1 User Responses . 31 2.5.2 Multi-Modal Perception Results . 32 2.5.3 Learning Performance Results . 33 2.6 Conclusion . 36 v III HAPTIC EXPLORATION FROM ROBOTIC VISION.......... 38 3.1 System Overview . 39 3.1.1 Human Interface . 39 3.1.2 Robotic System . 40 3.1.3 System Controller . 42 3.2 Stereo Vision Processes . 46 3.2.1 Stereo Vision for Large-scale Perception . 47 3.2.2 Mono-stereo for Proximity Perception . 48 3.2.3 Post-processing of Disparity Images . 49 3.2.3.1 Ground Detection . 50 3.2.3.2 Histogram-based Mixed-scale Disparity Map . 50 3.2.3.3 Separation of Foreground Objects and Background 51 3.3 3D Map Building . 55 3.4 Haptic Rendering from Vision-based Robotic Perception . 56 3.4.1 Haptic 3D-Rendering Algorithm . 58 3.4.2 Haptic Interaction with Robotic Sensor Data . 59 3.5 Results . 61 3.5.1 Stereo Process Results . 63 3.5.2 Mono-Stereo Process Results . 63 3.5.3 Human Subject Results with Haptic Rendering . 66 3.6 Conclusions . 67 IV HAPTIC TELEPRESENCE AND MULTI-MODAL INTERACTION . 70 4.1 System Architecture for a Telepresence Robotic System . 71 4.2 System Blocks and Functional Modules . 73 4.2.1 Handling of the Information Flow from the RGB-D Sensor . 73 4.2.2 Handling of the Sensory Limitations of the RGB-D Sensor . 74 4.2.3 Multi-modal Feedback for Tele-perception . 75 4.2.3.1 Haptic Feedback . 76 vi 4.2.3.2 Auditory Feedback . 77 4.2.4 Finite State Machine . 78 4.3 Experimental Setup . 84 4.4 Results . 86 4.4.1 User Performance for Task Completion . 86 4.4.2 Control Load for the User . 88 4.4.3 Robot Trajectory . 88 4.4.4 Questionnaire Results . 91 4.5 Conclusion . 93 V HAPTIC SKILL-TRANSFER........................ 95 5.1 Background . 96 5.2 Algorithms . 97 5.2.1 Neural Network Learning Module . 98 5.2.2 SVM Learning Module . 99 5.2.3 Haptic Guidance . 100 5.3 Experimental Setup . 101 5.4 Results . 102 5.5 Analysis of Haptic Skill Transfer . 108 5.6 Conclusion . 111 VI CONCLUSION................................ 112 6.1 Key Contributions . 113 6.1.1 Haptics for Non-visual Environmental Feedback . 113 6.1.2 Haptic Exploration from Robotic Vision . 114 6.1.3 Haptic Telepresence and Multi-modal Interaction . 115 6.1.4 Haptic Skill-Transfer . 116 6.2 Future Work . 116 REFERENCES................................... 118 vii LIST OF TABLES 1 Population of VI among age groups in U.S.A. .5 2 Post-session Survey Results for Questions 1 and 2 . 31 3 Processing time and RMSE value of depth error for image pairs in Figure 45 . 63 4 Processing time and RMSE value of depth error for image pairs in Figure 46 . 65 5 Results of haptic object-recognition experiment with subjects without VI after mono-stereo process . 67 6 Results of haptic object-recognition experiment with subjects with VI after mono-stereo process . 67 7 Confusion matrix of subjects without VI in identifying objects with haptic exploration . 68 8 Confusion matrix of subjects with VI in identifying objects with haptic exploration . 68 9 List of color names differentiable with verbal feedback. 78 10 List of States for our Telepresence System. 81 11 List of Events for our Telepresence System. 82 12 List of Sub-states (Robot) for our Telepresence System. 83 13 List of Sub-states (Haptic source) for our Telepresence System. 83 14 Success rates of human subjects in Scenario 1 & 3 . 87 15 List of color names differentiable with verbal feedback. 91 16 Data compression ratio of ANN and SVM over 3 datasets (UNIT=KB).108 17 Training time for ANN and SVM over 3 datasets (UNIT=sec). 109 18 LCS results for ANN and SVM. 111 viii LIST OF FIGURES 1 Snellen chart. .4 2 Population of VI among age groups in U.S.A. .5 3 Traditional aids for VI. .6 4 Examples of modern assistive devices. .7 5 GuideCane: a mobile robotic system for navigational aid for VI [85]. .9 6 RoboCart [42]. 10 7 Haptic vest for assisting a blind driver [30]. 10 8 V-Go telepresence robot. 12 9 Haptic force primitives. 13 10 Common haptic interfaces. 14 11 Advanced haptic interfaces. 15 12 LEGO MindstormTM NXT robot. 18 13 System Architecture and Communication Flow . 21 14 Feedback signals for NXT robot traveling forward: (a) Haptic feedback and (b) auditory feedback. 22 15 Feedback signals for NXT robot turning left/right: (a,b) Haptic feed- back and (c,d) auditory feedback. 24 16 Feedback signals for NXT robot sensing an obstacle in front: (a) Haptic feedback and (b) auditory feedback. 25 17 Feedback signals when NXT robot bumped into a wall or an obstacle: (a) Haptic feedback and (b) auditory feedback. 26 18 Feedback signals when NXT robot reached a goal: (a) Haptic feedback and (b) auditory feedback. 27 19 Programming and testing a robot in camps for students with visual impairments. (a) Testing with direct tactile sensing, and (b) testing with multi-modal feedback (Wiimotes are marked with circles). 27 20 Two mazes used throughout the camp to test the students' program- ming skills and the multi-modal feedback system. 31 21 DTW result of Group 1 in Maze #2 with both haptic and auditory feedback . 33 ix 22 DTW result of Group 2 in Maze #1 with only haptic feedback . 34 23 Boxplot of DTW for Maze #1 . 34 24 Boxplot of DTW for Maze #2 . 35 25 Learning curve for Maze #1. 35 26 Learning curve for Maze #2. 36 27 Learning rate. 36 28 Basic architecture of the HEMM system. 40 29 Human interface for HEMM system. 41 30 Haptic exploratory mobile manipulation (HEMM) system. 41 31 Workspace configurations in a HEMM system. 43 32 Joint configuration of the Pioneer Arm [41]. 44 33 D-H parameters for the Pioneer Arm. 44 34 Several results of stereo disparity-generation algorithms. 46 35 Ground estimation process on hue/saturation/value (HSV) channels using a statistical-region-merging algorithm. (a) Hue channel image of an indoor scene, (b) saturation channel image of the scene, (c) value channel image of the image, (d){(f) Results SRM process on corre- sponging (a){(c) images, (g) final ground estimation from (d){(f). 51 36 Stereo perception process. 52 37 Flow-chart of 3D perception through the mono-stereo process with foreground/background separation. 53 38 Example of the mono-stereo process. ..
Load more

Recommended publications
  • Effect of Interference on Multi-Sensory Haptic Perception of Stretch and Squeeze
    Effect of Interference on Multi-Sensory Haptic Perception of Stretch and Squeeze Zane A. Zook, Joshua J. Fleck, Tiffani W. Tjandra, and Marcia K. O’Malley Abstract— Multi-sensory haptic systems have the potential of an actuated band that tightens around the arm causing to transfer a wide variety of information to a human user squeeze and twist sensations [9], [10], [11]. Stretch and by delivering multiple types of haptic cues simultaneously. pressure based devices have been successfully used for However, these systems may cause undesirable perceptual interference, which has already been observed in wearable emotional indicators in digital communication [12] and to systems that simultaneously convey skin stretch and squeeze provide directional information [13]. The third category of cues. To investigate this observed perceptual interference, we wearable haptic feedback, vibration, has been used to convey conducted a psychophysical evaluation of the just-noticeable a variety of meaningful information, including grasping force difference (JND) in skin stretch and squeeze cue magnitudes [13], deviation from a postural set point [14], [15], object independently as well as in the presence of an interfering cue. A haptic testbed delivered each cue to a user’s proximal forearm. slip [16], real-time quality of task performance [17], and First, the JNDs of the two haptic cues were each measured navigational cues [18]. alone. Then, the cues were delivered simultaneously and the Prior work with these feedback modalities has focused on JND values for stretch with squeeze interference and squeeze identifying the most natural or intuitive forms of feedback with stretch interference were measured. We found that the JND for the stretch cue increased with the addition of an for a specific application.
    [Show full text]
  • Multisensory Congruence and Its Effect on the Aesthetic Experience<Link
    Available online at www.sciencedirect.com Journal of CONSUMER PSYCHOLOGY Journal of Consumer Psychology 20 (2010) 410–418 Feminine to smell but masculine to touch? Multisensory congruence and its effect on the aesthetic experience☆ ⁎ Aradhna Krishna a, , Ryan S. Elder b, Cindy Caldara c a Dwight F. Benton of Marketing, University of Michigan, Ann Arbor, MI, USA b University of Michigan, Ann Arbor, MI, USA c University of Grenoble, Grenoble, France Received 9 June 2010; revised 22 June 2010; accepted 29 June 2010 Available online 7 August 2010 Abstract We draw upon literature examining cross-modal sensory interactions and congruence to explore the impact of smell on touch. In line with our predictions, two experiments show that smell can impact touch in meaningful ways. Specifically, we show that multisensory semantic congruence between smell and touch properties of a stimulus enhances haptic perception and product evaluation. We explore this relationship in the context of two properties of touch, namely texture and temperature, and demonstrate that both smell and touch can have semantic associations, which can affect haptic perception and product evaluation depending on whether they match or not. In study 1, we focus on the semantic association of smell and touch (texture) with gender and in study 2 with temperature. Our results extend prior work on smell and touch within consumer behavior, and further contribute to emerging literature on multisensory interactions. Published by Elsevier Inc. on behalf of Society for Consumer Psychology. Keywords: Sensory aesthetics; Sensory perception; Semantic congruence; Smell; Touch Full appreciation of an aesthetic product experience comes emotions, and judgments (Berlyne, 1974).
    [Show full text]
  • Cognitive Functions of the Brain: Perception, Attention and Memory
    IFM LAB TUTORIAL SERIES # 6, COPYRIGHT c IFM LAB Cognitive Functions of the Brain: Perception, Attention and Memory Jiawei Zhang [email protected] Founder and Director Information Fusion and Mining Laboratory (First Version: May 2019; Revision: May 2019.) Abstract This is a follow-up tutorial article of [17] and [16], in this paper, we will introduce several important cognitive functions of the brain. Brain cognitive functions are the mental processes that allow us to receive, select, store, transform, develop, and recover information that we've received from external stimuli. This process allows us to understand and to relate to the world more effectively. Cognitive functions are brain-based skills we need to carry out any task from the simplest to the most complex. They are related with the mechanisms of how we learn, remember, problem-solve, and pay attention, etc. To be more specific, in this paper, we will talk about the perception, attention and memory functions of the human brain. Several other brain cognitive functions, e.g., arousal, decision making, natural language, motor coordination, planning, problem solving and thinking, will be added to this paper in the later versions, respectively. Many of the materials used in this paper are from wikipedia and several other neuroscience introductory articles, which will be properly cited in this paper. This is the last of the three tutorial articles about the brain. The readers are suggested to read this paper after the previous two tutorial articles on brain structure and functions [17] as well as the brain basic neural units [16]. Keywords: The Brain; Cognitive Function; Consciousness; Attention; Learning; Memory Contents 1 Introduction 2 2 Perception 3 2.1 Detailed Process of Perception .
    [Show full text]
  • An Examination of Piaget's Stages of Haptic Perception in Young Children
    DOCUMENT RESUME ED 097 109 PS 007 427 AUTHOR Harper, Ruth Valerie TITLE An Examination of Piagetos Stages of Haptic Perception in !ming Children. PUB DATE (73] NOTE 32p.; Master's Thesis, University of Illinois at Urbana-Champaign, 1973 EDRS PRICE HIP-$0.75 HC-$1.85 PLUS POSTAGE DESCRIPTORS Age Differences; *Developmental Psychology; *Haptic Perception; Imagination; *Kindergarten Children; Literature Reviews; Maturation; *Memory; Object Manipulation; *Preschool Children; Sensory Experience; Sex Differences; Tables (Data); Verbal Stimuli IDENTIFIERS Euclidean Objects; Familiar Objects; *Piaget (Jean); Topological Objects ABSTRACT This paper examines the developmental stages of haptic perception (the process of recognizing objects by the senseof touch alone), and attempts to clarify some conflicting resultsof studies of the effects of memory and object type. The paper also presents a specific study of haptic perceptionin 144 preschool and kindergarten children from various socioeconomic levels. Thechildren were randomly assigned to two memoryconditions and one of three object groups (Familiar, topological, or Euclidean).Training stimuli for the experiment consisted of two sets of three familiarobjects. Each child played a "Can you find it?" game in attempting to recognize and choose a standard object that had previously been presented. Test stimuli were three sets of plastic objects corresponding to the three object groups under examination. Procedures were similar to those used in trainingwith one modification in timing to determine the effect of memory. Results provided partial support for Piaget's theory of hapticperception. Data was analyzed to determine the effects of age,object type, difficulty level, sex, and memory on the development of haptic perception.(SDH) A U $ DEPARTMENT OP HEALTH.
    [Show full text]
  • Cognitive Functions of the Brain: Perception, Attention and Memory
    IFM LAB TUTORIAL SERIES # 6, COPYRIGHT c IFM LAB Cognitive Functions of the Brain: Perception, Attention and Memory Jiawei Zhang [email protected] Founder and Director Information Fusion and Mining Laboratory (First Version: May 2019; Revision: May 2019.) Abstract This is a follow-up tutorial article of [17] and [16], in this paper, we will introduce several important cognitive functions of the brain. Brain cognitive functions are the mental processes that allow us to receive, select, store, transform, develop, and recover information that we've received from external stimuli. This process allows us to understand and to relate to the world more effectively. Cognitive functions are brain-based skills we need to carry out any task from the simplest to the most complex. They are related with the mechanisms of how we learn, remember, problem-solve, and pay attention, etc. To be more specific, in this paper, we will talk about the perception, attention and memory functions of the human brain. Several other brain cognitive functions, e.g., arousal, decision making, natural language, motor coordination, planning, problem solving and thinking, will be added to this paper in the later versions, respectively. Many of the materials used in this paper are from wikipedia and several other neuroscience introductory articles, which will be properly cited in this paper. This is the last of the three tutorial articles about the brain. The readers are suggested to read this paper after the previous two tutorial articles on brain structure and functions [17] as well as the brain basic neural units [16]. Keywords: The Brain; Cognitive Function; Consciousness; Attention; Learning; Memory Contents 1 Introduction 2 2 Perception 3 2.1 Detailed Process of Perception .
    [Show full text]
  • Memory Influences Haptic Perception of Softness
    www.nature.com/scientificreports OPEN Memory infuences haptic perception of softness Anna Metzger & Knut Drewing The memory of an object’s property (e.g. its typical colour) can afect its visual perception. We Received: 5 June 2017 investigated whether memory of the softness of every-day objects infuences their haptic perception. Accepted: 20 September 2019 We produced bipartite silicone rubber stimuli: one half of the stimuli was covered with a layer of an Published: xx xx xxxx object (sponge, wood, tennis ball, foam ball); the other half was uncovered silicone. Participants were not aware of the partition. They frst used their bare fnger to stroke laterally over the covering layer to recognize the well-known object and then indented the other half of the stimulus with a probe to compare its softness to that of an uncovered silicone stimulus. Across four experiments with diferent methods we showed that silicon stimuli covered with a layer of rather hard objects (tennis ball and wood) were perceived harder than the same silicon stimuli when being covered with a layer of rather soft objects (sponge and foam ball), indicating that haptic perception of softness is afected by memory. Our perception of the environment is not solely determined by its physical properties but can be partially mod- ulated top-down. Such top-down infuences are multiple and of various kinds, for instance we can voluntary change the sensory input by moving our sensors to relevant object locations1 or move them optimally to extract relevant object properties2, deploy our attention to relevant locations3 or features of an object4 or disambiguate an ambiguous fgure by expecting a certain object (for a review on top-down infuences see Gilbert & Li, 20135).
    [Show full text]
  • Corporeal Experience: a Haptic Way of Knowing
    Corporeal Experience: A Haptic Way of Knowing MÁIRE EITHNE O’NEILL, Montana State University, Bozeman Contemporary architectural discourse suggests we consider the influence of place-form and the capacity of the body to read the environment in a variety of senses on our understanding of space. This article discusses lit- terms other than those of sight alone suggest a potential strategy for erature that explores the character and significance of spatial perceptions 2 gained by movement, touch, and other sensibilities, which are known as hap- resisting the domination of universal technology.” tic senses. Case studies of ranchers in rural Montana investigated how The interpretive effort in critical regionalism—as in other people accumulated their place-based experiences. This population demon- forms of contextual design—may be limited in scope if the ten- strated a strong tendency to rely on geographic contact and movement in space to inform them about the places in which they lived and worked. The dency of the designer is to place singular emphasis on the visual article concludes by discussing the implications of considering haptic sensi- character of existing settings. What gets in the way of new thought bilities in design education. is the guiding assumption that the inherent identity of a place can be identified by only visible formal elements, and that a particular visual interpretation of place identity is largely shared by inhabit- Introduction ants.3 If we accept the notion of critical regionalism we must seri- ously consider aspects of experience in space that are nonvisual. It has been twenty-three years since the publication of Body, In Chambers for a Memory Palace (1994), Donlyn Lyndon and Memory, and Architecture (1977), in which Kent Bloomer and Charles Moore base a series of spatial themes on observations of char- Charles Moore proposed that as architects we have overlooked a acteristic experiences that various places make possible.
    [Show full text]
  • The Development of Haptic Processing Skills from Childhood to Adulthood by Means of Two-Dimensional Materials
    The development of haptic processing skills from childhood to adulthood by means of two-dimensional materials. Anaïs Mazella, Jean-Michel Albaret, Delphine Picard To cite this version: Anaïs Mazella, Jean-Michel Albaret, Delphine Picard. The development of haptic processing skills from childhood to adulthood by means of two-dimensional materials.. Canadian Journal of Experimen- tal Psychology, Canadian Psychological Association, 2018, 72 (1), pp.48 - 57. 10.1037/cep0000121. hal-01768582 HAL Id: hal-01768582 https://hal-amu.archives-ouvertes.fr/hal-01768582 Submitted on 25 Apr 2018 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. The Development of Haptic Processing Skills from Childhood to Adulthood by means of Two-Dimensional Materials A Mazella, J-M Albaret, D. Picard Abstract Research into haptic perception has mostly focused on three-dimensional (3D) objects, and more needs to be known about the processing of two-dimensional (2D) materials (e.g. raised dots and lines and raised-line shapes, patterns and pictures). This study examines the age- related changes in various skills related to the haptic exploration of 2D raised-line and dot materials and how these skills are related to haptic picture perception.
    [Show full text]
  • Haptic Perception, Attention, and Effects on Performance in a Driving Context
    ISSN: 1402-1544 ISBN 978-91-7439-XXX-X Se i listan och fyll i siffror där kryssen är DOCTORAL T H E SI S Department of Business Administration, Technology and Social Sciences and Effects on Attention, Performance in a Camilla DrivingGrane Context Haptic Perception, Division of Human Work Sciences Haptic Perception, Attention, and Effects on Performance in a Driving Context ISSN: 1402-1544 ISBN 978-91-7439-490-0 Use of a Haptic Rotary Device in a Menu Selection Task Luleå University of Technology 2012 Camilla Grane HAPTIC PERCEPTION, ATTENTION, AND EFFECTS ON PERFORMANCE IN A DRIVING CONTEXT USE OF HAPTIC ROTARY DEVICE IN A VISUAL MENU SELECTION TASK CAMILLA GRANE LULEÅ UNIVERSITY OF TECHNOLOGY Department of Business Administration, Technology and Social Sciences Division of Human Work Sciences Engineering Psychology Printed by Universitetstryckeriet, Luleå 2012 ISSN: 1402-1544 ISBN 978-91-7439-490-0 Luleå 2012 www.ltu.se Till Love och Tuva med kärlek PREFACE This thesis work was part of research collaboration between Luleå University of Technology and Volvo Car Corporation partly financed by Vinnova PFF and the EFESOS project. I have always had the car industry, and specifically Volvo Car Corporation, in mind during this thesis work. One of my main goals has been to provide the industry with information that could be used to develop more usable and safer in-vehicle interfaces for the driver. Therefore, it is important to me to write this thesis with a broad group of readers in mind, researchers within my field as well as HMI designers and developers in the car industry.
    [Show full text]
  • Aging and the Visual, Haptic, and Cross-Modal Perception of Natural Object Shape
    Perception, 2006, volume 35, pages 1383 ^ 1395 DOI:10.1068/p5504 Aging and the visual, haptic, and cross-modal perception of natural object shape J Farley Norman, Charles E Crabtree, Hideko F Norman, Brandon K Moncrief, Molly Herrmannô, Noah Kapley Department of Psychology, Western Kentucky University, Bowling Green, KY 42101-1030, USA; e-mail: [email protected]; ô Department of Psychology, DePauw University, Greencastle, IN 46135, USA Received 31 August 2005, in revised form 28 December 2005; published online 25 October 2006 Abstract. One hundred observers participated in two experiments designed to investigate aging and the perception of natural object shape. In the experiments, younger and older observers performed either a same/different shape discrimination task (experiment 1) or a cross-modal matching task (experiment 2). Quantitative effects of age were found in both experiments. The effect of age in experiment 1 was limited to cross-modal shape discrimination: there was no effect of age upon unimodal (ie within a single perceptual modality) shape discrimination. The effect of age in experiment 2 was eliminated when the older observers were either given an unlimited amount of time to perform the task or when the number of response alternatives was decreased. Overall, the results of the experiments reveal that older observers can effectively perceive 3-D shape from both vision and haptics. 1 Introduction Vision and haptics (active touch) represent the two sensory modalities by which human observers perceive 3-D object shapeöwe see environmental objects and we feel, grasp, and utilize them with our hands. Without vision, we cannot perceive the 3-D shape of objects at a distance.
    [Show full text]
  • Differences in Haptic and Visual Perception of Expressive 1Dof Motion
    Differences in Haptic and Visual Perception of Expressive 1DoF Motion Elyse D. Z. Chase Sean Follmer Stanford University Stanford University Stanford, CA, USA Stanford, CA, USA [email protected] [email protected] ABSTRACT 1 INTRODUCTION Humans can perceive motion through a variety of different modali- Social communication between humans is critical for many interac- ties. Vision is a well explored modality; however haptics can greatly tions. Specifically, nonverbal cues, including gesture, posture, gaze, increase the richness of information provided to the user. The de- and expression, are an essential part of communication [Argyle tailed differences in perception of motion between these two modal- 2013; Knapp et al. 2013; Siegman and Feldstein 2014]. Additionally, ities are not well studied and can provide an additional avenue for touch is a core method humans use to communicate with one an- communication between humans and haptic devices or robots. We other. Much work has gone into categorizing both the dimensions analyze these differences in the context of users interactions with and functions of touch [Burgoon et al. 2016; Knapp et al. 2013]. Stud- a non-anthropomorphic haptic device. In this study, participants ies also have shown that touch can increase likeability between two experienced different levels and combinations of stiffness, jitter, strangers [Breed and Ricci 1973; Fisher et al. 1976] and compliance and acceleration curves via a one degree of freedom linear motion in a request [Willis and Hamm 1980]. Overall, touch is a powerful display. These conditions were presented with and without the communicative tool utilized by humans. opportunity for users to touch the setup.
    [Show full text]
  • Using Interference Tasks to Study Tactile and Haptic Memory Rebecca Lawson1, Alexandra M
    CHAPTER 19 Remembering Touch: Using Interference Tasks to Study Tactile and Haptic Memory Rebecca Lawson1, Alexandra M. Fernandes2,3, Pedro B. Albuquerque3, Simon Lacey4 1Department of Experimental Psychology, University of Liverpool, UK; 2Institute for Energy Technology, Halden, Norway; 3School of Psychology, University of Minho, Braga, Portugal; 4Department of Neurology, Emory University, Atlanta, GA, USA INVESTIGATING OUR SENSE OF TOUCH We are rarely aware of using our memory for touch and yet research suggests that we are efficient—perhaps sur- prisingly so—at storing and subsequently accessing memories of how something felt to us. In some cases we may do this explicitly, for example, when deciding whether a melon is ripe or a cake is cooked, but in many more cases we are probably not aware that we are reactivating memories of things that we have touched. Relatively little research has been conducted on memory for touch compared with visual and auditory memory. The proportion of papers on memory for each modality has been stable, with around 70% of search results for visual plus memory, 20% for auditory plus memory, 5% for olfactory plus memory, and less than 5% in total for tactile, haptic, and gustatory plus memory.1 Gallace and Spence (2009) provided a review of the literature on haptic and tactile memory. More recently, Wang, Bodner, and Zhou (2013; see also Wang et al., 2012) reviewed the neural basis of tactile working memory. Here, we focus on the empirical findings from previous interference studies investigating short-term and working memory for touch and also on evaluating this methodology. We then present two studies investigating interference effects on haptic memory for three-dimensional (3D) objects.
    [Show full text]