A Developmental Approach to the Study of Affective Bonds for Human-Robot Interaction Antoine Hiolle a Thesis Submitted in Partia

Total Page:16

File Type:pdf, Size:1020Kb

A Developmental Approach to the Study of Affective Bonds for Human-Robot Interaction Antoine Hiolle a Thesis Submitted in Partia A Developmental Approach to the Study of Affective Bonds for Human-Robot Interaction Antoine Hiolle A thesis submitted in partial fulfilment of the requirements of the University of Hertfordshire for the degree of Doctor of Philosophy The programme of research was carried out in the School of Computer Science, Faculty of Science, Technology and Creative Arts, University of Hertfordshire. February 2015 Acknowledgements I would like to thank my main supervisor Lola Cañamero for her constant support and the opportunities she has given me during all these years. I am grateful to the second and third members of the supervising team, Neil Davey and Rod Adams, for their valuable feedback. I am also grateful to Lorraine Nicholls and all the administrative staff of STRI for their constant help and positive attitude. I am of course extremely grateful to all the members of the two EU projects I worked on (ALIZ-e and FEELIX-GROWING). Too many names to name but I have rarely met on two different occasions a group of such enthusiastic and stimulating persons. Our interactions helped me develop as a person and a researcher, and built some long lasting friendships. I am also grateful to all the members of the Adaptive Systems Research Group, especially the few that would stay after hours to discuss exciting topics or program for an all-nighter. Throughout this work, I was first supported by a research studentship from the Adaptive Systems Research Group, School of Computer Science, University of Hertfordshire. This research has also received support from the EU FP6 funded Project FEELIX GROWING, contract FP6 IST-045169 and the EU FP7 ALIZ-e project (grant 248116). Finally, I am greatly indebted to two amazing women. Sandra Costa, the love of my life, for her just being constantly amazing, supportive, motivating, and surprising. And my mother, who is probably the best human being in the world and has always been. Antoine Hiolle i Abstract Robotics agents are meant to play an increasingly larger role in our everyday lives. To be successfully integrated in our environment, robots will need to develop and display adap- tive, robust, and socially suitable behaviours. To tackle these issues, the robotics research community has invested a considerable amount of efforts in modeling robotic architectures inspired by research on living systems, from ethology to developmental psychology. Fol- lowing a similar approach, this thesis presents the research results of the modeling and experimental testing of robotic architectures based on affective and attachment bonds be- tween young infants and their primary caregiver. I follow a bottom-up approach to the modelling of such bonds, examining how they can promote the situated development of an autonomous robot. Specifically, the models used and the results from the experiments carried out in laboratory settings and with naive users demonstrate the impact such affec- tive bonds have on the learning outcomes of an autonomous robot and on the perception and behaviour of humans. This research leads to the emphasis on the importance of the interplay between the dynamics of the regulatory behaviours performed by a robot and the responsiveness of the human partner. The coupling of such signals and behaviours in an attachment-like dyad determines the nature of the outcomes for the robot, in terms of learning or the satisfaction of other needs. The experiments carried out also demonstrate of the attachment system can help a robot adapt its own social behaviour to that of the human partners, as infants are thought to do during their development. ii Contents Acknowledgments i Abstract ii Chapter 1 Introduction 1 1.1 Motivations, Scope, and Problem Statement . ....... 3 1.2 OutlineoftheThesis.............................. 6 1.3 Contributions to Knowledge . ... 9 1.4 ResearchProjects................................ 11 1.4.1 The FEELIX GROWING Project . 11 1.4.2 TheALIZ-Eproject ........................... 12 Chapter 2 Attachment Theory and Affective Bonds: The Caregiver as an External Regulator of Affect 14 2.1 The Origins of Attachment theory . 14 2.2 Development of the Bond between the Infant and the Attachment Figure . 15 2.3 The Caregiver as a Secure Base and its Role in the Regulation of the Affect ofInfants ..................................... 18 2.4 The Neurophysiology of Mother-Infant Affective Interactions . 21 iii 2.5 Artificial Models of Mother-Infant Attachment . ........ 23 2.6 Summary ..................................... 24 Chapter 3 Affective Processes and Interactions for Autonomous Robots 26 3.1 Affective Processes: Motivations and Emotions in Humans and Other Animals 26 3.1.1 Definitions and functions of affect and emotions . ...... 26 3.1.2 Emotional Arousal . 28 3.1.3 Affective Components for the Attachment System . ..... 29 3.2 Affective Interactions and Exploration for Autonomous Robots . 30 3.2.1 Artificial Affective Systems for Human-Robot Interactions . 31 3.3 Exploration and Comfort Systems for Autonomous Robots . ......... 33 3.3.1 Robotic Comfort Zones . 33 3.3.2 Bottom-up Approach to the Imprinting Phenomenon . 33 3.3.3 Exploration, Novelty, and Curiosity . ..... 35 3.4 Summary and Proposed Methodology for the Design and Operationalization of a Minimal Attachment System . 37 Chapter 4 A Model of Attachment-based Regulation of Affect for Au- tonomous Robots 39 4.1 Outline ...................................... 39 4.1.1 Contributors and Funding Bodies . 40 4.2 Adaptation of the Paradigms and Mechanisms of the Attachment System . 40 4.3 The Dyadic Regulation Model for Attachment: Interactions between Arousal andComfort ................................... 41 4.3.1 Arousal as an Average of the External Stimulation . ...... 42 4.3.2 Evaluation of the comfort . 45 iv 4.4 Comparison of the Attachment Model to the Simulation Model of Stevens andZhang..................................... 49 4.5 Novelty and Learning Accuracy as Sources of Stimulation for the Arousal of aLearningRobot................................. 54 4.5.1 The Auto-Associative Memory . 56 4.5.2 The Self-Organizing Map for the Categorisation of Perceptual Features 60 4.6 Robot Architecture with the Attachment System . ....... 66 4.7 Summary ..................................... 71 Chapter 5 An Artificial Arousal System for Robot Exploration 73 5.1 Outline ...................................... 73 5.2 Contributors and funding bodies . 74 5.3 The Robotic Platform used: The Sony AIBO ERS-7 Robot . 74 5.3.1 Software interface . 75 5.3.2 Perceptions used in the experiment . 77 5.3.3 Regulatory and Exploratory Behaviours . 80 5.4 Experiments.................................... 82 5.4.1 Experimental Setup and Research Hypotheses . ..... 82 5.5 Results of the Variation of the Responsiveness of the Caregiver . 84 5.5.1 HighResponsiveness .. .. .. .. .. .. .. .. .. .. .. .. 84 5.5.2 MediumResponsiveness . 87 5.5.3 LowResponsiveness .. .. .. .. .. .. .. .. .. .. .. .. 90 5.6 Discussion..................................... 93 5.7 Summary ..................................... 96 Chapter 6 Human-Robot Caregiving Interactions with Naive Users 98 v 6.1 Outline ...................................... 98 6.2 Contributors and funding bodies . 99 6.3 Experimental Setting for Caregiving Interactions . ........... 99 6.3.1 Research Questions, Hypotheses, and Measures . 100 6.3.2 Experimental Setup and Protocol . 101 6.3.3 Questionnaire...............................104 6.4 Results.......................................107 6.4.1 Results from the questionnaires . 107 6.4.2 Results per Subjects Group . 109 6.4.3 Comfort and Stimulation of the Robot . 111 6.4.4 Annotation of the video recordings . 111 6.5 Discussion.....................................115 6.5.1 Summary .................................117 Chapter 7 Regulatory Profile Influence on Exploration and Learning 119 7.1 Outline ......................................119 7.2 Contributors and funding bodies . 120 7.3 The Robotic Platform Used: Aldebaran’s Humanoid Robot NAO . 120 7.4 New Experimental Setup and Research Questions . .......123 7.4.1 ResearchQuestions. .123 7.4.2 The Experimental Setup . 124 7.4.3 Perceptual System . 125 7.4.4 TheArousalSystem .. .. .. .. .. .. .. .. .. .. .. ..127 7.4.5 Action Selection and the Behavioral System . 128 7.4.6 Caregiver Responses for Equal Responsiveness . .......129 7.4.7 TwoRobotProfiles. .. .. .. .. .. .. .. .. .. .. .. ..130 vi 7.5 Results.......................................132 7.5.1 Reaction to a global change in the environment . 132 7.5.2 Local sources of Arousal increase . 133 7.5.3 Effect of the Profiles in the Exploration in a Simple Environment . 134 7.5.4 Effect of the Profiles in the Exploration in a more Complex Environ- ment....................................137 7.5.5 Experiments with Varying Responsiveness of the Caregiver: Affec- tiveAdaptation..............................142 7.6 Summary .....................................146 Chapter 8 Attachment and Dyadic Regulation in Motivational Systems 150 8.1 Outline ......................................150 8.1.1 Contributors and funding bodies . 151 8.2 The Diabetic Robot Toddler . 152 8.2.1 Paradigm and Interactive Scenario . 152 8.2.2 Principles for the Adaptation of the Attachment System to the Sce- nario and the Motivational System of the Robot . 154 8.3 Subset of the Architecture used for the Attachment System .........159 8.3.1 Perception of the Human Caregiver and Social Motivation . 160 8.3.2 Dynamics of the Motivations . 160 8.3.3 Behaviours and Action Selection . 162 8.4 Influence of the Comfort, Arousal,
Recommended publications
  • Long-Term Socially Perceptive And
    Long-term socially perceptive and interactive robot companions: challenges and future perspectives Ruth Aylett Ginevra Castellano Bogdan Raducanu MACS, Heriot-Watt University Schl of EECE Computer Vision Centre Riccarton University of Birmingham Edifici “O” – Campus UAB Edinburgh EH14 4AS, UK Birmingham, B15 2TT, UK 08193 Bellaterra (Barcelona), Spain [email protected] [email protected] [email protected] Ana Paiva Marc Hanheide INESC-ID and Instituto Superior School of Computer Science Técnico, Universidade Técnica de University of Birmingham Lisboa, Portugal Birmingham, B15 2TT, UK [email protected] [email protected] ABSTRACT even though they knew that they were not [29]. Work with early This paper gives a brief overview of the challenges for multi- social robots such as Kismet [5] substantiated this for robots too. model perception and generation applied to robot companions Users act as if these technological artefacts had their own inner located in human social environments. It reviews the current life: motives, goals, beliefs, and feelings; thus applying the position in both perception and generation and the immediate Intentional Stance [13] to them. We argue that the term technical challenges and goes on to consider the extra issues believability [2], often used as an evaluation metric for such raised by embodiment and social context. Finally, it briefly interactions, is closely related to how far a user feels able to take discusses the impact of systems that must function continually this intentional stance and suspend their disbelieve in the actual over months rather than just for a few hours.
    [Show full text]
  • Embodied Robot Models for Interdisciplinary Emotion Research
    DRAFT. TO APPEAR IN IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2019, SPECIAL ISSUE “COMPUTATIONAL MODELLING OF EMOTION” 1 Embodied Robot Models for Interdisciplinary Emotion Research Lola Canamero˜ Abstract—Due to their complex nature, emotions cannot be properly understood from the perspective of a single discipline. In this paper, I discuss how the use of robots as models is beneficial for interdisciplinary emotion research. Addressing this issue through the lens of my own research, I focus on a critical analysis of embodied robots models of different aspects of emotion, relate them to theories in psychology and neuroscience, and provide representative examples. I discuss concrete ways in which embodied robot models can be used to carry out interdisciplinary emotion research, assessing their contributions: as hypothetical models, and as operational models of specific emotional phenomena, of general emotion principles, and of specific emotion “dimensions”. I conclude by discussing the advantages of using embodied robot models over other models. Index Terms—Emotion models, robot models of emotions, embodied emotions, affective cognition, affective interaction, autonomous robots, human-robot interaction, embodied artificial intelligence, interdisciplinary research. F 1 INTRODUCTION “This suggestion [...] would require tight collab- in interdisciplinary emotion research through the lens of orations between neuroscientists and roboticists in my own research, focusing on embodied robot models, in order to be refined, but because of the very peculiar a critical reflection on the interplay between my interest characteristics of emotions, such an endeavor could in interdisciplinary research and my actual robot models. lead to important advances in robot [...] designs. However, some (but not all) of the discussions in this paper These advances in turn could lead to new insights will also apply to other approaches to emotion modeling on the functions of emotions and would suggest such as computer simulations or embodied virtual humans.
    [Show full text]
  • Eliciting Caregiving Behaviour in Dyadic Human-Robot Attachment-Like Interactions
    Eliciting caregiving behaviour in dyadic human-robot attachment-like interactions Antoine Hiolle Adaptive Systems Research Group, STRI & School of Computer Science, University of Hertfordshire, U.K. Lola Ca˜namero School of Computer Science, University of Hertfordshire, U.K. Marina Davila-Ross University of Portsmouth, U.K. and Kim A. Bard University of Portsmouth, U.K. Based on research in developmental robotics and psychology findings in attachment theory in young infants, we designed an arousal-based model controlling the behaviour of a Sony AIBO robot during the exploration of a children play mat. When the robot experiences too many new perceptions, the increase of arousal triggers calls for attention from its human caregiver. The caregiver can choose to either calm the robot down by providing it with comfort, or to leave the robot coping with the situation on its own . When the arousal of the robot has decreased, the robot moves on to further explore the play mat. We present here the results of two experiments using this arousal-driven control architecture. In the first setting, we show that such a robotic architecture allows the human caregiver to influence greatly the learning outcomes of the exploration episode, with some similarities to a primary caregiver during early childhood. In a second experiment, we tested how human adults behaved in a similar setup with two different robots: one needy, often demanding attention, and one more independent, requesting far less care or assistance. Our results show that human adults recognise each profile of the robot for what they have been designed, and behave accordingly to what would be expected, caring more for the needy robot than the other.
    [Show full text]
  • Using Emotional Interactions for Visual Navigation Task Learning Cyril Hasson, Sofiane Boucenna, Philippe Gaussier, Laurence Hafemeister
    Using Emotional Interactions for Visual Navigation Task Learning Cyril Hasson, Sofiane Boucenna, Philippe Gaussier, Laurence Hafemeister To cite this version: Cyril Hasson, Sofiane Boucenna, Philippe Gaussier, Laurence Hafemeister. Using Emotional Inter- actions for Visual Navigation Task Learning. International Conference on Kansei Engineering and Emotion Reasearch, Mar 2010, Paris, France. pp.1578-1587. hal-00538386 HAL Id: hal-00538386 https://hal.archives-ouvertes.fr/hal-00538386 Submitted on 22 Nov 2010 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. KEER2010, PARIS | MARCH 2-4 2010 INTERNATIONAL CONFERENCE ON KANSEI ENGINEERING AND EMOTION RESEARCH 2010 USING EMOTIONAL INTERACTIONS FOR VISUAL NAVIGATION TASK LEARNING C. Hasson1 ∗ , S. Boucenna1 , P. Gaussier1,2 and L. Hafemeister1 1ETIS, CNRS UMR 8051, ENSEA, Univ Cergy-Pontoise, France 2IUF, France ABSTRACT The aim of this study is to show how robots learning could be easier and accessible to non experts if it relies on emotional interactions, more precisely on social referencing abilities, rather than on specialized supervised learning technics. To test this idea, we coupled two systems : a robotic head able to learn to recognize and imitate emotional facial expressions and a mobile robot able to learn autonomous visual navigation tasks in a real environment.
    [Show full text]
  • Emotions As a Dynamical System: the Interplay Between the Meta-Control and Communication Function of Emotions
    PALADYN Journal of Behavioral Robotics Research Article · DOI: 10.2478/s13230-012-0005-4 · JBR · 2(3) · 2011 · 111-125 Emotions as a dynamical system: the interplay between the meta-control and communication function of emotions C. Hasson, P. Gaussier∗, Abstract S. Boucenna Classical models of emotions consider either the communicational aspect of emotions (for instance the emotions conveyed by the facial expressions) or the second order control necessary for survival purpose when the autonomy ETIS, CNRS UMR 8051, ENSEA, of the system is an issue. Here, we show the interdependence of communication and meta-control aspects of Cergy Pontoise University 2 Av Adolphe emotion. We propose the idea that emotions must be understood as a dynamical system linking two controllers: one Chauvin, devoted to social interactions (i.e. communication aspects) and another one devoted to the interactions within the 95300 Pontoise, France physical world (i.e metacontrol of a more classical controller). Illustrations will be provided from applications involving navigation among dierent goal places according to dierent internal drives or object grasping and avoidance. Received 2012/01/25 Accepted 2012/02/27 Keywords meta-control · navigation · action selection · emotional interactions · interactive learning · autonomous robotics 1. Introduction and complex environment remains a dicult task [8, 49]. The varying nature of the environment as well as the robot’s own imperfections will lead to situations where the learned behaviors are not sucient and might be end up with deadlocks [23]. Lacking the ability to monitor Models and computational architectures of emotional systems can be their behavior, robots get no satisfaction from productive actions and divided into two dierent families: on one side, the models devoted to no frustration from vain ones.
    [Show full text]
  • Is the Mobile Phone a Personalized Social Robot?
    intervalla: Vol. 1, 2013 ISSN: 2296-3413 Is the Mobile Phone a Personalized Social Robot? Jane Vincent London School of Economics and Political Science University of Surrey Digital World Research Centre ABSTRACT This paper explores how some people use their mobile phone to manage their emotions and presentation of self to such an extent that they develop a strong bond with it, turning to it first in times of emotional need. It examines how some social robots, designed by experts to provide bespoke emotional support, can address only particular emotional problems. This is further examined by contrasting the electronic emotions managed via the mobile phone with the uses for three social robots: Amazing Ally, KASPAR and Paro. Unlike these robots, that are effective only when responding to certain pre-programmed emotions, the mobile phone appears to be a constant companion dealing with every eventuality. Imbued with the user’s feelings and emotions that surround the continuous and always on presence of the device, the user constantly turns to it for solace, to share joyous moments, recall special memories and more. The resulting close emotional and physical association with a device that is filled with the personal biography of its user is that the mobile phone becomes like a personal social robot; a co-construction of functional machine and intimate emotional experiences known only to the user. KEY WORDS: personal social robot, emotion, mobile phone, electronic emotions Copyright © 2013 (Vincent). Licensed under the Creative Commons Attribution Noncommercial No Derivatives (by-nc-nd/3.0). Vincent Personalized Social Robot INTRODUCTION There is a lot more that we haven’t even begun to understand well enough in ourselves to know how to implement […] will we ever know how to build a robot like us? (Picard, 2011) This paper explores the particular qualities of our emotional relationship with mobile phones and how it compares and contrasts with the parallel development of social (and sociable) robots.
    [Show full text]
  • Imitation As a Communication Tool for Online Facial Expression Learning and Recognition
    The 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems October 18-22, 2010, Taipei, Taiwan Imitation as a Communication Tool for Online Facial Expression Learning and Recognition S. Boucenna 1, P. Gaussier 1,2, P. Andry 1, L. Hafemeister 1 1ETIS, CNRS UMR 8051, ENSEA, Univ Cergy-Pontoise, 2IUF, {boucenna,gaussier,andry,hafemeister }@ensea.fr We are interested in understanding how babies learn allowing to associate for instance the vision of an “happy to recognize facial expressions without having a teaching face” with their own internal emotional state of happiness [7]. signal allowing to associate a facial expression to a given Our starting point was motivated by the question of how a abstract label (i.e the name of the facial expression ’sadness’, “naive” system can learn to respond correctly to other’s ex- ’happiness’...). Our starting point was a mathematical model pressions during a natural interaction. ”Natural” here means showing that if the baby uses a sensory motor architecture that the interaction should be the less constrained as possible, for the recognition of the facial expression then the parents without explicit reward or ad-hoc detection mechanism or must imitate the baby facial expression to allow the on-line formated teaching technique. In this case, a good inspiration learning. In this paper, a first series of robotics experiments is given by the baby-mother interaction, where the newborn showing that a simple neural network model can control or the very young baby, has a set of expressions linked with the robot head and learn on-line to recognize the facial his/her own emotions.
    [Show full text]
  • Social Robots and Emotion: Transcending the Boundary Between Humans and Icts
    intervalla: Vol. 1, 2013 ISSN: 2296-3413 Social Robots and Emotion: Transcending the Boundary Between Humans and ICTs Satomi Sugiyama Franklin College Switzerland Jane Vincent London School of Economics and Political Science University of Surrey Digital World Research Centre KEY WORDS: social robot, emotion, ICTs, mobile phone, body Copyright © 2013 (Sugiyama & Vincent). Licensed under the Creative Commons Attribution Noncommercial No Derivatives (by-nc- nd/3.0). Sugiyama & Vincent Social Robots and Emotion The notion of social robots often evokes the idea of ‘humanoid social robots’ which are “human- made autonomous entities that interact with humans in a humanlike way” (Zhao, 2006, p. 405). These humanoid social robots, and also zoomorphic social robots, are becoming a part of our everyday communicative interactions. They have been introduced to us as relational artefacts such as Tamagotchis, Furbies, and Aibos, asking the question of who we are becoming as we develop intimate and emotional relationships with machines (Picard 1997; Turkle, 2007, 2012). These relationships between humans and machines have been discussed not only in terms of intelligent machines, such as humanoid social robots incorporated into our social domains, but also in terms of the hybridization of the human body and machines (Haraway 1991; Fortunati, 2003a, 2003b; Katz, 2003; Fortunati, Katz, & Riccini, 2003). At the surface level, humanoid social robots and artificial intelligence might create an impression that the questions about the relationship between humans and technologies are still far removed from our everyday experiences and saved for the research laboratories and the world of science fiction. However, information and communication technologies (ICTs) have been slowly but steadily ‘approaching’ the human body, calling for a reconsideration of the notion of social robots.
    [Show full text]
  • Emotional Expression in Social Interactions of Infants with And
    Emotional Expression in Social Interactions of Infants with and without Down Syndrome by Kate Thorsteinsson Department of Psychology University of Portsmouth United Kingdom Submitted: April 2011 Funded by FEELIX GROWING, an EU collaborative grant 1 Declaration Whilst registered as a candidate for the above degree, I have not been registered for any other research award. The results and conclusions embodied in this thesis are the work of the named candidate and have not been submitted for any other academic award. 2 Acknowledgements I would like to thank the following people: Professor Kim Bard, my Director of Studies, who has offered me her knowledge, guidance and unstinting support throughout. Thank you for your patience. Professor Sue Buckley, my supervisor, of the Down Syndrome Education International Trust, for her support and comments, and who enabled me the opportunity to work with families and their young infants with Down syndrome. Also to Dr Anne Hillstrom, my supervisor, for her valuable input and feedback Dr Sherria Hoskins and Mr John Oates for their time and support in reviewing the thesis and for their valuable comments. All the staff at the Down Syndrome Education Trust, for their help in recruiting and for finding me space at the centre to conduct my studies. All those involved in the Feelix Growing project, and in particular to the grant leaders, who secured funding for my PhD from the EU. The lab technicians for solving all those technical hiccups. My husband Ian, who has invested so much to keep me smiling throughout, and to my mother, Maureen, who has given her support in so many ways, not least as emergency babysitter and budget manager.
    [Show full text]
  • Imitation As a Communication Tool for Online Facial Expression Learning and Recognition Sofiane Boucenna, P
    Imitation as a Communication Tool for Online Facial Expression Learning and Recognition Sofiane Boucenna, P. Gaussier, P. Andry, L. Hafemeister To cite this version: Sofiane Boucenna, P. Gaussier, P. Andry, L. Hafemeister. Imitation as a Communication Toolfor Online Facial Expression Learning and Recognition. IROS, 2010, France. hal-00522773 HAL Id: hal-00522773 https://hal.archives-ouvertes.fr/hal-00522773 Submitted on 1 Oct 2010 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Imitation as a Communication Tool for Online Facial Expression Learning and Recognition S. Boucenna1, P. Gaussier1,2, P. Andry1, L. Hafemeister1 1ETIS, CNRS UMR 8051, ENSEA, Univ Cergy-Pontoise, 2IUF, {boucenna,gaussier,andry,hafemeister}@ensea.fr We are interested in understanding how babies learn allowing to associate for instance the vision of an “happy to recognize facial expressions without having a teaching face” with their own internal emotional state of happiness [7]. signal allowing to associate a facial expression to a given Our starting point was motivated by the question of how a abstract label (i.e the name of the facial expression ’sadness’, “naive” system can learn to respond correctly to other’s ex- ’happiness’...).
    [Show full text]
  • Emotional Interaction As a Way to Regulate Robot Behavior Sofiane Boucenna, Philippe Gaussier, and Laurence Hafemeister
    42 IEEETRANSACTIONSONAUTONOMOUSMENTALDEVELOPMENT,VOL.6,NO.1,MARCH2014 Development of First Social Referencing Skills: Emotional Interaction as a Way to Regulate Robot Behavior Sofiane Boucenna, Philippe Gaussier, and Laurence Hafemeister Abstract—In this paper, we study how emotional interactions emotional values can be provided by a variety of modalities with a social partner can bootstrap increasingly complex behav- of emotional expressions, such as facial expressions, voice, iors such as social referencing. Our idea is that social referencing as gestures, etc. We choose to use facial expressions since they well as facial expression recognition can emerge from a simple sen- are an excellent way to communicate important information sory–motor system involving emotional stimuli. Without knowing that the other is an agent, the robot is able to learn some complex in ambiguous situations but also because their recognition can tasks if the human partner has some “empathy” or at least “res- be learned autonomously very quickly [12]. Our idea is that onate” with the robot head (low level emotional resonance). Hence, social referencing as well as facial expression recognition can we advocate the idea that social referencing can be bootstrapped emerGe from a simple sensory-motor system. All our work is from a simple sensory–motor system not dedicated to social inter- based on the idea of the perception ambiguity. In this case, the actions. inability at first to differentiate our own body from the body Index Terms—Emotion, human–robot interaction, sen- of other if the actions of the other are correlated with our own sory–motor architecture, social referencing. actions.
    [Show full text]
  • From Conditioning of a Non Specific Sensor to Emotional Regulation of Behavior Cyril Hasson, Philippe Gaussier
    From Conditioning of a Non Specific Sensor to Emotional Regulation of Behavior Cyril Hasson, Philippe Gaussier To cite this version: Cyril Hasson, Philippe Gaussier. From Conditioning of a Non Specific Sensor to Emotional Regulation of Behavior. International Conference on Artificial Neural Networks, Sep 2010, Thessaloniki, Greece. pp.317-326. hal-00538402 HAL Id: hal-00538402 https://hal.archives-ouvertes.fr/hal-00538402 Submitted on 22 Nov 2010 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. From conditioning of a non specific sensor to emotional regulation of behavior Cyril Hasson and Philippe Gaussier Cergy-Pontoise University, CNRS, ENSEA ETIS laboratory UMR 8051, F-95000 Abstract. Inspired by the emotional conditionings performed by the amygdala, we describe a simulated neural network able to learn the mean- ing of a previously neutral stimulation. A robot using this neural network can learn the conditioning of a non specific sensor activated by the ex- perimentator and its internal state of pain or pleasure. This biologically inspired adaptative and natural way to interact with the robot is tested with a mobile robot learning navigation tasks in a real environment. 1 Introduction This study focuses on the interest of an adaptative and biologically plausible neural network used to interact with a robot in a non predifined but meaning- full way.
    [Show full text]