Improving Motor Coordination in HRI with Bio-Inspired Controllers Melanie Jouaiti
Total Page:16
File Type:pdf, Size:1020Kb
Improving Motor Coordination in HRI with Bio-Inspired Controllers Melanie Jouaiti To cite this version: Melanie Jouaiti. Improving Motor Coordination in HRI with Bio-Inspired Controllers. HRI Pioneers Workshop 2020 - 15th annual Human-Robot Interaction Pioneers Workshop, Mar 2020, Cambridge, United Kingdom. 10.1145/3371382.3377439. hal-02435758 HAL Id: hal-02435758 https://hal.archives-ouvertes.fr/hal-02435758 Submitted on 11 Jan 2020 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Improving Motor Coordination in HRI with Bio-Inspired Controllers Melanie Jouaiti [email protected] Université de Lorraine, CNRS, Loria Nancy ABSTRACT Social synchrony is at the root of interpersonal interactions Gestural communication is an important aspect of HRI in social, [8, 11, 21] and thus humans expect robots to adapt to them and assistance and rehabilitation robotics. Indeed, social synchrony is demonstrate appropriate responses. Robot controllers with adaptive a key component of interpersonal interactions which affects the capabilities are therefore necessary for social acceptance. My work interaction at a behavioral level, as well as at a social level. It is is two-fold: first, improve motor coordination in robots usinga therefore paramount for the robot to be able to adapt to its interac- bio-inspired controller, and second, use this controller for effective tion partner, at the risk of experiencing an awkward interaction. motor rehabilitation with autistic children. Bio-inspired controllers endowed with plasticity mechanisms can be employed in order to make these interactions as natural and en- 2 RELATED WORKS joyable as possible. Integrating adaptive properties can lead to the Synchrony is an important aspect of interpersonal interactions emergence of motor coordination and hence to social synchrony. A which has been evidenced by numerous studies. [17] observed that non-negligible aspect of the work consists in studying humans in synchrony has to be bi-directional and may fail if the robot is not HRI to understand human behavior better and design better inter- adaptive. [19] showed that subjects attributed a greater likability actions. On the long term, this could be quite useful for improved to a partner waving in phase with them. Moreover, in the case robot-assisted motor therapy. of inter-limb coordination, neural synchrony has been observed between cortical areas of the brain [29] but also between two dis- CCS CONCEPTS tinct brains [25, 28]. Neuroscientists assume that emotional and • Human-centered computing; • Computing methodologies social interactions involve a coupling between individuals which → Bio-inspired approaches; • Computer systems organiza- is achieved thanks to neural structures with similar properties as tion → Robotic control; Robotics; those implicated in the neural control of movements. The consensus that robots should be adaptive leads to the emer- KEYWORDS gence of several methods. Motor coordination in robots can be achieved using Dynamic Movement Primitives [13], such as in [22] Motor coordination; human-robot interaction; bio-inspired con- where a robotic arm was able to synchronize with an external signal troller and perform coordinated drum beating with a changing frequency. ACM Reference Format: [2] employed a reservoir of oscillators to reproduce rhythmic arm Melanie Jouaiti. 2020. Improving Motor Coordination in HRI with Bio- movements with the NAO robot. While the oscillator can be slightly Inspired Controllers. In Companion of the 2020 ACM/IEEE International entrained during the interaction, the oscillators do not retain the fre- Conference on Human-Robot Interaction (HRI ’20 Companion), March 23– quency, going back to their original properties right afterwards. [5] 26, 2020, Cambridge, United Kingdom. ACM, New York, NY, USA, 3 pages. combined a rhythmic pattern generator (Hopf [12]) and a discrete https://doi.org/10.1145/3371382.3377439 pattern generator (VITE [3]) to achieve motor coordination. 1 INTRODUCTION 3 ACHIEVING MOTOR COORDINATION In rhythmic social interactions, humans experience two physical USING CENTRAL PATTERN GENERATORS phenomena which can also be observed in oscillators: the magnet ef- (CPGS) fect entrains both systems until they are coupled and synchronized; CPGs are biological neural structures found in the central nervous the maintenance effect is the struggle of each system to preserve system of vertebrates or in some ganglia of invertebrates. CPGs its own intrinsic frequency [9]. These mechanisms could play a are the source of neural activity that controls rhythmic and stereo- fundamental role in interpersonal interactions [6]. typed behaviors, such as locomotion, swimming, flying, breathing, swallowing. They can generate a pattern without an input and Permission to make digital or hard copies of part or all of this work for personal or adapt to an external feedback. Mesoscopic CPGs are usually based classroom use is granted without fee provided that copies are not made or distributed on a pair of half-center neurons [10], controlling the extensor and for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. flexor muscles. Half-center oscillators are composed of two neurons For all other uses, contact the owner/author(s). which would not have the ability to oscillate individually but their HRI ’20 Companion, March 23–26, 2020, Cambridge, United Kingdom coupling leads to an oscillatory behavior. © 2020 Copyright held by the owner/author(s). ACM ISBN 978-1-4503-7057-8/20/03. The oscillator neurons (See Fig. 1) employed here are based https://doi.org/10.1145/3371382.3377439 on the Rowat-Selverston neuron which is able to generate both coordination in brain signals. It relies on the assumption that both signals are locked with a constant phase difference but the PLV allows for deviation and evaluates its spread. It ranges from 0 (no coordination) to 1 (perfect coordination). Engagement is "the process by which two (or more) participants establish, maintain and end their perceived connection during in- teractions they jointly undertake" [26]. It can also be defined as "emotionally laden attention" [7]. Engagement is computed from EEG data [23]: SP¹βº enдaдement = (1) SP¹αº + SP¹θº With SP¹f º the spectral power of the frequency band f [θ (4 - Figure 1: CPG architecture based on the half-center model 8 Hz), α (8 - 13 Hz) and β (13 - 30 Hz)]. The higher the score, the from [24] for joint i. RG: rhythmic generator cells (Rowat- higher the engagement. Selverston here) for the extensor and flexor; PF, MN, SN: lay- ers of interneurons (Pattern Formation, Motoneurons, Sen- sory Neurons); ϵ: synaptic weight; W: mutual inhibition. See 5 CONCLUSION AND PERSPECTIVES [14] for a detailed explanation In this work, we incorporated plasticity mechanisms into CPG con- trollers to make them even more adaptive. Versatile control of a robot can be achieved to imitate both discrete and rhythmic move- rhythmic and discrete patterns. In the rhythmic mode, the CPG can ments and switch seamlessly from one to the other. We can thus adapt its intrinsic frequency, amplitude and synaptic weight using achieve synchronization in rhythmic tasks but also motor imitation hebbian plasticity mechanisms [14]. This CPG also has a discrete for discrete movements. The model in itself is also quite flexible mode where it behaves like a PID controller and it can adapt its and can be extended or modified with new plasticity rules better parameters to match the input amplitude [15]. The CPG controller suited for the purpose. confers several advantages: no robot model is necessary; it can take in any kind of input (position, velocity, torque...) and it can achieve We performed a user-study to evaluate the impact of adaptive coordination through multimodal information (visual, contact...). controllers on human engagement and coordination. Most partic- In previous work, we compared CPG control with a direct geo- ipants enjoyed the interaction much more when the partner was metric control for human imitation. In discrete mode, the CPG adaptive than when it was not, they were very playful and tested smooths out the signal and is thus less sensitive to noise than the the limits of the controller. This experiment also confirmed that direct geometric control. In rhythmic mode, the CPG adapts its humans expect their interaction partner to be able to adapt and feel parameters and is able to anticipate the signal. The direct geomet- the lack of adaptation as awkward. Most subjects also declared that ric approach endlessly tries to catch up with the signal and never they felt the non-adaptive partners adapted to them, demonstrating matches the full amplitude. that the subjects unconsciously coordinated. The adaptation achieved by the CPG is similar to synchronization In future work, we will perform several user studies to evalu- in humans: the CPG has an adaptation period, synchronization can ate human perception with