Task-Space Control Interface for Softbank Humanoid Robots and Its

Total Page:16

File Type:pdf, Size:1020Kb

Task-Space Control Interface for Softbank Humanoid Robots and Its Task-Space Control Interface for SoftBank Humanoid Robots and its Human-Robot Interaction Applications Anastasia Bolotnikova, Pierre Gergondet, Arnaud Tanguy, Sébastien Courtois, Abderrahmane Kheddar To cite this version: Anastasia Bolotnikova, Pierre Gergondet, Arnaud Tanguy, Sébastien Courtois, Abderrahmane Kheddar. Task-Space Control Interface for SoftBank Humanoid Robots and its Human-Robot Interaction Applications. IEEE/SICE 13th International Symposium on System Integration (SII 2021), Jan 2021, Online conference (originally: Iwaki, Fukushima), Japan. pp.560-565, 10.1109/IEEECONF49454.2021.9382685. hal-02919367v3 HAL Id: hal-02919367 https://hal.archives-ouvertes.fr/hal-02919367v3 Submitted on 8 Oct 2020 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Task-Space Control Interface for SoftBank Humanoid Robots and its Human-Robot Interaction Applications Anastasia Bolotnikova1;2, Pierre Gergondet4, Arnaud Tanguy3,Sebastien´ Courtois1, Abderrahmane Kheddar3;2;4 Abstract— We present an open-source software interface, Real robot called mc naoqi, that allows to perform whole-body task-space Quadratic Programming based control, implemented in mc rtc Fixed frame rate low-level actuator commands Robot sensors readings from framework, on the SoftBank Robotics Europe humanoid robots. Other robot device commands low-level memory fast access We describe the control interface, associated robot description mc_naoqi_dcm packages, robot modules and sample whole-body controllers. Device commands Local robot module Sensor data We demonstrate the use of these tools in simulation for a robot actuators - - encoders LEDs colors - - electric current interacting with a human model. Finally, we showcase and speakers audio - - IMU discuss the use of the developed open-source tools for running wheels speed* - - touch sensors tablet image* - - FSR * the human-robot close contact interaction experiments with real … - - … human subjects inspired from assistance scenarios. * Pepper robot only mc_naoqi * NAO robot only control interface I. INTRODUCTION AND BACKGROUND Forward QP solver result for new actuator commands Update real robot state Quadratic Programming (QP) task-space control has be- Forward control robot module devices state for new with new sensor data come a golden standard in humanoid robot control [1], [2], devices commands [3]. One of the most powerful software control frameworks that implements QP task-space control, called mc rtc1, is mc_rtc (FSM) controller now publicly available. This framework provides developers with useful tools for writing complex controllers for either result control robot state individual or multiple interacting robots to perform wide Used by Instances of variety of experiments, e.g. in aircraft automation [4] or in QP solver real robot state physically interacting with humans [5], [6] that we techni- cally explain and extend in this work. human model state In order to control any given complex robots with this Structure representing complete robot description framework, an interface must be developed to allow com- Kinematic tree parsed from URDF file, contact surfaces, Robot convex collision avoidance shapes, visual and physical links munication between the control framework and the robot’s representations, devices and sensors state representation, module low-level controllers, sensors and devices. One example of current robot state representation Used by 2 such open-source interface is the mc openrtm software URDF file Links meshes Robot that is used to control Humanoid Robotics Project robots Contact surfaces description files Convex collision shapes description files description from Kawada Robotics [7]. However, for different types of robots a specific interface, as well as robot description and Fig. 1: mc naoqi interface enables communication between robot module, need to be developed in order to adapt to SBRE humanoid robots and mc rtc control framework. It particularities of robot brand and low-level control strategies, can be used to steer the robot behaviour in HRI experiments. devices and onboard operating system (OS). The idea of task- space control is to lie exactly between low-level control and high-level planning with somewhat adjustable frontiers. In this work, we present the open-source software inter- that are running NAOqi OS and a customly developed local mc naoqi dcm face, called mc naoqi3, that enables running the controllers module (Sec. II). We also provide robot implemented with mc rtc framework on widely used Soft- modules and description packages that serve as a represen- mc rtc Bank Robotics Europe (SBRE) humanoid robots [8], [9], tation of SBRE robots in the framework (Sec. III). Additionally, we release a basic sample Finite State Machine 1SoftBank Robotics Europe, Paris, France (FSM) mc rtc controller for Pepper robot and its interaction 2University of Montpellier–CNRS LIRMM, Interactive Digital Humans, with a human model in simulation (Sec. IV). Finally, we Montpellier, France 3CNRS-AIST Joint Robotics Laboratory, IRL 3218, Tsukuba, Japan present our current instance use of the developed tools for 4Beijing Advanced Innovation Center for Intelligent Robots and Systems, running the mc rtc controllers developed for Human-Robot Beijing Institute of Technology, Beijing, China interaction (HRI) experiments with human subjects (Sec. V). 1https://jrl-umi3218.github.io/mc_rtc 2https://github.com/jrl-umi3218/mc_openrtm Fig. 1 shows an overview of the developed tools and their 3https://github.com/jrl-umi3218/mc_naoqi interconnection, described in detail in the rest of the paper. II. CONTROL INTERFACE B. Forwarding sensor data from the robot to the controller mc naoqi Fig. 2 gives a schematic overview of the mc rtc control The interface is also responsible for getting framework and its connection to the simulation and control the most up-to-date sensor readings from a robot low-level interfaces, such as mc naoqi. Interested readers are invited memory in real-time and forwarding sensor measurements mc rtc to visit mc rtc project website for more information, instal- in a suitable form to the controller real robot state lation instructions and tutorials. representation as a feedback. This way, the task-space QP controller keeps track of the real robot state and can use it to perform closed-loop QP control computations. Besides common sensor readings, such as encoder values, force sensors or Inertial measurement unit (IMU) measure- ments, mc naoqi interface also allows to forward from the robot to the mc rtc controller such sensor readings as electric motor current and touch sensor readings (from tactile or bumper sensors). We describe how custom robot sensors are implemented on the robot module side in detail in Sec III. For HRI applications, the touch sensor readings are espe- cially beneficial to be forwarded to the controller, as they allow to detect when a human touches the robot. This signal can then be used inside the mc rtc FSM controller, for instance, to trigger an appropriate reaction of the robot to the touch or to trigger a transition to a specific FSM state of Fig. 2: mc rtc control framework architecture. the controller. We demonstrate this use-case in our sample HRI experiment, presented in detail in Sec. V. Fig. 1 illustrates schematically the role of the mc naoqi interface as a communication layer between mc rtc control C. Local low-level robot module framework and NAOqi OS running onboard SBRE humanoid A customized local robot low-level module, called robots, such as NAO, Pepper or Romeo. In the following mc naoqi dcm4, is cross-compiled for NAOqi OS and is subsections, we describe the entire system in detail. set to run onboard the robot to read sensor values and set device commands synchronized with a robot control loop A. Forwarding device commands from controller to the robot via Device Communication Manager (DCM) every 12 ms, fastest update rate currently available for SBRE robots. mc naoqi The main role of the interface is to forward When a user connects to the robot via mc naoqi inter- the fixed frame rate control commands computed by the QP face, and commands to turn on robot motors, a preprocess mc rtc solver of whole-body QP controller to the onboard function is connected to DCM loop, to start setting the low-level robot actuators control. The decision variable of actuator commands at a fixed time rate, synchronized with mc rtc the QP controller is robot joint accelerations, which the other DCM operations. After the user commands to turn is integrated once to get desired velocity (e.g. for Pepper off robot motors via mc naoqi interface, the preprocess mobile base command), and then once more to get desired actuator command update function is disconnected from the robot joint angles for joint actuator commands. DCM loop. This way, the user can safely use other control For social, user-friendly and interacting humanoid robots, applications, such as Choregraphe, with the robot right after such as Pepper or NAO, it is highly beneficial to endow using mc naoqi interface, even though mc naoqi dcm mc rtc controller with the functionality to also forward module is still active on the robot. other device commands, such as sentence to play from the In order to prevent the default high-level robot behaviours speakers, desired tablet screen image or eye led color, from to interfere with the commands forwarded to the robot via the mc rtc controller to the robot devices via mc naoqi mc naoqi from the mc rtc controller, the default robot interface. This functionality allows mc rtc framework users safety reflexes are disabled when robot motors are turned to develop controllers which can provide a richer interaction on via mc naoqi.
Recommended publications
  • The Sphingidae (Lepidoptera) of the Philippines
    ©Entomologischer Verein Apollo e.V. Frankfurt am Main; download unter www.zobodat.at Nachr. entomol. Ver. Apollo, Suppl. 17: 17-132 (1998) 17 The Sphingidae (Lepidoptera) of the Philippines Willem H o g e n e s and Colin G. T r e a d a w a y Willem Hogenes, Zoologisch Museum Amsterdam, Afd. Entomologie, Plantage Middenlaan 64, NL-1018 DH Amsterdam, The Netherlands Colin G. T readaway, Entomologie II, Forschungsinstitut Senckenberg, Senckenberganlage 25, D-60325 Frankfurt am Main, Germany Abstract: This publication covers all Sphingidae known from the Philippines at this time in the form of an annotated checklist. (A concise checklist of the species can be found in Table 4, page 120.) Distribution maps are included as well as 18 colour plates covering all but one species. Where no specimens of a particular spe­ cies from the Philippines were available to us, illustrations are given of specimens from outside the Philippines. In total we have listed 117 species (with 5 additional subspecies where more than one subspecies of a species exists in the Philippines). Four tables are provided: 1) a breakdown of the number of species and endemic species/subspecies for each subfamily, tribe and genus of Philippine Sphingidae; 2) an evaluation of the number of species as well as endemic species/subspecies per island for the nine largest islands of the Philippines plus one small island group for comparison; 3) an evaluation of the Sphingidae endemicity for each of Vane-Wright’s (1990) faunal regions. From these tables it can be readily deduced that the highest species counts can be encountered on the islands of Palawan (73 species), Luzon (72), Mindanao, Leyte and Negros (62 each).
    [Show full text]
  • AUTONOMOUS NAVIGATION with NAO David Lavy
    AUTONOMOUS NAVIGATION WITH NAO David Lavy and Travis Marshall Boston University Department of Electrical and Computer Engineering 8 Saint Mary's Street Boston, MA 02215 www.bu.edu/ece December 9, 2015 Technical Report No. ECE-2015-06 Summary We introduce a navigation system for the humanoid robot NAO that seeks to find a ball, navigate to it, and kick it. The proposed method uses data acquired using the 2 cameras mounted on the robot to estimate the position of the ball with respect to the robot and then to navigate towards it. Our method is also capable of searching for the ball if is not within the robots immediate range of view or if at some point, NAO loses track of it. Variations of this method are currently used by different universities around the world in the international robotic soccer competition called Robocup. This project was completed within EC720 graduate course entitled \Digital Video Processing" at Boston University in the fall of 2015. i Contents 1 Introduction 1 2 Literature Review 1 3 Problem Solution 2 3.1 Find position of the ball . .3 3.2 Positioning the robot facing the ball . 10 3.3 Walking to the ball . 11 3.4 Kicking the ball . 12 4 Implementation 12 4.1 Image Acquisition . 13 4.2 Finding Contours and Circles . 13 4.3 Navigation and kicking for NAO . 13 5 Experimental Results 14 5.1 Ball identification results by method . 14 5.2 Confusion matrices . 14 5.3 Centering NAO to face the ball . 15 6 Conclusion and Future Work 16 7 Appendix 17 7.1 NAO features .
    [Show full text]
  • Evaluating the Nao Robot in the Role of Personal Assistant: the Effect of Gender in Robot Performance Evaluation †
    Proceedings Evaluating the Nao Robot in the Role of Personal Assistant: The Effect of Gender in Robot Performance Evaluation † Adrian Vega *, Kryscia Ramírez-Benavides, Luis A. Guerrero and Gustavo López Centro de Investigaciones en Tecnologías de la Información y Comunicación, Universidad de Costa Rica, 2060 San José, Costa Rica; [email protected] (K.R.-B.); [email protected] (L.A.G.); [email protected] (G.L.) * Correspondence: [email protected] † Presented at the 13th International Conference on Ubiquitous Computing and Ambient Intelligence UCAmI 2019, Toledo, Spain, 2–5 December 2019. Published: 20 November 2019 Abstract: By using techniques such as the Wizard of Oz (WoZ) and video capture, this paper evaluated the performance of the Nao Robot in the role of a personal assistant, which was valuated alongside the impact of the assigned gender (male/female) in the perceived performance of the robot assistant. Within a sample size of 39 computer sciences students, this study assessed criteria such as: perceived enjoyment, intention to use, perceived sociability, trust, intelligence, animacy, anthropomorphism, and sympathy, utilizing testing tools such as Unified Theory of Acceptance and Use of Technology (UTAUT) and Godspeed Questionnaire (GSQ). These methods identified a significant effect of the gender assigned to the robot in variables such as intelligence and sympathy. Keywords: human–robot interaction; HRI; HCI; UTAUT; GSQ; WoZ; gender 1. Introduction Starting as manufacturing machines, robots have opened to a wider application of areas such as education [1–3], personal assistance [4], health [5,6], and many others. Multiple research studies have described different elements to consider in the design of interactions with socially intelligent robots [6–9].
    [Show full text]
  • Examining the Use of Robots As Teacher Assistants in UAE
    Volume 20, 2021 EXAMINING THE USE OF ROBOTS AS TEACHER ASSISTANTS IN UAE CLASSROOMS: TEACHER AND STUDENT PERSPECTIVES Mariam Alhashmi* College of Education, Zayed University, [email protected] Abu Dhabi, UAE Omar Mubin Senior Lecturer in Human Computer [email protected] Interaction, Sydney, Australia Rama Baroud Part-Time Research Assistant [email protected] * Corresponding author ABSTRACT Aim/Purpose This study sought to understand the views of both teachers and students on the usage of humanoid robots as teaching assistants in a specifically Arab context. Background Social robots have in recent times penetrated the educational space. Although prevalent in Asia and some Western regions, the uptake, perception and ac- ceptance of educational robots in the Arab or Emirati region is not known. Methodology A total of 20 children and 5 teachers were randomly selected to comprise the sample for this study, which was a qualitative exploration executed using fo- cus groups after an NAO robot (pronounced now) was deployed in their school for a day of revision sessions. Contribution Where other papers on this topic have largely been based in other countries, this paper, to our knowledge, is the first to examine the potential for the inte- gration of educational robots in the Arab context. Findings The students were generally appreciative of the incorporation of humanoid robots as co-teachers, whereas the teachers were more circumspect, express- ing some concerns and noting a desire to better streamline the process of bringing robots to the classroom. Recommendations We found that the malleability of the robot’s voice played a pivotal role in the for Practitioners acceptability of the robot, and that generally students did well in smaller Accepting Editor Minh Q.
    [Show full text]
  • Advance Your Students Into the Future Secondary Education
    ADVANCE YOUR STUDENTS INTO THE FUTURE SECONDARY EDUCATION www.active-robots.com/aldebaran STEP INTO THE FUTURE CLASSROOM Robotics is the fastest growing industry and most advanced technology used in education and research. The NAO humanoid robot is the ideal platform for MOTIVATE STUDENTS teaching or researching in Science and Technology. — IMPROVE LEARNING By using our NAO robotics platform, instructors and researchers EFFECTIVENESS stay current with major technical and commercial breakthroughs in — TEACH A JOB-CREATING FIELD programming and applied research. WHY STUDY A HUMANOID ROBOT? MAJOR INNOVATION MULTIDISCIPLINARY PLATFORM ROBOT & JOB-CREATING FIELD FOR TEACHING & RESEARCH FASCINATION — — — After Computer and Internet, Robotics is the new Computer sciences, mechanics, electronics, Humanoid robots have always fascinated people technological revolution. With ageing population and control are already at the core of the NAO especially students with new applications and and labour shortage, humanoid robots will be platform. Our curriculum used in conjunction incredible inventions. Now technology has made one of the solutions for people assistance thanks with NAO allows students to develop a structured a huge leap forward. Stemming from 6 years to their humanoid shape adapted to a world approach to finding solutions and adapting a wide of research, NAO is one of the most advanced made for humans. Educate students today using range of cross-sectional educational content. One humanoid robots ever created. He is fully the NAO platform for opportunities in robotics, example is for the instructor to assign students programmable, open and autonomous. engineering, computer science and technology. In to program NAO to grasp an object and lift it.
    [Show full text]
  • Humanoid Navigation and Heavy Load Transportation in a Cluttered Environment Antoine Rioux, Wael Suleiman
    Humanoid navigation and heavy load transportation in a cluttered environment Antoine Rioux, Wael Suleiman To cite this version: Antoine Rioux, Wael Suleiman. Humanoid navigation and heavy load transportation in a cluttered environment. 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Sep 2015, Hambourg, Germany. pp.2180-2186, 10.1109/IROS.2015.7353669. hal-01521584 HAL Id: hal-01521584 https://hal.archives-ouvertes.fr/hal-01521584 Submitted on 12 May 2017 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Humanoid Navigation and Heavy Load Transportation in a Cluttered Environment Antoine Rioux and Wael Suleiman Abstract— Although in recent years several studies aimed at the navigation of robots in cluttered environments, just a few have addressed the problem of robots navigating while moving a large or heavy object. This is especially useful when transporting loads with variable weights and shapes without having to change the robot hardware. On one hand, a major advantage of using a humanoid robot to move an object is that it has arms to firmly grasp it and control it. On the other hand, humanoid robots tend to have higher drift than their wheeled counterparts as well as having significant lateral swing while walking, which propagates to anything they carry.
    [Show full text]
  • Introducing the New Generation of Nao Robot
    INTRODUCING THE NEW GENERATION OF NAO ROBOT SoftBank Robotics Europe Outline 01 INTRODUCTION OF NAO6 02 NAO6 VALUE PROPOSITION & BENEFITS 03 SOFTBANK ROBOTICS QUICK VIEW NAO6 INTRODUCTION NAO6 INTRODUCTION NAO6 IMPROVEMENTS MARKET SECTORS SoftBank Robotics Europe THE 6TH GENERATION OF HUMANOID ROBOT NAO II Attractive programmable platform: create a unique human-robot interaction experience and leverage it to a new level II DETECTION 2 5-megapixels cameras 58 cm ACOUSTIC COMPUTING 4 omnidirectional microphones CPU ATOM E3845 2 loudspeakers Quad core 1.91 GHz 4 GB DDR3 RAM 32 GB SSD CONNECTIVITY Bluetooth – Ethernet - Wi-Fi SPEECH RECOGNITION More than 20 Languages GRACEFUL BODY MOVEMENTS 25 degrees of freedom FALL MANAGER Detects falls & trigger the protection FALL RECOVERY Able to stand up alone EXPLORATION 4 sonars to detect obstacles ADAPTIVE WALK 8x Force Sensitive Resistors 5,5 kg NAO6, 6 MAJOR AREAS OF HARDWARE IMPROVEMENT II A continuous augmentation of robot performance: enriched package for a greater product II 1 - POWER 1 - POWER 6 CPU – ATOM Z530 ➔ E3845 NAO benefits from the progress made on Pepper which Memory: 8GB SDCard ➔ 32GB SSD makes it more powerful. 2 - VISION Camera – Aptina MT114 1.3Mpix ➔ 3 – AUDIO 2 - VISION Omnivision 5640 5Mpix Cardioid mic ➔ 6 Omnidirectional mic With its new cameras, NAO better detects people. + Audio codec Dual stream of the top and bottom cameras is now supported. 3 - AUDIO NAO6 hears and understands a lot better making dialog a full part of the interactions. 4 – MOTION Motors - PortEscape 16 GT ➔ PortEscape 16 GT MP 4 - MOTION Thanks to its new motors, NAO6 can move longer without overheating.
    [Show full text]
  • An Interactive Tool for Designing Complex Robot Motion Patterns
    An Interactive Tool for Designing Complex Robot Motion Patterns Georgios Pierris and Michail G. Lagoudakis Abstract— Low-cost robots with a large number of degrees KME was originally designed for and currently supports of freedom are becoming increasingly popular, nevertheless only the Aldebaran Nao humanoid robot (RoboCup edi- their programming is still a domain for experts. This paper tion) [1], which features a total of 21 degrees of freedom, and introduces the Kouretes Motion Editor (KME), an interactive software tool for designing complex motion patterns on robots its simulated model on the Webots simulator [2]. However, with many degrees of freedom using intuitive means. KME the main features of KME could be easily adapted for allows for a TCP/IP connection to a real or simulated robot, other robots and the tool itself could be used for a variety over which various robot poses can be communicated to or from of purposes, such as providing complex motion patterns the robot and manipulated locally using the KME graphical as starting points for learning algorithms and supporting user interface. This portability and flexibility enables the user to work under different modes, with different robots, using educational activities in robot programming courses. KME different host machines. KME was originally designed for and has been employed successfully by Kouretes, the RoboCup currently supports only the Aldebaran Nao humanoid robot team of the Technical University of Crete in Greece, for which features a total of 21 degrees of freedom. KME has designing various special actions (stand-up, ball kicks, goalie been employed successfully by Kouretes, the RoboCup team of falls), thanks to which the team ranked in the 3rd place at the Technical University of Crete, for designing various special actions, thanks to which the team ranked in the 3rd place at the RoboCup 2008 competition (Standard Platform League).
    [Show full text]
  • State of the Art: Bipedal Robots for Lower Limb Rehabilitation
    applied sciences Review State of the Art: Bipedal Robots for Lower Limb Rehabilitation Xiong Yang 1,†, Haotian She 2,†, Haojian Lu 1, Toshio Fukuda 2 and Yajing Shen 1,3,* 1 Department of Mechanical and Biomedical Engineering, University of Hong Kong, Tat Chee Avenue, Kowloon, Hong Kong 999077, China; [email protected] (X.Y.); [email protected] (H.L.) 2 Beijing Institute of Technology, No.5 Yard, Zhong Guan Cun South Street, Haidian District, Beijing 100000, China; [email protected] (H.S.); [email protected] (T.F.) 3 Centre for Robotics and Automation, CityU Shenzhen Research Institute, Shenzhen 518000, China * Correspondence: [email protected]; Tel.: +852-3442-2045 † These authors contributed equally to this work. Received: 5 October 2017; Accepted: 3 November 2017; Published: 16 November 2017 Abstract: The bipedal robot is one of the most attractive robots types given its similarity to the locomotion of human beings and its ability to assist people to walk during rehabilitation. This review summarizes the chronological historical development of bipedal robots and introduces some current popular bipedal robots age. Then, the basic theory-stability control and key technology-motion planning of bipedal robots are introduced and analyzed. Bipedal robots have a wide range of applications in the service, education, entertainment, and other industries. After that, we specifically discuss the applications of bipedal robots in lower limb rehabilitation, including wearable exoskeleton robots, rehabilitation equipment, soft exoskeleton robots, and unpowered exoskeleton robots, and their control methods. Lastly, the future development and the challenges in this field are discussed.
    [Show full text]
  • Understanding Robot Acceptance/ Rejection: the SAR Model
    2020 29th IEEE International Conference on Robot and Human Interactive Communication Aug 31 – Sept 4, 2020 Virtual Conference Understanding robot acceptance/ rejection: the SAR Model Mele C., Russo Spena T., Tregua M., Laddaga C., Ranieri A., Ruggiero A, Gargiulo R. Introduction Artificial Intelligence and robots are moving very rapidly into everyday life (Forbes, 2019). Robots offer opportunities for service automation, productivity and effectiveness (Wirtz et al., 2018; MIT 2018) - Dystopian future about their effect on Acceptance or employee and society (Forbes, 2018) Resistance? - Some recent failures or difficulties (e.g., Jibo, Kuri, Keckeer, Pepper) Literature on Social and Service Robots CLASSIFICATION ü Industrial, professional service, and personal service robots (Murphy et al., 2017); ü Embodied (with virtual body or face) or disembodied (only voice-based); ü Functional tool-like, zoomorphic animal-like, caricatured cartoon-like, anthropomorphic (Fong et al., 2003; Jörling, et al., 2019); ü Robot as a service (RAAS) (Tung et al., 2017). FUNCTIONALITIES ü Devices capable of autonomous decision-making (Pagallo, 2013) ü Physical presence, non-verbal capabilities and gestures (Mimoun and Poncin, 2015) ü Ability to adapt and interact with users (Čaić et al., 2018; Wirtz et al., 2018) ü Make customers feel they are with another social entity (van Doorn et al., 2017) Agents & Robots in Service Research: The sRAM mployees: frontline service roles (van Doorn et al., 2017; Wirtz et al., 2018) utonomous decision-making entities: service with potential positive performance on customer’s value and experience (Čaić et al., 2018; Huang and Rust, 2018, De Keyser et al., 2019) ocial entities: some threats to value creation in service settings can be envisaged (Bolton, 2017; Wirts et al., 2018, Čaić et al., 2018) Wirtz et al.
    [Show full text]
  • Discover 4 Examples of Pepper Helping in the Battle Against Covid-19
    Discover 4 examples of Pepper helping in the battle against Covid-19 Pepper has been deployed all across EMEA to help limit exposure to viruses and ensure people are wearing a mask in confined spaces. Paris, December 17th – As the whole world is still facing an unprecedented health crisis, SoftBank Robotics and its partners are developing new robotic solutions to help fight against the spread of the pandemic. Thanks to its partners, SoftBank Robotics has been able to deploy multiple Pepper robots all across EMEA to help companies and public places to enforce social distancing and mask wearing. Discover 4 examples of successful deployments in different industries: • Pepper helping elderly at Casa Sollievo hospital in Italy Thanks to the telepresence application called roboMate made by Behaviour Labs, Pepper can be remotely controlled to enter the room helping monitor hospitalized patients. The staff can communicate with the patient and check the health video monitor without physically accessing the room. The application roboMate also allows relatives to communicate with patients and thus maintain the link when visits are particularly restricted in the hospital. In addition, doctors can remotely start specific tests and exercises for cognitive behavioral rehabilitation. It allows the patient to talk to the psychologist and execute therapy using RAT (Robot Assisted Therapy). • Pepper reminding mask wearing in malls in Germany Thanks to ENTRANCE Robotics, Pepper has been deployed in multiple malls across Germany. Placed in the entrance area, Pepper has been tasked with reminding shoppers to wear masks. If Pepper recognizes a mask, he thanks them - if he doesn't, he kindly reminds them to put one on.
    [Show full text]
  • On the Use of the Humanoid Bioloid System for Robot-Assisted Transcription of Mexican Spanish Speech
    Article On the Use of the Humanoid Bioloid System for Robot-Assisted Transcription of Mexican Spanish Speech Santiago-Omar Caballero-Morales Received: 28 August 2015; Accepted: 9 December 2015; Published: 25 December 2015 Academic Editor: Hung-Yu Wang Postgraduate Division, Technological University of the Mixteca, Road to Acatlima Km. 2.5, Huajuapan de Leon, Oaxaca 69000, Mexico; [email protected] Abstract: Within the context of service robotics (SR), the development of assistive technologies has become an important research field. However, the accomplishment of assistive tasks requires precise and fine control of the mechanic systems that integrate the robotic entity. Among the most challenging tasks in robot control, the handwriting task (transcription) is of particular interest due to the fine control required to draw single and multiple alphabet characters to express words and sentences. For language learning activities, robot-assisted speech transcription can motivate the student to practice pronunciation and writing tasks in a dynamic environment. Hence, this paper is aimed to provide the techniques and models to accomplish accurate robot-assisted transcription of Spanish speech. The transcriptor is integrated by a multi-user speech recognizer for continuous speech and the kinematic models for the Mexican Spanish alphabet characters. The Bioloid system with the standard humanoid configuration and no special modifications or tools was considered for implementation. Particularly, the proposed transcriptor could perform the handwriting task with the Bioloid’s two two DOF (degrees-of-freedom) arms. This enabled writing of one-line short and long sentences with small alphabet characters (width <1.0 cm). It is expected that the technique and models that integrate the transcriptor can provide support for the development of robot-assisted language learning activities for children and young adults.
    [Show full text]