DOCSLIB.ORG

REFLEXIVE COLLISION RESPONSE with VIRTUAL SKIN Roadmap Planning Meets Reinforcement Learning

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
REFLEXIVE COLLISION RESPONSE with VIRTUAL SKIN Roadmap Planning Meets Reinforcement Learning REFLEXIVE COLLISION RESPONSE WITH VIRTUAL SKIN Roadmap Planning Meets Reinforcement Learning Mikhail Frank, Alexander Forster¨ and Jurgen¨ Schmidhuber Dalle Molle Institute for Artificial Intelligence (IDSIA), CH-6928 Manno-Lugano, Switzerland Facolta` di Scienze Informatiche, Universita` della Svizzera Italiana, CH-6904 Lugano, Switzerland Dipartimento Tecnologie Innovative, Scuola Universitaria Professionale della Svizzera Italiana CH-6928 Manno-Lugano, Switzerland Keywords: Roadmap planning, Reinforcement learning, Collision avoidance, Robotics framework. Abstract: Prevalent approaches to motion synthesis for complex robots offer either the ability to build up knowledge of feasible actions through exploration, or the ability to react to a changing environment, but not both. This work proposes a simple integration of roadmap planning with reflexive collision response, which allows the roadmap representation to be transformed into a Markov Decision Process. Consequently, roadmap planning is extended to changing environments, and the adaptation of the map can be phrased as a reinforcement learn- ing problem. An implementation of the reflexive collision response is provided, such that the reinforcement learning problem can be studied in an applied setting. The feasibility of the software is analyzed in terms of runtime performance, and its functionality is demonstrated on the iCub humanoid robot. 1 INTRODUCTION a way to improve their adaptiveness and exploit the versatility of modern hardware. This will undoubt- Currently available industrial robots are employed to edly require a broad spectrum of behaviors that are do repetitive work in structured environments, and applicable under a variety of environmental con- their highly specialized nature is therefore unprob- straints/configurations. At the highest level, the ver- lematic, or even desirable. However the next gener- satile agent/controller must solve a variety of differ- ation of robot helpers is expected to tackle a much ent problems by identifying relevant constraints and wider variety of applications, working alongside peo- developing or invoking appropriate behaviors. How- ple in homes, schools, hospitals, and offices. The ever we, as engineers and programmers, are not likely hardware exists already. State-of-the-art humanoid to be able to explicitly and accurately predict the robots such as the NASA/GM Robonaut 2 (Diftler wide range of constraints and operating conditions et al., 2011), the Willow Garage Personal Robot 2 that will be encountered in homes, schools, hospi- (http://www.willowgarage.com), the iCub from the tals, and offices, where the next generation of robots Italian Institute of Technology (IIT) (Metta et al., should serve. This is one motivation for the develop- 2008), and Toyota’s Partner Robots (Takagi, 2006; mental approach to robotics, which focuses on sys- Kusuda, 2008) are impressive machines with many tems that adaptively and incrementally build a reper- degrees of freedom (DOFs). Physically speaking, toire of actions and/or behaviors from experience. they should be capable of doing a much wider va- To effectively learn from experience, an riety of jobs than their industrial ancestors. Behav- agent/controller must explore. However given iors however are still programmed manually by ex- the fragility of robotic hardware, exploratory be- perts and the resulting programs are generally engi- havior can be quite hazardous. Self-collision and neered to solve a particular instance (or at best a set of collision with fixed objects in the environment related instances) of a task. Consequently, these ad- usually lead to calibration problems and/or broken vanced robots are endowed with relatively few, highly components, both of which require time-consuming specialized control programs, and their versatility re- maintenance efforts that interrupt experimentation. mains quite limited. For these reasons, implementing exploratory be- In order to realize the potential of modern hu- havior in simulation is an appealing alternative to manoid robots, especially with respect to service in the real world. In fact this is the approach favored unstructured, dynamic environments, we must find in most of the path planning literature, which fo- 642 Frank M., Förster A. and Schmidhuber J.. REFLEXIVE COLLISION RESPONSE WITH VIRTUAL SKIN - Roadmap Planning Meets Reinforcement Learning. DOI: 10.5220/0003883206420651 In Proceedings of the 4th International Conference on Agents and Artificial Intelligence (SSIR-2012), pages 642-651 ISBN: 978-989-8425-95-9 Copyright c 2012 SCITEPRESS (Science and Technology Publications, Lda.) REFLEXIVE COLLISION RESPONSE WITH VIRTUAL SKIN - Roadmap Planning Meets Reinforcement Learning cuses primarily on off-line search for feasible mo- ment is phrased as a reinforcement learning (RL) tions that interpolate a starting configuration and a problem. goal configuration. Many such planning algorithms 3. Topological changes to the roadmap can be han- offer desirable theoretical properties, such as proba- dled within the MDP framework. bilistic completeness. However, the configuration of the workspace/environment must not change between In section 6, we introduce our open source soft- the simulated synthesis and validation of a motion ware framework, which implements the tight cou- and the execution of the motion by hardware. Since pling of planning and reactive control modules. In the static environment assumption does not usually section 7, we conduct a brief feasibility study on the hold in the real world, the practical applicability of implemented software, which was developed in col- most path planning algorithms outside the laboratory laboration with the EU project IM-CLeVeR. Finally, is quite limited. in section 8 we discuss outstanding issues and future Exploratory behavior can of course be imple- work . mented on hardware, provided that there exists an on- line monitoring mechanism to prevent harmful col- lisions. Such a system must identify infeasible mo- 2 THE MOTION PLANNING tions and revise them in real-time. Run-time perfor- PROBLEM mance is clearly of primary concern, and most on-line collision avoidance approaches therefore revise mo- For an arm (or a humanoid upper body) working in tions according to some heuristics that are computed 3D space, the motion planning problem is formalized locally, in the neighborhood of impending collisions. as follows: The workspace, Fast though it is, re-planning motions according to lo- cal constraints only is indeed short-sighted, and on- W = 3 (1) line collision avoidance systems therefore make rela- R tively poor path planners. contains a robot composed of n links: We propose that an embodied, intelligent agent, n [ capable of adapting to a changing real world envi- A(q) = Ai(q) ⊂ W (2) ronment, requires both the ability to plan with re- i=1 spect to global task constraints and the ability to re- Each link, Ai, is represented by a semi-algebraic act to changes in its environment. Furthermore, it is model. The vector of joint positions our intuition that the planner should learn from the reactions to its plans, which requires a tightly inte- n q 2 C = R (3) grated approach to planning and control. In this work we consider the theoretical implications of coupling denotes the configuration of the robot A, and kine- a roadmap planner to a controller that provides re- matic constraints yield a proper functional mapping flexive reaction to collisions. Furthermore, we intro- q ! A(q). Furthermore, there exists an obstacle re- duce Virtual Skin, our open-source framework, which gion composed of m obstacles: monitors the state of a physical robot in real-time, m [ facilitating applied research on tightly coupled plan- O = Oi ⊂ W (4) ner/controler systems. i=1 The remainder of the paper proceeds as follows: Each obstacle, Oi, is also expressed as a semi- In section 2, the motion planning problem is defined. algebraic model. Prevalent approaches to motion planning and reactive To find feasible motions, we must disambiguate collision avoidance are discussed in sections 3 and 4, the feasible region of the configuration space, Cf ree ⊂ respectively. In section 5 we describe our assump- C, from the infeasible region: tions concerning the motion planning problem for non-static environments, and we propose the integra- Cin f easible = CO [Csel f ⊂ C (5) tion of reactive collision response into the roadmap C denotes the set of configurations q for which A(q) planning approach. The tight coupling of planning O intersects O: and control offers the considerable benefits that: 1. Roadmap planning is extended to non-static envi- CO = fq 2 C j A(q) \ O 6= ?g ⊂ C (6) ronments by transforming the roadmap graph into In equation 5 Csel f denotes the set of configurations q a Markov Decision Process (MDP). for which A(q) is self-intersecting. To handle this, let 2. Adaptation of the map to changes in the environ- P denote a set of pairs of indices ( j;k) 2 P such that 643 ICAART 2012 - International Conference on Agents and Artificial Intelligence j 6= k and j;k 2 f1;2;:::ng, which correspond to the Cin f easible must remain constant during the course of poses of two links A j and Ak that are not allowed to planning. The primary drawback of single query al- collide. As a matter of convenience, indices of links gorithms is their high complexity, which is O(mn), that share a common joint are typically excluded from where m is linear sampling density and n is the dimen- P. The set of self colliding poses can then be ex- sionality of the configuration space. A recent state- pressed: of-the-art algorithm, BT-RRT (Perez et al., 2011), re- quires 10 seconds to find a feasible solution to a rel- [ atively easy planning problem, wherein two arms (12 Csel f = fq 2 C j A j(q) \ Ak(q) 6= ?g ⊂ C (7) DOF) must circumvent the edge of a table. Moreover, [ j;k]2P the initial solution, the result of stochastic search, is The motion planning problem is essentially to find quite circuitous, and BT-RRT requires an additional 125 seconds to smooth the motion by minimizing a a trajectory T(qinitial;qgoal) ⊂ Cf ree that interpolates initial and goal configurations while not intersecting cost function in the style of optimal control.
Load more

Recommended publications
  • Artificial Intelligence: Soon to Be the World’S Greatest Intelligence, Or Just a Wild Dream? Edward R
    Johnson & Wales University ScholarsArchive@JWU Academic Symposium of Undergraduate College of Arts & Sciences Scholarship 3-22-2010 Artificial Intelligence: Soon to be the world’s greatest intelligence, or just a wild dream? Edward R. Kollett Johnson & Wales University - Providence, [email protected] Follow this and additional works at: https://scholarsarchive.jwu.edu/ac_symposium Part of the Artificial Intelligence and Robotics Commons, Arts and Humanities Commons, Nanoscience and Nanotechnology Commons, and the Social and Behavioral Sciences Commons Repository Citation Kollett, Edward R., "Artificial Intelligence: Soon to be the world’s greatest intelligence, or just a wild dream?" (2010). Academic Symposium of Undergraduate Scholarship. 3. https://scholarsarchive.jwu.edu/ac_symposium/3 This Research Paper is brought to you for free and open access by the College of Arts & Sciences at ScholarsArchive@JWU. It has been accepted for inclusion in Academic Symposium of Undergraduate Scholarship by an authorized administrator of ScholarsArchive@JWU. For more information, please contact [email protected]. Artificial Intelligence: Soon to be the world’s greatest intelligence, or just a wild dream? Edward Kollett Johnson & Wales University Honors Program 2009 Edward Kollett, Page 2 Artificial Intelligence is a term, coined by John McCarthy in 1956, that “in its broadest sense would indicate the ability of an artifact to perform the same kinds of functions that characterize human thought processes” (“Artificial Intelligence”). Typically, it is used today to refer to a computer program that is trying to simulate the human brain, or at least parts of it. Attempts to recreate the human brain have been a goal of mankind for centuries, but only recently, as computers have become as powerful as they are now, does the goal of a fully automated robot with human intelligence and emotional capabilities seems to be within reach.
    [Show full text]
  • Robonaut 2 Fact Sheet
    National Aeronautics and Space Administration Robonaut 2 facts NASA Almost 200 people from 15 countries have visited the International Space Station, but the orbiting complex has only had human crew members – until now. Robonaut 2, the latest generation of the Robonaut astronaut helpers, launched to the space station aboard space shuttle Discovery on the STS-133 mission in February 2011. It is the fi rst humanoid robot in space, and although its primary job for now is demonstrating to engineers how dexterous robots behave in space, the hope is that, through upgrades and advancements, it could one day venture outside the station to help spacewalkers make repairs or additions to the station or perform scientifi c work. R2, as the robot is called, was unpacked in April and powered up for the first time in August. Though it is currently being tested inside the Destiny laboratory, over time both its territory and its applications could expand. Initial tasks identified for R2 include velocity air measurements and handrail cleaning, both of which are simple but necessary tasks that require a great deal of crew time. R2 also has a taskboard on which to practice flipping switches and pushing buttons. Over time, the robot should graduate to more complex tasks. There are no plans to return R2 to Earth. History Work on the first Robonaut began in 1997. The idea was to build a humanoid robot that could assist astronauts on tasks in which another pair of hands would be helpful or to venture forth to perform jobs either too dangerous for crew members to risk or too mundane for them to spend time on.
    [Show full text]
  • Talk with a Robot
    Talk With A Robot With its small, portable, travel size, kids and adults will love to bring it around to play with. Type a custom snippet or try one of the examples. Though, it was an improvement over the depressing white/black, its charm wore out pretty quickly. © 2014 Steve Worswick. “When the robot was active, people tended to respond and give feedback to whatever the robot was doing, saying ‘Wow!’, ‘Good job. Python 100. Typically, a chat bot communicates with a real person, but applications are being developed in which two chat bots can communicate with each other. We started with some of the key features. Human Robot Intelligent That Can Talk Dance Sing Watch Home Smart Humanoid Robot For Kids Education , Find Complete Details about Human Robot Intelligent That Can Talk Dance Sing Watch Home Smart Humanoid Robot For Kids Education,Human Robot Intelligent,Human Robots,Robots That Can Talk from Toy Robots Supplier or Manufacturer-Shenzhen Yuanhexuan Industrial Co. Another communication method I want to talk about is XMLRPC, which stands for XML-formatted Remote Procedure Call. The bots have hammers attached to micro servos that they use to hit targets on the other robot. Two human look-a-like robots invented by Japanese engineers. Unemployment. The site Cleverbot. Choose a material for your robot. Typically, a chat bot communicates with a real person, but applications are being developed in which two chat bots can communicate with each other. Slideshow ( 2 images ). Type a custom snippet or try one of the examples. In this week’s Tech Talk podcast: Brian Stelter discusses recent hacks on major Web sites and the author of a new book on robots discusses what is to come.
    [Show full text]
  • Robonaut 2 – Operations on the International Space Station
    Robonaut 2 – Operations on the International Space Station Ron Diftler Robonaut Project Lead Software, Robotics and Simulation Division NASA/Johnson Space Center [email protected] 2/14/2013 Overview Robonaut Motivation GM Relationship Robonaut Evolution Robonaut 2 (R2) Capabilities Preparing for ISS Journey to Space On Board ISS Future Activities Spinoffs Robonaut Motivation Capable Tool for Crew • Before, during and after activities Share EVA Tools and Workspaces. • Human Like Design Increase IVA and EVA Efficiency • Worksite Setup/Tear Down • Robotic Assistant • Contingency Roles Surface Operations • Near Earth Objects • Moon/Mars Interplanetary Vehicles Astronaut Nancy Currie works with 2 Robonauts to build a truss structure during an Telescopes experiment. Robonaut Development History 1998 • Subsystem Development • Testing of hand mechanism ROBONAUT 1999 Fall 1998 • Single Arm Integration • Testing with teleoperator ROBONAUT 2000 Fall 1999 • Dual Arm Integration • Testing with dual arm control ROBONAUT 2001 Fall 2000 • Waist and Vision Integration • Testing under autonomous control 2002 ROBONAUT • R1A Testing of Autonomous Learning Fall 2001 • R1B Integration 2003 ROBONAUT • R1A Testing Multi Agent EVA Team Fall 2002 • R1B Segwanaut Integration 2004 ROBONAUT Fall 2003 • R1A Autonomous Manipulation • R1B 0g Airbearing Development 2005 ROBONAUT Fall 2004 • DTO Flight Audit • Begin Development of R1C ROBONAUT 2006 Fall 2006 • Centaur base • Coordinated field demonstration GM’s Motivation Why did GM originally come to us? • World
    [Show full text]
  • Ph. D. Thesis Stable Locomotion of Humanoid Robots Based
    Ph. D. Thesis Stable locomotion of humanoid robots based on mass concentrated model Author: Mario Ricardo Arbul´uSaavedra Director: Carlos Balaguer Bernaldo de Quiros, Ph. D. Department of System and Automation Engineering Legan´es, October 2008 i Ph. D. Thesis Stable locomotion of humanoid robots based on mass concentrated model Author: Mario Ricardo Arbul´uSaavedra Director: Carlos Balaguer Bernaldo de Quiros, Ph. D. Signature of the board: Signature President Vocal Vocal Vocal Secretary Rating: Legan´es, de de Contents 1 Introduction 1 1.1 HistoryofRobots........................... 2 1.1.1 Industrialrobotsstory. 2 1.1.2 Servicerobots......................... 4 1.1.3 Science fiction and robots currently . 10 1.2 Walkingrobots ............................ 10 1.2.1 Outline ............................ 10 1.2.2 Themes of legged robots . 13 1.2.3 Alternative mechanisms of locomotion: Wheeled robots, tracked robots, active cords . 15 1.3 Why study legged machines? . 20 1.4 What control mechanisms do humans and animals use? . 25 1.5 What are problems of biped control? . 27 1.6 Features and applications of humanoid robots with biped loco- motion................................. 29 1.7 Objectives............................... 30 1.8 Thesiscontents ............................ 33 2 Humanoid robots 35 2.1 Human evolution to biped locomotion, intelligence and bipedalism 36 2.2 Types of researches on humanoid robots . 37 2.3 Main humanoid robot research projects . 38 2.3.1 The Humanoid Robot at Waseda University . 38 2.3.2 Hondarobots......................... 47 2.3.3 TheHRPproject....................... 51 2.4 Other humanoids . 54 2.4.1 The Johnnie project . 54 2.4.2 The Robonaut project . 55 2.4.3 The COG project .
    [Show full text]
  • Iterative Design of Advanced Mobile Robots
    Journal of Computing and Information Technology 1 Iterative Design of Advanced Mobile Robots Fran¸coisMichaud1∗, Dominic L´etourneau1 Eric´ Beaudry2, Maxime Fr´echette1, Froduald Kabanza2, and Michel Lauria1 1Department of Electrical Engineering and Computer Engineering, Universit´ede Sherbrooke, Qu´ebec Canada 2Department of Computer Science, Universit´ede Sherbrooke, Qu´ebec Canada Integration of hardware, software and decisional com- 1. Introduction ponents is fundamental in the design of advanced mo- bile robotic systems capable of performing challenging The dream of having autonomous machines perform- tasks in unstructured and unpredictable environments. ing useful tasks in everyday environments, as un- We address such integration challenges following an it- structured and unpredictable as they can be, has erative design strategy, centered on a decisional archi- motivated for many decades now research in robotics tecture based on the notion of motivated selection of and artificial intelligence. However, intelligent and behavior-producing modules. This architecture evolved autonomous mobile robots is still in what can be over the years from the integration of obstacle avoid- ance, message reading and touch screen graphical inter- identified as being research phases, i.e., mostly basic faces, to localization and mapping, planning and schedul- research and concept formulation, and some prelimi- ing, sound source localization, tracking and separation, nary uses of the technology with attempts in clarify- speech recognition and generation on a custom-made in- ing underlying ideas and generalizing the approach teractive robot. Designed to be a scientific robot re- [Shaw 2002]. The challenge in making such a dream porter, the robot provides understandable and config- become a reality lies in the intrinsic complexities urable interaction, intention and information in a con- and interdependencies of the necessary components ference setting, reporting its experiences for on-line and to be integrated in a robot.
    [Show full text]
  • The Meteron Supvis-Justin Telerobotic Experiment and the Solex Proving Ground
    See discussions, stats, and author profiles for this publication at: http://www.researchgate.net/publication/277268674 SIMULATING AN EXTRATERRESTRIAL ENVIRONMENT FOR ROBOTIC SPACE EXPLORATION: THE METERON SUPVIS-JUSTIN TELEROBOTIC EXPERIMENT AND THE SOLEX PROVING GROUND CONFERENCE PAPER · MAY 2015 READS 16 8 AUTHORS, INCLUDING: Neal Y. Lii Daniel Leidner German Aerospace Center (DLR) German Aerospace Center (DLR) 20 PUBLICATIONS 43 CITATIONS 10 PUBLICATIONS 28 CITATIONS SEE PROFILE SEE PROFILE Benedikt Pleintinger German Aerospace Center (DLR) 9 PUBLICATIONS 11 CITATIONS SEE PROFILE Available from: Neal Y. Lii Retrieved on: 24 September 2015 SIMULATING AN EXTRATERRESTRIAL ENVIRONMENT FOR ROBOTIC SPACE EXPLORATION: THE METERON SUPVIS-JUSTIN TELEROBOTIC EXPERIMENT AND THE SOLEX PROVING GROUND Neal Y. Lii1, Daniel Leidner1, Andre´ Schiele2, Peter Birkenkampf1, Ralph Bayer1, Benedikt Pleintinger1, Andreas Meissner1, and Andreas Balzer1 1Institute of Robotics and Mechatronics, German Aerospace Center (DLR), 82234 Wessling, Germany, Email: [email protected], [email protected] 2Telerobotics and Haptics Laboratory, ESA, 2201 AZ Noordwijk, The Netherlands, Email: [email protected] ABSTRACT This paper presents the on-going development for the Supvis-Justin experiment lead by DLR, together with ESA, planned for 2016. It is part of the ESA initiated Me- teron telerobotics experiment suite aimed to study differ- ent forms of telerobotics solutions for space applications. Supvis-Justin studies the user interface design, and super- vised autonomy aspects of telerobotics, as well as tele- operated tasks for a humanoid robot by teleoperating a dexterous robot on earth (located at DLR) from the Inter- national Space Station (ISS) with the use of a tablet PC. Figure 1.
    [Show full text]
  • HBS-1: a Modular Child-Size 3D Printed Humanoid
    robotics Article HBS-1: A Modular Child-Size 3D Printed Humanoid Lianjun Wu, Miles Larkin, Akshay Potnuru and Yonas Tadesse * Received: 6 November 2015; Accepted: 4 January 2016; Published: 13 January 2016 Academic Editor: Huosheng Hu Humanoid, Biorobotics and Smart Systems Laboratory (HBS Lab), Department of Mechanical Engineering, The University of Texas at Dallas, Richardson TX 75080, USA; [email protected] (L.W.); [email protected] (M.L.); [email protected] (A.P.) * Correspondence: [email protected]; Tel.: +1-972-883-4556; Fax: +1-972-883-4659 Abstract: An affordable, highly articulated, child-size humanoid robot could potentially be used for various purposes, widening the design space of humanoids for further study. Several findings indicated that normal children and children with autism interact well with humanoids. This paper presents a child-sized humanoid robot (HBS-1) intended primarily for children’s education and rehabilitation. The design approach is based on the design for manufacturing (DFM) and the design for assembly (DFA) philosophies to realize the robot fully using additive manufacturing. Most parts of the robot are fabricated with acrylonitrile butadiene styrene (ABS) using rapid prototyping technology. Servomotors and shape memory alloy actuators are used as actuating mechanisms. The mechanical design, analysis and characterization of the robot are presented in both theoretical and experimental frameworks. Keywords: humanoid; mechanical design; actuators; manufacturing; 3D printing 1. Introduction Humanoid robots have great potential for use in our daily life by accompanying or working together with people. Growing interest in humanoid robots has spurred a substantial increase in their development over the past decade.
    [Show full text]
  • Fact Sheet: History of Robotics
    Fact Sheet: History of Robotics www.RazorRobotics.com ≈250 B.C. - Ctesibius, an ancient Greek engineer and mathematician, invented a water clock which was the most accurate for nearly 2000 years. ≈60 A.D. - Hero of Alexandria designs the first automated programmable machine. These 'Automata' were made from a container of gradually releasing sand connected to a spindle via a string. By using different configurations of these pulleys, it was possible to repeatably move a statue on a pre-defined path. 1898 - The first radio-controlled submersible boat was invented by Nikola Tesla. 1921 - The term 'Robot' was coined by Karel Capek in the play 'Rossum's Universal Robots'. 1941 - Isaac Asimov introduced the word 'Robotics' in the science fiction short story 'Liar!' 1948 - William Grey Walter builds Elmer and Elsie, two of the earliest autonomous robots with the appearance of turtles. The robots used simple rules to produce complex behaviours. 1954 - The first silicon transistor was produced by Texas Instruments. 1956 - George Devol applied for a patent for the first programmable robot, later named 'Unimate'. 1957 - Launch of the first artificial satellite, Sputnik 1. I, Robot Turtle robot Sputnik 1 1961 - First Unimate robot installed at General Motors. Used for welding and die casting. 1965 - Gordon E. Moore introduces the concept 'Moore's law', which predicts the number of components on a single chip would double every two years. 1966 - Work began on the 'Shakey' robot at Stanford Research Institute. 'Shakey' was capable of planning, route-finding and moving objects. 1969 - The Apollo 11 mission, puts the first man on the moon.
    [Show full text]
  • Arxiv:2105.02313V2 [Cs.RO] 7 May 2021
    iCub Lorenzo Natale, Chiara Bartolozzi, Francesco Nori, Giulio Sandini, Giorgio Metta This is a post-peer-review, pre-copyedit version of an article published in Humanoid Robotics: A Reference, Springer. The final authenticated version is available online at: https://doi.org/10.1007/978-94-007-6046-2 21 Cite this Chapter as: Natale L., Bartolozzi C., Nori F., Sandini G., Metta G. (2017) iCub. In: Goswami A., Vadakkepat P. (eds) Humanoid Robotics: A Reference. Springer, Dordrecht. https://doi.org/10.1007/978-94-007-6046-2 21 Abstract In this chapter we describe the history and evolution of the iCub hu- manoid platform. We start by describing the first version as it was designed dur- ing the RobotCub EU project and illustrate how it evolved to become the platform that is adopted by more than 30 laboratories world–wide. We complete the chapter by illustrating some of the research activities that are currently carried out on the iCub robot, i.e. visual perception, event-driven sensing and dynamic control. We conclude the Chapter with a discussion of the lessons we learned and a preview of the upcoming next release of the robot, iCub 3.0. arXiv:2105.02313v2 [cs.RO] 7 May 2021 Lorenzo Natale, Chiara Bartolozzi, Francesco Nori, Giulio Sandini, Giorgio Metta Istituto Italiano di Tecnologia, via Morego 30, 16163, Genova, Italy, e-mail: name.surname@ iit.it 1 2 Lorenzo Natale, Chiara Bartolozzi, Francesco Nori, Giulio Sandini, Giorgio Metta 1 Introduction Robotics has been growing at constant pace, with the expectation that robots will find application outside research laboratories.
    [Show full text]
  • PDF (Thumbnails)
    Serving robot finds work at Victoria restaurant () Utopia VR - The Metaverse for Everyone () Utopia VR Promo Video () Facebook warned over ‘very small’ indicator LED on smart glasses, as EU DPAs flag privacy concerns () Google’s Former AI Ethics Chief Has a Plan to Rethink Big Tech () Introducing iPhone 13 Pro | Apple () Introducing Apple Watch Series 7 | Apple () Apple reveals Apple Watch Series 7, featuring a larger, more advanced display () Xiaomi shows off concept smart glasses with MicroLED display () Xiaomi Smart Glasses | Showcase | A display in front of your eyes () ‘Neurograins’ Could be the Next Brain-Computer Interfaces () Welcome back to the moment. With Ray-Ban x Facebook () Facebook's Ray-Ban Stories smart glasses: Cool or creepy? () Introducing WHOOP 4.0 - The Personalized Digital Fitness and Health Coach () Introducing WHOOP Body - The Future of Wearable Technology () The Future of Communication in the Metaverse () Making pancakes with Reachy through VR Teleoperation () Trump Camp Posts Fake Video Of Biden () More than 50 robots are working at Singapore's high-tech hospital () The manual for Facebook’s Project Aria AR glasses shows what it’s like to wear them () Tesla Bot explained () Tesla Bot Takes Tech Demos to Their Logical, Absurd Conclusion () Watch brain implant help man 'speak' for the first time in 15 years () An Artificial Intelligence Helped Write This Play. It May Contain Racism () Elon Musk REVEALS Tesla Bot () Meet Grace, a humanoid robot designed for healthcare () Horizon Workrooms - Remote Collaboration Reimagined () Atlas | Partners in Parkour () Page 1 of 165 Inside the lab: How does Atlas work? () Neural recording and stimulation using wireless networks of microimplants () The Metaverse is a Dystopian Nightmare.
    [Show full text]
  • Telepresence Control of the NASA/DARPA Robonaut on a Mobility Platform
    Vienna, Austria ׀ Paper 24-29 April ׀ CHI 2004 Telepresence Control of the NASA/DARPA Robonaut on a Mobility Platform S. M. Goza, R. O. Ambrose M. A. Diftler, I. M. Spain Automation, Robotics and Simulation Division Robotics and Automation Department NASA/Johnson Space Center (JSC) Lockheed Martin Houston, TX 77058 USA Houston, Texas 77062 USA +1 281-483-4695 +1 281-483-0931 [email protected] [email protected] [email protected] [email protected] Interfaces and Presentation]: User Interfaces - Input devices Abstract Engineers at the Johnson Space Center recently combined and strategies, Interaction styles, Theory and methods; the upper body of the National Aeronautics and Space General Terms Administration (NASA) / Defense Advanced Research Design, Experimentation, Human Factors Projects Agency (DARPA) Robonaut system with a Robotic Mobility Platform (RMP) to make an extremely Keywords mobile humanoid robot designed to interact with human Humanoid robot, telepresence, teleoperation. teammates. Virtual Reality gear that immerses a human operator into Robonaut’s working environment provides the INTRODUCTION primary control pathway for remote operations. Humanoid robots offer great potential for assisting humans Human/robot interface challenges are addressed in the with a variety of tasks. By definition, they are designed to control system for teleoperators, console operators and perform an ever increasing set of tasks that are currently humans working directly with the Robonaut. Multiple limited to people. Tasks that currently require people to control modes are available for controlling the five fingered work in dangerous arenas are perfect candidates for dexterous robot hands and operator selectable depending on humanoid robots.
    [Show full text]