DOCSLIB.ORG

Touch and Tactile Perception for Robots

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Touch and Tactile Perception for Robots Touch and tactile perception for robots Václav Hlaváč Czech Technical University in Prague (ČVUT) Czech Institute of Informatics, Robotics, and Cybernetics (CIIRC) Prague 6, Jugoslávských partyzánů 1580/3 Czech Republic [email protected] http://people.ciirc.cvut.cz/hlavac/ 1 Human sense of touch Czech Institute of Informatics, Robotics and Cybernetics 2 Related human vocabulary •Tactile •Haptic • Perceptible to the sense • Of or relating to the sense of touch. of touch; tactile. • From Latin tactilis (“that • From Ancient Greek may be touched, ἁπτικός (haptikos, “able tangible”). to come in contact with”), ἅπτω (haptō, “I touch”). • From French tactile. •Haptics •Touch • (in medicine) The study of • Make physical contact the sense of touch. with. • (in computing) The study • From e.g. French of user interfaces that use toucher. the sense of touch. Source: Wiktionary Czech Institute of Informatics, Robotics and Cybernetics 3 A greater picture, a somatosensory system Czech Institute of Informatics, Robotics and Cybernetics 4 Somatosensory system • The touch impression uses several modalities. • Somatosensory system comprising the receptors and processing centers to perceive touch, temperature, proprioception (body position from stimuli inside the body), and nociception (pain). • Cutaneous sensations obtains inputs from the receptors embedded in the skin (examples: temperature, pressure, pain). • Kinesthetic sensations gets inputs from the receptors within muscles, tendons and joints (examples: body position, movement, weight, equilibrium). Czech Institute of Informatics, Robotics and Cybernetics 5 Towards robot tactile sensors •Receptors in humans cover the skin and epithelia, skeletal muscles, bones and joints, internal organs, and the cardiovascular system. •Tactile sensors in robotics ≈ cutaneous sensory receptors in humans. Czech Institute of Informatics, Robotics and Cybernetics 6 Human sensory physiology Afferent CNS Stimulus Receptors pathway integration Internal Sense organs External Transducers Energy source Czech Institute of Informatics, Robotics and Cybernetics 7 External stimuli, special senses Czech Institute of Informatics, Robotics and Cybernetics 8 Neurophysiological view Somatosensory system Cortical homunuculus comprises of 3 parts: . Visualization of the •Exteroceptive point-to-point mapping cutaneous system. between body surfaces (and function) to the •Proprioception system brain surface. (monitors body position). •Interoceptive system (monitors conditions within the body as blood pressure). Czech Institute of Informatics, Robotics and Cybernetics 9 Somatosensory map Czech Institute of Informatics, Robotics and Cybernetics 10 Sensory modality Czech Institute of Informatics, Robotics and Cybernetics 11 Various receptors in the skin Czech Institute of Informatics, Robotics and Cybernetics 12 Human touch signals • FAI; Meissner corpuscules; Fast Adapting type I; Respond to skin deformation only. • SAI; Merkel disc; Slow Adapting type I; dynamically sensitive and exhibit a response linked to the strength of maintained skin deformation. • FAII; Pacini corpuscules; Fast Adapting type I; Respond to changes in skin deformation and vibrations. • SAII; Ruffini receptors; Slow Adapting type II; Dynamically sensitive and exhibit a response linked to the strength of maintained skin deformation. Czech Institute of Informatics, Robotics and Cybernetics 13 Touch reception in animals •Touch reception (called also tangoreception) is a perception in an animal when in contact with a (solid) object. •Two types of receptors are common: •Tactile hairs (in many animals from worms, birds to mammals). Some can be very specialized as, e.g., cat whiskers. •Subcutaneous receptors, which lie in “the skin”. Czech Institute of Informatics, Robotics and Cybernetics 14 Whiskers In the nature: • comparable to finger tips • motion detection of In robotics, so far: distant objects • limited (binary, strain • navigation in the dark sensors, bending angles) • rich shape and texture information • neural processing model system for somatosensory processing Czech Institute of Informatics, Robotics and Cybernetics 15 Tactile sensing vs. haptics in robotics and/or computing Tactile sensing Haptics • What is sensed? • Haptics explores human Deformation of bodies touch sense as a (strain). channel. • Through deformation • The counterforce and its measure change of dynamics stimulates parameters, and find: touch, compliance, • Static texture, local compliance, vibrations, etc. or local shape. • ≈ 1 kHz loop needed. • Force (normal and/or shear) (indirect). • Two main devices: • Pressure. • Force feedback devices. • Slippage. • Haptic displays and rendering algorithms. Czech Institute of Informatics, Robotics and Cybernetics 16 Haptics, ideas • Haptics provides a • Haptics expands the human an additional bidirectional communi- communication channel cation by providing to sight and sound in sensory feedback that (computer) applications. simulates physical • Traditionally, the properties and force. bidirectional • Machine part of the communication is often haptic interface exerts secured by a keyboard forces to simulate and a mouse only. contact with a virtual object. Czech Institute of Informatics, Robotics and Cybernetics 17 Haptic devices • Virtual reality / telerobotics: • Exoskeletons. • Gloves. • Feedback devices: • Force feedback devices. • Tactile display devices. Czech Institute of Informatics, Robotics and Cybernetics 18 Haptics has many applications • Blind Persons • Entertainment • Programmable Braille • Arcade (steering wheels) • Access to GUIs • Home (game controllers) • Training • Automotive • Medical Procedures • BMW “iDrive” • Astronauts • Haptic Touchscreens • Education • Mobile Phones • Computer-Aided Design • Immersion “Vibetonz” • Assembly-Disassembly • Material Handling • Human Factors • Virtual Surfaces • Art / Animation / Modeling Czech Institute of Informatics, Robotics and Cybernetics 19 Pneumatic / magnetic tactile display • The inverse problem: When the collected data is to be presented directly to human as touch, force feedback… • UC Berkeley’s tactile display: • 5 x 5 array of pneumatic pins • 0.3 N per element, 3 dB point of 8 Hz, and 3 bits of force resolution 20 Czech Institute of Informatics, Robotics and Cybernetics Piezoelectric display for the blind • Display with 256 tactile dots on an area of 4 x 4 cm. • Displays characters instead of Braille cells. • Piezoelectric actuators. http://www.abtim.com/home__e_/home__e_.html Czech Institute of Informatics, Robotics and Cybernetics 21 Principles of tactile sensors • Mechanical – micro • Tactile element (tactel) switch. • A grid of tactels • Resistive – elastomer or foam. • Capacitive. • Magnetic (Hall effect). • Piezoresistive, etc. Czech Institute of Informatics, Robotics and Cybernetics 22 Mechanical sensor • One-directional reed switch • Omni-directional reed switch • Roller contact switch • Strain gauge (tensometer) • Etc. Czech Institute of Informatics, Robotics and Cybernetics 23 Strain gauge tactile sensor • Measures also the shear force . • Double Octagon Tactile Sensor (DOTS) Application in a gripper Czech Institute of Informatics, Robotics and Cybernetics 24 Resistive sensor • The basic principle is the measurement of the resistance of a conductive elastomer or foam between two points. • The majority of the sensors use an elastomer that consists of a carbon doped rubber. Czech Institute of Informatics, Robotics and Cybernetics 25 Disadvantages, resistive sensors • An elastomer has a long • If the elastomer becomes nonlinear time constant, permanently deformed different for applying and then a fatigue leading to releasing force. sensor malfunction. • Highly nonlinear transfer • This will give the sensor a function. poor long-term stability • Cyclic application of and will require its forces causes resistive replacement after an medium migration within extended period of use. the elastomer in time. Czech Institute of Informatics, Robotics and Cybernetics 26 Common package and pricing Price ranges from a few dollars to a few tens of dollars. Czech Institute of Informatics, Robotics and Cybernetics 27 Force-Sensitive-Resistor sensor • FSR = Force-Sensitive-Resistor • Used also for touch keyboards. Czech Institute of Informatics, Robotics and Cybernetics 28 Resistive touchscreen • Two flexible resistive layers are separated by a grid of spacers. • When the two layers are pressed together the resistance can be measured between several points. • This determines where the two resistive layers contacted. Czech Institute of Informatics, Robotics and Cybernetics 29 Capacitive force sensor (1) • Capacitance between two parallel plates = , where • is the permittivity of the dielectric medium, • is the plate area, • is the distance between plates, • The elastomer gives force-to-capacitance characteristic. Czech Institute of Informatics, Robotics and Cybernetics 30 Capacitive force sensor (2) • As the size is reduced to increase the spatial resolution, the sensor’s absolute capacitance will decrease. • To maximize the change in capacitance as force is applied, it is preferable to use a high permittivity, dielectric in a coaxial capacitor design. • The use of a highly dielectric polymer such as poly vinylidene fluoride maximizes the change capacitance. Czech Institute of Informatics, Robotics and Cybernetics 31 Capacitive touchscreen • A conductive layer is covered with a dielectric layer. • The finger = the other plate of the capacitor. • A few kHz signal is transmitted
Load more

Recommended publications
  • Tactile Sensing for Robotic Applications
    15 Tactile Sensing for Robotic Applications Ravinder S. Dahiya1, 2 and Maurizio Valle1 1University of Genova, 2Italian Institute of Technology, Genova, Italy 1. Introduction Robotic devices – limited to the structured environment of manufacturing plants until few years ago – are slowly making way into human life, which has led to the emergence of interaction and learning issues in robots. Such issues are important for future robot to be able to learn autonomously and to interact safely with the environment i.e. without causing any harm to it or to the objects with which it is interacting. In this context, it becomes important to study the ways and means of robot’s interaction with the environment. Humans interact and explore the environment through five main sense modalities viz. touch, vision, hearing, olfaction and taste. Loss of any of these modalities will result in the incomplete information about the environment. Irrespective of their importance with respect to each other, the study of their individual contribution in collecting information from environment is important for improving the sensing capabilities of any future robotic system. This chapter provides an overview of tactile sensing in robotics. This chapter is an attempt to answer three basic questions: • What is meant by Tactile Sensing? • Why Tactile Sensing is important? • How Tactile Sensing is achieved? The chapter is organized to sequentially provide the answers to above basic questions. Tactile sensing has often been considered as force sensing, which is not wholly true. In order to clarify such misconceptions about tactile sensing, it is defined in section 2. Why tactile section is important for robotics and what parameters are needed to be measured by tactile sensors to successfully perform various tasks, are discussed in section 3.
    [Show full text]
  • Static Tactile Sensing for a Robotic Electronic Skin Via an Electromechanical Impedance-Based Approach
    sensors Article Static Tactile Sensing for a Robotic Electronic Skin via an Electromechanical Impedance-Based Approach Cheng Liu 1,*, Yitao Zhuang 2, Amir Nasrollahi 3 , Lingling Lu 4, Mohammad Faisal Haider 3 and Fu-Kuo Chang 3 1 Department of Mechanical Engineering, Stanford University, Stanford, CA 94305, USA 2 Zenith Aerospace, Redwood City, CA 94063, USA; [email protected] 3 Department of Aeronautics and Astronautics, Stanford University, Stanford, CA 94305, USA; [email protected] (A.N.); [email protected] (M.F.H.); [email protected] (F.-K.C.) 4 Key Laboratory for Mechanics in Fluid Solid Coupling Systems, Institute of Mechanics, Chinese Academy of Science, Beijing 100190, China; [email protected] * Correspondence: [email protected] Received: 31 March 2020; Accepted: 14 May 2020; Published: 16 May 2020 Abstract: Tactile sensing is paramount for robots operating in human-centered environments to help in understanding interaction with objects. To enable robots to have sophisticated tactile sensing capability, researchers have developed different kinds of electronic skins for robotic hands and arms in order to realize the ‘sense of touch’. Recently, Stanford Structures and Composites Laboratory developed a robotic electronic skin based on a network of multi-modal micro-sensors. This skin was able to identify temperature profiles and detect arm strikes through embedded sensors. However, sensing for the static pressure load is yet to be investigated. In this work, an electromechanical impedance-based method is proposed to investigate the response of piezoelectric sensors under static normal pressure loads. The smart skin sample was firstly fabricated by embedding a piezoelectric sensor into the soft silicone.
    [Show full text]
  • Recent Progress in Flexible Tactile Sensor Systems: from Design to Application
    Zhu et al. Soft Sci 2021;1:3 Soft Science DOI: 10.20517/ss.2021.02 Review Open Access Recent progress in flexible tactile sensor systems: from design to application Jiefei Zhu1, Changjian Zhou2, Min Zhang1 1School of Electronic and Computer Engineering, Peking University, Shenzhen 518055, China. 2School of Microelectronics, South China University of Technology, Guangzhou 510641, China. Correspondence to: Dr. Min Zhang, School of Electronic and Computer Engineering, Peking University, Shenzhen 518055, China. E-mail: [email protected] How to cite this article: Zhu J, Zhou C, Zhang M. Recent progress in flexible tactile sensor systems: from design to application. Soft Sci 2021;1:3. https://dx.doi.org/10.20517/ss.2021.02 Received: 23 May 2021 First Decision: 17 Jun 2021 Revised: 30 Jun 2021 Accepted: 9 Jul 2021 First online: 9 Jul 2021 Academic Editor: Zhifeng Ren Copy Editor: Xi-Jun Chen Production Editor: Xi-Jun Chen Abstract With the rapid development of artificial intelligence, human-machine interaction, and healthcare systems, flexible tactile sensors have huge market potentials and research needs, so that both fundamental research and application demonstrations are evolving rapidly to push the potential to reality. In this review, we briefly summarize the recent progress of the flexible tactile sensor system, including the common sensing mechanisms, the important performance evaluation parameters, the device design trend, and the main applications. Moreover, the current device design trend towards flexible tactile sensor systems is discussed, including novel structures for outstanding performance, sensor arrays for large-area information acquisition, multi-mode information acquisition, and integration of tactile sensors with transistors.
    [Show full text]
  • Tactile-Sensing Based on Flexible PVDF Nanofibers Via Electrospinning: a Review
    sensors Review Tactile-Sensing Based on Flexible PVDF Nanofibers via Electrospinning: A Review Xiaomei Wang 1, Fazhe Sun 2, Guangchao Yin 1, Yuting Wang 3, Bo Liu 1,* and Mingdong Dong 3,* ID 1 Laboratory of Functional Molecules and Materials, School of Physics and Optoelectronic Engineering, Shandong University of Technology, Zibo 255049, China; [email protected] (X.W.); [email protected] (G.Y.) 2 Analysis Testing Center, Shandong University of Technology, Zibo 255100, China; [email protected] 3 Interdisciplinary Nanoscience Center (iNANO), Aarhus University, DK-8000 Aarhus C, Denmark; [email protected] * Correspondence: [email protected] (B.L.); [email protected] (M.D.) Received: 2 October 2017; Accepted: 4 December 2017; Published: 24 January 2018 Abstract: The flexible tactile sensor has attracted widespread attention because of its great flexibility, high sensitivity, and large workable range. It can be integrated into clothing, electronic skin, or mounted on to human skin. Various nanostructured materials and nanocomposites with high flexibility and electrical performance have been widely utilized as functional materials in flexible tactile sensors. Polymer nanomaterials, representing the most promising materials, especially polyvinylidene fluoride (PVDF), PVDF co-polymer and their nanocomposites with ultra-sensitivity, high deformability, outstanding chemical resistance, high thermal stability and low permittivity, can meet the flexibility requirements for dynamic tactile sensing in wearable electronics. Electrospinning has been recognized as an excellent straightforward and versatile technique for preparing nanofiber materials. This review will present a brief overview of the recent advances in PVDF nanofibers by electrospinning for flexible tactile sensor applications. PVDF, PVDF co-polymers and their nanocomposites have been successfully formed as ultrafine nanofibers, even as randomly oriented PVDF nanofibers by electrospinning.
    [Show full text]
  • Research Article Electronic Skin from High-Throughput Fabrication of Intrinsically Stretchable Lead Zirconate Titanate Elastomer
    AAAS Research Volume 2020, Article ID 1085417, 11 pages https://doi.org/10.34133/2020/1085417 Research Article Electronic Skin from High-Throughput Fabrication of Intrinsically Stretchable Lead Zirconate Titanate Elastomer Yiming Liu ,1 Huanxi Zheng,2 Ling Zhao,1 Shiyuan Liu,2 Kuanming Yao ,1 Dengfeng Li ,1 Chunki Yiu,1 Shenghan Gao,3 Raudel Avila,4 Pakpong Chirarattananon ,1 Lingqian Chang,5 Zuankai Wang ,2 Xian Huang,3 Zhaoqian Xie ,6 Zhengbao Yang ,2 and Xinge Yu 1 1Department of Biomedical Engineering, City University of Hong Kong, Hong Kong 999077, China 2Department of Mechanical Engineering, City University of Hong Kong, Hong Kong 999077, China 3Department of Biomedical Engineering, Tianjin University, Tianjin 300000, China 4Department of Mechanical Engineering, McCormick School of Engineering, Northwestern University, Evanston, IL 60208, USA 5School of Biology Science and Medical Engineering, Beihang University, Beijing 100191, China 6State Key Laboratory of Structural Analysis for Industrial Equipment, Department of Engineering Mechanics, International Research Center for Computational Mechanics, Dalian University of Technology, Dalian 116024, China Correspondence should be addressed to Lingqian Chang; [email protected], Zuankai Wang; [email protected], Xian Huang; [email protected], Zhaoqian Xie; [email protected], Zhengbao Yang; [email protected], and Xinge Yu; [email protected] Received 15 June 2020; Accepted 7 September 2020; Published 17 October 2020 Copyright © 2020 Yiming Liu et al. Exclusive Licensee Science and Technology Review Publishing House. Distributed under a Creative Commons Attribution License (CC BY 4.0). Electronic skin made of thin, soft, stretchable devices that can mimic the human skin and reconstruct the tactile sensation and perception offers great opportunities for prosthesis sensing, robotics controlling, and human-machine interfaces.
    [Show full text]
  • The Art of Tactile Sensing: a State of Art Survey
    International Journal of Sciences: Basic and Applied Research (IJSBAR) ISSN 2307-4531 (Print & Online) http://gssrr.org/index.php?journal=JournalOfBasicAndApplied --------------------------------------------------------------------------------------------------------------------------- The Art of Tactile Sensing: A State of Art Survey Royson Donate D’Souzaa*, Adithya Joshyb, Arjun Minic , Nikhitha .M. Panickerd aAssistant Professor, Manipal University, Dubai 345050, UAE b,c,d Student, Manipal University, Dubai 345050, UAE aEmail: [email protected] bEmail: [email protected] cEmail: [email protected] dEmail: [email protected] Abstract This paper describes about tactile sensors, its transduction methods, state-of-art and various application areas of these sensors. Here we are taking in consideration the sense of touch. This provides the robots with tactile perception. In most of the robotic application the sense of touch is very helpful. The ability of robots to touch and feel the object, grasping an object by controlled pressure, mainly to categorize the surface textures. Tactile sensors can measure the force been applied on an area of touch. The data which is interpreted from the sensor is accumulated by the array of coordinated group of touch sensors. The sense of touch in human is distributed in four kinds by tactile receptors: Meissner corpuscles, the Merkel cells, the Rufina endings, and the Pacinian corpuscles. There has many innovations done to mimic the behaviour of human touch. The contact forces are measured by the sensor and this data is used to determine the manipulation of the robot. Keywords: Tactile sensors; robotic sensors; tactile sensor applications. ------------------------------------------------------------------------ * Corresponding author. 252 International Journal of Sciences: Basic and Applied Research (IJSBAR) (2016) Volume 26, No 3, pp 252-266 1.
    [Show full text]