Static Tactile Sensing for a Robotic Electronic Skin Via an Electromechanical Impedance-Based Approach

Total Page:16

File Type:pdf, Size:1020Kb

Load more

sensors Article Static Tactile Sensing for a Robotic Electronic Skin via an Electromechanical Impedance-Based Approach Cheng Liu 1,*, Yitao Zhuang 2, Amir Nasrollahi 3 , Lingling Lu 4, Mohammad Faisal Haider 3 and Fu-Kuo Chang 3 1 Department of Mechanical Engineering, Stanford University, Stanford, CA 94305, USA 2 Zenith Aerospace, Redwood City, CA 94063, USA; [email protected] 3 Department of Aeronautics and Astronautics, Stanford University, Stanford, CA 94305, USA; [email protected] (A.N.); [email protected] (M.F.H.); [email protected] (F.-K.C.) 4 Key Laboratory for Mechanics in Fluid Solid Coupling Systems, Institute of Mechanics, Chinese Academy of Science, Beijing 100190, China; [email protected] * Correspondence: [email protected] Received: 31 March 2020; Accepted: 14 May 2020; Published: 16 May 2020 Abstract: Tactile sensing is paramount for robots operating in human-centered environments to help in understanding interaction with objects. To enable robots to have sophisticated tactile sensing capability, researchers have developed different kinds of electronic skins for robotic hands and arms in order to realize the ‘sense of touch’. Recently, Stanford Structures and Composites Laboratory developed a robotic electronic skin based on a network of multi-modal micro-sensors. This skin was able to identify temperature profiles and detect arm strikes through embedded sensors. However, sensing for the static pressure load is yet to be investigated. In this work, an electromechanical impedance-based method is proposed to investigate the response of piezoelectric sensors under static normal pressure loads. The smart skin sample was firstly fabricated by embedding a piezoelectric sensor into the soft silicone. Then, a series of static pressure tests to the skin were conducted. Test results showed that the first peak of the real part impedance signal was sensitive to static pressure load, and by using the proposed diagnostic method, this test setup could detect a resolution of 0.5 N force. Numerical simulation methods were then performed to validate the experimental results. The results of the numerical simulation prove the validity of the experiments, as well as the robustness of the proposed method in detecting static pressure loads using the smart skin. Keywords: robotic tactile sensing; electronic skin; piezoelectric sensors; static pressure load sensing; electromechanical impedance-based method 1. Introduction Tactile sensing in human and animal skins enables them to touch, sense temperature, etc. The haptic perception, if added to robots, can significantly enhance their performance through better human-robot and robot-environment interactions. In comparison, even the most sophisticated robots have at most a few dozen tactile sensors. Regardless of over thirty years of research, tactile sensing still falls behind progress in computer vision methods. The reason for this discrepancy is that compared to cameras, tactile sensors must be compliant, tough and flexible enough to coat the surfaces of robotic limbs and hands. In addition, as the number of sensors increases, wiring and signal transfer become a major issue [1–5]. To overcome the aforementioned challenges for robotic tactile sensing, Stanford Structures and Composites Laboratory (SACL) developed a smart skin shown in Figure1 by embedding a multi-modal stretchable sensor network [6] into a soft silicone. Guo [7] has documented in detail the fabrication and Sensors 2020, 20, 2830; doi:10.3390/s20102830 www.mdpi.com/journal/sensors SensorsSensors 20202020, ,2020, ,x 2830 FOR PEER REVIEW 22 of of 14 14 fabrication and material selection process of this skin. This artificial skin has been added to a robotic armmaterial for realizing selection autonomous process of this control skin.,This which artificial leverages skin advanced has beenadded sampling to a- roboticbased motion arm for planning realizing techniquesautonomous [7]. control, Utilizing which the signals leverages of the advanced multi-modal sampling-based sensors, which motion are embedded planning techniquesin the skin [in7]. stateUtilizing awareness the signals algorithms of the as multi-modal input parameters, sensors, the which robotic are arm embedded can sense in and the skinreact into stateenvironmental awareness changalgorithmses such as as input temperature parameters, variance the robotic and armlocal can dynamic sense and impacts react toonto environmental the skin [7]. changesHowever, such one as criticaltemperature aspect variancein tactile andsensing local has dynamic not been impacts well studied, onto the which skin [ 7is]. how However, to detect one static critical pressure aspect in in thetactile smart sensing skin using has not lead been zirconate well studied, titanate which (PZT) is howelements to detect, also static known pressure as piezoelectric in the smart sensors. skin using lead zirconate titanate (PZT) elements, also known as piezoelectric sensors. Figure 1. Robotic electronic skin (a.k.a. smart skin) with embedded multi-modal sensor network. Figure 1. Robotic electronic skin (a.k.a. smart skin) with embedded multi-modal sensor network. There exist different tactile sensors for measuring static pressure and contact conditions using differentThere transduction exist different mechanisms tactile sensors [8–11 for]. Resistive-basedmeasuring static tactile pressure sensors and cancontact reach conditions high sensitivity, using differentbut have transduction high power consumptionmechanisms [8 and–11] lack. Resistive the measurement-based tactile of sensors contact can forces reach [12 high]. Optical sensitivity, tactile butsensors have arehigh also power capable consumption of reaching and high lack sensitivity, the measurement although of they contact will force shows [ loss12]. ofOptical light duetactile to sensorsmicro bending are also chirping.capable of Meanwhile, reaching high power sensitivity, consumption although is also they abig will challenge show loss [12 of]. light Triboelectric due to microtactile bending sensors havechirping. the advantageMeanwhile, of power being self-powering,consumption is although also a big their challenge long-term [12]. unreliability Triboelectric is tactilestill an sensors issue [ 13have]. One the ofadvantage the most of common being self tactile-powering sensors, although are capacitive their long tactile-term sensors, unreliability which can is stillachieve an issue high [13 sensitivity]. One of [the4]. most However, common noises tactile coming sensors from are temperature capacitive tactile and humidity sensors, which variations, can achieveand even high electrical sensitivity noise [4] introduced. However, bynoises unshielded coming from power temperature supplies, may and significantlyhumidity variations decrease, and the evencapacitive electrical signal-to-noise noise introduced ratio. This by issue unshielded imposes power a signal supplies conditioning, may stage significantly in order to decrease obtain a highthe capacitivesignal-to-noise signal ratio,-to-noise which ratio. results This in issue complex imposes circuitry a signal [4]. In conditioning addition, under stage highly in order repetitive to obtain loads, a highthe capacitive signal-to-noise sensors ratio, are pronewhich toresults failure in due complex to mechanical circuitry fatigue,[4]. In addition, which undermines under highly the repetitive reliability loads,of the the method capacitive [14]. sensors are prone to failure due to mechanical fatigue, which undermines the reliabilityCompared of the method with capacitive [14]. sensors, PZT sensors are excellent in terms of mechanical robustness andCompared their simplicity with ofcapacitive use and noisesensors, resistance. PZT sensors Piezoelectricity are excellent in in PZT terms is a of well-known mechanical transduction robustness andmechanism their simplicity for dynamic of use forceand noise measurement resistance. byPiezoelectricity using the direct in PZT piezoelectric is a well-known effect. transduction However, a mechanismdifferent mechanism for dynamic is required force measurement to sense static by loads using using the PZTdirect sensors. piezoelectric One promising effect. However, method a is differentto use PZT mechanism sensors in is a required resonant to piezoelectric sense static sensingloads using mode. PZT Safour sensors. and One Bernard promising [15] demonstrated method is to usethat PZT the sensors measured in a electric resonant admittance piezoelectric spectrum sensing of mode. a PZT Safour sensor and can Bernard be correlated [15] demonstrated to the static forces that theapplied measured to the PZTelectric sensor. admittance Although spectrum their study of wasa PZT focused sensor on can the be applied correlated force into the the order static of forces 100 N, appliedwhich is to relatively the PZT high,sensor. and Although applied their directly study on thewas PZT focused sensor, on theirthe applied results showedforce in the possibilityorder of 100 of N,this which method is forrelatively tactile sensing.high, and In applied general, directly tactile sensing on the requires PZT sensor, a higher their resolution, results showed and sensors the possibilitymust be embedded of this method in a skin for material.tactile sensing. Suchinclusion In general, of tactile the sensors sensing inside requires skin materiala higher likeresolution silicone, andrubber sensors or fiberglass must be canembedded prevent in sensors a skin frommaterial. direct Suc contacth inclusion with externalof
Recommended publications
  • Tactile Sensing for Robotic Applications

    Tactile Sensing for Robotic Applications

    15 Tactile Sensing for Robotic Applications Ravinder S. Dahiya1, 2 and Maurizio Valle1 1University of Genova, 2Italian Institute of Technology, Genova, Italy 1. Introduction Robotic devices – limited to the structured environment of manufacturing plants until few years ago – are slowly making way into human life, which has led to the emergence of interaction and learning issues in robots. Such issues are important for future robot to be able to learn autonomously and to interact safely with the environment i.e. without causing any harm to it or to the objects with which it is interacting. In this context, it becomes important to study the ways and means of robot’s interaction with the environment. Humans interact and explore the environment through five main sense modalities viz. touch, vision, hearing, olfaction and taste. Loss of any of these modalities will result in the incomplete information about the environment. Irrespective of their importance with respect to each other, the study of their individual contribution in collecting information from environment is important for improving the sensing capabilities of any future robotic system. This chapter provides an overview of tactile sensing in robotics. This chapter is an attempt to answer three basic questions: • What is meant by Tactile Sensing? • Why Tactile Sensing is important? • How Tactile Sensing is achieved? The chapter is organized to sequentially provide the answers to above basic questions. Tactile sensing has often been considered as force sensing, which is not wholly true. In order to clarify such misconceptions about tactile sensing, it is defined in section 2. Why tactile section is important for robotics and what parameters are needed to be measured by tactile sensors to successfully perform various tasks, are discussed in section 3.
  • Recent Progress in Flexible Tactile Sensor Systems: from Design to Application

    Recent Progress in Flexible Tactile Sensor Systems: from Design to Application

    Zhu et al. Soft Sci 2021;1:3 Soft Science DOI: 10.20517/ss.2021.02 Review Open Access Recent progress in flexible tactile sensor systems: from design to application Jiefei Zhu1, Changjian Zhou2, Min Zhang1 1School of Electronic and Computer Engineering, Peking University, Shenzhen 518055, China. 2School of Microelectronics, South China University of Technology, Guangzhou 510641, China. Correspondence to: Dr. Min Zhang, School of Electronic and Computer Engineering, Peking University, Shenzhen 518055, China. E-mail: [email protected] How to cite this article: Zhu J, Zhou C, Zhang M. Recent progress in flexible tactile sensor systems: from design to application. Soft Sci 2021;1:3. https://dx.doi.org/10.20517/ss.2021.02 Received: 23 May 2021 First Decision: 17 Jun 2021 Revised: 30 Jun 2021 Accepted: 9 Jul 2021 First online: 9 Jul 2021 Academic Editor: Zhifeng Ren Copy Editor: Xi-Jun Chen Production Editor: Xi-Jun Chen Abstract With the rapid development of artificial intelligence, human-machine interaction, and healthcare systems, flexible tactile sensors have huge market potentials and research needs, so that both fundamental research and application demonstrations are evolving rapidly to push the potential to reality. In this review, we briefly summarize the recent progress of the flexible tactile sensor system, including the common sensing mechanisms, the important performance evaluation parameters, the device design trend, and the main applications. Moreover, the current device design trend towards flexible tactile sensor systems is discussed, including novel structures for outstanding performance, sensor arrays for large-area information acquisition, multi-mode information acquisition, and integration of tactile sensors with transistors.
  • Tactile-Sensing Based on Flexible PVDF Nanofibers Via Electrospinning: a Review

    Tactile-Sensing Based on Flexible PVDF Nanofibers Via Electrospinning: a Review

    sensors Review Tactile-Sensing Based on Flexible PVDF Nanofibers via Electrospinning: A Review Xiaomei Wang 1, Fazhe Sun 2, Guangchao Yin 1, Yuting Wang 3, Bo Liu 1,* and Mingdong Dong 3,* ID 1 Laboratory of Functional Molecules and Materials, School of Physics and Optoelectronic Engineering, Shandong University of Technology, Zibo 255049, China; [email protected] (X.W.); [email protected] (G.Y.) 2 Analysis Testing Center, Shandong University of Technology, Zibo 255100, China; [email protected] 3 Interdisciplinary Nanoscience Center (iNANO), Aarhus University, DK-8000 Aarhus C, Denmark; [email protected] * Correspondence: [email protected] (B.L.); [email protected] (M.D.) Received: 2 October 2017; Accepted: 4 December 2017; Published: 24 January 2018 Abstract: The flexible tactile sensor has attracted widespread attention because of its great flexibility, high sensitivity, and large workable range. It can be integrated into clothing, electronic skin, or mounted on to human skin. Various nanostructured materials and nanocomposites with high flexibility and electrical performance have been widely utilized as functional materials in flexible tactile sensors. Polymer nanomaterials, representing the most promising materials, especially polyvinylidene fluoride (PVDF), PVDF co-polymer and their nanocomposites with ultra-sensitivity, high deformability, outstanding chemical resistance, high thermal stability and low permittivity, can meet the flexibility requirements for dynamic tactile sensing in wearable electronics. Electrospinning has been recognized as an excellent straightforward and versatile technique for preparing nanofiber materials. This review will present a brief overview of the recent advances in PVDF nanofibers by electrospinning for flexible tactile sensor applications. PVDF, PVDF co-polymers and their nanocomposites have been successfully formed as ultrafine nanofibers, even as randomly oriented PVDF nanofibers by electrospinning.
  • Touch and Tactile Perception for Robots

    Touch and Tactile Perception for Robots

    Touch and tactile perception for robots Václav Hlaváč Czech Technical University in Prague (ČVUT) Czech Institute of Informatics, Robotics, and Cybernetics (CIIRC) Prague 6, Jugoslávských partyzánů 1580/3 Czech Republic [email protected] http://people.ciirc.cvut.cz/hlavac/ 1 Human sense of touch Czech Institute of Informatics, Robotics and Cybernetics 2 Related human vocabulary •Tactile •Haptic • Perceptible to the sense • Of or relating to the sense of touch. of touch; tactile. • From Latin tactilis (“that • From Ancient Greek may be touched, ἁπτικός (haptikos, “able tangible”). to come in contact with”), ἅπτω (haptō, “I touch”). • From French tactile. •Haptics •Touch • (in medicine) The study of • Make physical contact the sense of touch. with. • (in computing) The study • From e.g. French of user interfaces that use toucher. the sense of touch. Source: Wiktionary Czech Institute of Informatics, Robotics and Cybernetics 3 A greater picture, a somatosensory system Czech Institute of Informatics, Robotics and Cybernetics 4 Somatosensory system • The touch impression uses several modalities. • Somatosensory system comprising the receptors and processing centers to perceive touch, temperature, proprioception (body position from stimuli inside the body), and nociception (pain). • Cutaneous sensations obtains inputs from the receptors embedded in the skin (examples: temperature, pressure, pain). • Kinesthetic sensations gets inputs from the receptors within muscles, tendons and joints (examples: body position, movement, weight, equilibrium). Czech Institute of Informatics, Robotics and Cybernetics 5 Towards robot tactile sensors •Receptors in humans cover the skin and epithelia, skeletal muscles, bones and joints, internal organs, and the cardiovascular system. •Tactile sensors in robotics ≈ cutaneous sensory receptors in humans.
  • Research Article Electronic Skin from High-Throughput Fabrication of Intrinsically Stretchable Lead Zirconate Titanate Elastomer

    Research Article Electronic Skin from High-Throughput Fabrication of Intrinsically Stretchable Lead Zirconate Titanate Elastomer

    AAAS Research Volume 2020, Article ID 1085417, 11 pages https://doi.org/10.34133/2020/1085417 Research Article Electronic Skin from High-Throughput Fabrication of Intrinsically Stretchable Lead Zirconate Titanate Elastomer Yiming Liu ,1 Huanxi Zheng,2 Ling Zhao,1 Shiyuan Liu,2 Kuanming Yao ,1 Dengfeng Li ,1 Chunki Yiu,1 Shenghan Gao,3 Raudel Avila,4 Pakpong Chirarattananon ,1 Lingqian Chang,5 Zuankai Wang ,2 Xian Huang,3 Zhaoqian Xie ,6 Zhengbao Yang ,2 and Xinge Yu 1 1Department of Biomedical Engineering, City University of Hong Kong, Hong Kong 999077, China 2Department of Mechanical Engineering, City University of Hong Kong, Hong Kong 999077, China 3Department of Biomedical Engineering, Tianjin University, Tianjin 300000, China 4Department of Mechanical Engineering, McCormick School of Engineering, Northwestern University, Evanston, IL 60208, USA 5School of Biology Science and Medical Engineering, Beihang University, Beijing 100191, China 6State Key Laboratory of Structural Analysis for Industrial Equipment, Department of Engineering Mechanics, International Research Center for Computational Mechanics, Dalian University of Technology, Dalian 116024, China Correspondence should be addressed to Lingqian Chang; [email protected], Zuankai Wang; [email protected], Xian Huang; [email protected], Zhaoqian Xie; [email protected], Zhengbao Yang; [email protected], and Xinge Yu; [email protected] Received 15 June 2020; Accepted 7 September 2020; Published 17 October 2020 Copyright © 2020 Yiming Liu et al. Exclusive Licensee Science and Technology Review Publishing House. Distributed under a Creative Commons Attribution License (CC BY 4.0). Electronic skin made of thin, soft, stretchable devices that can mimic the human skin and reconstruct the tactile sensation and perception offers great opportunities for prosthesis sensing, robotics controlling, and human-machine interfaces.
  • The Art of Tactile Sensing: a State of Art Survey

    The Art of Tactile Sensing: a State of Art Survey

    International Journal of Sciences: Basic and Applied Research (IJSBAR) ISSN 2307-4531 (Print & Online) http://gssrr.org/index.php?journal=JournalOfBasicAndApplied --------------------------------------------------------------------------------------------------------------------------- The Art of Tactile Sensing: A State of Art Survey Royson Donate D’Souzaa*, Adithya Joshyb, Arjun Minic , Nikhitha .M. Panickerd aAssistant Professor, Manipal University, Dubai 345050, UAE b,c,d Student, Manipal University, Dubai 345050, UAE aEmail: [email protected] bEmail: [email protected] cEmail: [email protected] dEmail: [email protected] Abstract This paper describes about tactile sensors, its transduction methods, state-of-art and various application areas of these sensors. Here we are taking in consideration the sense of touch. This provides the robots with tactile perception. In most of the robotic application the sense of touch is very helpful. The ability of robots to touch and feel the object, grasping an object by controlled pressure, mainly to categorize the surface textures. Tactile sensors can measure the force been applied on an area of touch. The data which is interpreted from the sensor is accumulated by the array of coordinated group of touch sensors. The sense of touch in human is distributed in four kinds by tactile receptors: Meissner corpuscles, the Merkel cells, the Rufina endings, and the Pacinian corpuscles. There has many innovations done to mimic the behaviour of human touch. The contact forces are measured by the sensor and this data is used to determine the manipulation of the robot. Keywords: Tactile sensors; robotic sensors; tactile sensor applications. ------------------------------------------------------------------------ * Corresponding author. 252 International Journal of Sciences: Basic and Applied Research (IJSBAR) (2016) Volume 26, No 3, pp 252-266 1.