DOCSLIB.ORG

Millimeter Wave Sensing: a Review of Application Pipelines and Building Blocks

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Millimeter Wave Sensing: a Review of Application Pipelines and Building Blocks IEEE SENSORS JOURNAL, VOL. XX, NO. XX, XXXX XXXX 1 Millimeter Wave Sensing: A Review of Application Pipelines and Building Blocks Bram van Berlo, Amany Elkelany, Tanir Ozcelebi, and Nirvana Meratnia Abstract— The increasing bandwidth require- ment of new wireless applications has lead to Millimeter wave sensing applications standardization of the millimeter wave spec- trum for high-speed wireless communication. Human Object Environment Position Health-related Action Sudden and harmful Identification and Position Harmful event Identification Acquisition Inspection Monitoring The millimeter wave spectrum is part of 5G and tracking monitoring recognition event detection classification tracking detection Power Parking space Foreign covers frequencies between 30 and 300 GHz Shape Localization Vital sign Activity Fall Speech Target Pen lines information debris Head Bathroom Drone Hazardous Gait Tracking Sleep Obstacle Drones corresponding to wavelengths ranging from 10 motion accident propellers terrain Hand Bird Disease Presence Traffic to 1 mm. Although millimeter wave is often gesture wingbeats Ego- Concealed Pose Pedestrian considered as a communication medium, it has motion objects Surface Lap joints also proved to be an excellent ‘sensor’, thanks cracks Building to its narrow beams, operation across a wide cracks bandwidth, and interaction with atmospheric Radar Signal reconstruction and denoising White box constituents. In this paper, which is to the best Millimeter Signal Signal transformation Manual Math./physics- Grey box Performance Pre- domain Feature mapping driven metrics Active Imaging Wave based Modeling Evaluation Model processing Data Extraction Automatic of our knowledge the first review that com- Signal Collection Data reconstruction and denoising Data-driven improvement Spatial Sweeping domain mapping Shallow black box Data transformation and tuning Deep black box pletely covers millimeter wave sensing appli- Dataset creation and augmentation cation pipelines, we provide a comprehensive overview and analysis of different basic appli- cation pipeline building blocks, including hardware, algorithms, analytical models, and model evaluation techniques. The review also provides a taxonomy that highlights different millimeter wave sensing application domains. By performing a thorough analysis, complying with the systematic literature review methodology and reviewing 165 papers, we not only extend previous investigations focused only on communication aspects of the millimeter wave technology and using millimeter wave technology for active imaging, but also highlight scientific and technological challenges and trends, and provide a future perspective for applications of millimeter wave as a sensing technology. Index Terms— 5G, analytical modeling, millimeter wave, millimeter wave sensing application pipeline, radar, systematic literature review. I. INTRODUCTION The increasing bandwidth requirement has lead to stan- dardization of the millimeter wave spectrum for high-speed NTRODUCTION of new wireless applications, their higher wireless communication in the IEEE 802.11ad, 802.11aj, and I service quality requirements, and a significant increase 802.11ay amendments [4]–[6]. The millimeter wave is also of application users have put continuous demand on digital part of the fifth-generation mobile communication technology wireless communication bandwidth. To address this, Netflix (5G) [7], [8]. Although use of the millimeter wave spectrum and YouTube, for instance, have reduced video streaming for communication is often directly associated with 5G, there quality in Europe to mitigate data traffic peaks in the 2.4 and arXiv:2012.13664v1 [eess.SP] 26 Dec 2020 are key differences. The millimeter wave spectrum is just one 5 GHz WiFi bands. These peaks are caused by an increased part of what 5G networks use to provide higher data rates. It amount of video and movie streams due to home confinement covers frequencies between 30 and 300 GHz corresponding measures taken during the COVID-19 pandemic [1]. In the to wavelengths ranging from 10 to 1 mm [9], [10], located future, 8K video streaming will require a minimum data rate between the centimeter wave and terahertz wave spectrums. of 50 Mbps per TV. In case multiple simultaneous streams Thanks to covering a wide bandwidth and utilizing a short are launched on the same network, gigabit connections will wavelength, the millimeter wave spectrum is able to provide approach their limit [2]. Maintaining the required network higher data rates compared to other widely used wireless bandwidth and processing speed remains challenging for cloud technologies such as WiFi. Compared to the spectrum in which gaming as a service [3]. 5 GHz WiFi operates, the bandwidth of the millimeter wave spectrum is 10x higher, i.e., 270 GHz versus 27 GHz. Under B.R.D. van Berlo, A.M.A. Elkelany, T. Ozcelebi, and N. Merat- nia are with the Interconnected Resource-aware Intelligent Systems the assumption that environmental and legislative limitations cluster, Department of Mathematics and Computer Science, Eind- do not exist, this means that the number of channels that can hoven University of Technology, 5600 MB Eindhoven, The Netherlands be created in the millimeter wave spectrum is also 10x more. (e-mail: [email protected]; [email protected]; [email protected]; [email protected]). Correspondence should be addressed to B.R.D. Because millimeter waves operate at much higher frequencies van Berlo. compared to the WiFi bands, the wavelengths are much 2 IEEE SENSORS JOURNAL, VOL. XX, NO. XX, XXXX XXXX 1. Search 2. Explorative 3. Filter shorter. Consequently, the size of electronic components can Phase Classification Phase Phase be reduced. This, in turn, causes the beam emitted by elec- Additional paper tronic components to be much narrower. The narrow beams, in searches combination with greater signal attenuation compared to the 4. Pipeline Building Block Definition Phase WiFi bands, allow increased communication density [10], i.e., For every building block... number of messages communicated in parallel over separate Algorithms, models, hardware, etc. links with the same carrier frequency in a limited area. identification, review, and analysis Although millimeter wave is often considered as a commu- Deficiency and nication medium, it has also proved to be an excellent ‘sensor’ Summary error correction for humans, objects, and environmental sensing [9], [10], table creation thanks to its narrow beams, operation across a wide bandwidth, and interaction with atmospheric constituents. Narrow beams Paragraph, classification table, result in greater sensing resolution and directivity. A wide and figure formulation bandwidth and specific penetration, reflection, and attenuation reactions to different materials allow distinguishing different Fig. 1. Review process block diagram objects and humans [11], [12]. However, using millimeter waves in sensing applications also has disadvantages. Signals at extremely high frequen- techniques for each of the identified millimeter wave cies suffer from significant attenuation. Millimeter waves can sensing application pipeline building blocks. therefore hardly be used for long-distance applications [13]. • Identifying commonalities, gaps, and shortcomings of The financial cost of deploying a millimeter wave sensing current studies and solutions focusing on the use of system, e.g., on a vehicle, is still high even though this millimeter wave as a sensing technology. cost is projected to decrease in the future [14]. Millimeter • Highlighting scientific and technological challenges and waves also suffer significant penetration loss through solid trends, and providing a future perspective for applications materials like concrete. As rain-drops are comparable in size of millimeter wave as a sensing technology. to the wavelength of millimeter waves, heavy rain can cause The review is organized as follows: Section II explains considerable attenuation due to scattering [9], [10]. the review methodology. Section III establishes an application The applications that use millimeter waves utilize a wide taxonomy based on the research papers that report on millime- variety of hardware and algorithms for data collection, data ter wave sensing. Section IV identifies the common building pre-processing, feature extraction, feature analysis, analytical blocks that make up the application pipelines presented in the modeling, and modeling evaluation. This paper provides a millimeter wave sensing papers. It also presents a thorough comprehensive overview and analysis of millimeter wave analysis of the wide variety of hardware, algorithms, analytical sensing application pipelines and basic building blocks, in- models, and model evaluation techniques across these papers cluding hardware, algorithms, analytical models, and model in the respective building blocks. Section V identifies and evaluation techniques, offers an insight into challenges and explains the challenges and trends, and provides a future trends, and provides a future perspective for applications perspective for applications of millimeter wave as a sensing of millimeter wave as a sensing technology. Therefore, the technology. Finally, Section VI concludes the paper. review has struck a balance between the amount of details that are provided for each millimeter wave sensing application II. REVIEW METHODOLOGY pipeline building block and does not elaborate on details of We have conducted this review with a specific process each application domain and algorithm
Load more

Recommended publications
  • Using Coding to Improve Localization and Backscatter Communication Performance in Low-Power Sensor Networks
    Using Coding to Improve Localization and Backscatter Communication Performance in Low-Power Sensor Networks by Itay Cnaan-On Department of Electrical and Computer Engineering Duke University Date: Approved: Jeffrey Krolik, Co-supervisor Robert Calderbank, Co-supervisor Matthew Reynolds Henry Pfister Loren Nolte Dissertation submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy in the Department of Electrical and Computer Engineering in the Graduate School of Duke University 2016 Abstract Using Coding to Improve Localization and Backscatter Communication Performance in Low-Power Sensor Networks by Itay Cnaan-On Department of Electrical and Computer Engineering Duke University Date: Approved: Jeffrey Krolik, Co-supervisor Robert Calderbank, Co-supervisor Matthew Reynolds Henry Pfister Loren Nolte An abstract of a dissertation submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy in the Department of Electrical and Computer Engineering in the Graduate School of Duke University 2016 Copyright c 2016 by Itay Cnaan-On All rights reserved except the rights granted by the Creative Commons Attribution-Noncommercial Licence Abstract Backscatter communication is an emerging wireless technology that recently has gained an increase in attention from both academic and industry circles. The key innovation of the technology is the ability of ultra-low power devices to utilize nearby existing radio signals to communicate. As there is no need to generate their own ener- getic radio signal, the devices can benefit from a simple design, are very inexpensive and are extremely energy efficient compared with traditional wireless communica- tion. These benefits have made backscatter communication a desirable candidate for distributed wireless sensor network applications with energy constraints.
    [Show full text]
  • The Investigation of Gyroelectric N-Inas Phase Shifters Characteristics
    ELECTRONICS AND ELECTRICAL ENGINEERING ISSN 1392 – 1215 2012. No. 6(122) ELEKTRONIKA IR ELEKTROTECHNIKA HIGH FREQUENCY TECHNOLOGY, MICROWAVES T 191 AUKŠTŲJŲ DAŽNIŲ TECHNOLOGIJA, MIKROBANGOS The Investigation of Gyroelectric n-InAs Phase Shifters Characteristics V. Malisauskas, D. Plonis Department of Electronic Systems, Vilnius Gediminas Technical University, Naugarduko St., 41-425, LT-03227, Vilnius, Lithuania, phone: +370 5 2744766, e-mail: [email protected] http://dx.doi.org/10.5755/j01.eee.122.6.1836 Introduction 0 1.ems , s j j r r B 0 The microwave phase shifters can be manufactured d1 d1 2.1 emr , r 1 using microstrip lines and open cylindrical waveguides [1]. d2 d2 21 The propagation and attenuation of phase wave’s cha- 2.2 emr , r 22 racteristics may vary in ferrite and semiconductor aa z r 3 3.emrr , waveguides by changing longitudinal magnetic flux den- s sity, external dielectric layer width and permittivity of r R1 dielectric layer, semiconductor temperature, the concentra- d1 tion of the free charge carriers. R 2 Nowadays the investigation of the semiconductor and d2 semiconductor-dielectric waveguides is very relevant and important for the sake of science. The usage and possibili- Fig. 1. Structure of the gyroelectric open cylindrical phase shifter ties of latter mentioned waveguides in gyroelectric phase with two dielectric layers: 1 – semiconductor core, 21 and 22 – external non-magnetic dielectric layers, 3 – air shifters are not known [2–4]. n-InAs semiconductor has been selected for the pur- The structure area 2, consists of two (area 2 and 2 ) pose of investigation. The super high frequency transistors 1 2 external non-magnetic dielectric layers complex relative are manufactured using n-InAs semiconductors, which eedd12, d1,2 =.1m have the higher concentration of electrons.
    [Show full text]
  • Circularly Polarized 2 Bit Reconfigurable Beam-Steering
    2416 IEEE TRANSACTIONS ON ANTENNAS AND PROPAGATION, VOL. 68, NO. 3, MARCH 2020 Communication Circularly Polarized 2 Bit Reconfigurable Beam-Steering Antenna Array Peiqin Liu ,YueLi , and Zhijun Zhang Abstract—In this communication, a circularly polarized (CP) reconfigurable 2 bit antenna array is proposed for beam-steering applica- tions. The proposed antenna array utilizes a novel CP reconfigurable 2 bit patch antenna as radiation element. For a reconfigurable 2 bit element, there should be four phase states (i.e., 0◦,90◦, 180◦, and 270◦).Inthe proposed radiation element, a corner truncated microstrip patch antenna is presented for CP radiation. Owing to the symmetry of the patch antenna, the 0◦ and 180◦ phase states are achieved by selecting feeding points of the patch instead of using complex feeding network. A 90◦ digital phase shifter is cascaded to realize the 90◦ and 270◦ phase states for the 2 bit reconfigurable element. Based on the novel 2 bit CP element, an eight-element CP reconfigurable 2 bit antenna array is fabricated and tested to verify the design strategy at 3.65 GHz. The measured results match well with simulation. By appropriately controlling the ON and OFF states of p-i-n diodes, the proposed CP array can be steered from −49◦ to +49◦. Index Terms—2 bit radiation element, beam scanning, circular polar- ization, reconfigurable array. I. INTRODUCTION Circularly polarized (CP) beam-steering antennas have attracted special attention in various applications, such as satellite communication system, wireless communication system, and radar system [1]. In the past decade, many researchers have been concen- trating on beam steering with circular polarization.
    [Show full text]
  • Retrodirective Phase-Lock Loop Controlled Phased Array Antenna for a Solar Power Satellite System
    RETRODIRECTIVE PHASE-LOCK LOOP CONTROLLED PHASED ARRAY ANTENNA FOR A SOLAR POWER SATELLITE SYSTEM A Thesis by SAMUEL JOHN KOKEL Submitted to the Office of Graduate Studies of Texas A&M University in partial fulfillment of the requirements for the degree of MASTER OF SCIENCE December 2004 Major Subject: Electrical Engineering RETRODIRECTIVE PHASE-LOCK LOOP CONTROLLED PHASED ARRAY ANTENNA FOR A SOLAR POWER SATELLITE SYSTEM A Thesis by SAMUEL JOHN KOKEL Submitted to the Office of Graduate Studies of Texas A&M University in partial fulfillment of the requirements for the degree of MASTER OF SCIENCE Approved as to style and content by: ______________________________ ______________________________ Kai Chang Robert Nevels (Chair of Committee) (Member) ______________________________ ______________________________ Frederick Strieter Alexandre Kolomenski (Member) (Member) ______________________________ Chanan Singh (Head of Department) December 2004 Major Subject: Electrical Engineering iii ABSTRACT Retrodirective Phase-Lock Loop Controlled Phased Array Antenna for a Solar Power Satellite System. (December 2004) Samuel John Kokel, B.S., Texas A&M University Chair of Advisory Committee: Dr. Kai Chang This thesis proposes a novel technique using a phase-lock loop (PLL) style phase control loop to achieve retrodirective phased array antenna steering. This novel approach introduces the concept of phase scaling and frequency translation. It releases the retrodirective transmit-receive frequency ratio from integer constraints and avoids steering approximation errors. The concept was developed to achieve automatic and precise beam steering for the solar power satellite (SPS). The testing was performed using a transceiver converting a pair of received 2.9 GHz signals down to 10 MHz, and up converting two 10 MHz signals to 5.8 GHz.
    [Show full text]
  • Ambient Backscatter Communications
    1 Ambient Backscatter Communications: A Contemporary Survey Nguyen Van Huynh∗, Dinh Thai Hoang∗, Xiao Luy, Dusit Niyato∗, Ping Wang∗, and Dong In Kimz ∗School of Computer Science and Engineering, Nanyang Technological University, Singapore yDepartment of Electrical and Computer Engineering, University of Alberta, Canada zSchool of Information and Communication Engineering, Sungkyunkwan University (SKKU), Korea Abstract—Recently, ambient backscatter communications has Recently, ambient backscatter [12] has been emerging as a been introduced as a cutting-edge technology which enables smart promising technology for low-energy communication systems devices to communicate by utilizing ambient radio frequency which can address effectively the aforementioned limitations (RF) signals without requiring active RF transmission. This technology is especially effective in addressing communication in conventional backscatter communications systems. In ambi- and energy efficiency problems for low-power communications ent backscatter communications systems (ABCSs), backscatter systems such as sensor networks. It is expected to realize devices can communicate with each other by utilizing sur- numerous Internet-of-Things (IoT) applications. Therefore, this rounding signals broadcast from ambient RF sources, e.g., paper aims to provide a contemporary and comprehensive TV towels, FM towels, cellular base stations, and Wi-Fi literature review on fundamentals, applications, challenges, and research efforts/progress of ambient backscatter communications. access
    [Show full text]
  • MMIC Technology for Advanced Space Communications Systems
    NASA Technical Memorandum 83749 MMIC Technology for Advanced Space Communications Systems A. N. Downey, D. J. Connolly, and G. Anzic Lewis Research Center Cleveland, Ohio Prepared for the Seventeenth Annual Electronics and Aerospace Conference (EASCON) sponsored by the Institute of Electrical and Electronics Engineers Washington, D.C., September 10-12, 1984 NASA MMIC TECHNOLOGY FOR ADVANCED SPACE COMMUNICATIONS SYSTEMS A. N. Downey, D. J. Connolly, and G. Anzic National Aeronautics and Space Administration Lewis Research Center Cleveland, Ohio 44135 ABSTRACT development contract and a summary of progress to date follows. The current NASA program for 20 and 30 GHz Monolithic Microwave Integrated Circuit (MMIC) 20 GHz Variable Power Amplifier technology is reviewed. MMIC advantages are dis- cussed. Millimeter wavelength MMIC applications The 20 GHz VPA is a fully monolithic GaAs and technology for communications systems are pre- module providing 2.5 GHz of bandwidth (17.7 to sented. Passive and active MMIC-compatible com- 20.2 GHz) at five digitally controlled power ponents for millimeter wavelength applications are levels. Contract goals are 500 mW rf output power investigated. The cost of millimeter wavelength with 20 dB minimum gain and 15 percent efficiency MMIC's is projected. at the maximum power condition, and 12.5 mW output power with 4 dB minimum gain and 6 percent efficiency at the lowest power "on" condition. In INTRODUCTION the off state, maximum dissipation will be 50 mW. Intermodulation products are to be 20 dB below the Advanced space communications systems concepts carrier. A TTL-compatible four-bit digital input such as NASA's Advanced Communications Technology is used to control the discrete power levels.
    [Show full text]
  • Self-Interference in Full-Duplex 2×2 MIMO Transceivers: Channel Characterization and RF/Analog Cancellation
    Self-Interference in Full-Duplex 2×2 MIMO Transceivers: Channel Characterization and RF/Analog Cancellation Fei Chen Department of Electrical & Computer Engineering McGill University Montreal, Canada April 2017 A thesis submitted to McGill University in partial fulfillment of the requirements for the degree of Master of Engineering. c 2017 Fei Chen 2017/04/07 i To my parents, with all my love. ii Abstract Spectrum resources become more and more scarce over last few decades, leading to the sig- nificance of effectively utilizing and allocating spectrum. Recently, in-band full-duplex (FD) operation has gained more attention as a potential approach of enhancing spectrum efficiency by simultaneous transmission and reception over the same frequency. One of the most challenging problems in FD communications is the existing strong self-interference (SI) from transmitter and co-located receiver. The SI must be suppressed to a sufficiently low level by a combination of an- tenna, radio frequency (RF) and baseband cancellation stages so that the intended signal received from the distant transmitter can be reliably demodulated. In this work, we study the SI-channel characteristics and develop a high performance RF/Analog self-interference canceller (SIC) for a 2×2 MIMO FD transceiver. First of all,SI cancellation technique requires knowledge ofSI propagation characteristics and models. We investigate of the wideband SI-channel propagation characteristics of a 2×2 MIMO with dual-polarized antennas. The SI-channels are measured at center frequency of 2.45GHz with 500MHz bandwidth in various environments: anechoic chamber, laboratory room, and cor- ridor. The measurement results show that the SI-channel can be represented by a multipath model composting of two segments: a quasi-static internal SI-sub-channel due to the particular Tx/Rx antenna structure and a time-varying and dynamic external SI-sub-channel due to possible reflec- tions from the surrounding objects.
    [Show full text]
  • Design of MIMO Antenna for Future 5G Communication Systems تصميم
    الجـامعـــــــــة اﻹســـــﻻميــة بغــــــزة The Islamic University of Gaza عمادة البحث العلمي والدراسات العليا Deanship of Research and Graduate Studies كـــلـــيــــــــــــة الـــهـــنـــــدســـــــة Faculty of Engineering Master of Electrical Engineering ماجستيــر الهنــدســـة الكهـــربائيـــة Design of MIMO Antenna for Future 5G Communication Systems تصميم هوائي متعدد المداخل ومتعدد المخارج ﻷنظمة اتصاﻻت الجيل الخامس By Tareq H. Elhabbash Supervised by Dr. Talal F. Skaik Associate Professor of Electrical Engineering A thesis submitted in partial fulfillment of the requirements for the degree of Master of Electrical Engineering April/2019 إقــــــــــــــرار أنا الموقع أدناه مقدم الرسالة التي تحمل العنوان: Design of MIMO Antenna for Future 5G Communication Systems تصميم هوائي متعدد المداخل ومتعدد المخارج ﻷنظمة اتصاﻻت الجيل الخامس أقر بأن ما اشتملت عليه هذه الرسالة إنما هو نتاج جهدي الخاص، باستثناء ما تمت اﻹشارة إليه حيثما ورد، وأن هذه الرسالة ككل أو أي جزء منها لم يقدم من قبل اﻻخرين لنيل درجة أو لقب علمي أو بحثي لدى أي مؤسسة تعليمية أو بحثية أخرى. Declaration I understand the nature of plagiarism, and I am aware of the University’s policy on this. The work provided in this thesis, unless otherwise referenced, is the researcher's own work, and has not been submitted by others elsewhere for any other degree or qualification. طارق حسين الهباش :Student's name اسم الطالب: Signature: التوقيع: Tareq Date: التاريخ: 1/3/2019 I Abstract 5G communication system is considered as a revolution in the wireless communication market where a very high bandwidth is required for modern smart phones. This fast revolution drives researchers for developing the communication technology whether in software or hardware fields.
    [Show full text]