Automotive DMS (Driver Monitoring System) Research Report, 2019-2020

June 2020 STUDY GOAL AND OBJECTIVES METHODOLOGY This report provides the industry executives with strategically significant Both primary and secondary research methodologies were used competitor information, analysis, insight and projection on the in preparing this study. Initially, a comprehensive and exhaustive competitive pattern and key companies in the industry, crucial to the search of the literature on this industry was conducted. These development and implementation of effective business, marketing and sources included related books and journals, trade literature, R&D programs. marketing literature, other product/promotional literature, annual reports, security analyst reports, and other publications. REPORT OBJECTIVES Subsequently, telephone interviews or email correspondence  To establish a comprehensive, factual, annually updated and cost- was conducted with marketing executives etc. Other sources effective information base on market size, competition patterns, included related magazines, academics, and consulting market segments, goals and strategies of the leading players in the companies. market, reviews and forecasts.  To assist potential market entrants in evaluating prospective INFORMATION SOURCES acquisition and joint venture candidates. The primary information sources include Company Reports,  To complement the organizations’ internal competitor information and National Bureau of Statistics of China etc. gathering efforts with strategic analysis, data interpretation and insight.  To suggest for concerned investors in line with the current development of this industry as well as the development tendency.

 To help company to succeed in a competitive market, and Copyright 2012 ResearchInChina understand the size and growth rate of any opportunity. Room 2-626, 6th Floor, No.1, Shanyuan Street, Haidian District, Beijing, 100080 Phone: +86 10 82600828 ● Fax: +86 10 82601570 ● www.researchinchina.com ● [email protected] Abstract Automotive DMS Research: DMS installations shoot up, with a year-on-year upsurge of 360% in Q1 2020 DMS (Driver Monitoring System) is bifurcated into active DMS and passive DMS. Passive DMS judges the driver's state based on the steering wheel turning and driving trajectory. Active DMS, generally enabled by cameras and near-infrared technology, detects the driver's state from eyelid closure, blinking, gaze direction, yawning, and head movements. Only active DMS is studied in this report.

In 2006, the LS 460 was packed with active DMS for the first time, and the camera was mounted on the top of the steering column cover with six built-in near-infrared LEDs. Automakers are not interested in active DMS, because they believe that it increases the cost of the vehicle and consumers may be reluctant to pay for it. Yet, a train of accidents over the recent years highlight the importance of DMS in ADAS, especially L2/L3. Active DMS started to soar from 2018, with the massive availability of the L2 system and the to-be-spawned L3 system.

Euro-NCAP issued a roadmap for 2025, which requires that new cars must be equipped with DMS from July 2022. China has legislated the mandatory installation of DMS for commercial vehicles, and similar stipulations for passenger cars are just around the corner. The active DMS market is growing prosperous as relevant chip, software and algorithm vendors are vigorously promoting the development of DMS technology.

Copyright 2012ResearchInChina Room 2-626, 6th Floor, No.1, Shanyuan Street, Haidian District, Beijing, 100080 Phone: +86 10 82600828 ● Fax: +86 10 82601570 ● www.researchinchina.com ● [email protected] 10,170 units of active DMS were installed in new passenger cars in China in 2019, surging by 174% on an annualized basis. In 2020Q1, the installations skyrocketed 360% year-on- year to 5,137 units amid the wide use of active DMS in the models priced between RMB150,000 and RMB200,000 and the adoption by W E Y, Xpeng, Geely, to name a few.

Most Tier1 suppliers have launched total DMS solutions, including Valeo, Bosch, Continental, Denso, Hyundai Mobis, Visteon, Veoneer, etc. Among Chinese companies, the DMS of Hikvision, SenseTime, Baidu, and Dahua Technology have been found on various brand models. Copyright 2012ResearchInChina Room 2-626, 6th Floor, No.1, Shanyuan Street, Haidian District, Beijing, 100080 Phone: +86 10 82600828 ● Fax: +86 10 82601570 ● www.researchinchina.com ● [email protected] Rise of DMS algorithm developers

DMS is used mainly to monitor drivers’ fatigue and distraction. Yet a larger number of sensors, vision + infrared cameras, and even radars mean availability of more functions, e.g., face recognition, age and gender recognition, emotion recognition, seat belt detection, posture, position and forgetting detection, cabin abnormality detection, and infant detection. Face, gender and expression recognition helps with identity authentication and offers richer interaction between human and vehicle. DMS that is now used just for early warning will enable personalized body control and more functions once it is coupled with ADAS/AD systems.

In Valeo’s case, its AI-driven DMS uses convolutional neural network (CNN) algorithms for emotion recognition and allows unique settings by recognizing the driver’s face.

The versatility, however, cannot be met only by Tier1 suppliers in the short run. That’s why DMS is often co-developed by Tier1 suppliers and algorithm companies.

With years of efforts on development of computer vision technology, ArcSoft Corporation Limited has developed DMS, ADAS and BSD, among others, to meet automobile industry’s needs for vision-related capabilities. The developer’s intelligent driving algorithm business expanded rapidly in 2019, contributing revenue of RMB16.0566 million, a substantial increase as compared to 2018 (RMB2.2021 million), and rang in RMB17.0076 million in the first quarter of 2020, more than the full-year revenue of 2019.

Copyright 2012ResearchInChina Room 2-626, 6th Floor, No.1, Shanyuan Street, Haidian District, Beijing, 100080 Phone: +86 10 82600828 ● Fax: +86 10 82601570 ● www.researchinchina.com ● [email protected] ArcSoft’s peers such as EyeSight, Smart Eye, FotoNation and Seeing Machine all have been working on development of software algorithms for years. Even so, use of DMS technology still faces plenty of tough challenges:

 The highest technical barrier before application of vision-based DMS technology is its performance in high or low light which may lead to all white or all black images, respectively. In this case, even the most advanced algorithms won’t work.  How to quantitatively define fatigue and drowsiness also creates a bottleneck to use of DMS. The most effective way to measure fatigue and define the relation between fatigue and temperature, dermal resistance, eye movement, respiratory rate, heart rate and brain activity, is measurement of pulse and heart rate variability (HRV), but the technology is still not mature enough.  Widely varying signal-to-noise ratio and contrast, obscured and dithered images, and light difference in different weathers and time periods will issue in images of differing brightness.  Face detection challenges: in-plane rotation of face; out-of-plane rotation of face; existence of cosmetics, beard and glasses; expression (happy, cry, etc.); obscured face; real-time processing requirements.  DMS latency caused by insufficient computing power, communication, etc.. Interference to users caused by too many false alarms.  Few sample databases for training algorithms.

Companies are trying to add more sensors and more powerful chips to solve the problems that vision cameras fail to address in multiple scenarios.

Copyright 2012ResearchInChina Room 2-626, 6th Floor, No.1, Shanyuan Street, Haidian District, Beijing, 100080 Phone: +86 10 82600828 ● Fax: +86 10 82601570 ● www.researchinchina.com ● [email protected] Hardware improvement and cockpit monitoring

In May 2019, OmniVision Technologies and Shanghai Fullhan Microelectronics announced a joint solution for capturing and processing high quality color (RGB) and infrared (IR) automotive interior images, day and night, with a single camera. This solution combines OmniVision’s OV2778 2MP RGB-IR image sensor which offers high sensitivity across all lighting conditions with Fullhan’s FH8310 image signal processor (ISP). The result is high quality video for both machine vision in- cabin monitoring systems (IMS) and viewing applications, simultaneously, providing integrated solutions for facial recognition, the detection of objects and unattended children, remote monitoring, and recording for ride-hailing and robotaxi vehicles.

In June 2019, Vayyar, an Israeli startup, announced the launch of the first automotive 4D point cloud application on a single radar chip. The single chip with point cloud displays the dimension, shape, location and movement of people and objects, enabling the complete classification of the car’s environment, regardless of bad lighting or harsh weather conditions. In-cabin solutions include seat belt reminders, optimized airbag deployment, gesture control, driver drowsiness alerts, and infant detection alarms.

In September 2019, ON Semiconductor rolled out a complete in-cabin monitoring system inclusive of driver monitoring and occupant monitoring functions. The demonstration includes three ON Semiconductor 2.3-megapixel RGB-IR image sensors. This multi-camera system utilizes Ambarella’s CV2AQ System-on-Chip (SoC) and integrates Eyeris’ AI software performing complex body and facial analytics, occupant activity monitoring, object detection, among others.

Copyright 2012ResearchInChina Room 2-626, 6th Floor, No.1, Shanyuan Street, Haidian District, Beijing, 100080 Phone: +86 10 82600828 ● Fax: +86 10 82601570 ● www.researchinchina.com ● [email protected] In February 2020, Analog Devices, Inc. (ADI) announced a collaboration with Jungo to develop a Time-of-Flight (ToF) and 2D infrared- (IR) based camera solution to enable driver- and in-cabin monitoring in vehicles. The combination of ADI’s ToF technology with Jungo’s Codriver software is expected to enable the monitoring of vehicle occupants for levels of drowsiness and distraction by observing head and body position as well as eye gaze.

Valeo has also rolled out its cockpit monitoring technologies, such as vision-based rear seat monitoring solution and radar-based living beings detection solution.

EyeSight Cabin Sense in-car Occupancy Monitoring System (OMS) detects occupants, their posture or whether they wear seatbelts or not, as well as whether any child or object like a bag is forgotten in car or not.

In a nutshell, DMS will be thriving with wide use of L2/L3 automated driving in the upcoming several years. In future, it will evolve into cockpit monitoring system which will play a crucial role even in the era of L4 autonomy.

Copyright 2012ResearchInChina Room 2-626, 6th Floor, No.1, Shanyuan Street, Haidian District, Beijing, 100080 Phone: +86 10 82600828 ● Fax: +86 10 82601570 ● www.researchinchina.com ● [email protected] Table of contents

1 Automotive DMS Technology 2.3 Comparison of Some Active DMS Suppliers’ Products 2.4 DMS Market Sales 1.1 Infrared Technology 2.5 Market Features 1.1.1 Introduction to Infrared 1.1.2 Infrared Use in Automobile 3 Development Trends of Automotive DMS 1.2 DMS Technology 1.2.1 Introduction to DMS 3.1 DMS Technology Trends 1.2.2 Passive DMS 3.1.1 Technology Trend 1 1.2.3 Active DMS 3.1.2 Technology Trend 2 1.2.4 Operating Principle and Installation Position of Active DMS 3.1.3 Technology Trend 3 1.2.5 Active DMS Based on Cameras and NIR 3.1.4 Technology Trend 4 1.2.6 Hardware Architecture and Technical Requirements of DMS 3.1.5 Technology Trend 5 1.2.7 Software & Algorithm Architecture and Technical 3.1.6 Technology Trend 6 Requirements of ArchDMS 3.1.7 Technology Trend 7 1.3 Advances in Related Chip Technology 3.2 DMS Market Trends 1.3.1 Technical Progress 1 3.2.1 Market Trend 1 1.3.2 Technical Progress 2 3.2.2 Market Trend 2 1.3.3 Technical Progress 3 3.3 Tendencies of DMS Software and Algorithms 1.3.4 Technical Progress 4 3.3.1 Software and Algorithm Trend 1 1.3.5 Technical Progress 5 3.3.2 Software and Algorithm Trend 2 3.3.3 Software and Algorithm Trend 3 2 Automotive DMS Industry Chain and Market Analysis 4 DMS Application of OEMs 2.1 Active DMS Industry Chain 4.1 DMS Technology Solutions of Major OEMs 2.2 Players in the Industrial Chain 4.2 Cadillac CT6 Room 2-626, 6th Floor, No.1, Shanyuan Street, Haidian District, Beijing, 100080 Phone: +86 10 82600828 ● Fax: +86 10 82601570 ● www.researchinchina.com ● [email protected] Table of contents

4.3 SUBARU FORESTER 5.4 Visteon 4.4 BMW X5 5.4.1 Profile 4.5 DS7 5.4.2 Visteon DMS 4.6 Leapmotor S01 5.5 Bosch 4.7 EXEED TXL 5.6 Veoneer 4.8 Geely Xingyue 5.6.1 Profile 4.9 XPeng G3 5.6.2 Veoneer DMS 4.10 WEY VV7 5.7 OSRAM 4.11 GAC NE Aion LX 5.8 Mitsubishi Electric 4.12 NIO ES8 5.9 Aptiv 5.9.1 Profile 5 Tier1 Suppliers of Automotive DMS 5.9.2 Aptiv DMS 5.1 Valeo 5.10 Continental 5.1.1 Profile 5.11 Harman 5.1.2 Valeo DMS and In-car Monitoring System 5.12 Autocruis 5.1.3 Main Features of Valeo DMS 5.12.1 Profile 5.1.4 Applied Scenarios of Valeo DMS 5.12.2 Autocruis ADAS Products 5.2 DENSO 5.12.3 Autocruis Product & Technology Roadmap 5.2.1 Profile 5.12.4 Autocruis DMS 5.2.2 DENSO Driver Monitoring Cameras 5.12.5 Features of Autocruis DMS 5.2.3 DENSO Commercial Vehicle DMS 5.12.6 Functional Safety Design Architecture of Autocruis DMS 5.3 Hyundai Mobis 5.12.7 Autocruis Eye Gaze Estimation Model 5.3.1 Profile 5.13 Roadefend 5.3.2 Hyundai Mobis DMS 5.13.1 Profile 5.3.3 Occupant Detection System 5.13.2 Roadefend’s Technologies Room 2-626, 6th Floor, No.1, Shanyuan Street, Haidian District, Beijing, 100080 Phone: +86 10 82600828 ● Fax: +86 10 82601570 ● www.researchinchina.com ● [email protected] Table of contents

5.13.3 Roadefend’s Recognition of Driver State 6.1.2 Seeing Machines -- Revenue 5.13.4 Driver Behavior Acquisition, Analysis and Warning System 6.1.3 Seeing Machines -- Products 5.13.5 Big Data Analysis of Driver Behaviors 6.1.4 Seeing Machines -- DMS Operating Principle 5.13.6 Roadefend’s Successful Cases 6.1.5 Seeing Machines -- DMS Business Overview 5.14 SinoChipAi 6.1.6 Seeing Machines -- DMS Roadmap 5.14.1 Profile 6.1.7 Seeing Machines -- Evolution of Core Technologies 5.14.2 SinoChipAi Vision Products 6.2 Affectiva 5.14.2 SinoChipAi Vision Product: DSM 6.2.1 Profile 5.14.2 SinoChipAi Vision Product: 3D Face Recognition 6.2.2 Application of Affectiva Technology 5.15 MINIEYE 6.2.3 Emotional AI Use in Automobile 5.15.1 Profile 6.2.4 Driver and Occupant Monitoring 5.15.2 MINIEYE DMS 6.2.5 Tracking of Driver Emotions and Cognitive State 5.16 Zhejiang Dahua Technology 6.2.6 Emotional AI and Mood Measurement 5.16.1 Profile 6.2.7 Emotion Database 5.16.2 Products 6.2.8 Affectiva Driver Emotion Tracking Studies 5.17 Hikvision 6.2.9 Driver Dejection Detection 5.18 Baidu 6.2.10 Driver Fatigue Monitoring with Facial Expression and 5.18.1 Profile Voice 5.18.2 Baidu Driver Fatigue Monitoring System 6.3 EyeSight 5.18.3 Baidu DMS Software 6.3.1 Profile 6.3.2 EyeSight Automotive Solution: Drive Sense 6 Automotive DMS Suppliers 6.3.3 EyeSight Automotive Solution: Cabin Sense 6.1 Seeing Machines 6.3.4 EyeSight Automotive Solution: Fleet Sense 6.1.1 Seeing Machines -- Profile 6.3.5 EyeSight’s Technologies 6.1.2 Seeing Machines -- Revenue 6.3.6 EyeSight’s Automotive Products Room 2-626, 6th Floor, No.1, Shanyuan Street, Haidian District, Beijing, 100080 Phone: +86 10 82600828 ● Fax: +86 10 82601570 ● www.researchinchina.com ● [email protected] Table of contents

6.3.7 EyeSight’s Clients and Partners 6.4 Smart Eye 6.4.1 Profile 6.4.2 General Hardware Development Platform of Smart Eye 6.4.3 Smart Eye DMS -- Detection of Facial Expression 6.4.4 Smart Eye DMS -- Detection of Human Pose and Gesture Recognition 6.4.5 Smart Eye DMS -- Object Classification 6.4.6 Smart Eye DMS -- Feature Detection 6.4.7 Smart Eye’s R&D of Next-generation Eye-tracking Technology 6.5 FotoNation 6.5.1 Profile 6.5.2 FotoNation DMS 6.5.3 FotoNation DMS Core Technology 6.6 Untouch Technologies 6.6.1 Profile 6.6.2 Untouch Tech’ Product: U-Drive Smart Cockpit Monitoring 6.6.3 Untouch Tech at 2020 CES: Exhibition of U-SAFE Smart Safe Cockpit 6.6.4 Untouch Tech at 2020 CES: Exhibition of U-COMFORT Smart Cozy Cockpit 6.7 SenseTime 6.7.1 Profile 6.7.2 SenseTime DMS 6.8 ArcSoft 6.9 Eyeris

Room 2-626, 6th Floor, No.1, Shanyuan Street, Haidian District, Beijing, 100080 Phone: +86 10 82600828 ● Fax: +86 10 82601570 ● www.researchinchina.com ● [email protected] How to Buy

You can place your order in the following alternative ways: Choose type of format 1.Order online at www.researchinchina.com PDF (Single user license) …………..3,400 USD 2.Fax order sheet to us at fax number:+86 10 82601570 Hard copy ………………….……. 3,600 USD 3. Email your order to: [email protected] PDF (Enterprisewide license)…...... 5,000 USD 4. Phone us at +86 10 82600828

Party A: Name: ※ Reports will be dispatched immediately Address: Contact Person: Tel once full payment has been received. E-mail: Fax Payment may be made by wire transfer or Party B: credit card via PayPal. Name: Beijing Waterwood Technologies Co., Ltd (ResearchInChina) Address: Room 2-626, 6th Floor, No.1, Shanyuan Street, Haidian District, Beijing, 100080 Contact Liao Yan Phone: 86-10-82600828 Person: E-mail: [email protected] Fax: 86-10-82601570 Bank details: Beneficial Name: Beijing Waterwood Technologies Co., Ltd Bank Name: Bank of Communications, Beijing Branch Bank Address: NO.1 jinxiyuan shijicheng,Landianchang,Haidian District,Beijing Bank Account No #: 110060668012015061217 Routing No # : 332906 Bank SWIFT Code: COMMCNSHBJG

Title Format Cost

Total

Room 2-626, 6th Floor, No.1, Shanyuan Street, Haidian District, Beijing, 100080 Phone: +86 10 82600828 ● Fax: +86 10 82601570 ● www.researchinchina.com ● [email protected] RICDB service About ResearchInChina

ResearchInChina (www.researchinchina.com) is a leading independent provider of China business intelligence. Our research is designed to meet the diverse planning and information needs of businesses, institutions, and professional investors worldwide. Our services are used in a variety of ways, including strategic planning, product and sales forecasting, risk and sensitivity management, and as investment research. Our Major Activities  Multi-users market reports  Database-RICDB  Custom Research  Company Search

RICDB (http://www.researchinchina.com/data/database.html ), is a visible financial data base presented by map and graph covering global and China macroeconomic data, industry data, and company data. It has included nearly 500,000 indices (based on time series), and is continuing to update and increase. The most significant feature of this base is that the vast majority of indices (about 400,000) can be displayed in map.

After purchase of our report, you will be automatically granted to enjoy 2 weeks trial service of RICDB for free.

After trial, you can decide to become our formal member or not. We will try our best to meet your demand. For more information, please find at www.researchinchina.com

For any problems, please contact our service team at: Room 2-626, 6th Floor, No.1, Shanyuan Street, Haidian District, Beijing, 100080 Phone: +86 10 82600828 ● Fax: +86 10 82601570 ● www.researchinchina.com ● [email protected]