DOCSLIB.ORG

Accelerating ADAS with Open Source Introduction

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Accelerating ADAS with Open Source Introduction Accelerating ADAS with Open Source Introduction • Mikko Hurskainen - ミッコ フルスカイネン • Technical leadership positions in Nokia, Notava, Nomovok, Suunto, Link Motion • Now Technologist in Link Motion. Looking on future technologies. • Mission: making connected cars safe & secure Link Motion We make CONNECTED CAR COMPUTERS with HARDWARE - OS - APPLICATIONS Focus on SECURITY 10 years & 200+ with cost efficient Automotive software projects delivered performance Our HQ is in Finland 2002 2004 2006 2008 2015 2013 2011 2009 What’s ADAS ? Applications: Applications: • Commuter Applications: • Lane assist • Efficient transport • Manually driven car • Adaptive Cruise control • Local concierge • Collision avoidance Level 0 Level 1 Level 2 Level 3 Level 4 Level 5 No Driver Partial Conditional High Full Automation Assistance Automation Automation Automation Automation Applications: Applications: Applications: • Reverse camera • Automated parking • Taxi service • Cruise control • Highway cruiser • Moving office space • Visualization • Platooning • “Ultimate IoT machine” Classification: SAE Trends & Role of OSS Enablement of functionality ADAS becoming mainstream with OSS Level 0 Level 1 Level 2 Level 3 Level 4 Level 5 No Driver Partial Conditional High Full Automation Assistance Automation Automation Automation Automation Platformisation of ADAS Need for openness systems & cost-efficiency Linux for ADAS – why ? • Few years ago instrument cluster running Linux was thought not to be possible, now reality • ADAS becoming more complex – deeply embedded designs do not offer structure & re-use that well structured platforms, like Linux, can offer. • Developers prefer desktop platforms. • Linux is evolving into direction that it can be used for safety critical applications. Examples: NXP Linux, OSADL • Linux is POSIX compliant, possible to transfer results to other POSIX platforms. Also hybrid designs possible. Autonomous Driving Biggest challenge: how to ensure car behaves correctly in ALL situations ? Answer is Open Source: by making algorithms open those can be tested by large community OSS Toolbox for ADAS Algorithms New components OSS ADAS Platform OSS SW / communities Tools, testbench, drivers, platform, Products Automotive Platforms architecture, process, community Lower cost & faster time-to- market ISO 26262 Safety based view of the system ASIL Levels A B C D ASIL = Severity x (Exposure x Controllability) ASIL = Automotive Safety Integrity Level (ISO 26262) Process Compliancy Open Source vs ISO 26262 process • Rigorous reviews • No controlled process • Adherence to good coding • No responsible conventions persons • Well structured • Lack of testing software coverage • External reviews • Lack of design documentation • Known-to-work designs Need to also take account cyber security (eg SAE J3061) OSS ASIL Maturization Developers Community Maturization Product development Product Stable release ASIL pre-qualified ASIL qualified by the release by product by development maturization company community community Examples: RHEL, OSADL Technologies Need more: • Sensing • Connectivity • Fusion • ADAS components • Testbenches • Simulation BlueZ • Auditing • Security Evolutionary: OSS Rear Vision Camera https://github.com/openautocam Visual guidance Sensory guidance SAEL0 ASIL A ASIL Moving object Collision detection recognition Braking Visualization Collision detection B Drive train L1 control C Emergency brake L2 Revolutionary: ADAS Processor Connectivity • ADAS processor as brains of a car • Connected to vision, sensors, Camera Cluster & connectivity, Infotainment actuators Radar • Linux as a base ADAS processor instead of embedded system LIDAR Drivetrain Hybrid Designs ASIL A / B ASIL A Cluster & Infotainment Safety Cluster / Critical Infotainment SW Microkernel Drive Control ASIL B+ ASIL C / D Less, but more Powerful computers What’s needed ? Components Community V2X, Sensing, Co-development, Controller information Process Examples ISO 26262 Reverse camera, compliant cruise control Thank you ! ありがとうございます.
Load more

Recommended publications
  • Programming Iot Devices by Demonstration Using Mobile Apps
    Programming IoT Devices by Demonstration Using Mobile Apps Toby Jia-Jun Li1(✉), Yuanchun Li2, Fanglin Chen1, and Brad A. Myers1(✉) 1 Human-Computer Interaction Institute, Carnegie Mellon University, Pittsburgh, USA {tobyli,bam}@cs.cmu.edu, [email protected] 2 School of Electronics Engineering and Computer Science, Peking University, Beijing, China [email protected] Abstract. The revolutionary advances of Internet of Things (IoT) devices and applications have helped IoT emerge as an increasingly important domain for end-user development (EUD). Past research has shown that end users desire to create various customized automations, which would often utilize multiple IoT devices. Many solutions exist to support EUD across multiple IoT devices, but they are limited to devices from the same manufacturer, within the same “eco- system” or supporting a common API. We present EPIDOSITE, a mobile program‐ ming-by-demonstration system that addresses this limitation by leveraging the smartphone as a hub for IoT automation. It enables the creation of automations for most consumer IoT devices on smartphones by demonstrating the desired behaviors through directly manipulating the corresponding smartphone app for each IoT device. EPIDOSITE also supports using the smartphone app usage context and external web services as triggers and data for automations, enabling the crea‐ tion of highly context-aware IoT applications. Keywords: Internet of Things · Programming by demonstration · End user development 1 Introduction In the recent years, the rapid growth of Internet of Things (IoT) has surrounded users with various smart appliances, sensors and devices. Through their connections, these smart objects can understand and react to their environment, enabling novel computing applications [39].
    [Show full text]
  • Link Motion README the Definitive User Guide
    Link Motion README The Definitive User Guide Author: Mika Reinikainen Copyright © 2018 by Link Motion Oy All rights reserved. This book or any portion thereof may not be reproduced or used in any manner without the express written permission of Link Motion Oy. Font: Neuton (SIL Open Font License v1.10) Document version: 2.94 www.link-motion.com About This Book 5 Who Are We? 6 How We Do It 9 Organisation Structure 9 Virtual Teams 11 Distributed Work 12 Values 16 Getting Things Done 17 Our Toolbox 19 Communication is Key 26 Be the Bearer of Bad News 27 Give Feedback 28 Customer Communication 28 The Rumour Mill 29 Insider Learning 30 The Human Touch 30 Practice Makes Perfect 31 Proactivity 32 Craftsmanship 34 Customer Projects and Programs 36 What Are We Selling? 38 Everyone Is a Sales Person 41 Self-Development 43 Annual Reviews 45 Rainy Days 46 Keeping Secrets 48 Hiring 50 Who Should Join Us? 50 Closing Words 52 About This Book Welcome, neophyte! This book is a general introduction to working at Link Motion. It talks about who we are and where we want to go. Much of what is said here is based on real experiences that we have gone through over the years. Many things have been learned the hard way and it is only appropriate to share our experiences. After you are done with this book, you should have a pretty good idea of what it is like to work with us. The book is full of tips and guidelines, but it does not contain detailed information about company policies, regulations or technical topics, which probably would have gotten outdated before we had managed to get this book out to print.
    [Show full text]
  • Ford Targets 2021 for Autonomous Vehicles
    NEWS OEMs need centralised platforms for adas Automotive OEMs will eye, who all have an - erage between eight and for in-vehicle network - need to adopt new plat - nounced centralised au - twelve teraflops, orders ing. Ethernet-based prod - forms based on cen - tonomous platforms. of magnitude beyond the ucts from the likes of tralised processors and While each is in a dif - typical smart sensor de - Marvell Semiconductor high-speed low-latency ferent stage of develop - ployed in adas. and Valens are well posi - networking on the route ment, all have common Physical separation of tioned to meet the needs The monthly magazine for automotive electronics engineers to autonomous vehicles, themes, particularly in re - dumb sensors and cen - of high bandwidth and says ABI Research. lation to processing tralised processing will automotive requirements Issue 33 As vehicles become in - power. The platforms av - also open opportunities at a low cost. Ford targets 2021 for September 2016 dependent and begin to drive and react to traffic From connected cars to connected bikes IN THIS on their own, autonomous autonomous vehicles ISSUE systems will aggregate and process data from a Ford plans to have a high- president and CEO. “We have a strategic ad - Page 2: Centralised variety of on-board sen - volume, fully au - The four start-ups are vantage because of our platforms for adas sors and connected infra - tonomous SAE level- lidar sensor company ability to combine the structure. This forces the four-capable vehicle in Velodyne, Israel-based software and sensing Page 3: Nissan fits industry to hit a hard reset commercial operation in computer vision and ma - technology with sophisti - 200 cars in case on adas architectures, 2021 in a ride-hailing or chine learning company cated engineering,” said currently dominated by ride-sharing service.
    [Show full text]
  • Blinded and Confused: Uncovering Systemic Flaws in Device Telemetry for Smart-Home Internet of Things
    Blinded and Confused: Uncovering Systemic Flaws in Device Telemetry for Smart-Home Internet of Things TJ OConnor, William Enck, Bradley Reaves {tjoconno,whenck,bgreaves}@ncsu.edu North Carolina State University ABSTRACT 1 INTRODUCTION The always-on, always-connected nature of smart home devices The rapid growth of smart-home IoT devices oers convenience, complicates Internet-of-Things (IoT) security and privacy. Unlike connecting us to a broad-array of sensors and actuators in our traditional hosts, IoT devices constantly send sensor, state, and homes. The always-responsive nature of IoT provides on-demand heartbeat data to cloud-based servers. These data channels require access to seamlessly monitor and control every aspect of our homes. reliable, routine communication, which is often at odds with an For example, smart-locks allow us to remotely schedule and control IoT device’s storage and power constraints. Although recent eorts access to our homes from a smart phone, and connected doorbells such as pervasive encryption have addressed protecting data in- can detect motion and send video push-notications to our smart transit, there remains little insight into designing mechanisms for phones. The always-on, always-connected nature of smart home protecting integrity and availability for always-connected devices. IoT devices also oers extensive forensic evidence for criminal This paper seeks to better understand smart home device security investigations and legal proceedings. For example, data from Fitbit, by studying the vendor design decisions surrounding IoT telemetry Google Nest, Amazon Echo, and Ring Doorbell devices have aided messaging protocols, specically, the behaviors taken when an IoT law enforcement in solving crimes [16, 26].
    [Show full text]
  • Programming Iot Devices by Demonstration Using Mobile Apps
    Programming IoT Devices by Demonstration Using Mobile Apps Toby Jia-Jun Li1(✉), Yuanchun Li2, Fanglin Chen1, and Brad A. Myers1(✉) 1 Human-Computer Interaction Institute, Carnegie Mellon University, Pittsburgh, USA {tobyli,bam}@cs.cmu.edu, [email protected] 2 School of Electronics Engineering and Computer Science, Peking University, Beijing, China [email protected] Abstract. The revolutionary advances of Internet of Things (IoT) devices and applications have helped IoT emerge as an increasingly important domain for end-user development (EUD). Past research has shown that end users desire to create various customized automations, which would often utilize multiple IoT devices. Many solutions exist to support EUD across multiple IoT devices, but they are limited to devices from the same manufacturer, within the same “eco- system” or supporting a common API. We present EPIDOSITE, a mobile program‐ ming-by-demonstration system that addresses this limitation by leveraging the smartphone as a hub for IoT automation. It enables the creation of automations for most consumer IoT devices on smartphones by demonstrating the desired behaviors through directly manipulating the corresponding smartphone app for each IoT device. EPIDOSITE also supports using the smartphone app usage context and external web services as triggers and data for automations, enabling the crea‐ tion of highly context-aware IoT applications. Keywords: Internet of Things · Programming by demonstration · End user development 1 Introduction In the recent years, the rapid growth of Internet of Things (IoT) has surrounded users with various smart appliances, sensors and devices. Through their connections, these smart objects can understand and react to their environment, enabling novel computing applications [39].
    [Show full text]
  • User`S Manual
    Standalone Digital Video Recorder Premium DVR 4, 8, 16 Channel Models User`s Manual MADE IN KOREA M2313KQCR This document contains preliminary information and is subject to change without notice. KQ3 FCC Compliance Statement Notice to Users: This equipment has been tested and found to comply with the limits for a Class A digital device. Pursuant to Part 15 of the FCC Rules, these limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment. This equipment generates, uses and can radiate radio frequency energy and, if not installed and used in accordance with the instruction manual, may cause harmful interference to radio communications. Operation of this equipment in a residential area is likely to cause harmful interference in which case the user will be required to correct the interference at own expense. CAUTION Changes or modifications not expressly approved by the party responsible for compliance could void the user’s authority to operate the equipment. ATTENTION Des changements ou des modifications non expressément approuvées par le responsable de la conformité pourraient annuler l'autorisation de l'utilisateur à exploiter l'équipement. The equipment complies with the requirement of FCC CFR 47 PART 15 SUBPART B, Class A. Explanation of Graphical Symbols This symbol indicates the presence of important operating and maintenance (servicing) instruction in the literature accompanying the product. Ce symbole indique la présence d’instructions importantes et de maintenances dans le manuel accompagnant le produit This symbol indicates the presence of non-insulated “dangerous voltage” within the product’s enclosure that may be of sufficient magnitude to constitute a risk of electric shock to persons.
    [Show full text]
  • H S : Behavior Transparency and Control for Smart Home Iot Devices
    HS: Behavior Transparency and Control for Smart Home IoT Devices TJ OConnor Reham Mohamed Markus Miettinen North Carolina State University Technische Universität Darmstadt Technische Universität Darmstadt [email protected] [email protected] [email protected] William Enck Bradley Reaves Ahmad-Reza Sadeghi North Carolina State University North Carolina State University Technische Universität Darmstadt [email protected] [email protected] [email protected] ABSTRACT 1 INTRODUCTION The widespread adoption of smart home IoT devices has led to a The pervasiveness of the Internet-Of-Things (IoT) devices is esti- broad and heterogeneous market with awed security designs and mated to reach 50 billion by 2020 [31]. A substantial population privacy concerns. While the quality of IoT device software is un- of these IoT devices is emerging in the residential environment. likely to be xed soon, there is great potential for a network-based These smart home devices oer convenience by monitoring wire- solution that helps protect and inform consumers. Unfortunately, less sensors such as temperature, carbon monoxide, and security the encrypted and proprietary protocols used by devices limit the cameras. Further, these devices enable automating actions including value of traditional network-based monitoring techniques. In this sounding alarms, making coee, or controlling lighting. As the func- paper, we present HS, a building block for enhancing tionality of these devices mature, they are increasingly interacting smart home transparency and control by classifying IoT device com- autonomously, invisible to the end-user. Turning oa connected munication by semantic behavior (e.g., heartbeat, rmware check, alarm can signal a coee pot to begin brewing and a motion-sensor motion detection).
    [Show full text]
  • Buy $13 NQ Mobile Inc
    Equity Research Company Rating Price Target December 21, 2017 NQ Mobile Inc. Buy $13 Ticker North America Sector Price at Dec 20, 2017 (USD) 4.00 NQ United States Technology Market Cap 422M 52-week range 3.16-4.50 Trading Below Net Cash; The Next Big Thing – Internet of Volume (ADV– 3 months) 0.54 M Vehicles, Blockchain and Smart Cars Source: S&P Capital IQ Rosenblatt Roundup • NQ currently has $725 million in cash and notes ($459 million of which in- Jun Zhang China Telecom and IT cludes the divestment of two assets). The stock’s market cap is trading 212 607-3180 close to $400 million as of yesterday’s close. [email protected] • NQ announced a $150 million stock buyback and management buyout pro- gram at $5.25. Company Summary: • We have become increasingly interested in the story since the core busi- NQ Mobile Inc. provides mobile Internet ness has been transforming. We highlight the smart car system, aka Link services in the People’s Republic of China Motion, which involves the internet of vehicles and blockchain technology. and internationally. The company provides products and services in the areas of mobile • In our view, this could become a several hundred-million dollar revenue security, privacy, productivity, personalized business over the next few years. cloud, and family protection. It operates through two segments, Consumer and En- terprise. The One Trade Below Cash NQ announced that they have received $459 million in cash and $270 million in senior notes with an 8% interest from a Chinese private equity firm, Tongfang NQ Mobile Inc (NQ) Price Chart – 1 Yr Hightech M&A fund, to sell two business units—its mobile gaming and mobile entertainment businesses.
    [Show full text]
  • Network Service Dependencies in Commodity Internet-Of-Things Devices
    Network Service Dependencies in Commodity Internet-of-Things Devices Poonam Yadav Qi Li University of Cambridge University of Cambridge Cambridge, UK Cambridge, UK [email protected] [email protected] Anthony Brown Richard Mortier University of Nottingham University of Cambridge Nottingham, UK Cambridge, UK [email protected] [email protected] ABSTRACT from sensors, actuators and computation deployed in the built We continue to see increasingly widespread deployment of IoT de- environment. Governments, commercial organisations, and private vices, with apparent intent to embed them in our built environment citizens are all experimenting with how IoT devices can make us, likely to accelerate if smart city and related programmes succeed. In our cities, and our infrastructure more efficient. Standards such this paper we are concerned with the ways in which current gener- as Building Information Modelling (BIM) level 2 are increasingly ation IoT devices are being designed in terms of their ill-considered widely used to model building design and construction, and future dependencies on network connectivity and services. Our hope is to iterations (anticipated BIM levels 3 and 4) are expected to cover provide evidence that such dependencies need to be better thought development of the built environment and associated infrastructure through in design, and better documented in implementation so (e.g., transport, refuse, utilities, communications, health, education) that those responsible for deploying these devices can be properly more broadly [43]. For example, the UK Government has required informed as to the impact of device deployment (at scale) on infras- “fully collaborative 3D BIM (with all project and asset information, tructure resilience.
    [Show full text]
  • Link Motion Inc. a Leading Smart Car and Smart Ride Company
    Link Motion Inc. A leading smart car and smart ride company Presentation at Oppenheimer Technology, Internet and Communications Conference Link Motion Inc. (NYSE: LKM) August 2018 Safe Harbor Statement The following presentation has been prepared by Link Motion Inc. (the “Company”) solely for informational purposes and is not an offer to buy or sell or a solicitation of an offer to buy or sell any security or instrument or to participate in any investment activity or trading strategy, nor may it or any part of it form the basis of or be relied on in connection with any contract or commitment whatsoever. NOTHING HEREIN CONSTITUTES AN OFFER TO SELL OR THE SOLICITATION OF AN OFFER TO BUY ANY SECURITIES OR INSTRUMENT IN ANY STATE OR JURISDICTION. The information included herein was obtained from various sources, including certain third parties, and has not been independently verified. The information presented or contained in these materials is subject to change without notice. No representation or warranty, express or implied, is made and no reliance should be placed on the truth, accuracy, fairness, completeness or reasonableness of the information or sources presented or contained in these materials. By viewing or accessing these materials, the recipient hereby acknowledges and agrees that neither the Company nor any of its directors, officers, employees, affiliates, agents, advisers or representatives accepts any responsibility for or makes any representation or warranty, express or implied, with respect to the truth, accuracy, fairness, completeness or reasonableness of the information contained in, and omissions from, these materials and that neither the Company nor any of its directors, officers, employees, affiliates, agents advisers or representatives accepts any liability whatsoever for any loss howsoever arising from any information presented or contained in these materials.
    [Show full text]
  • Packet-Level Signatures for Smart Home Devices
    Packet-Level Signatures for Smart Home Devices Rahmadi Trimananda, Janus Varmarken, Athina Markopoulou, Brian Demsky University of California, Irvine frtrimana, jvarmark, athina, [email protected] Abstract—Smart home devices are vulnerable to passive in- we observed that events on smart home devices typically result ference attacks based on network traffic, even in the presence of in communication between the device, the smartphone, and the encryption. In this paper, we present PINGPONG, a tool that can cloud servers that contains pairs of packets with predictable automatically extract packet-level signatures for device events lengths. A packet pair typically consists of a request packet (e.g., light bulb turning ON/OFF) from network traffic. We from a device/phone (“PING”), and a reply packet back to the evaluated PINGPONG on popular smart home devices ranging device/phone (“PONG”). In most cases, the packet lengths are from smart plugs and thermostats to cameras, voice-activated devices, and smart TVs. We were able to: (1) automatically extract distinct for different device types and events, thus, can be used previously unknown signatures that consist of simple sequences to infer the device and the specific type of event that occurred. of packet lengths and directions; (2) use those signatures to detect Building on this observation, we were able to identify new the devices or specific events with an average recall of more than packet-level signatures (or signatures for short) that consist 97%; (3) show that the signatures are unique among hundreds only of the lengths and directions of a few packets in the of millions of packets of real world network traffic; (4) show that smart home device traffic.
    [Show full text]
  • Innovations Report 2018 Offers You a Compact Summary of the New and Further Developed Products, Systems and Services That Will Be Showcased at This Year’S Event
    The Innovations Report The International Suppliers Fair (IZB) Think Digital. 16th – 18th October 2018 Wolfsburg | Allerpark | Germany Including 38 World Premieres! www.izb-online.com #izb2018 THE IZB – A PLATFORM FOR INNOVATIONS The innovations developed by automotive supplier companies play a significant role in shaping the future of mobility. Nowadays, this goes hand in hand with ground-breaking topics with a focus on networked cars, autonomous driving or the digitalisation of the entire value chain. From 16th to 18th October, the exhibitors at the 10th International Suppliers Fair (IZB) at the Allerpark in Wolfsburg will provide an insight into what exactly will define the automotive world of the future. These exhibitors have already announced that they will be showcasing a total of 117 innovations at the event, 38 of which are even world premieres. As you can see, there is certainly plenty to look forward to at the IZB 2018. All exhibition categories of this year‘s event will feature new innovations and products being presented for the first time, which underlines the role of the IZB as an important international marketplace for future-oriented innovations. The fields of electronics, development, IT, logistics and production in particular will offer visitors the chance to discover new and unique solutions. The broad spectrum ranges from upgraded more classic components through to driver assistance and navigation systems and right through to manufacturing processes and digital solutions. The IZB Innovations Report 2018 offers you a compact summary of the new and further developed products, systems and services that will be showcased at this year’s event.
    [Show full text]