Lane Detection for DEXTER, an Autonomous Robot, in the Urban Challenge

Total Page:16

File Type:pdf, Size:1020Kb

Lane Detection for DEXTER, an Autonomous Robot, in the Urban Challenge Lane Detection for DEXTER, an Autonomous Robot, in the Urban Challenge by SCOTT MCMICHAEL Submitted in partial fulfillment of the requirements For the degree of Master of Science Thesis Adviser: Dr. Wyatt Newman Department of Electrical Engineering and Computer Science CASE WESTERN RESERVE UNIVERSITY May 2008 CASE WESTERN RESERVE UNIVERSITY SCHOOL OF GRADUATE STUDIES We hereby approve the thesis/dissertation of _____________________________________________________ candidate for the ______________________degree *. (signed)_______________________________________________ (chair of the committee) ________________________________________________ ________________________________________________ ________________________________________________ ________________________________________________ ________________________________________________ (date) _______________________ *We also certify that written approval has been obtained for any proprietary material contained therein. Table of Contents Table of Contents ................................................................................................................ 2 Table of Figures ................................................................................................................... 6 1 ‐ Abstract .......................................................................................................................... 8 2 ‐ Introduction ................................................................................................................... 9 3 ‐ Background .................................................................................................................. 11 4 ‐ Hardware Platform ...................................................................................................... 14 4.1 ‐ DEXTER .................................................................................................................. 14 4.2 ‐ Cameras ................................................................................................................. 16 4.3 ‐ Laser Scanners ....................................................................................................... 19 4.4 ‐ Infrared Cameras ................................................................................................... 20 4.5 ‐ Computers ............................................................................................................. 21 5 ‐ Software Architecture .................................................................................................. 22 5.1 ‐ Overview ............................................................................................................... 23 5.2 ‐ Lane Detection System .......................................................................................... 25 5.2.1 ‐ Sensor Fusion Theory ..................................................................................... 26 5.2.2 – Steering Command Chain .............................................................................. 28 6 ‐ Road Detection Modules ............................................................................................. 29 6.1 ‐ Rake Edge Detector ............................................................................................... 31 2 6.2 ‐ Color Roadbed Detector ....................................................................................... 31 6.3 ‐ Texture Road Detector .......................................................................................... 33 6.4 ‐ Side Camera Road Detectors ................................................................................ 33 6.5 ‐ LIDAR Road Detector ............................................................................................. 34 7 ‐ Edge Crawler ................................................................................................................ 34 7.1 ‐ Curve Extraction .................................................................................................... 35 7.2 ‐ Curve Filtering ....................................................................................................... 37 7.2.1 ‐ Simple Filtering ............................................................................................... 38 7.2.2 ‐ Curve Breakup ................................................................................................ 38 7.2.3 ‐ Curve Fit Filtering ........................................................................................... 40 7.2.4 ‐ Expectation Filtering ....................................................................................... 41 7.3 ‐ Confidence Estimation and Formatting ................................................................ 43 8 ‐ Road Tracker ................................................................................................................ 43 8.1 ‐ Get Context Information ....................................................................................... 44 8.2 ‐ Line Tracking ......................................................................................................... 46 8.2.1 ‐ Line Input ........................................................................................................ 46 8.2.2 ‐ Line Maintenance ........................................................................................... 46 8.2.3 ‐ Line Merging ................................................................................................... 47 8.3 ‐ Line Identification ................................................................................................. 49 3 8.4 ‐ Centerline Estimation ............................................................................................ 53 9 ‐ Lane Observer .............................................................................................................. 55 9.1 ‐ Map Query Sequence ............................................................................................ 55 9.2 ‐ Sensor Filtering ...................................................................................................... 57 9.3 ‐ Source Selection .................................................................................................... 59 10 ‐ Test Site Performance ................................................................................................ 64 10.1 ‐ Case Quad ........................................................................................................... 64 10.2 ‐ Squire Valleview Farm ......................................................................................... 68 10.3 ‐ Beachwood .......................................................................................................... 69 10.4 ‐ Plumbrook ........................................................................................................... 70 10.5 ‐ National Qualifying Event ................................................................................... 77 11 ‐ Analysis and Future Work .......................................................................................... 80 11.1 ‐ Edge Crawler ....................................................................................................... 80 11.2 ‐ Road Tracker ....................................................................................................... 82 11.3 ‐ Lane Observer ..................................................................................................... 84 11.4 ‐ Future Development ........................................................................................... 85 12 ‐ Conclusions ................................................................................................................ 86 13 ‐ Appendices ................................................................................................................. 87 Appendix A – Common Algorithms ............................................................................... 87 4 A1 ‐ Line Fit Difference Calculation ........................................................................... 87 A2 ‐ Polynomial Fitting............................................................................................... 87 A3 ‐ Line Fit Merging .................................................................................................. 87 A4 ‐ RANSAC Line Fit .................................................................................................. 91 A5 –Path Divergence Detection ................................................................................. 93 Appendix B – Sensor Calibration ................................................................................... 93 Appendix C – Coordinate Frames .................................................................................. 95 Appendix D – Position Shift Steering............................................................................. 97 14 ‐ References ............................................................................................................... 100 5 Table of Figures Figure 1 ‐ DEXTER as received by Team CASE.. ................................................................. 14 Figure 2 ‐ DEXTER as it competed in the National Qualifying Event.. .............................. 16 Figure 3 – Lane detection sensor diagram. ....................................................................... 18 Figure 4 ‐ Computer usage by the lane detection system. ............................................... 22 Figure
Recommended publications
  • Innovation in Ecosystem Business Models: an Application to Maas and Autonomous Vehicles in Urban Mobility System
    Innovation in ecosystem business models : An application to MaaS and Autonomous vehicles in urban mobility system Rodrigo Gandia To cite this version: Rodrigo Gandia. Innovation in ecosystem business models : An application to MaaS and Autonomous vehicles in urban mobility system. Economics and Finance. Université Paris-Saclay; University of Lavras, UFLA (Brésil), 2020. English. NNT : 2020UPASC018. tel-02895349 HAL Id: tel-02895349 https://tel.archives-ouvertes.fr/tel-02895349 Submitted on 9 Jul 2020 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Innovation in Ecosystem Business Models: An Application to MaaS and Autonomous Vehicles in Urban Mobility System Thèse de doctorat de l'université Paris-Saclay École doctorale n° 573 Interfaces : approches interdisciplinaires, fon- dements, applications et innovation (Interfaces) Spécialité de doctorat : Ingénierie des systèmes complexes Unité de recherche : Université Paris-Saclay, CentraleSupélec, Laboratoire Genie Industriel, 91190, Gif-sur-Yvette, France. Référent : CentraleSupélec Thèse présentée et
    [Show full text]
  • Autonomous Vehicle, Sensing and Communication Survey 1 Introduction
    Autonomous Vehicle, Sensing and Communication Survey Edited and submitted by Shraga Shoval Prepared by Shlomi Hacohen and Oded Medina Department of Mechanical Engineering, Ariel University, Ariel, Israel. August 2020 Abstract Autonomous vehicles introduce dramatic changes to the way in which we travel. This technology has the potential to impact the transportation across a wide array of categories including safety, congestion, and travel behavior. In this report we review the main issues involved in autonomous driving as discussed in the literature and shed light on topics that we believe require further development. 1 Introduction The challenges in autonomous driving require a combination of many capabilities, among them: localization, motion planning, vehicle’s systems control (steering, acceleration/deceleration, signaling, etc.), road perception, prediction of other road-users behavior, awareness of dangers, etc. These capabilities have a various level of importance for various levels of driving automation. Even though the first autonomous vehicle (AV) was experimented in 1926 [104], a real-modern autonomous vehicle was first presented in 1986 by a team from Carnegie Mellon University [58]. Since 2010, many major automotive manufacturers, such as GM, Mercedes Benz, Ford, Toyota, and many more are developing AVs [90]. A demonstration of AV equipped with numerous sensors and communication systems was presented by Toyota in 2013 [10]. In 2016, Google’s AV has passed over one million kilometers. These events present a glimpse to the landmarks in the development of AV that, due to the complexity of the task, progresses slowly with considerable amount of attention to safety and reliability. AVs need a large amount of data for reliable decision making.
    [Show full text]
  • Using Fuzzy Logic in Automated Vehicle Control
    Intelligent Transportation Systems Using Fuzzy Logic in Automated Vehicle Control José E. Naranjo, Carlos González, Ricardo García, and Teresa de Pedro, Instituto de Automática Industrial Miguel A. Sotelo, Universidad de Alcalá de Henares ntil recently, in-vehicle computing has been largely relegated to auxiliary U tasks such as regulating cabin temperature, opening doors, and monitoring Automated versions fuel, oil, and battery-charge levels. Now, however, computers are increasingly assum- of a mass-produced ing driving-related tasks in some commercial models. Among those tasks are vehicle use fuzzy logic • maintaining a reference velocity or keeping a safe nomous robots and fuzzy control systems and the distance from other vehicles, Universidad de Alcalá de Henares’s knowledge of techniques to both • improving night vision with infrared cameras, and artificial vision. (The “Intelligent-Vehicle Systems” • building maps and providing alternative routes. sidebar discusses other such projects.) We’re devel- address common oping a testbed infrastructure for vehicle driving that Still, many traffic situations remain complex and includes control-system experimentation, strategies, challenges and difficult to manage, particularly in urban settings. and sensors. All of our facilities and instruments are The driving task belongs to a class of problems that available for collaboration with other research groups incorporate human depend on underlying systems for logical reasoning in this field. So far, we’ve automated and instru- and dealing with uncertainty. So, to move vehicle mented two Citroën Berlingo mass-produced vans procedural knowledge computers beyond monitoring and into tasks related to carry out our objectives. to environment perception or driving, we must inte- into the vehicle control grate aspects of human intelligence and behaviors Automated-vehicle equipment so that vehicles can manage driving actuators in a Figure 1 shows two mass-produced electric Cit- algorithms.
    [Show full text]
  • Connected and Autonomous Vehicles: Implications for Policy and Practice in City and Transportation Planning
    Connected and Autonomous Vehicles: Implications for Policy and Practice in City and Transportation Planning by Charles Ng supervised by Laura Taylor A Major Paper submitted to the Faculty of Environmental Studies in partial fulfillment of the requirements for the degree of Master in Environmental Studies York University, Toronto, Ontario, Canada December 8, 2017 Acknowledgments This paper could not have been completed without the help and support of the caring individuals that I am thankful to have in my life. I would like to thank and acknowledge my mother, Maria, and my sister, Ka Lang for providing me with love and support; my advisor, Peter Timmerman, and my supervisor, Laura Taylor, for providing me with academic and non-academic support; and my invaluable friends that I have made in the MES program for their encouragement, support and relief. i Foreword My Area of Concentration for my Plan of Study is sustainable transportation planning for growth management. Connected and Autonomous Vehicles will change the urban landscape, the roles of governments and present new challenges to planners. This paper has allowed me to view transportation planning through the lens of emerging technologies and how this affects cities in the short and long term. There are many sustainability and growth management implications with Connected and Autonomous Vehicles. For example, automated vehicles can foster decentralization because it easily enables travel however, if utilized correctly, automated vehicles can also compliment local transit systems to support intensification. This is especially important in Ontario (Canada’s first province to allow testing of autonomous vehicles on public roads) as it directly relates to the goals and policies related to sprawl and sustainability as outlined in Ontario’s four provincial land use plans: The Growth Plan for the Greater Golden Horseshoe (GGH), The Greenbelt Plan, The Oak Ridges Moraine Conservation Plan and the Niagara Escarpment Plan.
    [Show full text]
  • The Study on Innovation, Development and Implementation
    ISSN (Online) 2581-9429 IJAR SCT ISSN (Print) 2581-XXXX International Journal of Advanced Research in Science, Communication and Technology (IJARSCT) Volume 11, Issue 1, November 2020 Impact Factor: 4.819 The Study on Innovation, Development and Implementation of the Self-driving Car Aniruddha Chaki Student, Department of Electrical Engineering Siliguri Institute of Technology, Siliguri, India Abstract: The development of the self-driving car is one of the greatest inventions of the century. With the technological advancement, the implementation of the autonomous vehicle has become the major attention among the researchers. This paper discusses the brief history of self-driving cars, its research and development, key technologies behind the self-driving, main aspects of implementing self-driving cars. The paper also describes some challenges with possible solutions to the fully autonomous vehicle in mass implementation. Keywords: Advanced Driver Assistance System (ADAS), autonomous, navigation, positioning, self- driving technology, radar, lidar, path planning, obstacle avoidance, Full Self driving (FSD), accidents, protests, advantages, challenges. I. INTRODUCTION In this 21st-century progress in technology has made man as omnipotent, omniscient and omnipresent as a god. It is being tried to find out and accomplish any work with higher efficiency, lesser cost, and least possible effort. This makes researchers explore the domain of Automation, Machine learning, and Artificial Intelligence to handle the hardest of the jobs which were once tedious and cumbersome for humans [1]. We are driving towards the future where humans will only be involved in high mental ability skills and all the other works will be automated [2]. In this paper, the previous researches in the field of self-driving have been studied.
    [Show full text]
  • Morgan Stanley NDR
    AMBARELLA.COM AMBARELLA.COM December 6th & 9th, 2019 COPYRIGHT COPYRIGHT AMBARELLA 2019 Morgan Stanley NDR Frankfurt, Germany and Milan, Italy Dr. Alberto Broggi, GM Ambarella Italy Casey Eichler, CFO Louis Gerhardy, Corporate Development 1 Forward-Looking Statements This presentation contains forward-looking statements that are subject to many risks and uncertainties. All statements made in this presentation other than statements of historical facts are forward-looking statements, including, without limitation, statements regarding Ambarella’s strategy, future operations, financial targets, future revenues, projected costs, prospects, plans and objectives for future operations, future product introductions, future rate of our revenue growth, the size of markets addressed by the company's solutions and the growth rate of those markets, technology trends, our ability to address market and customer demands and to timely develop new or enhanced solutions to meet those demands, our ability to achieve design wins, and our ability to retain and expand our customer and partner relationships. In some cases, you can identify forward-looking statements by terms such as "may," "will," "should," "could," "would," "expects," "plans," "anticipates," "believes," "estimates," "projects," "predicts," "potential," or the negative of those terms, and similar expressions and comparable terminology intended to identify forward-looking statements. We have based forward-looking statements largely on our estimates of our financial results and our current expectations
    [Show full text]
  • Study on Electrical Vehicle and Its Scope in Future
    © 2018 JETIR February 2018, Volume 5, Issue 2 www.jetir.org (ISSN-2349-5162) Study on Electrical Vehicle and Its Scope in Future Divya Sharma, Department of Electrical Engineering Galgotias University, Yamuna Expressway Greater Noida, Uttar Pradesh ABSTRACT: The cars are based on programming in advanced time to give the individual driver relaxed driving. In the automobile industry, various opportunities are known, which makes a car automatic. Google, the largest network, has been working on self-driving cars since 2010 and yet an innovative adaptation to present a mechanised vehicle in a radically new model is continuing to be launched. The modelling, calibration and study of changes in city morphology in autonomous vehicles (AVs). Transport system are utilized to travel among the tangential houses as well as the intermediate work and necessitate transportation space. The main benefits of an autonomous vehicle areit can be operated day parking area for other uses, mitigatemetropolitanground. We also reduce the cost per kilometre of driving. Researchers are interested in the area of automotive automation, where most applications are found in different places. The technology in this research paper will help to understand the quick, present and future technologies used or used in the automotive field to render automotive automation. KEYWORDS: Autonomous Vehicle, Linriccan Wonder, Robotic Van, Self-Driving Car, Tesla corporation. INTRODUCTION Users all over the world are delighted with the introduction of an automated vehicle for the general
    [Show full text]
  • Forecasting Americans' Long-Term Adoption of Connected And
    FORECASTING AMERICANS’ LONG-TERM ADOPTION OF CONNECTED AND AUTONOMOUS VEHICLE TECHNOLOGIES 1 Prateek Bansal 2 Graduate Research Assistant 3 Department of Civil, Architectural and Environmental Engineering 4 The University of Texas at Austin 5 [email protected] 6 Phone: 512-293-1802 7 Kara M. Kockelman 8 (Corresponding Author) 9 E.P. Schoch Professor in Engineering 10 Department of Civil, Architectural and Environmental Engineering 11 The University of Texas at Austin 12 [email protected] 13 14 15 The following paper is a pre-print, the final publication can be found in 16 Transportation Research Part A: Policy and Practice, 95:49-63 (2017). 17 18 19 ABSTRACT 20 Automobile enterprises, researchers, and policymakers are interested in knowing the future of 21 connected and autonomous vehicles (CAVs). To this end, this study proposes a new simulation- 22 based framework to forecast Americans’ long-term (year 2015 to 2045) adoption levels of CAV 23 technologies under eight different scenarios based on: 5% and 10% annual drops in technology 24 prices; 0%, 5%, and 10% annual increments in Americans’ willingness to pay (WTP); and 25 changes in government regulations. This simulation was calibrated with the data obtained from a 26 survey of 2,167 Americans, in order to obtain their preferences for CAV technologies and their 27 household’s annual vehicle transaction decisions. 28 29 Results indicate that the average WTP (of respondents with a non-zero WTP) to add connectivity 30 and Level 3 and Level 4 automations are $110, $5,551, and $14,589, respectively. Long-term 31 fleet evolution suggests that the privately held light-duty vehicle fleet will have 24.8% Level 4 32 AV penetration by 2045 under an annual 5% price drop and constant WTP values.
    [Show full text]
  • From Local Academic Spin-Off to International Firm: the Case of Vislab
    International Business Research; Vol. 13, No. 6; 2020 ISSN 1913-9004 E-ISSN 1913-9012 Published by Canadian Center of Science and Education From Local Academic Spin-Off to International Firm: The Case of VisLab Maria Cristina Arcuri1, Elisa Bocchialini2 & Gino Gandolfi2 1 Department of Economics and Management, University of Florence, Florence, Italy 2 Department of Economics and Management, University of Parma, Parma, Italy Correspondence: Elisa Bocchialini, Department of Economics and Management, University of Parma, Via J.F. Kennedy, 6 – 43125 Parma, Italy. Received: April 7, 2020 Accepted: May 8, 2020 Online Published: May 22, 2020 doi:10.5539/ibr.v13n6p100 URL: https://doi.org/10.5539/ibr.v13n6p100 Abstract Universities play an important role in developing and transferring technology. In Italy, much innovation takes place where universities are located outside large towns, as in the case of VisLab. VisLab, the Vision and Intelligent Systems Laboratory, founded by Prof. Alberto Broggi of Parma University, is a pioneer in perception systems and autonomous vehicle research. It is also the spin-off of the University of Parma acquired by Silicon Valley company Ambarella Inc., in July 2015 for $30 million. After the deal, VisLab remained in Italy and all the staff, about thirty researchers, were hired by VisLab for the Parma location. This paper examines the university-industry interaction and, in particular, academic spin-off, as a source of economic growth, pointing out the importance of the context. The study describes the main characteristics of the VisLab case, including the possible alternative strategies, the structure of the final M&A deal and the advantages deriving from Parma and surrounding area.
    [Show full text]
  • Terramax Vision at the Urban Challenge 2007
    1 TerraMax Vision at the Urban Challenge 2007 Alberto Broggi, Andrea Cappalunga, Claudio Caraffi, Stefano Cattani, Stefano Ghidoni, Paolo Grisleri, Pier Paolo Porta, Matteo Posterli, Paolo Zani VisLab – Dipartimento di Ingegneria dell’Informazione Universita` degli Studi di Parma, ITALY www.vislab.it fbroggi,kappa,caraffi,cattani,ghidoni,grisleri,portap,posterli,[email protected] Abstract—This paper presents the TerraMax vision systems used during the 2007 DARPA Urban Challenge. First a descrip- tion of the different vision systems is provided, focusing on their hardware configuration, calibration method and tasks. Then each componentis described in details, focusing on the algorithms and sensor fusion opportunities: obstacle detection, road markings detection and vehicle detection. The conclusions summarize the lesson learned from the developing of the passive sensing suite and its succesful fielding in the Urban Challenge. I. INTRODUCTION The Challenges organized by DARPA are considered some of the most important milestones in the field of vehicular Fig. 1. The TerraMax vehicle. robotics. Not only did DARPA provide a vigorous help in the flourishing of new technological solutions, but the many researchers who accepted these challenges demonstrated that in order to decide on the action to be taken, it is not sufficient the current technology is indeed mature enough to drive to model the vehicle itself like it happens on the control side, vehicles in off-road and urban-like environments. but it is mandatory to model the real world as well; therefore, The design and realization of autonomous vehicles capable a huge number of situations must be taken into account. of handling unknown and dynamic situations involve different Different technologies have been tested and implemented aspects, spanning from new technologies to implementation, on the robotic vehicles that participated in the DARPA Urban from concept to hardware issues, challenging many different Challenge, ranging from conservative products up to com- research fields.
    [Show full text]
  • 2014 Automated Vehicles Symposium Proceedings
    2014 Automated Vehicles Symposium Proceedings 2014 Automated Vehicle Symposium – Synopsis of Proceedings DISCLAIMER The opinions, findings, and conclusions expressed in this publication are those of the speakers and contributors to the Automated Vehicle Symposium and not necessarily those of the United States Department of Transportation. The United States Government assumes no liability for its contents or use thereof. If trade names manufacturers’ names or specific products are mentioned, it is because they are considered essential to the object of the publication and should not be construed as an endorsement. The United States Government does not endorse products or manufacturers. 2014 Automated Vehicles Symposium Proceedings—Final December 2014 Publication Number: FHWA-JPO-14-176 Prepared by: Volpe National Transportation Systems Center Cambridge, MA 02142 Prepared for: Intelligent Transportation Systems Joint Program Office Office of the Assistant Secretary for Research and Technology 1200 New Jersey Avenue, S.E. Washington, DC 20590 2 Acknowledgments The 2014 Automated Vehicles Symposium (AVS 2014) was produced through a partnership between the Association of Unmanned Vehicle Systems International (AUVSI) and Transportation Research Board (TRB), and is indebted to its many volunteer contributors and speakers who developed the symposium content, produced sessions, and contributed to the development of these proceedings. AVS 2014 also benefitted from the direct financial contributions of its commercial benefactors, and the institutional support of the many companies and agencies that supported the time, travel, and participation for their staff. The organizing committee gratefully acknowledges the United States Department of Transportation (U.S. DOT) Intelligent Transportation Systems Joint Program Office (ITS JPO) for the level of its support to AVS 2014 and for these proceedings.
    [Show full text]
  • Report on VRA Network
    Ref. Ares(2015)4974225 - 10/11/2015 EUROPEAN COMMISSION DG Communications Networks, Content & Technology SEVENTH FRAMEWORK PROGRAMME INFORMATION AND COMMUNICATION TECHNOLOGIES Coordination and Support Action Grant Agreement Nr 610737 Support action for Vehicle and Road Automation network Report on VRA Network Deliverable no. D2.2 Dissemination level PU Work Package no. WP2 Main author(s) Davide Brizzolara, Maxime Flament Co-author(s) VRA Partners Version Nr (F: final, D: draft) V1.0 F File Name VRA_20151031_WP2_DEL2.2_v1.0.docx Project Start Date and Duration 01 July 2013, 42 months D2.2 – Report on VRA Network V1.0 F Document Control Sheet Main author(s) or editor(s): Davide Brizzolara, Maxime Flament Work area: WP2 Document title: Report on VRA Network Version history: Version Date Main author Summary of changes number v0.1 01/09/2015 Davide Brizzolara ToC v0.2 13/09/2015 Davide Brizzolara Chapter 5 and 6 v0.3 24/09/2015 Davide Brizzolara Updates according to the feedback of the VRA partners v0.4 25/11/2015 Davide Brizzolara Revision of the content v0.5 06/11/2015 Davide Brizzolara Updates of Chapter 5 v0.1 09/11/205 Davide Brizzolara Final updates Approval: Name Date Prepared Davide Brizzolara, Maxime Flament 09/11/2015 Reviewed Maxime Flament 09/11/2015 Authorised Maxime Flament 09/11/2015 Circulation: Recipient Date of submission EC 09/11/2015 VRA consortium 09/11/2015 VRA is an ERTICO Partnership activity 2 D2.2 – Report on VRA Network V1.0 F Table of Contents Table of Contents 3 List of Figures 5 List of Tables 5 1 Introduction
    [Show full text]