Development of a Performance Specification for Camera/Video Imaging Systems on Heavy Vehicles Final Report: Supporting Research

Total Page:16

File Type:pdf, Size:1020Kb

Development of a Performance Specification for Camera/Video Imaging Systems on Heavy Vehicles Final Report: Supporting Research DOT HS 810 960 July 2008 Development of a Performance Specification for Camera/Video Imaging Systems on Heavy Vehicles Final Report: Supporting Research This document is available to the public from the National Technical Information Service, Springfield, Virginia 22161 This publication is distributed by the U.S. Department of Transportation, National Highway Traffic Safety Administration, in the interest of information exchange. The opinions, findings and conclusions expressed in this publication are those of the author(s) and not necessarily those of the Department of Transportation or the National Highway Traffic Safety Administration. The United States Government assumes no liability for its content or use thereof. If trade or manufacturers’ names or products are mentioned, it is because they are considered essential to the object of the publication and should not be construed as an endorsement. The United States Government does not endorse products or manufacturers. TECHNICAL REPORT DOCUMENT PAGE 1. Report No. 2. Government Accession No. 3. Recipient’s Catalog No. DOT HS 810 960 4. Title and Subtitle 5. Report Date Development of a Performance Specification for Cam­ July 2008 era/Video Imaging Systems on Heavy Vehicles 6. Performing Organization Code: 7. Author(s) 8. Performing Organization Report No. Wierwille, Walter W.; Schaudt, William A.; Spaulding, Jeremy M.; Gupta, Santosh K.; Fitch, Gregory M.; Wiegand, Douglas M.; Hanowski, Richard J. 9. Performing Organization Name and Address 10. Work Unit No. Virginia Tech Transportation Institute 3500 Transportation Research Plaza (0536) 11. Contract or Grant No. Blacksburg, VA 24061 DTNH22-05-D-01019 12. Sponsoring Agency Name and Address 13. Type of Report and Period Covered National Highway Traffic Safety Administration Final Report, Supporting Research 1200 New Jersey Avenue SE. July 2003 – June 2007 Section NVS-322, Room W46-418 14. Sponsoring Agency Code Washington, DC 20590 15. Supplementary Notes Note that “Final Report, Specifications” appears in a separate document. 16. Abstract Video technology has advanced rapidly and is available today at relatively low cost, with relatively high performance and small size. An important potential application for this technology is in heavy vehicles. It can be used to provide views to the driver that were previously unavailable (“enhancements”), and it can also be used to take the place of certain mirrors (“surrogates”). Enhancement applications are directed toward reducing blind spots or allowing better views around the heavy vehicle, whereas surrogate applications are directed toward replacement of essential mirrors. Such mirrors create aerodynamic drag and require the need for external structures. Consequently, there is a desire to replace them with video, if it is feasible to do so. This research project had the main objective of devising and testing a variety of concepts for the use of camera/video im­ aging systems (C/VISs) applied to heavy vehicles, with emphasis on tractor trailers but potentially also applying to other heavy vehicles. Part of the objective was to develop operational specifications for feasible C/VISs, which would be sup­ ported by the research results. The current report provides an overview of the research conducted to support the final specifications which are provided in a companion document (Wierwille, Schaudt, Gupta, Spaulding, & Hanowski, 2007). The current report reviews all of the work performed. Earlier topics covered in summary in the report include: review of video technology, identification of viewing needs, development of candidate use concepts, conducting a driver focus group, and preparation of initial specifications. Later topics included experimentation; specifically, the following were carried out: preliminary road testing of various C/VISs, preparation and performance of formal road testing, analysis of all results, and documentation of the entire project. Both the earlier and later topics are covered in the current report and form the justification for the final specifications document. 17. Key Words 18. Distribution Statement Truck Video, Video Monitoring, Truck Blind Spots, No restrictions. This document is available through the National Truck Mirrors, Truck Visibility, Truck Safety, Rear­ Technical Information Service; Springfield, VA 22161. view 19. Security Classif. (of this re­ 20. Security Classif. (of this page) 21. No. of Pages 22. Price port) Unclassified 320 This report is free of charge Unclassified from the NHTSA Web site at www.nhtsa.dot.gov Form DOT F 1700.7 (8-72) Reproduction of completed pages authorized iii METRIC CONVERSION CHART SI* (MODERN METRIC) CONVERSION FACTORS APPROXIMATE CONVERSIONS TO SI UNITS Symbol When You Know Multiply By To Find Symbol LENGTH in inches 25.4 millimeters mm ft feet 0.305 meters m yd yards 0.914 meters m mi miles 1.61 kilometers km AREA in2 square inches 645.2 square millimeters mm 2 ft2 square feet 0.093 square meters m2 yd2 square yard 0.836 square meters m2 ac acres 0.405 hectares ha mi2 square miles 2.59 square kilometers km2 VOLUME fl oz fluid ounces 29.57 milliliters mL gal gallons 3.785 liters L ft3 cubic feet 0.028 cubic meters m3 yd3 cubic yards 0.765 cubic meters m3 NOTE: volumes greater than 1000 L shall be shown in m3 MASS oz ounces 28.35 grams g lb pounds 0.454 kilograms kg T short tons (2000 lb) 0.907 megagrams (or "metric ton") Mg (or "t") TEMPERATURE (exact degrees) oF Fahrenheit 5 (F-32)/9 Celsius oC or (F-32)/1.8 ILLUMINATION fc foot-candles 10.76 lux lx fl foot-Lamberts 3.426 candela/m2 cd/m2 FORCE and PRESSURE or STRESS lbf poundforce 4.45 newtons N lbf/in2 poundforce per square inch 6.89 kilopascals kPa APPROXIMATE CONVERSIONS FROM SI UNITS Symbol When You Know Multiply By To Find Symbol LENGTH mm millimeters 0.039 inches in m meters 3.28 feet ft m meters 1.09 yards yd km kilometers 0.621 miles mi AREA mm2 square millimeters 0.0016 square inches in2 m2 square meters 10.764 square feet ft2 m2 square meters 1.195 square yards yd2 ha hectares 2.47 acres ac km2 square kilometers 0.386 square miles mi2 VOLUME mL milliliters 0.034 fluid ounces fl oz L liters 0.264 gallons gal m3 cubic meters 35.314 cubic feet ft3 m3 cubic meters 1.307 cubic yards yd3 MASS g grams 0.035 ounces oz kg kilograms 2.202 pounds lb Mg (or "t") megagrams (or "metric ton") 1.103 short tons (2000 lb) T TEMPERATURE (exact degrees) oC Celsius 1.8C+32 Fahrenheit oF ILLUMINATION lx lux 0.0929 foot-candles fc cd/m2 candela/m2 0.2919 foot-Lamberts fl FORCE and PRESSURE or STRESS N newtons 0.225 poundforce lbf kPa kilopascals 0.145 poundforce per square inch lbf/in2 *SI is the symbol for the International System of Units. Appropriate rounding should be made to comply with Section 4 of ASTM E380. (Revised March 2003) v TABLE OF CONTENTS TECHNICAL REPORT DOCUMENT PAGE......................................................................................... iii METRIC CONVERSION CHART ............................................................................................................ v ABBREVIATIONS AND NOMENCLATURE .................................................................................... xxiii ABSTRACT .............................................................................................................................................. xxv ACKNOWLEDGEMENTS AND DISCLAIMER NOTICE.............................................................. xxvii CHAPTER 1: INTRODUCTION .............................................................................................................. 1 PROJECT BACKGROUND ............................................................................................................................. 1 FINAL REPORT AS JUSTIFICATION FOR THE FINAL SPECIFICATIONS............................................................ 2 TECHNICAL DEFINITIONS OF SURROGATES AND ENHANCEMENTS.............................................................. 2 MAJOR PROJECT STEPS............................................................................................................................... 3 CHAPTER 2: IDENTIFICATION OF HUMAN FACTORS ISSUES RELEVANT TO VIDEO IN HEAVY VEHICLES.......................................................................................................... 7 MIRROR REGULATIONS AND RECOMMENDED PRACTICES FOR HEAVY TRUCKS......................................... 7 Regulations ........................................................................................................................................... 7 SAE Standards ...................................................................................................................................... 7 Recommended Practices Documents .................................................................................................... 9 CURRENT C/VIS WORK............................................................................................................................ 11 PATENT RESEARCH OVERVIEW ................................................................................................................ 11 HUMAN FACTORS CONCERNS AND COMPARISON OF MIRRORS TO C/VISS .............................................. 12 Mirror versus Camera System Comparisons ...................................................................................... 12 Environmental Concerns and Reliability ............................................................................................ 13 Imaging Concerns..............................................................................................................................
Recommended publications
  • Contrast Sensitivity
    FUNDAMENTALS OF MULTIMEDIA TECHNOLOGIES Lecture slides BME Dept. of Networked Systems and Services 2018. Synopsis – Psychophysical fundamentals of the human visual system – Color spaces, video components and quantization of video signal – ITU-601 (SD), and ITU-709 (HD) raster formats, sampling frequencies, UHDTV recommendations – Basics of signal compression: differential quantization, linear prediction, transform coding – JPEG (DCT based transform coding) – Video compression: motion estimation and motion compensated prediction, block matching algorithms, MPEG-1 and MPEG-2, – H-264/MPEG-4 AVC: differences from MPEG-2 Multimedia Tech. 2 What is our aim, and why? – Components of a video format • size (resolution, raster) • frame rate • representation of a color pixel (color space, luma/chroma components) – Two main goals: • finding a video format, that ensures indistinguishable video quality from the real, original scene • derive a source encoder methodology resulting in unnoticeable errors for Human Visual System – Suitable representation/encoding method, adapted to human vision ! important to know basics of human vision Multimedia Tech. 3 Visible spectrum Visible light and colors – The Human Visual System (HVS) is sensitive to a narrow frequency band of the electromagnetic spectrum: • frequencies/wavelengths between ultraviolet (UV) and infrared (IR): between ca. 400 and 700 nm of wavelength – Different wavelengths: different color experiences for HVS – Basic perceived colors: • blue, cyan, green, yellow, orange, red, purple. • White (and
    [Show full text]
  • The Influence of Motion Quality on Responses Towards Video Playback Stimuli Emma Ware1,2,3,*, Daniel R
    © 2015. Published by The Company of Biologists Ltd | Biology Open (2015) 00, 1-9 doi:10.1242/bio.011270 RESEARCH ARTICLE The influence of motion quality on responses towards video playback stimuli Emma Ware1,2,3,*, Daniel R. Saunders1,4 and Nikolaus F. Troje1,2,5,6 ABSTRACT morphological cues alone (Bird and Emery, 2008; Byers et al., Visual motion, a critical cue in communication, can be manipulated and 2010; Shimizu, 1998). The pigeon (Columbia livia) is a case in point: studied using video playback methods. A primary concern for the video pigeons interact with a rich repertoire of visual signals, each adapted to playback researcher is the degree to which objects presented on video incite action in others (Dittrich et al., 1998; Frost et al., 1998; Jitsumori appear natural to the non-human subject. Here we argue that the et al., 1999; Shimizu, 1998). It has previously been shown that male quality of motion cues on video, as determined by the video’s image pigeons will respond with courtship behaviour towards video images presentation rate (IPR), are of particular importance in determining a of females much more vigorously when these images are presented in subject’s social response behaviour. We present an experiment testing motion rather than still (Shimizu, 1998). Pigeons can discriminate the effect of variations in IPR on pigeon (Columbia livia) response between individual conspecifics when their images are presented in behaviour towards video images of courting opposite sex partners. motion, but not when they are shown still (Jitsumori et al., 1999). Male and female pigeons were presented with three video playback Further, pigeons can discriminate conspecific actions (such as pecking ‘ ’ stimuli, each containing a different social partner.
    [Show full text]
  • Using an LED As a Sensor and Visible Light Communication Device in a Smart Illumination System
    André Filipe Rato Bispo Licenciado em Ciências da Engenharia Electrotécnica e de Computadores Using an LED as a Sensor and Visible Light Communication Device in a Smart Illumination System Dissertação para obtenção do Grau de Mestre em Engenharia Electrotécnica e de Computadores Orientador: João Pedro Abreu de Oliveira, Professor Doutor, FCT-UNL Júri: Presidente: Prof. Doutor Luís Augusto Bica Gomes de Oliveira, FCT-UNL Arguente: Prof. Doutor Carlos Manuel Ferreira Carvalho, ISEL Vogal: Prof. Doutor João Pedro Abreu de Oliveira, FCT-UNL MARÇO, 2015 Using an LED as a Sensor and Visible Light Communication De- vice in a Smart Illumination System Copyright c André Filipe Rato Bispo, Faculdade de Ciências e Tecnologia, Uni- versidade Nova de Lisboa A Faculdade de Ciências e Tecnologia e a Universidade Nova de Lisboa têm o direito, perpétuo e sem limites geográficos, de arquivar e publicar esta dissertação através de exemplares impressos reproduzidos em papel ou de forma digital, ou por qualquer outro meio conhecido ou que venha a ser inventado, e de a divulgar através de repositórios científicos e de admitir a sua cópia e distribuição com objectivos educacionais ou de investigação, não comerciais, desde que seja dado crédito ao autor e editor. Ao Vicente. ACKNOWLEDGEMENTS First and foremost, I would like to thank Professor João Pedro Oliveira for his support, patience, and words of encouragement when things went haywire. Also I cannot ignore all the people, from professors to faculty staff, who took part in this journey of mine. Thank you all. I would also like to thank my dear colleagues, especially Filipe Quendera, Ricardo Madeira, Miguel Curvelo, and Daniel Batista who put up with me over this last stressful year.
    [Show full text]
  • Critical Fusion Frequency for Bright and Wide Field-Of-View Image Display Masaki Emoto and Masayuki Sugawara
    424 JOURNAL OF DISPLAY TECHNOLOGY, VOL. 8, NO. 7, JULY 2012 Critical Fusion Frequency for Bright and Wide Field-of-View Image Display Masaki Emoto and Masayuki Sugawara Abstract—The use of bright and wide field-of-view (FOV) dis- and SECAM (SEquentiel Couleur A Mémoire)—have frame plays in future TV systems will enable us to enjoy TV programs frequencies sufficiently high for viewers not to perceive flicker with a rich sense of presence, i.e., a sense of “being there.” How- under certain viewing conditions, including when the FOV ever, such displays can strongly stimulate human peripheral vision, image display is fairly dark and narrow. Use of a high frame which is sensitive to flicker. The recent widespread adoption of hold-type displays such as liquid crystal displays might circumvent frequency can eliminate flicker perception, but economical use the flicker problem in current TV systems. For temporal specifica- of bandwidth for recording and transmission must be consid- tion of future TV systems with bright and wide FOV displays, we ered simultaneously. The relationship between frame frequency measured the critical fusion frequency (CFF) in 26 participants, and bandwidth is therefore a trade-off. It is desirable to decide using varying luminance, duty ratios, and FOVs. We showed that on the lowest frame frequency at which flicker perception can CFF depended on the duty ratio and the FOV, and that more than 90 Hz was required to avoid flicker perception with wide FOV dis- be eliminated. To make this decision, the characteristics of plays. Moreover, we demonstrated that flicker was regularly per- human flicker perception—and the flicker threshold—need ceived in viewing wide FOV natural images presented at 60 Hz with to be elucidated under the conditions that will be used in the a 50% duty ratio.
    [Show full text]
  • Optical Camera Communications: Principles, Modulations, Potential and Challenges
    electronics Review Optical Camera Communications: Principles, Modulations, Potential and Challenges Willy Anugrah Cahyadi 1 , Yeon Ho Chung 2,* , Zabih Ghassemlooy 3 and Navid Bani Hassan 3 1 School of Electrical Engineering (SEE) and The Center for Advanced Intelligent Communications (AICOMS), Telkom University, Bandung 40257, Indonesia; [email protected] 2 Department of Information and Communications Engineering, Pukyong National University, Busan 48513, Korea 3 Mathematics, Physics and Electrical Engineering Department, Northumbria University, Newcastle upon Tyne NE1 8ST, UK; [email protected] (Z.G.); [email protected] (N.B.H.) * Correspondence: [email protected] Received: 20 July 2020; Accepted: 17 August 2020; Published: 19 August 2020 Abstract: Optical wireless communications (OWC) are emerging as cost-effective and practical solutions to the congested radio frequency-based wireless technologies. As part of OWC, optical camera communications (OCC) have become very attractive, considering recent developments in cameras and the use of fitted cameras in smart devices. OCC together with visible light communications (VLC) is considered within the framework of the IEEE 802.15.7m standardization. OCCs based on both organic and inorganic light sources as well as cameras are being considered for low-rate transmissions and localization in indoor as well as outdoor short-range applications and within the framework of the IEEE 802.15.7m standardization together with VLC. This paper introduces the underlying principles of OCC and gives a comprehensive overview of this emerging technology with recent standardization activities in OCC. It also outlines the key technical issues such as mobility, coverage, interference, performance enhancement, etc. Future research directions and open issues are also presented.
    [Show full text]
  • Modelling Visibility of Temporal Light Artefacts
    Modelling visibility of temporal light artefacts Citation for published version (APA): Perz, M. (2019). Modelling visibility of temporal light artefacts. Technische Universiteit Eindhoven. Document status and date: Published: 05/02/2019 Document Version: Publisher’s PDF, also known as Version of Record (includes final page, issue and volume numbers) Please check the document version of this publication: • A submitted manuscript is the version of the article upon submission and before peer-review. There can be important differences between the submitted version and the official published version of record. People interested in the research are advised to contact the author for the final version of the publication, or visit the DOI to the publisher's website. • The final author version and the galley proof are versions of the publication after peer review. • The final published version features the final layout of the paper including the volume, issue and page numbers. Link to publication General rights Copyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright owners and it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights. • Users may download and print one copy of any publication from the public portal for the purpose of private study or research. • You may not further distribute the material or use it for any profit-making activity or commercial gain • You may freely distribute the URL identifying the publication in the public portal. If the publication is distributed under the terms of Article 25fa of the Dutch Copyright Act, indicated by the “Taverne” license above, please follow below link for the End User Agreement: www.tue.nl/taverne Take down policy If you believe that this document breaches copyright please contact us at: [email protected] providing details and we will investigate your claim.
    [Show full text]
  • Analog Video Encoding Formats Ntsc
    ANALOG VIDEO ENCODING FORMATS NTSC NTSC is the analog television system in use in the United States and many other countries, including most of the Americas and some parts of East Asia. It is named for the National Television System(s) Committee, the industry-wide standardization body that created it. Analog television encodes picture information by varying the voltages and/or frequency of the signal. ... The Americas refers collectively to North and South America, as a relatively recent and less ambiguous alternative to the name America, which may refer to either the Americas (typically in languages other than English, where it is often considered a single continent) or to the United States (in English and...East Asia can be defined in either cultural or geographic terms. ... History The National Television Systems Committee was established in 1940 by the Federal Communications Commission (FCC) to resolve the conflicts which had arisen between companies over the introduction of a nationwide analog television system in the U.S. The committee in March 1941 issued a technical standard for black and white television. This built upon a 1936 recommendation made by the Radio Manufacturers Association (RMA) that used 441 lines. With the advancement of the vestigial sideband technique for broadcasting that increased available bandwidth, there was an opportunity to increase the image resolution. The NTSC compromised between RCA's desire to keep a 441-line standard (their NBC TV network was already using it) and Philco's desire to increase it to between 600 and 800, settling on a 525-line transmission. 1940 was a leap year starting on Monday (link will take you to calendar).
    [Show full text]
  • Rapid Categorisation in Pigeons (Columba Livia)
    DIPLOMARBEIT Titel der Diplomarbeit „Rapid discrimination and categorisation of briefly flashed stimuli in the pigeon (Columba livia)“ angestrebter akademischer Grad Magistra der Naturwissenschaften (Mag. rer. nat.) Verfasserin: Katharina KRAMER Matrikel-Nummer: 9503431 Studienrichtung /Studienzweig (lt. Zoologie Studienblatt): Betreuer: Ao. Univ. Prof. Mag. Dr. Ludwig Huber Wien, im Februar 2010 Rapid discrimination and categorisation of briefly flashed stimuli in the pigeon 2010 CONTENTS SUMMARY ................................................................................................................................ - 1 - ZUSAMMENFASSUNG ...................................................................................................................................- 3 - 1. INTRODUCTION ...........................................................................................................................................- 5 - 1.1. Theories of stimulus classification ....................................................................... - 6 - 1.1.1. Visual discrimination ................................................................................................................... - 6 - 1.1.2. Visual categorisation ...................................................................................................................- 7 - The biological relevance of categorisation ................................................................ - 7 - Empirical evidence throughout the animal kingdom .................................................
    [Show full text]
  • Real Time Fpga Implementation for Video Creation Vga Frame Rate Conversion System
    VOL. 11, NO. 15, AUGUST 2016 ISSN 1819-6608 ARPN Journal of Engineering and Applied Sciences ©2006-2016 Asian Research Publishing Network (ARPN). All rights reserved. www.arpnjournals.com REAL TIME FPGA IMPLEMENTATION FOR VIDEO CREATION VGA FRAME RATE CONVERSION SYSTEM Umarani E. and Vino T. Sathyabama University, Chennai, India E-Mail: [email protected] ABSTRACT This paper introduces real time Full VGA display Frame rate conversion implemented on FPGA. By using the Frame rate conversion, we can display the Video game. This article gives a programming design of video game based on the FPGA using VHDL. The Game realized the function of the movement and rotation of blocks, randomly generating next blocks. The successful transplant of video game provides a template for the development of other visual control systems in the FPGA. This system improves the Quality of Video, can create Images and providing Animation to the Images and can control the system using Joy Stick, code in VHDL Language. Planning to add Encryption with the created video for Communication. Keywords: VGA, video creation, VHDL, Sync pulses, image. INTRODUCTION TO VIDEO PROCESSING By using this system we can create Images and provide DEFINITION OF VIDEO SIGNAL animation to the Images and can control the system using Video signal can be fundamentally any sequence Joy Stick, code in VHDL Language. of time varying images. A still image is a spatial distribution of intensities that persist constant with time, whereas a time varying image has a spatial intensity distribution that varies with time. Video signal is considered as a series of images called frames.
    [Show full text]
  • V~S VRCODES: EMBEDDING UNOBTRUSIVE DATA for Efltute NEW DEVICES in VISIBLE LIGHT
    ~; ~ct-~v~s VRCODES: EMBEDDING UNOBTRUSIVE DATA FOR EflTUTE NEW DEVICES IN VISIBLE LIGHT by Grace Woo Submitted to the Department of Electrical Engineering and Computer Science in partial fulfillment of the requirements for the degree of Doctor of Philosophy in Electrical Engineering and Computer Science at the MASSACHUSETTS INSTITUTE OF TECHNOLOGY September 2012 @ Massachusetts Institute of Technology 2012. All rights reserved. A uthoi ............ ., . L .................... .................. Department of Electrical Engineering and Computer Science August 31st, 2012 Certified by . C ................... .. .................. Andy Lippman Senior Research Scientist Thesis Supervisor Accepted by ................. ... T. s ie Kolodziejski Chairman, Department Committee on Graduate Theses VRCodes: Embedding Unobtrusive Data for New Devices in Visible Light by Grace Woo Submitted to the Department of Electrical Engineering and Computer Science on August 31st, 2012, in partial fulfillment of the requirements for the degree of Doctor of Philosophy in Electrical Engineering Abstract This thesis envisions a public space populated with active visible surfaces which appear different to a camera than to the human eye. Thus, they can act as general digital interfaces that transmit machine-compatible data as well as provide relative orientation without being obtrusive. We introduce a personal transceiver peripheral, and demonstrate this visual environment enables human participants to hear sound only from the location they are looking in, authenticate with proximal surfaces, and gather otherwise imperceptible data from an object in sight. We present a design methodology that assumes the availability of many independent and controllable light transmitters where each individual trans- mitter produces light at different color wavelengths. Today, controllable light transmitters take the form of digital billboards, signage and overhead lighting built for human use; light-capturing receivers take the form of mobile cameras and personal video camcorders.
    [Show full text]