Augmented Reality and its application to maintaining and repairing vehicles. Rakesh (Teddy) Kumar Vision and Robotics Laboratory SRI International Sarnoff Email: [email protected] Phone: 1-609-734-2832 April 12th, 2011 © 2011 SRI International ‐ Company Proprietary Information Talk Overview 1. Introduction to SRI 2. Augmented Reality for Military Defense Training 3. Other Applications of Augmented Reality 4. Augmented Reality for Vehicle Repair and Maintenance 5. Conclusions Who We Are SRI is a world‐leading R&D organization • An independent, nonprofit corporation – Founded by Stanford University in 1946 – Independent in 1970; changed name from Stanford Research Institute to SRI International in 1977 – Sarnoff Corporation acquired as a subsidiary in 1987; integrated into SRI in 2011 • 2,100 staff members Silicon Valley ‐ Headquarters • More than 20 locations worldwide • 2009 revenues: approximately $470 million Washington, D.C. Tokyo, Japan VirginiaPennsylvania Florida New Jersey OPPORTUNITIES PROFILE INNOVATIONS CAPABILITIES PARTNERSHIPS Our Focus Areas MltidiiliMultidisciplinary teams leverage core thtechno logy and research areas Information Technology Health, Education, Engineering and and Economic Policy Systems SRI’s Value Creation Process™ Biotechnology Advanced Materials, Microsystems, and Nanotechnology OPPORTUNITIES PROFILE INNOVATIONS CAPABILITIES PARTNERSHIPS Clients throughout the World Providing value to our clients worldwide Mission: SRI is committed to discovery and to the application of science and technology for knowledgg,e, commerce, ppprosperity, and peace. OPPORTUNITIES PROFILE INNOVATIONS CAPABILITIES PARTNERSHIPS Representative Clients and Partners SRI delivers innovation to governments United States International • Departments of Defense, Energy, Education, Homeland Security, • Business Victoria, Australia Labor, Transportation, Commerce, Health and Human Services, • City of Kobe, Japan and State • Government of Murcia, Spain • Defense Advanced Research Projects Agency (DARPA) • Industrial Development Corporation of South Africa • Departments of the U.S. Army, Navy, Marines, and Air Force • Inter‐American Development Bank • Environmental Protection Agency (EPA) • National Institute of Advanced Industrial Science and Technology, Japan • National Aeronautics and Space Administration (NASA) • National Institute for Material Science, Japan • National Institutes of Health (NIH) • New Energy and Industrial Technology Development Organization, Japan • National Science Foundation (NSF) • King Abdul Aziz City for Science and Technology, Saudi Arabia • Office of Naval Research (ONR) • Institute of Science and Technology, Korea • Palm Beach County, FL Business Development Board • Ministry for Science, Technology, and the Environment, Malaysia • States of Connecticut, Illinois, Iowa, Kentucky, Oklahoma, and • Ministry of Industry, Science, Technology, Canada Pennsylvania • Ministry of Science and Technology, Brazil • University of California • Exporters Confederation, Philippines • U.S. Agency for International Development (USAID) • General Investment Authority, Saudi Arabia • U.S. Postal Service • Industrial Technology Research Institute, Taiwan • Tokyo University of Agriculture and Technology, Japan • The World Bank OPPORTUNITIES PROFILE INNOVATIONS CAPABILITIES PARTNERSHIPS Representative Clients and Partners SRI delivers innovation to established and start‐up businesses U.S. and International Businesses Venture Capitalists • Kleiner Perkins • Akzo‐Nobel Chemicals • Kuraray • Mayfield • Avery Dennison • Leucadia Corporation • Morgenthaler • British Broadcasting Corporation • Mazda Corporation • Oak Investment Partners • C&H Sugar • Mitsubishi Heavy Industries • St. Paul Venture Partners • Charles Schwab & Co. • Monsanto • U.S. Venture Partners • Chevron Corporation • Ocean Spray • Colin Medical Instruments • Post, Buckley, Schuh& Jernigan • Conoco • Playback Media • CVS • Samsung Corporation • Delphi Interiors • Sanofi Winthrop • Drexler Technology • Taiho Pharmaceutical • FedEx Corporation • Thames Water • Hitachi • Toray • Hyper Drive Co., Ltd. • Toyota • Kajima • Tyco OPPORTUNITIES PROFILE INNOVATIONS CAPABILITIES PARTNERSHIPS SRI Technology Spin‐off Ventures Publicly Traded Speech recognition Surgical robotics for customer service DNA testing services* Information Technology Customer service tools* Digital TV technologies* Digital TV equipment* Flat-panel displays* Electronic and digital signature solutions Video-on-demand services** Wireless mesh networks Video enhancement LCD technology* Iris biometric Virtual Personal Assistant Enterprise social Panoramic image Secure content systems identification* for smart phones* media technology editing software* distribution* Materials Bio/Medical Electroactive polymers Metal “print and plate” Digital color printing Super-bright LED Drug dispensing system* Drug discovery manufacturing process applications* light engines* (formerly Rosedale Medical) Glucose monitoring system Disposable hearing aid* Next-generation Portable power systems** Optical network Anti-counterfeiting fuel cells** components systems *Acquired or merged ** Dissolved 8 Computing SRI invented the foundations of personal computing 1964–1968: SRI’s Doug Engelbart and team Today: SRI spin‐off Siri, acquired by invented the computer mouse and demonstrated Apple in 2010, offers a virtual the foundations of personal computing. personal assistant—a new way to interact with the Internet on your mobile phone. Siri was born from the CALO project, an ambitious artificial intelligence program SRI led for DARPA. President Bill Clinton presents Doug Engelbart with the 2000 National Medal of Technology OPPORTUNITIES PROFILE INNOVATIONS CAPABILITIES PARTNERSHIPS Internet and Networks SRI was there “before the beginning” .com .gov .org 1969: SRI received the first logon to the ARPANET, Today: For the Department of Homeland Security, SRI predecessor of the Internet. administers the Cyber Security R&D Center, which develops technology for protection of the U.S. cyber 1970–1992: SRI ran the Network Information Center (NIC), infrastructure through partnerships with industry, the the domain name registration clearinghouse for all venture community, and the research community. computer hosts connecting to the ARPANET and Internet. SRI assigned all .com, .org, and .gov domain names. Today: SRI’s online Malware Threat Center helps network administrators understand current and emerging computer security threats and provides key 1987: SRI’s ppgioneering network intrusion detection network defense information. technology protects against malicious attacks. OPPORTUNITIES PROFILE INNOVATIONS CAPABILITIES PARTNERSHIPS Real‐time Video Processing We are world leaders in real‐time video analysis 1984: SRI Sarnoff’s Pyramid Vision is the first Today: SRI Sarnoff’s Acadia® II, developed to computer system capable of performing support the warfighter, performs real‐time video sophisticated visual search tasks in real time. enhancement, stabilization, multisensor video fifusion, tkitracking, and image ftfeature dtdetec tion. 1996: SRI Sarnoff delivered the first system to insert virtual advertising in live video broadcast as part of the scene. OPPORTUNITIES PROFILE INNOVATIONS CAPABILITIES PARTNERSHIPS Deep Technical Capabilities SRI applies idiiliinterdisciplinary skills to provide solilutions to your needs • Advanced materials and structures • Marine science and technology • Automotive techlhnologies • Mdil/Medical/surg ica l didevices • Computational biology • Microcircuit emulation • Cyber security • Networks and communication • Data collection and measurement • Persistent surveillance • Drug discovery and development • Product development and • Education, health, and economic ppyolicy fielding • • Energy and environment Product portfolio • • Homeland security and national Robotics and automation defense • Security and situational • Imaging systems awareness • Information and computing • Virtual personal assistants • Intelligence systems • Vision technologies OPPORTUNITIES PROFILE INNOVATIONS CAPABILITIES PARTNERSHIPS Automotive Technologies IiImproving safety, comfort, cost, and envilironmental impact • Systems – Collision avoidance – Pedestrian detection – Intelligent airbags – Active noise cancellation – Chassis controls Real‐time 3‐D sensing of • Informatics people and objects – Voice recognition – Peer‐to‐peer communications – GPS applica tions • Sensors and actuators – Seat occupant sensors – “Artificial muscle” valve actuators • Materials – Under‐the‐hood thermoplastics – Corrosion‐resistant coatings – Failure mechanics and vibration analysis OPPORTUNITIES PROFILE INNOVATIONS CAPABILITIES PARTNERSHIPS Robotics and Automation From the world’ s first reasoning robot to the latest advances • Advanced materials for automation – Electroactive ppyolymer “artificial muscle” – RF (radio frequency) tags • Robots – Inspection systems – Micro robots Centibots, the first team of 100 – Collaborative robots mobile, coordinated robots • Robotics – Video and image understanding – Safe operation – Machine vision systems for document understanding – Manufacturing and materials handling – GPS‐challenged navigation – 3D modeling • Transport – Ultra‐clean transport – Medical laboratory automation OPPORTUNITIES PROFILE INNOVATIONS CAPABILITIES PARTNERSHIPS Information and Computing Pioneer ing next‐generation, disrupti ve thtechno lilogies • Speech – Recognition and translation – Natural language understanding • Networks and distributed