Phase II Experiment 1 - 2014 Chevrolet Impala (2014B)
Total Page:16
File Type:pdf, Size:1020Kb
MIT/CSRC Project on Assessing the Demands of Voice Based In-Vehicle Interfaces Technical Report 2015-6A Phase II Experiment 1 - 2014 Chevrolet Impala (2014b) Revision (2015-6A) Submitted: November 30, 2015 Report (2015-6) Submitted: October 16, 2015 Initial Draft: June 15, 2015 Bruce Mehler, Bryan Reimer, Jonathan Dobres, Hale McAnulty, & Joseph F. Coughlin Abstract – Experiment 1 is the first in a series of three studies designed to develop data to support exploring the generalizability of, and extend upon, the findings on the demands of production level voice-command systems from the MIT AgeLab’s Phase I CSRC work that was undertaken in a 2010 Lincoln MKS. Self-report, eye glance, physiology (heart rate and skin conductance), driving performance, and task performance data were collected in a 2014 Chevrolet Impala with the MyLink infotainment system across a final analysis set of 48 participants meeting the age and gender distribution of NHTSA (2013) guidelines. Interactions considered consisted of baseline single-task highway driving, voice-based destination address entry into the navigation system, voice-based point of interest (POI) selection, and voice-based phone contact calling. Manual radio tuning and the auditory-vocal n-back were also included as reference tasks. Data collection in two additional vehicles (Experiment 2 - 2014 Mercedes CLA and Experiment 3 - 2015 Toyota Corolla) consisting of the same task categories and assessment measures were subsequently completed with results and reporting provided in independent reports. Lead Project Contact: Bryan Reimer, Ph.D. Phone (617) 452-2177 [email protected] Massachusetts Institute of Technology > AgeLab > 77 Massachusetts Ave, E40-291, Cambridge, MA 02139 Phone: 617.452.2177 > fax: 617.258.7570 > [email protected] > agelab.mit.edu AgeLab Technical Report 2015-6A REPORT DOCUMENTATION PAGE RECEIVING ORGANIZATION REPORT DATE REPORT TYPE + DATES COVERED Toyota Collaborative Safety Research Center 2015-6: October 16, 2015 Technical Report 2015-6A: Nov. 30, 2015 TITLE AND SUBTITLE FUNDING NUMBERS Assessing the Demands of Voice Based In-Vehicle Interfaces: Phase II Experiment 1 - 2014 Chevrolet Impala (2014b) AUTHOR(S) Bruce Mehler, Bryan Reimer, Jonathan Dobres, Hale McAnulty, & Joseph F. Coughlin PERFORMING ORGANIZATION NAME(S) AND ADDRESS(ES) PERFORMING ORGANIZATION REPORT NUMBER MIT AgeLab Massachusetts Institute of Technology Technical Report 2015-6A 77 Massachusetts Avenue, E40-279 Cambridge, MA 02139 USA SPONSORING/MONITORING AGENCY NAME(S) AND ADDRESS(ES) SPONSORING/MONITORING AGENCY REPORT NUMBER Toyota Collaborative Safety Research Center Collaborative Safety Research Center Toyota Technical Center USA, Inc. 1555 Woodridge Ave Ann Arbor, MI 48105 SUPPLEMENTARY NOTES 2015-6A Updates the formatting and presentation of tables in the Appendix to bring this report more in line with the subsequent reports for Phase II Studies 2 & 3. Some minor text updates were made as well. The “2014b” in the title is the internal MIT AgeLab code for the experiment. DISTRIBUTION/AVAILABILITY STATEMENT DISTRIBUTION CLASSIFICATION ABSTRACT Experiment 1 is the first in a series of three studies designed to develop data to support exploring the generalizability of, and extend upon, the findings on the demands of production level voice-command systems from the MIT AgeLab’s Phase I CSRC work that was undertaken in a 2010 Lincoln MKS. Self-report, eye glance, physiology (heart rate and skin conductance), driving performance, and task performance data were collected in a 2014 Chevrolet Impala with the MyLink infotainment system across a final analysis set of 48 participants meeting the age and gender distribution of NHTSA (2013) guidelines. Interactions considered consisted of baseline single-task highway driving, voice-based destination address entry into the navigation system, voice-based point of interest (POI) selection, and voice-based phone contact calling. Manual radio tuning and the auditory-vocal n-back were also included as reference tasks. Data collection in two additional vehicles (Experiment 2 - 2014 Mercedes CLA and Experiment 3 - 2015 Toyota Corolla) consisting of the same task categories and assessment measures were subsequently completed with results and reporting provided in independent reports. SUBJECT TERMS Voice-command, visual-manual demand, TEORT, driver-vehicle NUMBER OF PAGES interface, DVI, HMI, driver distraction, attention management, workload, cognitive 66 demand, guidelines, glance behavior, heart rate, skin conductance, driving performance. Recommended Citation: Mehler, B., Reimer, B., Dobres, J., McAnulty, H., & Coughlin, J.F. (2015). Assessing the Demands of Voice Based In-Vehicle Interfaces - Phase II Experiment 1 - 2014 Chevrolet Impala (2014b). MIT AgeLab Technical Report 2015-6A (November 30, 2015). Massachusetts Institute of Technology, Cambridge, MA. ©MIT AgeLab 2015 Page 2 of 66 AgeLab Technical Report 2015-6A Glossary of Terms (or Acronyms) ANOVA analysis of variance CAMP Crash Avoidance Metrics Partnership CAN controller area network CSRC Toyota Collaborative Safety Research Center DVI driver vehicle interface ISO International Organization for Standardization M mean MIT Massachusetts Institute of Technology NHTSA National Highway Transportation Safety Administration SCL skin conductance level SD standard deviation SE standard error SWR steering wheel reversals The Alliance Alliance of Automotive Manufacturers TEORT total eyes-off-road time - the sum of all glances off the forward roadway during a specific period ©MIT AgeLab 2015 Page 3 of 66 AgeLab Technical Report 2015-6A MIT/CSRC Project on Assessing the Demands of Voice Based In- Vehicle Interfaces Phase II Experiment 1 - 2014 Chevrolet Impala (2014b) Contents Glossary of Terms (or Acronyms) ................................................................................................................ 3 Introduction ................................................................................................................................................... 6 Intent of Present Report ............................................................................................................................ 6 Background for Current Work .................................................................................................................. 6 Research Focus for Phase II Studies ......................................................................................................... 7 Basic Research Objectives & Approach for Phase II Study 1 .................................................................. 8 Methods ........................................................................................................................................................ 9 Participants ............................................................................................................................................... 9 Apparatus .................................................................................................................................................. 9 Voice-Interface ..................................................................................................................................... 9 Instrumentation .................................................................................................................................. 11 Procedure ................................................................................................................................................ 12 Data Reduction and Analysis ................................................................................................................. 13 Results ......................................................................................................................................................... 14 Analysis Sample ..................................................................................................................................... 14 Organization of Results .......................................................................................................................... 15 Self-Reported Workload ......................................................................................................................... 16 Task Completion Time ........................................................................................................................... 17 Physiology .............................................................................................................................................. 18 Heart Rate ........................................................................................................................................... 18 Skin Conductance Level ..................................................................................................................... 19 Glance Behavior ..................................................................................................................................... 20 Mean Single Off-Road Glance Duration ............................................................................................ 21 Percentage of Single Off-Road Glances Greater than 2.0s ................................................................ 22 Total Eyes Off-Road Time (TEORT) ................................................................................................ 23 Number of Glances Off-Road ...........................................................................................................