Modeling Cognitive Response to Wireless Emergency Alerts to Inform Emergency Response Interventions Final Report March 2016 PNNL-25257 ii Courtney D. Corley [PI] Nathan O. Hodas Ryan Butner Joshua J. Harrison MODELING COGNITIVE Chris Berka [at ABM] RESPONSE TO WIRELESS EMERGENCY ALERTS TO INFORM EMERGENCY RESPONSE INTERVENTIONS PNNL-25257 Prepared for U.S. Department of Homeland Security Science and Technology Directorate, Support to the Homeland Security Enterprise and First Responders Group i ACKNOWLEDGMENTS Funding for this report was provided to Pacific Northwest National Laboratory by the U.S. Department of Homeland Security Science and Technology Directorate, Homeland Security Enterprise and First Responders Group. For more information about this document, contact: Pacific Northwest National Laboratory 902 Battelle Boulevard Richland, Washington 99354 Tel: 1-888-375-PNNL (7665) www.pnnl.gov Contents EXECUTIVE SUMMARY ......................................................................................................................................... 6 1.0 INTRODUCTION ......................................................................................................................................... 10 1.1 OVERVIEW OF PROJECT ................................................................................................................................. 10 1.2 BACKGROUND ON RISK COMMUNICATION ................................................................................................... 11 1.2.1 UNDERSTANDING RISK PERCEPTION AND COMMUNICATION .............................................................................. 11 1.2.2 RISK IDENTIFICATION ................................................................................................................................................. 11 1.2.3 COGNITIVE PROCESSING OF RISK PERCEPTION ...................................................................................................... 12 1.2.4 LINGUISTIC IMPLICATIONS ......................................................................................................................................... 13 1.3 BACKGROUND ON COGNITIVE PROCESSING OF RISK PERCEPTION ............................................................ 14 2.0 RISK COMMUNICATION AND PERCEPTION MESSAGES ............................................................... 17 2.1 EXEMPLAR DISASTER AND ALERT SELECTION............................................................................................. 17 2.2 HISTORICAL TWITTER DATA ACQUISITION ................................................................................................. 18 2.3 HISTORICAL QUERY DESIGN ......................................................................................................................... 18 2.4 EXEMPLAR TWEET SELECTION ..................................................................................................................... 18 3.0 DISENTANGLING THE LEXICONS OF DISASTER RESPONSE IN TWITTER .............................. 20 3.1 DATA ............................................................................................................................................................... 20 3.2 RISK CORPUS .................................................................................................................................................. 21 3.2.1 CLUSTERING.................................................................................................................................................................. 21 3.3 DISCUSSION ..................................................................................................................................................... 22 3.3.1 MOST INFORMATIVE AND SURPRISING TWEETS .................................................................................................... 24 3.3.2 DISCUSSION ON LEXICONS .......................................................................................................................................... 29 4.0 RISK COMMUNICATION AND PERCEPTION ONTOLOGY .............................................................. 30 4.1 OVERVIEW ...................................................................................................................................................... 30 4.2 ONTOLOGY ...................................................................................................................................................... 30 4.2.1 STRUCTURE ................................................................................................................................................................... 32 4.2.2 METHODOLOGY ............................................................................................................................................................ 32 4.2.3 SUBUNITS ...................................................................................................................................................................... 36 4.2.4 SAMPLE ONTOLOGICAL CLASSIFICATION ................................................................................................................ 37 5.0 EXPERIMENTAL DESIGN AND SETUP ................................................................................................. 39 5.1 PARTICIPANT POPULATION AND SCREENING .............................................................................................. 39 5.2 CONSENT AND STUDY PROCEDURES ............................................................................................................. 40 5.3 ORIENTATION SESSION .................................................................................................................................. 40 5.4 BENCHMARK SESSION - ALERTNESS MEMORY PROFILER (AMP) ............................................................. 41 5.5 EXPERIMENTAL SESSION ............................................................................................................................... 41 5.6 END OF EXPERIMENTAL SESSIONS ................................................................................................................ 42 5.7 DATA ANALYSIS .............................................................................................................................................. 42 5.8 DESCRIPTION OF TESTBEDS .......................................................................................................................... 42 5.8.1 AMP ............................................................................................................................................................................... 42 5.8.2 EMERGENCY RESPONSE TESTBED ............................................................................................................................ 44 5.9 DESCRIPTION OF PROTOCOL DEVICES.......................................................................................................... 45 5.9.1 B-ALERT® EEG WIRELESS SENSOR HEADSET ................................................................................................... 45 5.9.2 GSR ARMBANDS .......................................................................................................................................................... 46 5.10 RISK/BENEFIT ASSESSMENT ...................................................................................................................... 47 5.10.1 FORESEEABLE RISKS ................................................................................................................................................. 47 5.10.2 RISK MANAGEMENT AND EMERGENCY RESPONSE .............................................................................................. 48 5.10.3 POTENTIAL BENEFITS .............................................................................................................................................. 48 5.10.4 COMPENSATION ......................................................................................................................................................... 48 5.10.5 WITHDRAWAL FROM THE PROTOCOL ................................................................................................................... 48 5.11 CONFIDENTIALITY ........................................................................................................................................ 49 5.12 ROLES AND RESPONSIBILITIES OF MEDICAL MONITOR ............................................................................ 49 5.13 SURVEYS, QUESTIONNAIRES AND OTHER DATA COLLECTION INSTRUMENTS ........................................ 50 5.14 EXPERIMENTAL SETUP ................................................................................................................................ 50 5.14.1 PERFORMANCE DATA ............................................................................................................................................... 52 5.14.2 PHYSIOLOGICAL DATA .............................................................................................................................................. 58 6.0 PRIMARY STUDY METHODOLOGY AND EXPERIMENT DESIGN ................................................ 65 6.1 OVERVIEW ...................................................................................................................................................... 65 6.2 METHODOLOGY .............................................................................................................................................