Immersive virtual worlds: Multi-sensory virtual environments for health and safety training Dr Glyn Lawson, Emily Shaw, Dr Tessa Roper, Tommy Nilsson, Laura Bajorunaite, Ayesha Batool University of Nottingham, University Park, Nottingham, NG7 2RD www.iosh.com/multisensoryVE Research report IOSH, the Chartered body for health and All recipients of funding from our Research and safety professionals, is committed to Development Fund are asked to compile a evidence-based practice in workplace safety comprehensive research report of their findings, and health. We maintain a Research and which is subject to peer review. Development Fund to support research and inspire innovation as part of our work as a For more information on how to apply for grants thought leader in health and safety. from the Fund, visit www.iosh.com/getfunding, or contact: Duncan Spencer Head of Advice and Practice [email protected] Mary Ogungbeje OSH Research Manager [email protected] Ivan Williams OSH Research Adviser [email protected] Acknowledgement: IOSH would like to thank the peer reviewers of this report. Contents List of tables ........................................................................................................................................... 4 List of figures ......................................................................................................................................... 5 List of publications ............................................................................................................................... 10 Acknowledgements .............................................................................................................................. 11 Abstract ................................................................................................................................................ 12 EXecutive summary .............................................................................................................................. 13 1 General introduction ..................................................................................................................... 15 2 Literature review ........................................................................................................................... 17 2.1 Human behaviour in real-world emergency situations ......................................................... 17 2.2 The advantages of virtual environment training (VET) ......................................................... 18 2.3 Challenges with virtual environment training (VET) ............................................................. 20 2.4 EXisting studies of VR in emergency situations ................................................................... 21 2.5 Benefits of multi-sensory VEs for research and training in health and safety ...................... 23 3 Aims and objectives ...................................................................................................................... 24 4 Overall approach .......................................................................................................................... 26 4.1 Development of the use cases ............................................................................................. 27 4.2 EXperimental studies ............................................................................................................ 28 4.3 Specialist input ..................................................................................................................... 29 4.4 Technical solutions .............................................................................................................. 30 4.5 Multi-sensory simulation development ................................................................................. 31 4.6 VE development ................................................................................................................... 34 4.7 Usability studies ................................................................................................................... 48 4.8 VE iteration – Study 1 .......................................................................................................... 49 4.9 VE development for Study 2 ................................................................................................ 53 5 Study 1 – Behavioural validity ...................................................................................................... 76 5.1 Design .................................................................................................................................. 76 5.2 Participants .......................................................................................................................... 76 5.3 Equipment ............................................................................................................................ 77 5.4 Procedure ............................................................................................................................ 80 2 | Page 5.5 Data collection ..................................................................................................................... 81 5.6 Results ................................................................................................................................. 82 5.7 Subjective questionnaire analysis ........................................................................................ 89 5.8 Behavioural analysis ............................................................................................................ 90 5.9 Discussion ............................................................................................................................ 94 5.10 Limitations ............................................................................................................................ 98 5.11 Implications for VEs applied in safety conteXts .................................................................... 99 5.12 Conclusions ....................................................................................................................... 100 6 Study 2 – Effectiveness of training ............................................................................................. 101 6.2 Design ................................................................................................................................ 102 6.3 Participants ........................................................................................................................ 103 6.4 Equipment .......................................................................................................................... 104 6.5 Procedure .......................................................................................................................... 107 6.6 Results ............................................................................................................................... 108 6.7 Discussion .......................................................................................................................... 113 7 Benefits to business of a multi-sensory virtual training system .................................................. 116 7.1 Industry partner 1 – Rolls Royce, nuclear submarine manufacturer .................................. 116 7.2 Industry partner 2 – Jaguar Land Rover, automotive manufacturer .................................. 118 7.3 Relation to project findings ................................................................................................. 119 7.4 Costs of VE training ........................................................................................................... 120 7.5 Summary of business benefits ........................................................................................... 121 8 Overall discussion....................................................................................................................... 123 8.1 Limitations .......................................................................................................................... 124 8.2 Recommendations for practice .......................................................................................... 125 9 Overall conclusions .................................................................................................................... 129 10 References ................................................................................................................................. 131 11 AppendiX ..................................................................................................................................... 139 11.1 AppendiX A – Study 1, Post-task questionnaire ................................................................. 139 11.2 AppendiX B – Engine knowledge test ................................................................................ 140 11.3 AppendiX C – Fire safety knowledge test ........................................................................... 141 11.4 AppendiX D – Study 2, Subjective questionnaire ............................................................... 142 3 | Page List of tables Table 5-1 Experimental conditions ...................................................................................................... 76 Table 5-2 Demographic summary for each condition .........................................................................