Bnl-90424-2009
Total Page:16
File Type:pdf, Size:1020Kb
Human Factors of Advanced Reactors (NRC JCN Y-6529) BNL Tech Report No. BNL-90424-2009 Trends in HFE Methods and Tools and Their Applicability to Safety Reviews Prepared for: Division of Risk Analysis Office of Nuclear Regulatory Research U.S. Nuclear Regulatory Commission Washington, DC 20555-0001 Prepared by: John M. O’Hara Brookhaven National Laboratory Energy Sciences and Technology Department Upton, NY 11973-5000 C. Plott, J. Milanski, A. Ronan, S. Scheff, L. Laux, and J. Bzostek Alion Science and Technology Boulder, CO 80301 October 16, 2009 This page is intentionally left blank. ABSTRACT The U.S. Nuclear Regulatory Commission’s (NRC) conducts human factors engineering (HFE) safety reviews of applicant submittals for new plants and for changes to existing plants. The reviews include the evaluation of the methods and tools (M&T) used by applicants as part of their HFE program. The technology used to perform HFE activities has been rapidly evolving, resulting in a whole new generation of HFE M&Ts. The objectives of this research were to identify the current trends in HFE methods and tools, determine their applicability to NRC safety reviews, and identify topics for which the NRC may need additional guidance to support the NRC’s safety reviews. We conducted a survey that identified over 100 new HFE M&Ts. The M&Ts were compared to identify general trends. Seven trends were identified: Computer Applications for Performing Traditional Analyses, Computer-Aided Design, Integration of HFE Methods and Tools, Rapid Development Engineering, Analysis of Cognitive Tasks, Use of Virtual Environments and Visualizations, and Application of Human Performance Models. We assessed each trend to determine its applicability to the NRC’s review by considering (1) whether the nuclear industry is making use of M&Ts within each trend, and (2) whether the M&Ts could be reviewed using existing design review guidance. We identified three trends as applicable to the commercial nuclear industry and expected to impact safety reviews: Analysis of Cognitive Tasks, Use of Virtual Environments and Visualizations, and Application of Human Performance Models. These trends may be considered for review guidance development. iii This page is intentionally left blank. CONTENTS ABSTRACT ............................................................................................................................... iii ABBREVIATIONS .................................................................................................................... vii 1 INTRODUCTION .................................................................................................................. 1 1.1 Background ................................................................................................................. 1 1.2 The Role of HFE Methods and Tools in HFE Safety Reviews ..................................... 2 1.3 Objectives ................................................................................................................. 10 1.4 Report Organization .................................................................................................. 10 2 METHODOLOGY ............................................................................................................... 11 3 RESULTS ........................................................................................................................... 13 3.1 Methods and Tools Survey ........................................................................................ 13 3.1.1 Operating Experience Review ......................................................................... 14 3.1.2 Functional Requirements Analysis and Function Allocation ............................. 15 3.1.3 Task Analysis .................................................................................................. 17 3.1.4 Staffing and Qualifications ............................................................................... 20 3.1.5 Human-system Interface Design ...................................................................... 20 3.1.6 Procedure Development .................................................................................. 22 3.1.7 Training Program Development ....................................................................... 23 3.1.8 Verification, Validation, and Design Implementation ........................................ 24 3.1.9 Human Performance Monitoring ...................................................................... 26 3.2 Major Trends and Their Applicability to NRC Reviews............................................... 28 3.2.1 Computer Applications for Performing Traditional Analyses ............................ 28 3.2.2 Computer-aided Design ................................................................................... 29 3.2.3 Integration of HFE Methods and Tools ............................................................ 29 3.2.4 Rapid Development Engineering ..................................................................... 30 3.2.5 Analysis of Cognitive Tasks ............................................................................. 31 3.2.6 Use of Interactive Virtual Environments and Visualizations .............................. 31 3.2.7 Application of Human Performance Models ..................................................... 33 3.3 Conclusions .............................................................................................................. 34 4 SUMMARY ......................................................................................................................... 35 5 REFERENCES ................................................................................................................... 37 Appendix A Method and Tool Descriptions ................................................................... A-1 Appendix B Applicability of Methods and Tools to NUREG-0711 Review Element Cross Reference Table ............................................................................... B-1 v TABLES Table 1-1 National Research Council’s Reasons Systems Fail ................................................ 3 Table 3-1 Number of HFE Methods and Tools by Review Element........................................ 13 Table 3-2 Operating Experience Data, Access, and Management ......................................... 15 Table 3-3 Requirements Management Methods and Tools .................................................... 16 Table 3-4 Information Analysis Methods and Tools ............................................................... 17 Table 3-5 Function Allocation Methods and Tools ................................................................. 17 Table 3-6 New Task Analysis Methods and Tools ................................................................. 19 Table 3-7 Staffing and Qualifications Methods and Tools ...................................................... 20 Table 3-8 Human-System Interface Design Methods and Tools ............................................ 22 Table 3-9 Procedures Development Methods and Tools ....................................................... 23 Table 3-10 Training Delivery Technologies .............................................................................. 24 Table 3-11 Training Planning and Management Methods and Tools ....................................... 24 Table 3-12 Verification and Validation Methods and Tools ...................................................... 26 Table 3-13 Human Performance Monitoring Methods and Tools ............................................. 28 Table 3-14 Results Summary .................................................................................................. 34 FIGURES Figure 1-1 Top-down approach to design .................................................................................. 9 Figure 1-2 NUREG-0711 HFE Review Elements ....................................................................... 9 Figure 2-1 Technical Approach ................................................................................................ 11 vi ABBREVIATIONS ACTA applied cognitive task analysis AIM authoring instructional materials ATEAMS afloat, training, exercise, and management system C3TRACE Command, Control, and Communication Techniques for Reliable Assessment of Concept Execution CARE computer aided requirements engineering CASHE-PVS Computer Aided Systems Human Engineering Performance Visualization System CCAB Complex Cognitive Assessment Battery CMS computerized maintenance system CREATE Control Room Engineering Advanced Toolkit Environment CSDT Crew Station Design Tool DDSM directory of design support methods DELMIA Digital Enterprise Lean Manufacturing Interactive Application DoD Department of Defense DOORS Dynamic Object Oriented Requirements System DUTCH Designing for Users and Tasks Form Concepts to Handles ECAT Engineering Control Analysis Tool EPIC Executive Process Interactive Control EPRI SHP Electric Power Research Institute Strategic Human Performance FAST Fatigue Avoidance Scheduling Tool HCDA Human Centered Design Advisor HFE human factors engineering ICS-CTA Interactive Cognitive Subsystems to Cognitive Task Analysis IMPRINT Improved Performance Research Integration Tool INSAG International Nuclear Safety Advisory Group IPME Integrated Performance Modeling Environment IRqAR Integral Requisite Analyzer ISMAT Integrated Simulation Manpower Analysis Tool JASS Job Assessment Software System KARMA Knowledge-based Augmented Reality