CORA Task 001 Phase Two: Data Collection Plan for the Naval Exercise and Experimentation Support Framework
Total Page:16
File Type:pdf, Size:1020Kb
CORA Task 001 Phase Two: Data Collection Plan for the Naval Exercise And Experimentation Support Framework PWGSC Contract Number: W7714-156105/001/SV TASK 001 ISR Report 6066-01-01 Version 4.0 18 November 2016 Presented to: Dr. Peter Dobias Ms. Cheryl Eisler MARPAC N02OR Team Defence Research and Development Canada – Centre for Operational Research and Analysis PO Box 1700 STN Forces Victoria, BC V9A 7N2 Contract Report DRDC-RDDC-2016-C326 Prepared by: International Safety Research 38 Colonnade Road North Ottawa, Ontario Canada K2E 7J6 Disclaimer: The scientific or technical validity of this Contract Report is entirely the responsibility of the Contractor and the contents do not necessarily have the approval or endorsement of the Department of National Defence of Canada. © Her Majesty the Queen in Right of Canada, as represented by the Minister of National Defence, 2016 © Sa Majesté la Reine (en droit du Canada), telle que représentée par le ministre de la Défense nationale, 2016 Abstract The mission of the Royal Canadian Navy (RCN) is to employ combat-effective, general- purpose maritime forces during domestic and international operations. [1][2] The RCN conducts this mission through activities that are completed on both coasts. The Maritime Forces Pacific (MARPAC) Operational Research Team (ORT) supports MARPAC/JTFP exercises (EX), including tabletop and command post exercises (TTX/CPX) and war games; these can be at various levels up to and including the Naval Task Group (TG) level. [3] Up until now, each ORT project had been treated as a separate entity, and each time an exercise support requirement arises, a new data collection and analysis plan was developed. The ORT commenced a multi-phased project to align MARPAC/Joint Task Force Pacific (JTFP) exercises and experiments with the ORT role in supporting defence priorities, assigned missions, and tasks.[4] Phase One of the project, documented in a separate report [4], generated the six-phase Exercise and Experimentation Support Framework (the ‘Framework’) to support exercises and experiments conducted at the Regional Joint Task Force, Naval TG, and individual ship or sub-unit level. The Framework is based on existing high level Canadian and United States (U.S.) military doctrine and existing bodies of knowledge within the civil emergency management domain. [5][6][7][8][9] It provides a method for task decomposition. A set of seven scenarios was also developed which reflect current and future RCN joint priorities. The current work, Phase Two, completes the Framework by developing a generic, consistent, robust, and reusable data collection process and analysis methodology. Phase Two also addressed the requirements for adhering to the Defence Research and Development Canada (DRDC) Human Research Ethics Committee (HREC) policies. [10][11][12] The data collection process and the adherence to the HREC policies are addressed in this report and the data analysis will be addressed separately. [12] In Phase Two, three major groupings of exercises were developed based on the earlier Phase One work. These groupings represented TG exercises (TGEX), live simulations and TTX/CPX. High-level strategic documentation from the Canadian and U.S. military and emergency management domains were used to identify relevant naval and joint tasks and associated measures. Two complex scenarios were used (i.e., a multi- national exercise involving a Canadian Naval TG and an inter-agency, joint exercise conducted by coastal Joint Task Force) to identify common operational tasks associated with the main groupings of TGEX and TTX/CPX activities; live simulations were not directly addressed due to limitations in project resources and scope. Qualitative and quantitative measures were derived from decomposing the tasks for each scenario. Data collection templates were generated for each of the main types of measures that were identified during the analysis. The data collection templates are designed to be quickly and easily adaptable by the MARPAC ORT to meet specific exercise and experimentation parameters. The current findings support the final step in the creation of the Framework that will document, with notional datasets, the types of analyses and identify open source tools that could be used to perform the data analyses. Naval Exercise & Experimentation Support Framework Report ISR Report 6066-01-01 QUALITY ASSURANCE AND VERSION TRACKING Authorization Naval Exercise & Experimentation Support Title Framework Draft Report Report number 6066-01-01 Version 4.0 Signature Prepared by K. Forbes/K. Salchert Reviewed by S. Lavigne Approved by M. McCall Approved for M. McCall Corporate Release by Ver. Action By Date 1.0 Release to Client M. McCall 31-Aug-16 2.0 Release to Client M. McCall 4-Nov-16 3.0 Release to Client M. McCall 18-Nov-16 4.0 Release to Client M. McCall 27-Nov-16 i Naval Exercise & Experimentation Support Framework Report ISR Report 6066-01-01 ii Naval Exercise & Experimentation Support Framework Report ISR Report 6066-01-01 TABLE OF CONTENTS 1. BACKGROUND ......................................................................................................... 1 1.1 General Framework from Phase One ................................................................. 2 1.2 Collaboration between RCN and MARPAC ORT ............................................... 4 1.3 Purpose .............................................................................................................. 4 1.4 Overview of the report ........................................................................................ 4 2. METHODOLOGY ...................................................................................................... 7 2.1 Scenario selection .............................................................................................. 7 2.2 Task list development ......................................................................................... 7 2.3 Measures ............................................................................................................ 8 2.4 Assessment and refinement of measures .......................................................... 8 2.4.1 Develop data and information requirements ................................................ 9 2.4.2 Develop proposed data collection methods ................................................. 9 3. DRDC Human research ethics .............................................................................. 10 3.1.1 Initiate ........................................................................................................ 10 3.1.2 Conceive .................................................................................................... 10 3.1.3 Design ....................................................................................................... 10 3.1.4 Planning ..................................................................................................... 11 3.1.5 Conduct ..................................................................................................... 11 3.1.6 Assess ....................................................................................................... 11 4. DATA AND INFORMATION REQUIREMENTS ...................................................... 12 5. DATA COLLECTION METHODS ............................................................................ 14 5.1 Approach to template development .................................................................. 14 5.2 Record of observation ....................................................................................... 14 5.3 Checklist ........................................................................................................... 15 5.4 Dichotomous choice (yes/no) ........................................................................... 15 5.5 Likert-type rating scale ...................................................................................... 15 5.6 Open-ended questions ..................................................................................... 16 5.7 Time/data stamp and data sample ................................................................... 17 6. SUMMARY .............................................................................................................. 19 REFERENCES ................................................................................................................ 20 ACRONYMS ................................................................................................................... 23 Annex A. Process Diagram For Task List Development ...................................... 27 Annex B. TGEX Scenario ......................................................................................... 28 Annex C. TTX/CPX Scenario ................................................................................... 30 Annex D. Documentation Descriptions for Scenario Task List Development ... 34 Annex E. TGEX Task List ........................................................................................ 38 Annex F. TTX/CPX Task List ................................................................................... 76 Annex G. Process Diagram For Adhering to HREC Requirements ................... 166 iii Naval Exercise & Experimentation Support Framework Report ISR Report 6066-01-01 Annex H. HREC Policies For Framework Implementation ................................. 172 Annex I. Summary of Extracted Measures ...........................................................