Performance Measurement Plan (Pfmp) for the Smart Columbus Demonstration Program
Total Page:16
File Type:pdf, Size:1020Kb
Performance Measurement Plan (PfMP) for the Smart Columbus Demonstration Program FINAL REPORT | June 2019 Produced by City of Columbus Notice This document is disseminated under the sponsorship of the Department of Transportation in the interest of information exchange. The United States Government assumes no liability for its contents or use thereof. The U.S. Government is not endorsing any manufacturers, products, or services cited herein and any trade name that may appear in the work has been included only because it is essential to the contents of the work. Acknowledgment of Support This material is based upon work supported by the U.S. Department of Transportation under Agreement No. DTFH6116H00013. Disclaimer Any opinions, findings, and conclusions or recommendations expressed in this publication are those of the Author(s) and do not necessarily reflect the view of the U.S. Department of Transportation. Acknowledgments The Smart Columbus Program would like to thank project leads and local stakeholders for each of the Smart Columbus projects for their assistance in drafting and reviewing this Smart Columbus Performance Measurement Plan. Performance Measurement Plan (PfMP) – Final Report | Smart Columbus Program | i Abstract This Performance Measurement Plan describes the outcomes of Smart Columbus and how the objectives of each of projects relate to them. The plan identifies and explains the methodology proposed to evaluate the indicators for each project, which will provide insight into the performance of a project in meeting the objectives. The plan also describes the data necessary to evaluate the objectives and the required reporting frequency and contents. The responsibilities and types of interactions between the City of Columbus and an independent evaluator are also described. Performance Measurement Plan (PfMP) – Final Report | Smart Columbus Program | iii Table of Contents 1.1. Enabling Technologies ....................................................................................................... 1 1.2. Enhanced Human Services ............................................................................................... 2 1.3. Emerging Technologies ..................................................................................................... 2 1.4. Outcomes ............................................................................................................................. 2 1.5. Purpose of Plan ................................................................................................................... 3 1.6. Deployment Areas .............................................................................................................. 4 1.7. Project Timeline ................................................................................................................... 7 1.8. Methodology ........................................................................................................................ 8 1.9. Report Organization ........................................................................................................... 9 1.9.1. References ............................................................................................................................. 10 1.10. Relation to Other Documents ......................................................................................... 10 1.10.1. Project Systems Engineering Documentation ..................................................................... 10 1.10.2. Data Privacy Plan ................................................................................................................... 11 1.10.3. Data Management Plan ......................................................................................................... 11 1.10.4. Independent Evaluation Support Plan .................................................................................. 11 1.10.5. Safety Management Plan ...................................................................................................... 11 2.1. Introduction ........................................................................................................................ 13 2.2. Safety .................................................................................................................................. 14 2.3. Mobility ............................................................................................................................... 15 2.4. Opportunity ........................................................................................................................ 15 2.5. Environment ...................................................................................................................... 15 2.6. Agency Efficiency ............................................................................................................. 15 2.7. Customer Satisfaction ...................................................................................................... 16 3.1. Introduction ........................................................................................................................ 17 3.2. Definition of Confounding Factors ................................................................................. 17 3.3. Study-Area-Specific Factor ............................................................................................. 17 3.3.1. Fuel Prices .............................................................................................................................. 17 3.3.2. Weather .................................................................................................................................. 18 3.3.3. Adjacent Projects ................................................................................................................... 18 3.3.4. Seasonal Traffic ...................................................................................................................... 18 3.3.5. Traffic Incidents ...................................................................................................................... 19 Performance Measurement Plan (PfMP) – Final Report | Smart Columbus Program | v Table of Contents 3.3.6. Underreporting of Crashes .................................................................................................... 19 3.3.7. Penetration Rate .................................................................................................................... 19 3.3.8. User Understanding ............................................................................................................... 19 3.3.9. Signal Timing Updates ........................................................................................................... 20 3.3.10. System Maintenance ............................................................................................................. 20 3.4. Deployment-Specific Factors .......................................................................................... 20 3.4.1. ConOps Non-Operational Conditions ................................................................................... 20 3.4.2. ConOps Maintenance Conditions ......................................................................................... 20 3.4.3. Safety Management Plan ...................................................................................................... 21 3.4.4. Measurement Errors Due to Concurrent Projects to Measure Performance .................... 21 4.1. Introduction ........................................................................................................................ 23 4.2. Design of Experiment ....................................................................................................... 23 4.2.1. Randomized Experiments ..................................................................................................... 24 4.2.2. Quasi-Experimental Design .................................................................................................. 25 4.2.3. Non-Experimental Design ..................................................................................................... 25 4.3. Sample Size Determination ............................................................................................. 27 5.1. Introduction ........................................................................................................................ 29 5.1.1. Performance Measurement Background ............................................................................. 29 5.1.2. Purpose of Performance Measurement ............................................................................... 29 5.2. Performance Measurement and Evaluation Terminology .......................................... 29 5.2.1. Introduction ............................................................................................................................. 30 5.2.2. Logic Model ............................................................................................................................ 30 5.2.3. Outcomes ............................................................................................................................... 30 5.2.4. Project-Specific Confounding Factors .................................................................................. 32 5.2.5. Project Costs .........................................................................................................................