Performance Evaluation of USAID/Serbia and Montenegro’s Preparedness, Planning and Economic Security (PPES) Project September 5, 2012 This Performance Evaluation was prepared for USAID/Serbia & Montenegro by Art Warman, Annika Caldwell and Alexander Grushevsky under Evaluation Services IQC task order AID-169-TO-12-00002 awarded to International Business and Technical Consultants, Inc. (IBTCI). The authors’ views expressed in this evaluation report do not necessarily reflect the views of the United States Agency for International Development or the United States Government. Nuraplast, a USAID PPES-supported company in Presevo DAI photograph PERFORMANCE EVALUATION OF USAID/SERBIA AND MONTENEGRO’S PREPAREDNESS, PLANNING AND ECONOMIC SECURITY (PPES) PROJECT FINAL EVALUATION REPORT Prepared by Art Warman Annika Caldwell Alexander Grushevsky September 5, 2012 This Final Evaluation Report was prepared by International Business and Technical Consultants, Inc. (IBTCI) under Evaluation Services IQC task order AID-169-TO-12-00002. The authors’ views expressed in this report do not necessarily reflect the views of the United States Agency for International Development or the United States Government. Table of Contents ACRONYMS AND ABBREVIATIONS ....................................................................................................................... iii ACKNOWLEDGEMENTS ...............................................................................................................................................v MAP OF PPES ACTIVITIES 2006-2011 .....................................................................................................................vi EXECUTIVE SUMMARY ................................................................................................................................................ vii Findings – Overall .................................................................................................................................................... viii Recommendations – Overall ................................................................................................................................ viii Findings and Recommendations by Component ............................................................................................... ix Component I, Preparedness Planning - Findings and Conclusions ........................................................ ix Component II, Economic Security - Youth Findings and Conclusions .................................................. x Component II, Economic Support - Business Findings and Conclusions .............................................. x Best Practices ............................................................................................................................................................. xi 1.0 . INTRODUCTION ..................................................................................................................................................... 1 1.1 Historical Perspective .................................................................................................................................... 1 1.1.1 Component l: Preparedness Planning ................................................................................................. 1 1.1.2 Component II: Economic Security ...................................................................................................... 1 1.2 Purpose of the Evaluation .................................................................................................................................. 2 1.3 Key Evaluation Questions ................................................................................................................................. 2 2.0 . APPROACH AND METHODOLOGY ................................................................................................................ 3 2.1 Approach........................................................................................................................................................... 3 2.2 Methodology .................................................................................................................................................... 3 2.2.1 Preparedness and Planning ..................................................................................................................... 4 2.2.2 Youth and Business ................................................................................................................................. 4 3.1 Introduction to the Components of PPES ............................................................................................... 5 3.2 Preparedness Planning: Findings, Conclusions and Recommendations .............................................. 5 Overall evaluation findings ................................................................................................................................ 5 Key Evaluation Findings ..................................................................................................................................... 7 Conclusions and Recommendations .............................................................................................................. 9 3.3 Economic Security: Youth Findings, Conclusions and Recommendations ...................................... 10 Overall Evaluation Findings ............................................................................................................................. 10 Key Evaluation Findings ................................................................................................................................... 11 3.4 Economic Security: Business Support Findings, Conclusions and Recommendations .................. 14 Overall evaluation findings .............................................................................................................................. 14 Key evaluation findings .................................................................................................................................... 16 PPES Performance Evaluation: Final Evaluation Report i Conclusions and Recommendations ............................................................................................................ 18 4.0 . GLOBAL FINDINGS, CONCLUSIONS AND RECOMMENDATIONS ................................................ 18 4.1 The Grants Program .................................................................................................................................... 18 4.2 Findings, Conclusions, and Recommendations ...................................................................................... 20 Findings ................................................................................................................................................................ 20 Recommendations ............................................................................................................................................ 20 Best Practice ...................................................................................................................................................... 21 ANNEXES: ........................................................................................................................................................................ 22 ANNEX A: EVALUATION SCOPE OF WORK ..................................................................................................... 22 ANNEX B: SURVEY INSTRUMENTS......................................................................................................................... 27 ANNEX C: INDIVIDUALS AND ORGANIZATIONS CONTACTED ............................................................ 43 ANNEX D: DOCUMENTS REVIEWED .................................................................................................................... 55 PPES Performance Evaluation: Final Evaluation Report ii ACRONYMS AND ABBREVIATIONS ASEE Management Consulting Company for South Eastern Europe BSO Business Support Organization COE Council of Europe DAI Development Alternatives, Inc. DEMA Danish Emergency Management Agency DF Serbian Development Fund DMT Disaster Management Team DPPI Disaster Preparedness and Prevention Initiative DRR Disaster Risk Reduction ES Economic Security IBTCI International Business & Technical Consultants, Inc. IDP Internally Displaced Person IFRC International Federation of the Red Cross JAS Junior Achievement Serbia LES Law on Emergency Situations MOD Ministry of Defense MOI Ministry of Interior MOU Memorandum of Understanding MoYS Ministry of Youth and Sport NAVES National Association for Emergency Situations NES National Employment Service NTC National Training Center OSCE Organization for Security and Cooperation in Europe PMP Performance Monitoring Plan PMT Project Management Team PP Preparedness and Planning PPES Preparedness, Planning and Economic Security Project RCS Red Cross of Serbia RBM Results Based Management RDA Regional Development Agency RRF Results and Resources Framework SCOPES Contingency Planning and Economic Security Program SEDA Sandzak Economic Development Agency SEM Sector for Emergency Management SME Micro, Small and Medium Enterprises SOW Scope of Work SP Service Provider SRC Serbian Red Cross UNDP United Nations Development Program UNISDR United Nations International Strategy for Disaster Reduction USAID/Serbia United States Agency for International Development