INDEPENDENT FINAL EVALUATION JANUARY 2017 Reducing Vulnerability through Disaster Risk Management (DRM) in Khyber Pakhtunkhwa (KPK) Province, Pakistan - Phase 3 Funded by: The Royal Norwegian Embassy By : Zaki Ullah GLOW CONSULTANTS This report was commissioned by Action Against Hunger | ACF International. The comments contained herein reflect the opinions of the Evaluators only. Action Against Hunger Author / Contacts This independent final evaluation of “Reducing Vulnerability through Disaster Risk Management (DRM) in Khyber Pakhtunkhwa (KPK) Province, Pakistan - Phase 3” was commissioned by Action Against Hunger and was produced by GLOW Consultants Private Limited. For further information regarding this study please contact: • Mr. Shahzad Ajmal ([email protected]) at Action Against Hunger Pakistan; or • Mr. Zaki Ullah ([email protected]) at GLOW Consultants. Cover Page Photo Evaluation team member meeting a community representative in Upper Dir. GLOW CONSULTANTS (PRIVATE) LIMITED SECP Registration No: 0088603 Address: GLOW Consultants Private Limited, 4th Floor, Software Technology Park-1, F 5/1, Islamabad, Pakistan / Phone: +92-51-2828 948 / +92 345 85 75 974 Email us: [email protected] i | P a g e R N E I I I D R R P r o j e c t E v a l u a t i o n R e p o r t Action Against Hunger Preface / Acknowledgements GLOW Consultants is pleased to submit this evaluation report to Action Against Hunger Pakistan. The team would like to say thank you to Action Against Hunger team and other stakeholders whose support made this evaluation possible. The team would also like to acknowledge all those who contributed to our data collection efforts. Without their contribution, this evaluation would not have been possible. Disclaimer The views expressed in this evaluation report are those of the GLOW Consultants. They do not necessary represent those of Action Against Hunger or any other institution mentioned in the report. Evaluation Team • Mr. Zaki Ullah – Lead Evaluator • Mr. Saeed Ullah Khan - Co Evaluator • Ms. Aisha Batool – Technical Expert • Mr. Zia Ul Islam – Data Analyst ii | P a g e R N E I I I D R R P r o j e c t E v a l u a t i o n R e p o r t Action Against Hunger Project Summary Reducing Vulnerability through Disaster Risk Project Name Management (DRM) in Khyber Pakhtunkhwa (KPK) Province, Pakistan – Phase 3 Contract Number PAK 3044-14/0009 Partners (if applicable) NA Districts - Charsadda, Nowshera, Dir Lower and Dir Upper. Location Province - Khyber Pakhtunkhwa Country - Pakistan. Sector Disaster Risk Management (DRM) 27 Months (but actual implementation period is Duration 13 months) Starting Date 1st October 2014 Ending Date 31st December 2016 Intervention / Country Office Language English Donor and Contribution Royal Norwegian Embassy Country Office administering the Action Against Hunger Pakistan Programme / Project iii | P a g e R N E I I I D R R P r o j e c t E v a l u a t i o n R e p o r t Action Against Hunger Table of Content Author / Contacts.......................................................................................................................... i Preface / Acknowledgements ...................................................................................................... ii Disclaimer ................................................................................................................................... ii Evaluation Team.......................................................................................................................... ii Project Summary ........................................................................................................................ iii List of Acronyms ......................................................................................................................... v List of Figures ............................................................................................................................ vi List of Tables .............................................................................................................................. vi Executive Summary .................................................................................................................. vii Section 1: Background................................................................................................................- 2 - 1.1 Emergency Context in Pakistan ........................................................................................- 2 - 1.2 Overview of the Project.....................................................................................................- 2 - 1.3 Project Details ...................................................................................................................- 3 - Section 2: Evaluation Approach and Case Study Design ...........................................................- 5 - 2.1 Evaluation Questions.........................................................................................................- 5 - 2.2 Evaluation Approach.........................................................................................................- 5 - 2.2.1 Review of Relevant Documents/Secondary Data ..........................................................- 5 - 2.2.2 Primary Data Collection Tools.......................................................................................- 6 - 2.2.3 Geographical Coverage ..................................................................................................- 6 - 2.2.4 Group Discussions (GDs)...............................................................................................- 8 - 2.2.5 Key Informant Interviews ..............................................................................................- 9 - 2.2.6 Checklists .......................................................................................................................- 9 - 2.2.7 Data Analysis .................................................................................................................- 9 - 2.3 Limitations of the Study ..................................................................................................- 10 - Section 3: Key Findings............................................................................................................- 11 - 3.1 Design..............................................................................................................................- 11 - 3.2 Relevance/Appropriateness:............................................................................................- 14 - 3.3 Coherence........................................................................................................................- 18 - 3.4 Coverage..........................................................................................................................- 19 - 3.5 Efficiency ........................................................................................................................- 20 - 3.6 Effectiveness: ..................................................................................................................- 22 - 3.7 Sustainability and likelihood of impact...........................................................................- 25 - Section 4: Significant Change Stories.......................................................................................- 28 - Section 5: Conclusions..............................................................................................................- 31 - Section 6: Lesson Learnt...........................................................................................................- 35 - Section 7: Recommendations....................................................................................................- 36 - Appendix...................................................................................................................................- 39 - Annexure 1: Good Practice ...................................................................................................- 39 - Annexure 2: Evaluation Criteria Table .................................................................................- 41 - Annexure 3: List of documents for literature review ............................................................- 42 - Annexure 4: List of KIIs .......................................................................................................- 42 - Annexure 5: Data Collection Tools.......................................................................................- 42 - Annexure 6: Revised Logical Framework.............................................................................- 42 - Annexure 7: Evaluation ToRs ...............................................................................................- 42 - Annexure 8: VDMC and Cluster Disaggregated Data ..........................................................- 42 - iv | P a g e R N E I I I D R R P r o j e c t E v a l u a t i o n R e p o r t Action Against Hunger List of Acronyms CBDRM Community Based Disaster Risk Management CBOs Community Based Organizations CDPM Centre for Disaster Preparedness and Management DAC Development Assistance Committee DDMU District Disaster Management Unit DRM Disaster Risk Management DRR Disaster Risk Reduction ERT Emergency Response Team EWS Early Warning System GD Group Discussion IDPs Internally Displaced Persons INGO International Non Government Organization KII