Independent Final Evaluation Report
Total Page:16
File Type:pdf, Size:1020Kb
Independent Final Programme Evaluation Report DFID-funded programme “to improve maternal health and infant survival rates through supporting women and children in Badin District, Pakistan” March 2017 DFID * Cover Picture: A participant from Health Literacy class demonstrating her newly acquired skills to write and fill in a basic form in Village Shevo Kolhi, Badin District. (Photo Credit: GLOW Consultants) AUTHORS This independent final programme evaluation report was commissioned by Feed the Minds and was supported by its partner National Rural Development Programme. It was produced by GLOW Consultants Pvt Limited Pakistan. For further information, please contact Mr. Saeed Ullah Khan ([email protected]). The contact point for Feed the Minds is Ms. Albha Bowe ([email protected]). GLOW CONSULTANTS (PRIVATE) LIMITED SECP Registration No: 0088603 Address: GLOW Consultants Private Limited, 4th Floor, Software Technology Park-1, F 5/1, Islamabad, Pakistan / Phone: +92-51-2828 948 / +92 345 85 75 974 Email us: [email protected] i | P a g e Final Programme Evaluation DFID Figure 1: Discussions with Health Literacy Facilitator belonging to Hindu minority engaged in FTM programme in Badin District, (Photo Credit: GLOW Consultants) PREFACE The evaluation team would like to thank everyone who participated in and supported the undertaking of this evaluation. This includes the communities the team visited as well as the management and field staff of National Rural Development Programme. EVALUATION TEAM Mr. Saeed Ullah Khan (Lead Consultant) Dr. Ejaz Ahmed (Consultant) Mr. Zaki Ullah Khan (Consultant) Dr. Ms. Salma Khalil (Technical Expert) Ms. Sobia Sattar (Consultant); Ms. Qurat Ul Ain Nawaz (Consultant) ii | P a g e Final Programme Evaluation DFID CONTENTS Authors ......................................................................................................................................................... i Preface ........................................................................................................................................................ ii Evaluation Team ......................................................................................................................................... ii Contents ..................................................................................................................................................... iii List of Figures ............................................................................................................................................. v List of Tables .............................................................................................................................................. v List of Key Acronyms ................................................................................................................................. v Executive Summary ................................................................................................................................... vi SECTION 1-INTRODUCTION ................................................................................................................. 1 1.1 Purpose of the Evaluation ........................................................................................................... 1 1.2 Organisation context ................................................................................................................... 2 1.3 Overview of UK Aid Direct funded activities ............................................................................ 2 SECTION 2: EVALUATION METHODLOGY ....................................................................................... 4 2.1 Evaluation Plan ........................................................................................................................... 4 2.1.1 Evaluation Geographical Coverage............................................................................................ 4 2.1.2 Evaluation Inquiry Techniques ........................................................................................... 5 2.1.3 Sample Size for FGDs and KIIs .......................................................................................... 5 2.1.4 Additional Data Sources ......................................................................................................... 6 2.1.5 Gender Consideration ............................................................................................................. 7 2.1.6 Data Collection and Quality Assurance .................................................................................. 7 2.2 Strengths and weaknesses of selected design and research methods .......................................... 7 2.2.1 Strengths ............................................................................................................................. 7 2.2.2 Weaknesses ......................................................................................................................... 7 2.3 Summary of problems and issues encountered ........................................................................... 7 SECTION 3: PROGESS TOWARDS OUTCOMES ................................................................................. 8 3.1.1 Women Health Committees (WHC) ................................................................................... 8 3.1.2 Men’s Support Groups (MSGs) ........................................................................................ 13 3.1.3 Community Midwives (CMs) ........................................................................................... 15 3.1.3 Health Literacy Facilitators (HLFs) .................................................................................. 19 3.1.4 Health Literacy Class Participants .................................................................................... 21 3.1.5 Other Stakeholders ............................................................................................................ 22 3.2 Relevance .................................................................................................................................. 23 3.3 Effectiveness ............................................................................................................................. 25 3.4 Efficiency .................................................................................................................................. 26 3.5 Sustainability ............................................................................................................................. 26 3.6 Impact ....................................................................................................................................... 27 iii | P a g e Final Programme Evaluation DFID SECTION 4: CONCLUSIONS ............................................................................................................... 30 4.1 Summary of achievements against evaluation questions .......................................................... 30 4.2 Summary of achievements against rationale for UK Aid Direct funding ................................. 33 4.3 Overall Impact and Value for Money of UK Aid Direct Funded Activities ............................. 37 SECTION 5: LESSONS LEARNT........................................................................................................... 38 SECTION 6: RECOMMENDATIONS .................................................................................................. 39 6.1 Number of WHC Members ....................................................................................................... 39 6.2 Refresher training of WHC Members ....................................................................................... 39 6.3 Numbers and Membership MSG .............................................................................................. 39 6.4 Capacity Building of MSGs ...................................................................................................... 39 6.5 MSG Support to WHC for Advocacy and Lobby ..................................................................... 39 6.6 Improving Linkages with Government Health Facilities .......................................................... 39 6.7 Training of Community Midwives ........................................................................................... 40 6.8 Refreshers Related to Usage of Smart Phones .......................................................................... 40 6.9 Enhancing Skills/ Qualification Requirement for HLF and Class Duration. ............................ 40 6.10 Capacity Building on Awareness and Lobbying Activities and its Logic ................................ 40 6.11 Policy Level Engagements ........................................................................................................ 41 6.12 Increase Scale of the Programme .............................................................................................. 41 Annex 1 Evaluation Matrix ................................................................................................................... b Annex 2: Programme villages and phases ................................................................................................... e Annex 3: FGD details .................................................................................................................................. j Annex 4: Evaluation