Performance Evaluation of the Women's Leadership
Total Page:16
File Type:pdf, Size:1020Kb
EVALUATION PERFORMANCE EVALUATION OF THE WOMEN’S LEADERSHIP PORTFOLIO November 29, 2018 This publication was produced at the request of the United States Agency for International Development for the E3 Analytics and Evaluation Project. It was prepared independently by Management Systems International, A Tetra Tech Company; and Development and Training Services, a Palladium Company. PERFORMANCE EVALUATION OF THE WOMEN’S LEADERSHIP PORTFOLIO November 29, 2018 Contracted under AID-OAA-M-13-00017 E3 Analytics and Evaluation Project Prepared by: Darcy Ashman, Team Leader (MSI) with Susan Settergren (Palladium), Laurel Bradley (MSI), Amanda Janczak (MSI), Jessica Ngo (MSI), and Nicholas Prichard (Palladium). Cover Photo Captions and Credits: Left: Women in the Philippines participating in legislative advocacy lobbying. Credit: Miriam College – Women and Gender Institute and USAID. Middle: Women in Ethiopia sorting cashews as part of the Agribusiness Leadership Network. Credit: USAID. Right: Female police officers at a training on child marriage and female genital cutting in Ethiopia. Credit: USAID. DISCLAIMER The author’s views expressed in this publication do not necessarily reflect the views of the United States Agency for International Development or the United States Government. ABSTRACT This performance evaluation examines the Women’s Leadership Portfolio (WLP) to help USAID understand the characteristics of the portfolio and how it contributed to the implementation of the USAID Gender Equality and Female Empowerment (GEFE) Policy. The evaluation identifies achievements made by WLP activities and assesses their sustainability. Focusing on a sample of 45 WLP activities, the evaluation team conducted quantitative and qualitative analysis of over 1,000 USAID and implementing partner (IP) documents; telephone interviews with USAID/Washington (USAID/W), mission, and IP staff; and field-based interviews in six countries with local partners and beneficiaries. The evaluation finds that the WLP contributed important GEFE Policy outcomes in strengthening women’s leadership and decision-making in development and in preventing and responding to gender- based violence. The WLP made important, if fewer, contributions to increasing women’s access to productive resources and services. A key WLP achievement was decentralizing the management of WLP activities from USAID/W gender teams to missions and other Agency operating units, which increased USAID’s involvement in implementing gender programming globally. Comprehensive WLP activities with multiple interventions implemented over longer periods achieved more substantial results. The evaluation recommends that USAID/W WLP managers increase the potential impact and sustainability of future activities by focusing on key priorities and selected areas where pivotal gains can be made. WLP managers should allocate scarce resources to fewer, more strategically selected activities with larger budgets for longer periods. Enhanced communication and learning among USAID, its partners, and stakeholders will further enhance results, capacity, and resolve to continue advancing gender equitable development and resilience. Performance Evaluation of the Women’s Leadership Portfolio iii ACKNOWLEDGEMENTS In commissioning this evaluation of the Women’s Leadership Portfolio (WLP), USAID’s Office of Gender Equality and Women’s Empowerment took on a complex challenge similar to the new whole-of- project evaluations that USAID missions are beginning to undertake. Such evaluations seek to better understand the performance of multiple activities in multi-faceted, multi-year efforts to impact important development goals. The WLP has a global reach and engaged many partners in key USAID activities to improve development outcomes through enhanced gender equality and women’s empowerment. Management Systems International (MSI) and Development and Training Services (dTS) appreciate being selected to share in this undertaking through USAID’s E3 Analytics and Evaluation Project. MSI and dTS would like to thank USAID’s activity manager for the evaluation, Niloufer de Silva, whose guidance and active engagement in all phases of the evaluation helped ensure that USAID’s needs and hopes for this study were understood. The team also thanks the many USAID staff, implementing partners, local partners, and beneficiary respondents who contributed time and insights to the evaluation, and to the E3 Analytics and Evaluation Project Contracting Officer’s Representative, Bhavani Pathak, for her support. The authors of this report drew on the collective efforts of many MSI and dTS team members involved in earlier stages of the evaluation, including Molly Hageboeck, Judy Benjamin, Carolyn Fonseca, Aleksandra Markovitch, Grace Fisiy, Max Shanstrom, Maria Covalenco-Tietz, Laura Sinclair, Nurjahan Begum, Alfredo Torres, Yodit Teklemichael, Ben Okeyo, Simeon Runesha, Svitlana Gornaya, Jill Tirnauer, Katherine Jackstadt, Samantha Samuel-Nakka, and Milad Pournik. Performance Evaluation of the Women’s Leadership Portfolio iv CONTENTS Abstract ......................................................................................................................................... iii Acknowledgements ...................................................................................................................... iv Contents ......................................................................................................................................... v Acronyms ..................................................................................................................................... vii Key Terms ....................................................................................................................................viii Executive Summary ..................................................................................................................... xi Introduction ................................................................................................................................... 1 Evaluation Purpose ........................................................................................................................................................ 1 Evaluation Audiences .................................................................................................................................................... 1 Evaluation Questions .................................................................................................................................................... 2 Evaluation Methodology ............................................................................................................... 3 Phases 1 and 2 ................................................................................................................................................................ 3 Selecting a Sample of WLP Activities ....................................................................................................................... 3 Developing the Data Collection Plan and Tools ................................................................................................... 3 Collecting and Analyzing Data ................................................................................................................................... 4 Limitations and Mitigation ........................................................................................................................................... 6 Overview of the Women’s Leadership Portfolio ....................................................................... 6 Findings ........................................................................................................................................ 11 Evaluation Question 1: How did the WLP contribute toward implementing USAID’s GEFE Policy? .... 11 Evaluation Question 2: How did partners support the design, funding, and implementation of WLP activities? ....................................................................................................................................................................... 19 Evaluation Question 3: What are the characteristics, strengths, and weaknesses of WLP interventions? ......................................................................................................................................................................................... 24 Evaluation Question 4: What results were achieved by WLP activities? ...................................................... 32 Evaluation Question 5: To what extent are the WLP activities sustainable? ............................................... 40 Conclusions and Recommendations .......................................................................................... 46 Conclusions .................................................................................................................................................................. 46 Recommendations ...................................................................................................................................................... 48 Annexes ........................................................................................................................................ 53 Annex I: Evaluation Statement of Work ................................................................................................................ 53 Annex II: Evaluation Methodology .........................................................................................................................