Independent External Evaluation of the Joint Financing Arrangement II (JFA-II) Support of Pooled Fund Partners to the 2010-2012 ECA Business Plan November 2012 Evaluation Team 1. HAILESELASSIE Teklehaimanot (Lead Consultant) Doctor of Philosophy in Education, M.A. in Geography (Regional Planning), B.A. in Education, Geography Major and Psychology minor 2. MOLUTSI Patrick Dibere Peace Doctor of Philosophy in Sociology Master of Philosophy in Sociology B. A History and Sociology Postgraduate Diploma in Population Studies Diploma in Public International Law Diploma in Education 3. FOMBAD Rudolf Bayong Doctor of Philosophy in Agriculture, Master of Science in Agricultural Biochemistry and Nutrition, Bachelor of Science in Biochemistry ACKNOWLEDGEMENTS Many people have contributed differently to this Evaluation and its Report. First we would like to express our gratitude to the United Nations Economic Commission for Africa (ECA) and the members of the Joint Financing Arrangement (JFA) for giving us this opportunity to undertake this evaluation. Many people around Africa could have been chosen to do it but were not. It was a privilege and honour that we deeply appreciate. This exercise was both insightful and educational to us. Our deepest appreciation goes to the different people from different governments and organizations who gave so generously of their precious time to respond to our long questions. We were amazed by the willingness of all those we met to go an extra hour to speak to us sometimes till the late hours of the day. This spirit of giving and readiness to assist ran across a wide spectrum of our respondents from those in Addis Ababa – AUC, ECA, JFA partners to Ministers of the Governments of the Republics of Ethiopia and Rwanda to officials of government and regional organizations in the countries visited and to the civil society organizations that we met in the field. We thank them all. The work of evaluation would have been very difficult without the highly professional and efficient steering and support services of Mr. Anthony Nwanze and his hardworking team in the Partnerships and Technical Cooperation Office (PATCO) of ECA. Planning and execution of the evaluation fieldwork was superb and the day to day administrative support was incredible. Many of the staff of the Office even sacrificed their family time on the weekends to assist the team with printing and related support services. We thank you all and hope that the quality of this Report march the amount of time you put into it. We thank the staff of the UNECA library in Addis Ababa who had to put up with these three strangers who were always coming in and out at odd hours and demanding this and that of their time. Finally, this Report was written with the positive spirit of contributing to the goal of Africa’s development. The achievement of this goal requires honesty and frankness – the values which hope this Report manifests. We thank you all. The Evaluation Team Contents Executive Summary ..................................................................................................................... Error! Bookmark not defined. Chapter 1: Background ................................................................................................................................................................ 1 Chapter 2: Evaluation Analytical Framework and Methods ......................................................................................................... 3 2.1 Objectives of the Evaluation .............................................................................................................................................. 3 2.2 The Scope .......................................................................................................................................................................... 3 2.3 Analytical Framework and Evaluation Criteria .................................................................................................................. 3 2.4 Evaluation Design: Sampling of Countries and Sub-programmes ..................................................................................... 7 2.5 Sources and Types of Data ................................................................................................................................................. 9 2.6. Data analysis and Triangulation ...................................................................................................................................... 10 2.7 Limitations of Evaluation ................................................................................................................................................. 11 Chapter 3: Evaluation Findings and Analysis ............................................................................................................................. 13 3.1 Macroeconomic Analysis, Finance and Economic Development and NEPAD ............................................................... 14 3.2 Regional Integration, Trade and Infrastructure ................................................................................................................ 20 3.3 Sub-programme on Promoting Good Governance and Public Administration ................................................................ 27 3.4 Sub-programme on Gender Equality and Social Development ........................................................................................ 34 3.5 Evaluation of the JFA Partnership ................................................................................................................................... 41 Chapter 4: General Conclusions, Lessons Learnt and Recommendations .................................................................................. 47 4.1 Conclusions ...................................................................................................................................................................... 47 4.2 Lessons Learnt ................................................................................................................................................................. 50 4.3 Recommendations ............................................................................................................................................................ 50 Bibliography ............................................................................................................................................................................... 52 ANNEX I: Terms of Reference .................................................................................................................................................. 55 Annex II: Analytical Framework ................................................................................................................................................ 60 Annex III: Schedule of Activities ............................................................................................................................................... 65 Annex IV: PROTOCOL 1 - SAMPLING GUIDE ...................................................................................................................... 66 Annex V: PROTOCOL 2 IN-DEPTH DISCUSSION GUIDE ................................................................................................... 67 ANNEX VI: PROTOCAL 3 TO BE ANSWERED BY GENERAL STAKEHOLDERS TO THE PROGRAMME ................. 81 ANNEX VII: PROTOCOL 4 DISSEMINATION OF ECA FLAGSHIP PUBLICATIONS AND OTHER IMPORTANT DOCUMENTS ........................................................................................................................................................................... 87 ANNEX VIII: PROTOCOL 5 A GUIDE OF FOCUS GROUP DISCUSSIONS WITH ECA SUB-PROGRAMME BENEFICIARIES ....................................................................................................................................................................... 91 ANNEX IX: PROTOCOL 6 FOR JFA DEVELOPMENT PARTNERS.................................................................................... 92 ANNEX X: PROTOCOL 7 PARTNERSHIP AND TECHNICAL COOPERATION OFFICE (PATCO) ................................ 96 ANNEX XI: Availability of Minimum Expected ECA Flagship Publications in Higher Education Institution Libraries .......... 98 ANNEX XII: Availability of Minimum Expected ECA Flagship Publications in Non-Higher Education Libraries ............... 100 ANNEX XIII: Availability of Minimum Expected ECA Flagship Publications in the Hands of Other Individual Officials & Experts (9 Respondents) ........................................................................................................................................................... 102 ANNEX XIV: List of people contacted during the field trip .................................................................................................... 104 Tables Table 1: Volume of JFA Investment by Thematic Area (US $ million) ............................................................................................... 2 Table 2: DAC Criteria and Key Evaluation Questions ........................................................................................................................ 6 Table 3: List of selected countries by selection criteria .................................................................................................................... 8 Table 4: Types of Tools by Respondents ..........................................................................................................................................