Evaluation Report Final
Total Page:16
File Type:pdf, Size:1020Kb
Final Evaluation - Technical Assistance for Sub-National Capacity Building in Payroll and PFM (EUTAPP) for partner Country South Sudan 2015/370804 EVALUATION REPORT FINAL 15th June 2016 This project is funded by A project implemented by AECOM The European Union International Development Europe SL The contents of this publication are the sole responsibility of AECOM International Development Europe SL and can in no way be taken to reflect the views of the European Union. Final Evaluation – Technical Assistance for Subnational Capacity Building in Payroll and PFM (EUTAPP) Final Evaluation Report 2015/379804 By Mr Hans Bjørn Olsen (TL) Mr James Onyoin Mr Wilson Baryabanoha Presented by AECOM International Development Europe SL (Spain) 3 Final Evaluation – Technical Assistance for Subnational Capacity Building in Payroll and PFM (EUTAPP) 4 Final Evaluation – Technical Assistance for Subnational Capacity Building in Payroll and PFM (EUTAPP) TABLE OF CONTENTS GLOSSARY OF ACRONYMS ................................................................................................ 7 ACKNOWLEDGEMENT ....................................................................................................... 9 EXECUTIVE SUMMARY .................................................................................................... 10 1. INTRODUCTION ....................................................................................................... 15 1.1 Evaluation Team and Methodology ......................................................................................................... 15 1.2 Background and Context .......................................................................................................................... 16 2. OVERALL FINDINGS ON EUTAPP ............................................................................... 18 2.2 Findings on Relevance and Coherence ..................................................................................................... 18 2.3 Findings on Effectiveness ......................................................................................................................... 19 2.4 Findings on Efficiency ............................................................................................................................... 21 2.5 Findings on Impact and Sustainability ...................................................................................................... 22 2.6 Findings on EU added value ..................................................................................................................... 23 3. OVERALL ASSESSMENT ............................................................................................ 24 3.1 Assessment on PFM and Payroll capacity building ................................................................................... 24 3.2 Assessment on institutional anchorage and changes ........................................................................ 25 3.3 Assessment on programme management and coordination .................................................................... 29 4. CONCLUSIONS, LESSONS AND RECOMMENDATIONS ................................................ 31 4.1 Conclusions .............................................................................................................................................. 31 5 Final Evaluation – Technical Assistance for Subnational Capacity Building in Payroll and PFM (EUTAPP) 4.2 Key Lessons Learned ................................................................................................................................ 33 4.3 Recommendations ................................................................................................................................... 34 LIST OF ANNEXES ............................................................................................................ 36 Annex 1: Terms of Reference ......................................................................................................................... 37 Annex 2: Short Summary of Evaluators .......................................................................................................... 38 Annex 3: Evaluation Approach and Methodology .......................................................................................... 40 Annex 4: Logical Framework and Intervention Logic ...................................................................................... 43 Annex 5: Maps of South Sudan ...................................................................................................................... 47 Annex 6: List of People met ........................................................................................................................... 50 Annex 7: List of Documents Consulted ........................................................................................................... 54 Annex 8: Answers to Evaluation Questions and Judgement Criteria .............................................................. 55 Annex 9: Brief State Visit report – County and CTMC Notes ........................................................................... 75 6 Final Evaluation – Technical Assistance for Subnational Capacity Building in Payroll and PFM (EUTAPP) Glossary of acronyms BSI Budget Support Initiative CB Capacity Building CBTF Capacity Building Trust Fund CES Central Equatoria State CTMC County Transfer Monitoring Committee DP Development Partner ED Executive Director EES Eastern Equatoria State EQ Evaluation Question ET Evaluation Team EU European Union EUD European Union Delegation EUR European Union Currency Technical assistance for sub-national capacity building in payroll and EUTAPP PFM FY Financial Year GATC Government Accountancy Training Centre GESS Girls Education South Sudan GRSS Government of Republic of South Sudan HoD Heads of Department HPF Health Pooled Fund HR Human Resource HRO Human Resource Officer HSSP Health Systems Strengthening Project IDCBP Institutional Development and Capacity Building Project JC Judgement Criteria JPA Joint Plan of Action LG Local Government LGB Local Government Board LGSDP Local Government Service Delivery Programme LGPFMM Local Government Public Finance Management Manual LOGOSEED Local Government and Service Delivery Project LKS Lakes State LSSAI Local Service Support Aid Instrument KPI Key Performance Indicators M&E Monitoring and Evaluation MoFEP Ministry of Finance and Economic Planning MoLPS Ministry of Labour, Public Service & Human Resources NBGS Northern Bar el Ghazal State OJT On-the-job training PEFA Public Expenditure and Financial Accountability Assessment PFM Public Finance Management QPR Quarterly Project Report QBPR Quarterly Budget Performance Report SBC State Building Contract SDF Service Delivery Framework SMoE State Ministry of Education SMoF State Ministry of Finance SMoH State Ministry of Health 7 Final Evaluation – Technical Assistance for Subnational Capacity Building in Payroll and PFM (EUTAPP) SMoLG State Ministry of Local Government SMoLPS&HRD State Ministry of Labour, Public Service and Human Resource Development SMT State Mentoring Team STMC State Transfer Monitoring Committee SSEPS Services for South Sudan Electronic Payroll System SSLA South Sudan Legislative Assembly SSP South Sudanese Pounds TL Team Leader ToR Terms of Reference TWG Technical Working Group UNDP United Nations Development Programme WB World Bank WS Warrap State WBGS Western Bar el Ghazal State WES Western Equatoria State 8 Final Evaluation – Technical Assistance for Subnational Capacity Building in Payroll and PFM (EUTAPP) Acknowledgement The Evaluation Team would like to thank the European Union Office’s Programme Manager Mr Gabriel Dayre and the Operations Manager, Mr Vincent De Boer, as well as the evaluation Reference Group members for their guidance and valuable comments during the various steps of the evaluation process. We would also like to thank the Local Government Board for facilitating the fieldwork of the Evaluation Team and accompanying the team members on the field tr ips. We would also like to thank the EU-TAPP Project Team – whether the Programme management team, the core team in Juba or State based teams - for being available at all times to discuss the issues regarding implementation of EU-TAPP. Last, but not least, we thank all South Sudanese officials met at central, State and County levels, for their valuable time, experience and opinions. 9 Final Evaluation – Technical Assistance for Subnational Capacity Building in Payroll and PFM (EUTAPP) Executive Summary This report presents the results of the evaluation of the European Union Technical Assistance to PFM and Payroll (EU-TAPP) in South Sudan (August 2014 to February 2016). The EU-TAPP project is implemented by ECORYS (Netherlands), and aims at developing the capacity of States and Counties in PFM and Payroll management, in order to contribute to accountability and sustainable local economic development. The Project is implemented in the ten States of South Sudan, but due to the on-going conflict the focus of the interventions was reduced mainly to the so-called 7 non conflict States (Western Equatoria, Eastern Equatoria, Central Equatoria, Warrap, Lakes, Northern Bar el Ghazal and Western Bar el Ghazal States) with each State having a team of two experts dealing with PFM and Payroll. The total budget of the project is EUR 4,495,575 with more than 65% of the total budget spent on technical assistance and the rest