Final Evaluation Report.Pdf
Total Page:16
File Type:pdf, Size:1020Kb
Fall 08 FINAL EVALUATION Serbia Thematic window Conflict Prevention & Peace Building Programme Title: Promoting Peace Building in Southern Serbia May Prepared by: 2013 A consortium of evaluators under supervision of TARA IC d.o.o, Novi Sad Prologue This final evaluation report has been coordinated by the MDG Achievement Fund joint programme in an effort to assess results at the completion point of the programme. As stipulated in the monitoring and evaluation strategy of the Fund, all 130 programmes, in 8 thematic windows, are required to commission and finance an independent final evaluation, in addition to the programme’s mid-term evaluation. Each final evaluation has been commissioned by the UN Resident Coordinator’s Office (RCO) in the respective programme country. The MDG-F Secretariat has provided guidance and quality assurance to the country team in the evaluation process, including through the review of the TORs and the evaluation reports. All final evaluations are expected to be conducted in line with the OECD Development Assistant Committee (DAC) Evaluation Network “Quality Standards for Development Evaluation”, and the United Nations Evaluation Group (UNEG) “Standards for Evaluation in the UN System”. Final evaluations are summative in nature and seek to measure to what extent the joint programme has fully implemented its activities, delivered outputs and attained outcomes. They also generate substantive evidence-based knowledge on each of the MDG-F thematic windows by identifying best practices and lessons learned to be carried forward to other development interventions and policy-making at local, national, and global levels. We thank the UN Resident Coordinator and their respective coordination office, as well as the joint programme team for their efforts in undertaking this final evaluation. MDG-F Secretariat The analysis and recommendations of this evaluation are those of the evaluator and do not necessarily reflect the views of the Joint Programme or MDG-F Secretariat. F I N A L E V A L U A T I O N - REPORT- May 2013 Prepared by A consortium of evaluators under supervision of TARA IC d.o.o, Novi Sad The views expressed are those of the author and do not necessarily reflect those of the UN Agencies involved in the Programme. This report has been prepared as a result of an independent assessment by the consultants. PREFACE This Final Evaluation covers assistance to the efforts of the Republic of Serbia by the Peace Building and Inclusive Development Programme (PBILD), implemented by the United Nations and funded by the Government of Spain under the Spanish MDG Achievement Fund (MDG-F), and the Governments Norway, Sweden and Switzerland under The Multi-Donor Trust Fund (MDTF). The evaluation team is grateful to the many people who contributed to this report and wishes to acknowledge the time taken by all who were able to meet us during the field mission, despite many competing and often urgent demands. We also particularly want to thank the core staff of the Joint Programme who gave us their time and insights. They made our work significantly easier. We appreciate and celebrate the spirit of openness and constructive engagement encountered in all of our meetings. Many thanks to all who granted us their valuable time and insights during the interviews. GLOSSARY OF ACRONYMS ADA Austrian Development Agency ALIE Active learning for Inclusive education ALMP Active labour market programme BEP Business Enabling Project CAC Citizens’ Assistance Centre CB Coordination Body CBC Cross Border Cooperation CBT Competency based training CC Collective Center CREAM Clear, Relevant, Economic, Adequate, Monitored CRJPO Center for development of Jablanicki and Pcinjski Districts CSO Civil Society Organizations CSW Centers for Social Work DS Democratic Party GDP Gross Domestic Product HQ Headquarters IDP Internally Displaced Person ILO International Labour Organization IOM International Organization for Migration IPA Instrument for Pre-Accession Assistance IRB Independent Regulatory Bodies JP Joint Programme JPMU Joint Programme Management Unit LAP Local Action Plan LED Local Economic Development LSG Local Self Government M&E Monitoring and Evaluation MDG Millennium Development Goal MDG-F Millennium Development Goal Achievement Fund MDTF Multi Donor Trust Fund MERD Ministry of Economy and Regional Development MIR Municipal Improvement and Revival Program MoH Ministry of Health MoYS Ministry of Youth and Sport MPALSG Ministry of Public Administration and Local Self-Government MPTF Multi-Partner Trust Fund MRDLSG Ministry of Regional Development and Local Self-Government NES National Employment Service NGOs Non-governmental organizations NMC National Minority Council NSC National Steering Committee ODA Official Development Assistance PHC Primary health care centre PMC Programme Management Committee PMU Programme Management Unit PRAG Practical Guide to Contract Procedures PRSP Poverty Reduction Strategy Paper PSC Programme Steering Committee RDA Regional Development Agency RHM Roma health mediators RTC Regional Training Centers RWG Regional Working Groups SAI State Audit Institution SCILD Strengthening Capacity for Local Inclusive Development SDC Swiss Agency for Development and Cooperation SIDA International Development Cooperation Agency of Sweden SLED Sustainable Local Economic Development SMART Specific, Measurable, Attainable, Relevant, Time-related SNP Serbian Progressive Party SORS Statistical Office of the Republic of Serbia SPS Socialist Party of Serbia ToR Terms of Reference UNCT UN Country Team UNDAF United Nations Development Assistance Framework UNDP United Nations Development Programme UN-HABITAT United Nations Human Settlements Programme UNHCR United Nations High Commissioner for Refugees UNICEF United Nations Children’s Fund USAID United States Agency for International Development WG Working Group YC Youth Club YO Youth Office Table of Contents GLOSSARY OF ACRONYMS PREFACE EXECUTIVE SUMMARY ………………………………………………………………………………….. 1 1. INTRODUCTION ………………………………………………………………………………………….. 4 1.1 PBILD background information and review of implementation ……………………….. 4 1.2 Description of the evaluation ………………………………………………………………………….. 9 2. PRESENTATION OF FINDINGS .......................................................................... 12 2.1 Relevance and strategic fit .................................................................................. 12 2.2 Validity of design .................................................................................................. 14 2.3 Progress and effectiveness .................................................................................. 19 2.4 Efficiency of resource use and effectiveness of management arrangements ..... 30 2.5 Impact orientation and sustainability ................................................................... 34 3. CONCLUSIONS ………………………………………………………………................................ 43 3.1 Relevance and Design ………………………………………………................................. 43 3.2 Efficiency and Implementation ………………………………………………………………………… 46 3.3 Effectiveness and Impact ………………………………………………………………………………… 48 3.4 Sustainability ………………………………………………………………………………………………….. 53 4. LESSONS LEARNED .......................................................................................... 55 5. RECOMMENDATIONS ………………………………………………………………………………….. 58 6. ANNEXES ........................................................................................................ 61 Annex 1. PBILD Final Evaluation Terms of Reference Annex 2. Documents for desk study Annex 3. PBILD Programme Monitoring Framework per 01 March 2013 Annex 4. Evaluation matrix Annex 5. List of interviews Annex 6. Sampling table Annex 7. Overview of undertaken sustainability supporting measures Annex 8. Donor contributions Annex 9. Synergies with other donors Annex 10. Development Context PBILD Peace Building and Inclusive Local Development 1 Final Evaluation Report Executive summary The “Peace Building and Inclusive Local Development Program” (PBILD) is a joint UN initiative, implemented in Southern Serbia in the period of 2009-2013. It consists of two projects: “Strengthening Capacity for Inclusive Local Development in South Serbia” (SCILD), financed by the Government of Norway, the International Development Cooperation Agency of Sweden (SIDA) and the Swiss Agency for Development and Cooperation (SDC) through the Multi Donor Trust Fund (MDTF); and “Promoting Peace Building in South Serbia” (PB), sponsored by the Government of Spain through the Millennium Development Goal Achievement Fund (MDG-F). Six participating agencies – UNDP, UN-HABITAT, UNICEF, UNHCR, IOM and ILO implemented the program activities. The Program worked in partnership with the Ministry for Public Administration and Local Self-Government, Ministry of Finance and Economy; Ministry of Health; Ministry of Education, Science and Technological Development; Ministry of Labor, Employment and Social Policy; Ministry of Youth and Sports; institutions such as the Coordination Body, the Ombudsperson’s office, Commissariat for refugees and IDPs, 11 municipalities and 2 cities in the region, social service providers and a range of social agents from civil society, private sectors, other international and local organizations and citizens. By implementation of the PBILD in a form of an integrated program, the UN responded to several fundamental issues currently existing in the Southern Serbia. The Southern Serbia refers to the 13 municipalities of the Pcinja and Jablanica