Cities Alliance Country Programme Eval 2017
Total Page:16
File Type:pdf, Size:1020Kb
Programme Evaluation of Cities Alliance Country Programmes Ghana, Uganda and Vietnam February 2017 Contents Executive summary 3 Vietnam 80 Introduction 4 Introduction 81 Methodology 4 Relevance 86 Recommendations 4 Effectiveness 90 Key Findings 5 Efficiency 98 Sustainability 102 Introduction 8 Partnership 104 Objectives And Scope of the Evaluation 10 Conclusion 106 Structure of the Report 10 Cities Alliance 11 Cross country findings 108 Relevance 110 Methodology 14 Effectiveness 111 Evaluation Framework 15 Efficiency 112 Primary and Secondary Data Collection 17 Sustainability 112 Synthesis and Analysis of Findings 19 Partnerships 113 Methodological limitations 19 Conclusion 114 Ghana 21 Introduction 22 Recommendations 116 Relevance 28 Effectiveness 33 Appendices 121 Efficiency 40 Appendix 1 - List of Abbreviations 122 Sustainability 44 Appendix 2 - Glossary 123 Partnerships 46 Appendix 3 - Satisfaction levels 124 Conclusion 48 Appendix 4 – The initial Evaluation Framework and Indicators 125 Uganda 50 Appendix 5 - Cities Alliance Tier Two Corporate Introduction 51 Scorecard Dashboard 128 Relevance 58 Appendix 6 - Ghana 129 Effectiveness 62 Appendix 7 - Vietnam 130 Efficiency 70 Appendix 8 - Reading List 131 Sustainability 74 Partnerships 76 Conclusion 78 2 | Programme Evaluation of Cities Alliance Country Programmes - Ghana, Uganda and Vietnam Executive summary Vietnam 80 Introduction 81 Relevance 86 Effectiveness 90 Efficiency 98 Sustainability 102 Partnership 104 Conclusion 106 Cross country findings 108 Relevance 110 Effectiveness 111 Efficiency 112 Sustainability 112 Partnerships 113 Conclusion 114 Recommendations 116 Appendices 121 Appendix 1 - List of Abbreviations 122 Appendix 2 - Glossary 123 Appendix 3 - Satisfaction levels 124 Appendix 4 – The initial Evaluation Framework and Indicators 125 Appendix 5 - Cities Alliance Tier Two Corporate Scorecard Dashboard 128 Appendix 6 - Ghana 129 Appendix 7 - Vietnam 130 Appendix 8 - Reading List 131 Executive Summary | 3 Introduction Methodology Cities Alliance is a global partnership for The evaluation was conducted over poverty reduction and the promotion 16-weeks, from September 2016 to January of sustainable development in cities, 2017. An evaluation framework and hosted by the United Nations Office for indicators were determined leveraging the Project Services (UNOPS) (Cities Alliance, Organisation for Economic Co-operation 2016). Launched in 1999 jointly by the and Development’s (OECDs) pillars of World Bank and UN-Habitat, the Cities Relevance, Effectiveness, Efficiency Alliance provides technical and financial and Sustainability, in conjunction with assistance to address urban poverty Cities Alliance’s Results Framework in developing countries. To help gauge and input from key stakeholders. The the effectiveness—and highlight the report also includes a separate pillar success—of its efforts, Cities Alliance on Partnerships, a core indicator of the commissioned an independent evaluation of effectiveness of the programmes. Primary the first wave of its Country Programmes, data was collected through visits to each which included Ghana, Uganda and country, interviews and surveys, and was Vietnam. The evaluation sought to inform supplemented by secondary data from future strategies and programming by project documentation. All findings were investigating the existing processes and synthesized and analysed to produce their performance in the field. Additionally, recommendations per country and pillar. the evaluation could help promote a common understanding of the programmes, while fostering dialogue regarding their assumptions, modalities and achievements among both beneficiaries and a wider international audience. Recommendations The evaluation found that Cities Alliance Relevance • Perform detailed country reviews. has a viable opportunity to advance its • Sequence and connect projects in the programme design. Country Programmes by leveraging the momentum generated, and lessons learned, • Adapt the approach to address during the first wave in Ghana, Uganda and new challenges. Vietnam. Cities Alliance should continue to Effectiveness • Select best-for-purpose partners. work through partnerships to strengthen the urban agenda. Moreover, it should • Develop in-country capacity. continue with its Country Programmes to Efficiency • Ensure Cities Alliance presence on the ground. help improve programme management and • Improve grant mechanisms. sustainability in the countries in which it operates. Sustainability • Implement a long-term programmatic approach. • Streamline the monitoring and evaluation processes. Partnerships • Engage partners outside Cities Alliance. • Engage the private sector. • Increase knowledge sharing. 4 | Programme Evaluation of Cities Alliance Country Programmes - Ghana, Uganda and Vietnam Key Findings All three Country Programmes were found to respond to as having played a prominent role in encouraging a national and international priorities; and to align with the bottom-up approach to urban development, with its objectives defined in the Country Programme Framework. participatory approach helping enable grassroots community This was due in part to Cities Alliance working closely with organisations to collaborate with national governments local governments and partners to design the work. The and international donors, empowering communities, and Relevance Ghana Programme focused on advocacy-based initiatives providing them with a voice in the urban agenda. The Did the projects to develop public awareness of urban issues, whereas in evaluation also found that the key contributions from Cities respond to external Uganda and Vietnam, the focus was primarily on policy Alliance (other than funding), centred on the provision of priorities, and did they development. Although the programmes were tailored technical assistance, coordination support and international align to the Country to each country, they were all designed to foster active experience. Partner organisations agreed that the same Programme objectives? citizenship involvement, support access to services and help level of outputs, over the same timeline, could not have develop policies for cities. Cities Alliance was acknowledged been achieved without the support of Cities Alliance. A total of 87 percent (122 out of 140) of all project to be heard at the political level. Local capacity has also activities were completed across four areas: National been developed through training, partnering, knowledge Policies, Local Strategies and Plans, Citizen’s Engagement production, sharing and exchange. and Capacity Development. All three countries are now in possession of an inclusive National Urban Policy. Effectiveness Uganda and Vietnam have developed effective Municipal Did the projects Development Strategies to plan and prepare their cities achieve the objectives for future urban development. Citizen’s engagement has defined in the Country increased through savings groups, forums and profiling Programme Framework? exercises, and the urban poor now have opportunities All three Country Programmes were found to have one of coordination. Programme management support appropriate structure and management capabilities in was found to be most efficient where Cities Alliance had place to deliver objectives. Cities Alliance helped enable its own human resource in-country for the duration of a participatory approach in each country by initiating the programme, reducing the reliance on local partners governance mechanisms such as National Urban Forums, for coordination (for example in Vietnam). Funding and Efficiency Advisory Groups and Programme Steering Committees. proposal processes were seen as transparent by most. However, the extent to which these mechanisms were However, a shift from The World Bank to United Nations Did the projects have the appropriate effective was largely reliant upon coordinating partners. Office for Project Services (UNOPS) in 2013 may have structure and hindered proposal processes due to a transition to For example, in Ghana, the Steering Committee was management new procedures and the need to redevelop grant legal capabilities in place to found to be less effective and efficient than in the other arrangements. On average, across all three countries, the deliver their objectives? countries due to limited local partner capacities. In both time from proposal submission to the first disbursement Ghana and Uganda, Cities Alliance was perceived as of funds was 249 days. fulfilling more of expert role and facilitating role than The evaluation found that the continuation of results leveraged and scaled the Municipal Development Forums; and outcomes may suffer from a lack of funding and and Ghana is rolling out the participatory National capabilities in-country. All partners would need additional Urban Forum to its municipalities. However, stakeholders funding and capacity development in order to sustain indicate that replication is reliant on in-country funding project outcomes. The projects found to be the most and capacity. Collaboration with Cities Alliance has Sustainability sustainable were those where follow-on funding and provided partner organisations and recipients with an synergies with other large international programmes had existing platform and strong credential that they can Will the results and outcomes of the already been secured. The replicability of mechanisms use to secure further work, thereby creating a multiplier projects continue and projects within the Country Programme