Independent Country Programme Evaluation
Total Page:16
File Type:pdf, Size:1020Kb
INDEPENDENT COUNTRY PROGRAMME EVALUATION OF UNDP CONTRIBUTION: INDONESIA ANNEXES United Nations Development Programme Independent Evaluation Office Contents Annex 1. Progress towards outcomes and outputs in results and resources framework ........................... 3 Annex 2. Indonesia ICPE Terms of Reference ............................................................................................. 35 Annex 3. List of people consulted .............................................................................................................. 44 Annex 1. Progress towards outcomes and outputs in results and resources framework Outcome 1. BY 2020, MORE VULNERABLE, LOW-INCOME AND FOOD-INSECURE PEOPLE HAVE AN ADEQUATE STANDARD OF LIVING AND EQUITABLE ACCESS TO DECENT WORK, SUSTAINABLE LIVELIHOODS, ECONOMIC DEVELOPMENT AND INCOME-EARNING OPPORTUNITIES. Outcome indicators Indicator-1.1: Papua Province poverty rate Outcome resources Estimated in CPD: $6.1 [$1.1 (regular), $5.0 (other)] Indicator-1.2: West Papua Province Poverty Rate ($m) Indicator-1.3: Papua Province Gini Index Expenditure to date: $1.5 [$0.7 (regular), $0.8 (other)] Indicator-1.4: West Papua Province Gini Index Level of influence on Marginal, cannot attribute. Estimated outcome: Significant shortfall on estimate outcome indicators CPD Output CPD Output IEO Assessment IEO Progress Other significant Key Focus and impact on gender Key interventions including Expenditure Indicators of UNDP rating contributions challenges/risks equality estimated value and 2016–19 ($m) influence on implementation period. output indicators Output 1.1: Local # of people with Insufficient Off track UNDP plays a Heavy reliance on GEN0: 0% - Tanah Papua Platform $1.5 governments and improved incomes evidence/low level strategic, important core funding for GEN1: 0% (TPP), 2015-2018, [$0.6; communities have enhanced through sustainable of influence. Cannot assess and valued role as programming, GEN2: 61% $0.2 (Regular) $0.4 (Other)] $0.7 (regular), capacity to design and productive activities, UNDP Chair of the Papua combined with GEN3: 39% - PIP - Support Papua and $0.8 (other) West Papua through LED, implement sustainable disaggregated by sex performance Platform, which sits declining donor 2016-2019, [$0.46; livelihood programmes and small against agreed under the Papua Desk support. Justification for Gender $0.45(Regular) $0.01(Other)] (Papua and West Papua). landholders. output. in the National marker ratings. - PIP- Papua Platform for Planning Agency CO should revise # local governments Acceleration of Sustainable (BAPPENAS), and is output description - Appears exaggerated. Not Development, 2018-2019, in targeted regions expected to facilitate and indicators so justified by available [$0.44; $0 (Regular) that have established coordination and they better capture performance reports. $0.44(Other)] local economic communication among value created by development development actors UNDP’s work in Evidence of gender equality agencies or and programmes in Papua and West outcomes. programmes to foster Papua and West Papua Provinces. growth, increase Papua. UNDP - Modest: Supported launch of a access to credit and local government gender-based provides technical support violence prevention programme assistance to the farmers/small in Papua, but level of attribution Papua Desk in entrepreneurs. to project is not clearly BAPPENAs and to the established. Indonesia Regional Development Planning Agency (BAPPEDA) and to the province of West Papua. Supporting evidence - Indonesian Government and donors provided positive feedback on UNDP support. - Performance reports outline a range of activities that are relevant to the needs of Papua and West Papua. - The CO initially had a local economic development (LED) initiative pipeline in Papua to be funded by the provincial/district government financing agreement, which did not materialise due to restrictions in government rules and regulation on subnational government financing to international organizations. Self-assessed performance Not available data Adequacy of supporting - Not adequate. evidence - Limited supporting evidence provided. Three project documents covering work in this area do not provide a clear framework for UNDP programming or strategy in Papua, and only one performance report has been provided. - No evaluations were available covering work under this output. Outcome 2. BY 2020, THE POOR AND MOST VULNERABLE HAVE BETTER AND MORE EQUITABLE ACCESS TO QUALITY BASIC SOCIAL SERVICES, INCLUDING HEALTH AND EDUCATION, AND TO COMPREHENSIVE SOCIAL PROTECTION AND BETTER ACCESS TO WATER SUPPLY AND SANITATION. Outcome indicators Indicator-2.1: Human Development Index, Outcome resources Estimated in CPD: $2.7 [1.4$ (regular), 1.3$ (other)] Indicator-2.2: Gender Development Index ($m) Indicator-2.3: National poverty rate Expenditure to date: $11.2 [$0.8 (regular), $10.4 (other) Indicator-2.4: % of the population registered in the Social Health Insurance scheme, disaggregated by sex Estimated outcome: Significant excess on estimate. Indicator-2.5: Percentage of provincial governments that have scored B (= good, 65%-75%) or above in the Government Institution Performance Accountability Report ('LAKIP') Level of influence on Marginal, cannot attribute. outcome indicators OUTPUT OUTPUT LEVEL OF IEO Progress Other significant Key challenges/ Focus and impact on gender Key interventions, including Expenditure INDICATORS INFLUENCE ON rating contributions risks equality estimated value and 2016–19 ($m) STATED OUTPUT implementation period. INDICATORS Output 2.1. Subnational Output Indicators: Insufficient Off track Successfully promoted- Frameworks for GEN0: 1% - PIP - SDGs Localization $3.2 authorities have improved evidence/low level recognition of the implementation of GEN1: 43% Programme in Indonesia, % of subnational financing, of influence Cannot assess importance of the projects supporting GEN2: 56% 2018-2019, [$0.8; $0.6 (regular), budget in targeted implementation/monitoring of UNDP SDGs as a universal achievement of this GEN3: 0% $0(Regular) $0.8(Other)] $2.6 (other) regions allocated for output are short - PIP - Tech. Assistance Millennium Development performance objective, and one basic health and term and future SDGs Implementation in Goals/sustainable against agreed through which policy Justification for Gender education services. funding is Indonesia, 2017-2019, development goal output. development and marker ratings. Baseline(2014): 4% uncertain. [$0.75; $0.15(Regular) $0.6 acceleration programmes debate in Indonesia Target: 30% - Funding capacity (Other)] and delivery of basic can be usefully does not match - Mixed evidence, but from services framed. available designs and project Percentage of Supported local stated CPD reporting, attribution of - RBAP Pipeline Development sustainable planning in three aspirations. expenditure exaggerates Fund, 2016-2019, [$0.6; development goal provinces, with micro - Challenge to gender focus of the output. $0.4 (Regular) $0.2 (Other)] action plans and projects at the district assess extent to - Achieving 2030 Agenda for which support is Sustainable Development in goal-related level focused on waste Evidence of gender equality resulting in more AP, 2018-2021, [$0.6; $0 acceleration management and outcomes. effective policies or (Regular) $0.6 (Other)] frameworks that are agriculture. programmes. - PIP - SDG Support - 2018: None reported at least 70% funded - Scalability of micro- Programme, 2016-2019, - 2017: Women’s representation Baseline(2014): 0% projects is not clear, [$0.4; $0 (Regular) $0.4 in SDG secretariat structure in and documentation (Other)] Target: 80% one province cited as only of results is achievement. probably not of - 2016: Cites SDGs inclusion sufficient quality to principle applied by SDG support scaling up. national secretariat as sole - CO should revise result. output description and indicators so they better capture value created by UNDP’s work on SDG mainstreaming. Supporting evidence - Support for the SDG’s secretariat in Bappenas towards: o Development and launching of National Action Plan o Development of Indonesia SDG Roadmap towards 2030 o Development of SDG Monitoring and Evaluation Framework targeting Non-state Actors, and o Development of SDG Communication Strategy. o Delivery of second Voluntary National Review at the July 2019 High Level Political Forum. - Support for local planning in three provinces, including implementation of micro projects at the district level focused on waste management and agriculture. - Exploration of potential to encourage innovative financing instruments to underpin SDG achievement o Establishment of a small grant funded partnership with BAZNAS (the national zakat board of Indonesia) to harness zakat, and Bank Jambi to implement a micro hydro power plant benefitting over 5,000 people from 800 families in four poor villages. o Support through secretariat to implementation of SDG at sub national level and directly with one province through funding from the Tanoto foundation. o Micro project, jointly with ILO and UNESCO to explore potential to mobilise innovative financing for SDGs, specifically to promote equal access to quality education and skills development. Self-assessed performance None available data Adequacy of supporting - Not adequate. evidence - Limited project progress reporting available. The number of frameworks and agreements through which support has been provided makes it difficult to understand UNDP’s long-term strategy