Ministry of Foreign Affairs Annual Report on Japan’s ODA Evaluation 2017
Annual Report on Japan’s ODA Evaluation 2017 Ministry of Foreign Affairs
Preface
To secure Japan’s national interests, it is essential for Japan as a “Proactive Contributor to Peace” based on the principle of international cooperation to work together with the international community including developing countries to address global challenges.
In 2016, the first year to implement the “2030 Agenda for Sustainable Development” which was adopted at the United Nations, Japan has established the Sustainable Development Goals (SDGs) Promotion Headquarters, which is headed by the Prime Minister as chair and composed by the entire cabinet members, and has taken the initiative in achieving the SDGs, based on the pledge that “No one will be left behind”, including the aim to eradicate extreme poverty by 2030.
Japan will simultaneously develop “quality infrastructure” by drawing on its expertise and technologies, which in turn will lead to “quality growth” in developing countries, growth of the Japanese economy and community empowerment. It is also essential to implement cooperation that will promote two-way economic growth. In the international community today, a huge amount of private funding flows to the developing countries, and various actors including the private sector, local governments, and non-governmental organizations (NGOs) are involved in global activities. These actors play important roles in dealing with development challenges and promoting sustainable growth in developing countries. Under these circumstances, Japan needs to address such development challenges not only through ODA but also by strengthening collaboration with these various actors.
ODA is an important tool, both for fulfilling Japan’s responsibility in the international community and for promoting the national interests of Japan. Therefore, Japan needs to further evolve ODA. On the other hand, the Government of Japan’s severe fiscal situation and domestic challenges are a reality, meaning ODA often faces harsh criticism. Thus the Ministry of Foreign Affairs (MOFA) has responsibility to carefully explain the activities and significance and results of ODA to the Japanese people, and gain their understanding and support in making strategic and effective use of ODA. We will continue these efforts ceaselessly to realize diplomacy that goes together with the Japanese people.
In order to implement ODA more effectively and efficiently, MOFA carries out ODA evaluations by third parties to evaluate from an objective and neutral position. Furthermore, MOFA carries out policy evaluations of economic cooperation policies based on the Government Policy Evaluations Act (GPEA).
Amid evolving circumstances surrounding development cooperation, MOFA strives to carry out ODA evaluation in a clear and comprehensible manner in order to further deepen the peoples’ understanding on development cooperation. Moreover, to introduce such initiatives, every year MOFA publishes an annual report providing an overview of the ODA evaluation by the Government of Japan as a whole.
We hope that this report will provide our readers with a deeper understanding on Japan’s development cooperation and its evaluation. January 2018 Makita Shimokawa Deputy Vice-Minister Minister’s Secretariat Cover Photos
Photo provided by Japan International Cooperation Agency (JICA) Annual Report on Japan’s ODA Evaluation 2017
Preface Cover Photos
Chapter 1 Overview of ODA Evaluation
1.1 International Trends in ODA Evaluation and the Contribution of Japan...... 2 1.2 Trends in ODA Evaluation in Japan...... 4 [Column] ◆Synergy between ODA Evaluation Workshop and APEA Conference...... 5 1.3 Japan’s ODA Evaluation...... 6
Chapter 2 Overview of FY2016 ODA Evaluation
2.1 Overview of FY2016 ODA Evaluation...... 10 2.2 Evaluations by MOFA...... 12 2.3 Evaluations by Other Ministries and Agencies...... 27 2.4 Operations Evaluations by JICA...... 38 2.5 Partner Country-led Evaluation...... 40 [Column] Japanese ODA Evaluation of Forestry Industry in Uruguay...... 40
Chapter 3 Follow-up Efforts on FY2015 Evaluation Results
3.1 Country Assistance Evaluations...... 44 3.2 Priority Issue Evaluations...... 49 3.3 Aid Modality Evaluation...... 52 3.4 Other Evaluation...... 53
Reference
List of Past ODA Evaluation Studies Conducted by MOFA...... 56 Chronology of ODA Evaluation ...... 61 List of Abbreviations and Acronyms...... 62 Related Websites and References ...... 63
Chapter 1 Overview of ODA Evaluation
1.1 International Trends in ODA Evaluation and the Contribution of Japan...... 2 ● Background • Towards Development Effectiveness ● The OECD-DAC Network on Development Evaluation (EvalNet) ● Recent Trends • Adoption of “2030 Agenda for Sustainable Development” • Membership in the Multilateral Organisation Performance Assessment Net- work (MOPAN) ● Japan’s Contributions • The ODA Evaluation Workshop
1.2 Trends in ODA Evaluation in Japan...... 4 ● Introduction of ODA Evaluation ● Enhancement of ODA Evaluation ● ODA Evaluation and the PDCA Cycle for Appropriate Feedback ● ODA Review ● Development Cooperation Charter [Column] ● Synergy between ODA Evaluation Workshop and APEA Conference...... 5
1.3 Japan’s ODA Evaluation...... 6 ● Objectives of ODA Evaluation ● Structure of the Implementation Process ● Classification by Evaluation Targets ● Diversity amongst Evaluators ● Criteria for ODA Evaluation and Recommendations ● Application of Results ● Publicizing Evaluation Results 1.1 International Trends in ODA Evaluation and the Contribution of Japan
Background The OECD-DAC Network on Development Evaluation (EvalNet) Originally, countries carried out Official Development Assistance (ODA) evaluations individually as part of their The DAC Network on Development Evaluation (EvalNet), administrative activities. In the 1970s, growing awareness one of the subsidiary bodies of the OECD-DAC, was estab- of the importance of ODA evaluations led to the full-fledged lished in 1981. Currently, 46 countries and agencies includ- start of international discussions on evaluation at the ing Japan have joined EvalNet. Development Assistance Committee of the Organization for EvalNet holds regular meetings approximately twice Economic Co-operation and Development (OECD-DAC) every year. It aims to facilitate the evaluation efforts of and a range of other international fora. countries and to promote development aid effectiveness, Since the 1990s, development assistance activities of the through exchanging information among member countries international community have transitioned from the level of and agencies on their evaluation systems and evaluation individual projects to programs (in which multiple projects results and discussing ways to improve evaluation method- sharing common objectives are grouped together, etc.). Due ologies. Japan has been participating in EvalNet meetings to to the transition, evaluations have expanded from those of share information on evaluation measures. Japan is further- individual projects to sector-based development assistance more a member of the Evaluation Capacity Development activities. Additionally, partly due to the establishment of (ECD) task force established under EvalNet with a view to macro-level indicators for the Millennium Development contributing to the ECD of partner countries. Goals (MDGs) that were adopted at the United Nations in The director of ODA Evaluation Division has been serv- 2001, development assistance and its evaluation focuses ing as the vice-chair of EvalNet since February, 2017. have evolved from the individual project level to those tai- lored to the specific issues and needs of recipient coun- Recent Trends tries. They have furthermore evolved to take into account the importance of coordination with other donors as well as ■ Adoption of the “2030 Agenda for Sustainable consistency with the developing countries’ procedures for Development” receiving aid. The “2030 Agenda for Sustainable Development (2030 Agenda)” was adopted, as the successor to MDGs formu- ■ Towards Development Effectiveness lated in 2001, at the United Nations Sustainable Development The Global Partnership for Effective Development Summit held in September 2015. The 2030 Agenda is a set of Cooperation (GPEDC) has promoted the effectiveness of new international goals established to address the remain- development cooperation in order to achieve the develop- ing challenges of MDGs (such as education and maternal ment goals of the international community. GPEDC mon- and child health) as well as new challenges (such as climate itors the progress of achievements by providers(countries, change and widening inequality) that have emerged over the organizations, foundations) of development cooperation and 15-year period following the establishment of MDGs. The recipient countries of their commitments on “ownership of implementation period of the 2030 Agenda is from 2016 development priorities by developing countries,” “focus on to 2030. The 2030 Agenda lists “Sustainable Development results,” “inclusive development partnerships,” and “trans- Goals” consisting of 17 goals and 169 targets aimed at erad- parency and accountability to each other.” These commit- icating poverty and realizing a sustainable world. The main ments were agreed at the Fourth High Level Forum on Aid feature of the 2030 Agenda is its universality applicable not Effectiveness (HLF-4) in 2011. The monitoring is con- only to developing countries but also to all countries includ- ducted based on the following 10 indicators: 1) Development ing developed countries and through the process of its ini- co-operation is focused on results consistent with develop- tiatives pledges that “no one will be left behind” anywhere ing countries’ priorities, 2) Civil society operates within an on our planet. environment which maximizes its engagement in and con- Under the 2030 Agenda, follow-up and review are also tribution to development, 3) Engagement and contribution emphasized and detailed paragraphs on them are added. The of the private sector to development, 4) Transparency: infor- 2030 Agenda mentions that “governments have primary mation on development co-operation is publicly available, responsibility for follow-up.” This means that each coun- 5) Development cooperation is more predictable, 6) Aid try will independently follow the state of progress taking is on budgets (allocated to the budget which are subject to into consideration the capabilities and development levels parliamentary scrutiny), 7) Mutual accountability among of each country based on the recognition that ownership development cooperation actors is strengthened through by countries is crucial for attaining sustainable develop- inclusive reviews, 8) Gender equality and women’s empow- ment. On the other hand, improvements in statistics, data erment, 9) Effective institutions: developing countries’ sys- systems and evaluation capacities are necessary for devel- tems are strengthened and used, and 10) Aid is untied. oping countries to carry out follow-ups. For this purpose, Japan has provided its assistance to realize these com- each country and international organizations provide neces- mitments. From the perspective of evaluation, it is import- sary support to developing countries to build up evaluation ant to improve the evaluation capacities of recipient coun- capacities. A set of global indicators has been established tries for effective development. for follow-up and each country carries out its follow-up based on these indicators or indicators formulated by each
2 1.1 International Trends in ODA Evaluation and the Contribution of Japan country. Periodic reviews of the state of progress are under- development. By contrast, improvements in statistics, data taken at the “High-level Political Forum on Sustainable systems and evaluation capacities are necessary for devel- Development” convened by the United Nations Economic oping countries to carry out follow-ups. For this purpose, Chapter 1 Overview of ODA Evaluation and Social Council and others. each country and international organizations provide neces- In May 2016, Japan has established the Sustainable sary support to developing countries to build up evaluation Development Goals (SDGs) Promotion Headquarters and capacities. A set of global indicators has been established formulated the SDGs Implementation Guiding principles for follow-up and each country carries out its follow-up in December of that year for comprehensive and effective based on these indicators or indicators formulated by each implementation of the SDGs’ policies in order to enhance country. Periodic reviews of the state of progress are under- a close coordination with relevant governmental agencies. taken at the “High-level Political Forum on Sustainable Japan also established the SDGs Promotion Roundtable Development” convened by the United Nations Economic Meetings under the SDGs Promotion Headquarters, where and Social Council and others. a wide range of stakeholders including local government, NGOs/NPOs, academia, private sectors, international Japan’s Contributions organizations, and various other organizations, gather and exchange opinions to enhance collaboration with them. Improving the evaluation capacities of developing coun- Japan is making utmost efforts in implementation, fol- tries is crucial for raising developing country ownership and low-up and review of the agenda along with the interna- enhancing development efficiency. Therefore, Japan is pro- tional community. viding a variety of assistance to raise the evaluation capaci- ties of developing countries. Specifically, MOFA holds ODA ■ Membership in the Multilateral Organisation evaluation workshops and entrusts evaluations to partner Performance Assessment Network (MOPAN) countries (for details, refer to pages 34 in Chapter 2). Since late 2014, Japan has been a member of the Multilateral Meanwhile, the Japan International Cooperation Agency Organisation Performance Assessment Network (MOPAN), (JICA) has held seminars for implementation organizations which was established by member countries in jointly in partner countries and has provided technical assistance assessing the effectiveness of multilateral organisations (as for strengthening monitoring and evaluation systems in of 2017, 17 countries are members including Japan). Nepal. MOPAN assesses the operation, management, and achievements of the multilateral organizations and then ■ ODA Evaluation Workshop releases the institutional reports. It is expected that the MOFA has hosted the ODA Evaluation Workshop since assessment results will be effectively made use of. 2001, inviting government officials and experts from Asian and Pacific countries. ■ Adoption of the “2030 Agenda for Sustainable The objectives of the workshop are: (1) to promote under- Development” standing of ODA evaluation issues and evaluation meth- The “2030 Agenda for Sustainable Development (2030 odologies in the Asia-Pacific region and thereby enhance Agenda)” was adopted at the United Nations Sustainable evaluation capacities, especially of partner countries; and Development Summit held in September 2015. The 2030 (2) to improve ODA evaluation capacities of stakeholders Agenda is a set of new international goals established to in developing countries not only to further enhance the aid address the remaining challenges of MDGs (such as edu- effectiveness of donor countries but also to enhance the cation and maternal and child health) as well as new chal- ownership and transparency of developing countries and lenges (such as climate change and widening inequality) their development effectiveness. that have emerged over the 15-year period following the In the past 14 workshops, participants exchanged infor- establishment of MDGs. The implementation period of the mation and shared views on various topics, including coun- 2030 Agenda is from 2016 to 2030. The 2030 Agenda lists tries’ specific efforts for enhancing evaluation capacities “Sustainable Development Goals” consisting of 17 goals and joint evaluations of ODA by developing and donor and 169 targets aimed at eradicating poverty and realizing a countries. *See page 5 sustainable world. The main feature of the 2030 Agenda is ODA Evaluation Workshops its universality applicable not only to developing countries but also to all countries including developed countries and Date Venue 1 7-8 November 2001 Tokyo, Japan through the process of its initiatives pledges that “no one 2 13-14 November 2002 Tokyo, Japan will be left behind” anywhere on our planet. 3 12-13 November 2003 Tokyo, Japan Under the 2030 Agenda, follow-up and review are also 4 17-21 January 2005 Bangkok, Thailand emphasized and detailed paragraphs on them are added. The 5 26-27 January 2006 Tokyo, Japan 2030 Agenda mentions that “governments of each country 6 18-20 October 2006 Manila, Philippines 7 28-29 November 2007 Kuala Lumpur, Malaysia have primary responsibility for follow-up.” This means that 8 3-4 March 2009 Singapore each country will independently follow the state of prog- 9 18 February 2010 Tokyo, Japan ress taking into consideration the capabilities and develop- 10 24-25 February 2011 Hanoi, Viet Nam ment levels of each country based on the recognition that 11 26-27 November 2012 Manila, Philippines ownership by countries is crucial for attaining sustainable 12 2-3 December 2014 Kuala Lumpur, Malaysia 13 9-10 December 2015 Tokyo, Japan 14 23 October 2016 Hanoi, Vietnam
1.1 International Trends in ODA Evaluation and the Contribution of Japan 3 1.2 Trends in ODA Evaluation in Japan
Introduction of ODA Evaluation established in order to reflect such results in the formulation and planning of ODA policies.” Therefore, MOFA decided to The beginning of ODA evaluation in Japan traces back to emphasize the improvement of checking systems, aiming to the implementation of ex-post evaluations of individual proj- enhance the ODA evaluation system and to reflect the evalu- ects by the Overseas Economic Cooperation Fund (OECF) in ation results in policies through establishment of the PDCA 1975. This came about partly as a result of discussions held cycle (figure 1). at the OECD-DAC from around 1970 that began to focus Figure 1. The PDCA Cycle on the necessity for evaluations of development cooperation. Subsequently, MOFA began ex-post evaluations of ODA Plan projects in 1981, followed by the initiation of ex-post evalu- Policy planning and Formulation ations of ODA projects by JICA in 1982. The main objective of these evaluations at the time was to manage individual projects properly to make Japan’s ODA more effective. Act Do Since the 1980s, as the scale and scope of Japan’s ODA Feedback Implementation expanded and public interest regarding ODA increased, ODA evaluation began to draw attention as a means for the Government of Japan to fulfill its accountability on ODA. Check Therefore, in addition to the main objective of ODA evalua- Evaluation tions, which is to improve management of ODA, MOFA set another main objective to ensure accountability to the people of Japan and began to actively engage in publicizing evalu- ation results. As a result, MOFA clarified the positioning of ODA eval- uation in the PDCA cycle and has strengthened its system to Enhancement of ODA Evaluation provide feedback on evaluation results to ODA policy for- mulation and implementation. MOFA has considered mea- As ODA evaluation evolved to hold broader objectives and sures in response to lessons learned and recommendations robust functions, experts began to request the implementa- obtained from evaluation results, reflecting them in ODA tion of evaluations from the ex-ante through ex-post phases. policies and implementation. This was based on the idea that it is more effective to con- duct evaluations prior to and midway through a project than ODA Review to only verify its outcomes after implementation. This was deemed to allow for the consistent management of ODA In June 2010, MOFA conducted the “ODA Review” and from planning and formulation up to implementation and the decided to undertake the following measures for ODA achievement of outcomes. Based on these trends, the ODA evaluation: Charter revised in August 2003 clearly indicated the need (1) reinforce the independence of evaluation units and recruit for enhancement of evaluation. The Charter noted that Japan external personnel to strengthen the ODA evaluation shall implement coherent evaluation from the ex-ante, mid- system term, to ex-post stages, as well as the evaluation of policies, (2) establish mechanisms that ensure meaningful lessons programs, and projects. It goes on to state that third-party from past successes and failures evaluations by experts with professional expertise shall be (3) disclose information through promotion of “visualiza- enhanced in order to measure, analyze, and objectively eval- tion” of evaluation. uate the outcomes of ODA. Therefore, in 2011, the ODA Evaluation Division was With the implementation of the Government Policy relocated from the International Cooperation Bureau, which Evaluations Act (hereafter, GPEA) in 2002 (details pro- is in charge of ODA policies, to the Minister’s Secretariat, vided in Chapter 2, p. 23), it was stipulated that adminis- thereby strengthening its independence. Since then, MOFA trative organizations themselves shall perform evaluations. has recruited an external evaluation expert as the director of Furthermore, it was stipulated that evaluation results should the division. In addition, MOFA selects evaluations in accor- be reflected in the subsequent planning of ODA policies and dance with the priority areas of Japan’s foreign policies and its efficient and effective implementation (feedback). development cooperation and ensures that evaluation results is incorporated into ODA policies. ODA Evaluation and the PDCA Cycle for To promote the “visualization” of evaluation, MOFA has Appropriate Feedback introduced a rating system (more information in Chapter 1, p. 8) in 2011. In this way, while ODA evaluation has increased The policy statement “Basic Policies 2005” approved by its importance, it has expanded its evaluation objectives and the Cabinet states that “Objective third-party evaluation scope, diversified its evaluators, reinforced its independence, including cost-effectiveness analysis of ODA projects should and strengthened its feedback functions. be conducted. The outcomes should be disclosed to the pub- lic, and the PDCA (Plan, Do, Check, Act) cycle should be
4 1.2 Trends in ODA Evaluation in Japan Development Cooperation Charter development cooperation cycle of policymaking, imple- mentation, and evaluation in an integrated manner.” The In February 2015, the Development Cooperation Charter new Charter takes a step further by stating that evaluation Chapter 1 Overview of ODA Evaluation was established taking into consideration the current circum- is essential for implementing effective and efficient ODA: stances surrounding ODA that include the diversification “In the light of the importance of evaluation not only for of development issues as well as the actors tackling them. improving effectiveness and efficiency but for accountabil- The Development Cooperation Charter clearly articulates ity to the public, Japan will conduct evaluations at the policy the philosophy of Japan’s development cooperation, namely, and program/project levels and give appropriate feedback of “Contributing proactively to peace, stability, and prosperity the results during the decision-making and program/project of the international community as a peace-loving nation.” implementation process.” Under this philosophy, the Charter prescribes the follow- Moreover, the Charter states that “development coopera- ing basic policies: 1) contributing to peace and prosperity tion provides one of the most important tools for Japan in its through cooperation for non-military purposes; 2) promot- agile diplomacy implementation” considering that “develop- ing human security; and 3) cooperation aimed at self-reliant ment cooperation is important for ensuring Japan’s national development through assistance for self-help efforts as well interests.” On this basis, the Charter sets forth that “efforts as dialogue and collaboration based on Japan’s experience will be made to undertake evaluation from a diplomatic point and expertise. of view, as well,” noting that an evaluation will incorporate With regard to evaluation, the Charter states that the not only the “development point of view” of whether the Government will strengthen ODA’s PDCA cycle based on a development cooperation contributes to the development of strategic approach, noting that, “A more strategic approach the partner country, but also the “diplomatic point of view” should be taken to maximize the impact of Japan’s devel- of what favorable impacts the development cooperation will opment cooperation. It is also important to engage in the bring to Japan’s national interests.
Column
Synergy between ODA Evaluation Workshop and APEA Conference
The Asia-Pacific Evaluation Association (APEA) held International Evaluation Conference in Hanoi, Viet Nam from November 21 to 25, 2016. It was the first international conference of the APEA and co-hosted by the Government of Viet Nam, the United Nations and other international evaluation organizations. During the conference, the Ministry of Foreign Affairs (MOFA) of Japan conducted the 14th ODA Evaluation Workshop as one of the sessions on November 23. ODA evaluation workshop The APEA, a network of evaluation society in Asia-Pacific region was launched during Malaysian Evaluation Society Evaluation Conference in September 2012. The main aim of the APEA is to improve evaluation capacity of individuals and institutions in Asia-Pacific region. Its members include the Japan Evaluation Society. In order to establish the APEA,Japan had consistently given support with initiatives by emeritus professor Mr. Ryokichi Hirono of Seikei University, the founder of the APEA. MOFA had provided occasions for donors and partner countries to discuss the means to strengthen evaluation capacity in the past ODA Workshops held annually. The APEA International Evaluation Conference 2016 had 173 participants from 32 countries including countries from not only Asia but also Africa. Among them, 33 people from 18 countries participated to the ODA Evaluation Workshop. Having a workshop as a part of the APEA conference led to increase in number of participants who are engaged in evaluation and policy making. It also provided a learning opportunity for the ODA Evaluation Workshop participants through attending research presentations on evaluation and joining discussions on evaluation system in the developing countries. Moreover, we could welcome Dr. Romeo B. Santos, vice-chairman of the APEA and Mr. Emmanuel Jimenez, executive director of the International Initiative for Impact Evaluation (3ie) as commentators at the discussion. All these were possible because the workshop was implemented as one of the APEA conference sessions and we can say that it generated a significant syn- ergy effect.
Naonobu Minato Vice-chairman of APEA and affiliate professor of International University of Japan
Workshop session
1.2 Trends in ODA Evaluation in Japan 5 1.3 Japan’s ODA Evaluation
Objectives of ODA Evaluation programs and projects that involve ODA in the respective fields under their jurisdiction. These evaluations are con- MOFA carries out ODA evaluations under the following ducted mainly based on the GPEA. two objectives: Pursuant to the Basic Act on Central Government Reform (1) To Improve ODA Management: to contribute to the in 1988, MOFA assumes a central role in coordinating all improvement of ODA quality through feeding back lessons government entities for the overall planning and other tasks obtained from the examination of ODA activities to the pro- associated with ODA. Accordingly, Inter-Ministerial Liaison cess of ODA policy formulation and implementation. Meetings are held, which are comprised of the relevant min- (2) To Maintain Accountability: to fulfill accountability istries and agencies as well as JICA. Discussions on further and promote public understanding and support, by increas- improvements for the ODA evaluation activities are under- ing transparency of ODA through publication of evaluation taken by the entire government at the meetings, and MOFA results. compiles the results of the ODA evaluations of other minis- tries and agencies. Structure of the Implementation Process Chapter 2 of this report presents an overview of the eval- uations conducted by MOFA, other ministries and agencies, MOFA is mainly responsible for planning and formulating and JICA, mainly in FY2016. ODA policies, while JICA is responsible for implementing individual projects. MOFA and JICA collaborate on ODA Classification by Evaluation Targets evaluation by dividing their roles. MOFA conducts poli- cy-level and program-level evaluations in the form of third- ODA evaluations are classified into policy-level evalua- party evaluations based on the Order for Organization of the tion, program-level evaluation, and project-level evaluation Ministry of Foreign Affairs. according to what is being evaluated (table 1, p. 7). With the entry into force of the GPEA in 2002, each minis- try and agency is required to conduct self-evaluations of pol- Diversity amongst Evaluators icies under its jurisdiction. On this basis, since 2002, MOFA has implemented policy evaluations that include overall ODA evaluations are classified by type of evaluator, and ODA policy, as well as ex-ante and ex-post evaluations of include self-evaluation, internal evaluation, third-party eval- specific projects as required by the GPEA in the formof uation (external evaluation), evaluation conducted by recipi- self-evaluations. ent governments and agencies, as well as joint evaluation by JICA, on the other hand, conducts project-level evalua- MOFA and other countries and organizations. tions of individual projects, as well as thematic evaluations (1) Self-Evaluation on specific themes and development goals from cross-sec- Self-evaluation is an evaluation conducted by the divi- toral and comprehensive perspectives, in the form of third- sions that provide, implement, or manage assistance of their party evaluations and self-evaluations. assistance policies and programs. Evaluations conducted Other ministries and agencies of the Government of by MOFA and other ministries and agencies based on the Japan also plan and formulate policies as well as implement GPEA are classified as self-evaluation, as are JICA’s ex-ante
Figure 2. Japan’s ODA Evaluation Mechanism
Other ministries Inter-Ministerial Implementation of ODA and agencies Liaison Meeting MOFA project operations JICA
Formulation/Implementation Formulation of ODA policies Implementation of of ODA-related policies, (e.g., Country Assistance Policy, Sectoral Development Policy, Technical Cooperation, programs and projects Priority Policy for International Cooperation) ODA Loans and Grant Aid
Other Evaluation ODA evaluation Operations evaluation evaluation based on Evaluation based Based on the Order for Based on JICA Law studies the GPEA on the GPEA Organization of MOFA, and JICA’s internal ODA Charter, etc. regulations
Target: Target: Target: Policies/Programs Policy-level evaluation Project-level evaluation including ODA and Program-level Thematic evaluation ODA projects evaluation
Evaluator: Evaluator: Evaluator: Self-evaluation Third-party evaluation External evaluation, self-evaluation
6 1.3 Japan’s ODA Evaluation Table 1. Classification by Evaluation Targets
Type of Evaluation Description Examples Chapter 1 Overview of ODA Evaluation
Policy-level evaluation Evaluation of multiple programs or projects that are grouped together, for the purpose of achieving basic policies (e.g., ODA Charter, Japan’s Medium-Term Policy on ODA, and Country Assistance Policies).
Evaluation of overall ODA policies by country and Country Assistance Country Assistance Evaluation of Vietnam, Evaluation of region. Mainly evaluating the Country Assistance Evaluation Assistance for the South Caucasus Policies of MOFA.
Evaluation of the priority issues and areas in the Evaluation of Japan’s Education Cooperation Policy 2011-2015, Priority Issue ODA Charter, sectoral initiatives that Japan unveiled Evaluation of Japan’s Contribution to the Achievement of the Evaluation at key international meetings, etc. MDGs in Environmental Sector
Program-level evaluation Evaluation of multiple projects with common objectives that are grouped together. Conducts comprehensive evaluation and analysis based on specific themes or development targets.
Evaluation of Assistance for the Urban Transportation Sector Sector Program Evaluation of overall ODA activities in a specific in Viet Nam, Evaluation of Assistance to the Health Sector in Evaluation development area in specific countries or regions. Cambodia
Aid Modality Evaluation of Debt Cancellation, Evaluation of Grant Aid for Evaluation of individual aid schemes. Evaluation Poverty Reduction Strategy
Project-level evaluation Evaluation of individual ODA projects (mainly JICA).
Evaluation of individual development assistance Indonesia “Tanjung Priok Gas Fired Power Plant Extension Project” Project evaluation projects. Philippines “Coast Guard Project”(all one, JICA)etc.
evaluations of projects and certain ex-post evaluations of The joint evaluations with recipient countries have sig- projects. nificance in so far as they respect the ownership ofrecip- (2) Internal Evaluation ient countries and strengthen partnerships between Japan Evaluation conducted by the divisions responsible for and recipient countries, in addition to achieving the objec- reporting to the divisions of aid agencies is called internal tives of enhanced ODA management and fulfillment of evaluation. accountability. (3) Third-Party Evaluation (External Evaluation) Criteria for ODA Evaluation and This evaluation is conducted by a third-party who is Recommendations independent from both donors and recipients of assis- tance. In MOFA’s policy-level and program-level evalua- MOFA has established the following three criteria for tions, third-parties (experts and private sector consultants, ODA evaluation from a development viewpoint based on etc.) selected through an open competitive bidding system the so-called five “DAC Evaluation Criteria” (Relevance, are the principal evaluators. JICA also conducts third-party Effectiveness, Efficiency, Impact, and Sustainability), which evaluations in the form of ex-post evaluation of projects that were announced by the OECD-DAC in 1991. cost over a certain amount of funding or projects which are (1) Relevance of Policies: whether policies and programs are deemed to provide valuable lessons. consistent with Japan’s high-level policies on ODA and the (4) Evaluation Conducted by Recipient Governments and needs of recipient countries. Agencies (2) Effectiveness of Results: whether expected objectives are MOFA implements around one evaluation every year, pri- achieved. marily program-level evaluations, by requesting recipient (3) Appropriateness of Processes: whether processes have governments and agencies, private sector consultants, and been taken that would ensure the relevance and effectiveness evaluation experts to conduct the evaluation. The objective is of policies and programs. to secure the fairness and transparency of Japan’s ODA eval- In undertaking the evaluations, since FY2011, MOFA has uation, promote recipient countries’ understanding of Japan’s introduced a rating system (a straightforward approach to ODA, and enhance the evaluation capacities of recipient representing scores using a multi-point scale) to promote the countries by having recipient governments and agencies con- “visualization” of evaluation (see Chapter 1, p. 4). While rat- duct the evaluation. ings facilitate “visualization,” they do not take into account (5) Joint Evaluation the individual situation and background of what is being eval- This evaluation is conducted jointly by donors and recipi- uated and pose the danger of oversimplifying the evaluation ents of assistance or by different aid organizations. result. For this reason, MOFA always provides supplementary
1.3 Japan’s ODA Evaluation 7 explanations to its ratings, including the basis of its judgments. and their follow-up status are published in the Annual Report MOFA does not give numerical or letter ratings. on ODA Evaluation (please refer to Chapter 2 for the mea- Moreover, since FY2011, MOFA has introduced the new sures in response to the results of the FY2016 ODA evalua- evaluation criterion of “diplomatic viewpoints” to examine the tion, and Chapter 3 for the follow-up efforts to the results of impacts of assistance on Japan’s national interests, in addition the FY2015 ODA evaluation). to the above “development viewpoints” that examine to what The evaluation results are distributed to stakeholders in extent assistance contributes to the development of recipient recipient countries through translated summaries of evalua- countries. tion reports. Through such efforts, MOFA strives to provide With respect to these criteria for ODA evaluation and feedback to recipient countries. specific methodologies, MOFA has formulated the “ODA In addition, JICA conducts monitoring and evaluation Evaluation Guidelines” since 2003, publishing the 10th edi- in line with a project’s PDCA cycle in order to expand the tion in June 2016. development outcomes of the project. Evaluation conducted based on the GPEA is evaluated in line with the “Basic Plan on Policy Evaluation” established by MOFA, including viewpoints such as necessity, effectiveness, and efficiency. JICA conducts evaluations in accordance with Figure 4. Follow-up of Evaluation Results the Five DAC Evaluation Criteria. For some ex-post evalua- tions (third-party evaluations), the overall evaluation results Reflection in Country Assistance Policies, are rated on a four-level scale (A to D) to make the evaluation etc. results easier to understand. Improvement at Figure 3. Criteria for ODA Evaluation the level of overseas establishments DAC Criteria for MOFA’s Criteria Evaluating Development Reflection on policy to recommendations Assistance implementing agencies regarding of each evaluation report Setting response measures
Completion and publication implementing status of response measures Conveying response measures to overseas establishments and agencies G Development Viewpoint G Relevance Announcing the implementation (1) Relevance of Policies G Effectiveness (2) Effectiveness of Results G Efficiency End of Two fiscal (3) Appropriateness of G Impact the fiscal Next fiscal year years Processes G Sustainability year later ＋ Publicizing Evaluation Results G Diplomatic Viewpoint To facilitate understanding of Japan’s ODA evaluation, MOFA proactively publicizes evaluation results. In conduct- ing third-party evaluations, MOFA recommends that eval- In the third-party evaluations carried out by MOFA and uators (the third parties) prepare reader-friendly evaluation the evaluations implemented by JICA, “recommendations” reports. MOFA posts a summary and the full text of each on what should be actively promoted or improved for imple- report as well as its summary in English and other languages menting ODA policies and individual projects in the future (depending on the report) on MOFA’s ODA website. are derived based on the results of the evaluations conducted Furthermore, every year MOFA publishes the Annual in accordance with the above criteria. The recommenda- Report on Japan’s ODA Evaluation. The report is a compila- tions are presented to organizations relevant to the evaluated tion of the overview of the results of evaluations conducted projects. by MOFA, JICA, and other ministries and agencies in the previous fiscal year, as well as the response measures to each Application of Results recommendation by MOFA’s third-party evaluations and the implementation status of the response measures to the To establish a PDCA cycle, it is important that the evalu- recommendations of evaluations conducted two fiscal years ation results and recommendations from ODA evaluations before. This report is distributed to a wide range of entities, are fed back to policymakers and those engaged in project including Diet members, experts, NGOs, universities, and implementation and are reflected in future processes of libraries, and is also available on MOFA’s ODA website. policy making and project implementation. JICA publishes the JICA Annual Evaluation Report that Therefore, MOFA feeds back the evaluation results to its rel- compiles operations evaluation activities of the previous fis- evant divisions, JICA, and Japan’s overseas establishments. It cal year (see Chapter 2, p. 32 for more information on JICA’s also develops measures for addressing the recommendations activities). extracted from the evaluation results, taking account of their concreteness, feasibility, and other criteria. Furthermore, to ensure that the recommendations are reflected in subsequent policy-making and other processes, MOFA follows up on the status of such measures. Additionally, since FY2010, as part of the efforts for the “visualization” of ODA, these measures
8 1.3 Japan’s ODA Evaluation Chapter 2 Overview of FY2016 ODA Evaluation
2.1 Overview of FY2016 ODA Evaluation...... 10
2.2 Evaluations by MOFA...... 12 Country Assistance Evaluations ● Country Assistance Evaluation of the United Republic of Tanzania ● Country Assistance Evaluation of the Republic of Paraguay Priority Issue Evaluations ● Evaluation of Japan’s Assistance in the Pollution Control Field Aid Modality Evaluation ● Evaluation of Grant Aid for Promotion of Japanese Standards Sector Program Evaluation ● Evaluation of Assistance in the Industrial Human Resource Development Sector in Thailand Ex-Post Evaluation ● Ex-Post Evaluation on Grant Assistance for Japanese NGO Projects Evaluation Based on Government Policy Evaluations Act (GPEA)
2.3 Evaluations by Other Ministries and Agencies...... 27 ● List of ODA Evaluations Conducted by Other Ministries and Agencies in FY2016 ● Summary Financial Services Agency/ Ministry of Internal Affairs and Communications/ Ministry of Justice/ Ministry of Finance/ Ministry of Education, Culture, Sports, Science and Technology/ Ministry of Health, Labour and Welfare/ Ministry of Agriculture, Forestry and Fisheries/ Ministry of Economy, Trade and Industry/ Ministry of Land, Infrastructure, Transport and Tourism/ Ministry of the Environ- ment
2.4 Operations Evaluations by JICA...... 38
2.5 Partner Country-led Evaluation...... 40 ● Evaluation of Japan’s Office Development Assistance to the Uruguayan Forestry Sector
[Column] Japanese ODA Evaluation of Forestry Industry in Uruguay 2.1 Overview of FY2016 ODA Evaluation Chapter 2 provides an overview of ODA evaluations conducted by MOFA, JICA, and other ministries and agencies, etc., mainly in FY2016.
Evaluations by MOFA
MOFA implemented five third-party ODA evaluations in FY2016 that it commissioned to external experts. This chapter pro- vides an overview of these evaluations and presents MOFA’s response measures (as of July 2017) to the recommendations derived from these evaluations. Due to a lower number of evaluation cases compared with the previous fiscal year, there were no noticeable trends, but, regard- ing an evaluation from the point of view of development, “relevance of policy” was highly evaluated. However, many chal- lenges regarding “effectiveness of results” and “suitability of results” were pointed out, and it was indicated that there is room for improvement in the future Regarding the evaluation from a diplomatic point of view, diplomatic ripple effects such as diplomatic importance for Japan, strengthening economic relations between the two countries, deepening human exchange and fostering sympathizers for Japan could be confirmed. The original reports of each evaluation are available on the MOFA website. Also, MOFA’s ex-post monitoring on Grant Assistance for Japanese NGO Projects and self-evaluation based on the Government Policy Evaluations Act (GPEA) are outlined.
● Country Assistance Evaluations: 2 (Tanzania, Paraguay) ● Priority Issue Evaluations: 2 (Japan’s Contribution to the Achievement of the MDGs in Environmental Sector, Japan’s Education Cooperation Policy 2011-2015) ● Aid Evaluation: 1 (Debt Cancellation) ● Other Evaluation: 1 (Feedback Mechanism of Japan’s ODA)
Mongolia
● Priority Issue Evaluation Evaluation of Japan’s Assistance in the Pollution Control Field
Jordan,Sri Lanka
● Aid Modality Evaluation Evaluation of Grant Aid for Promotion of Japanese Standards
Angola Thailand Ex-post Evaluation on Grant Assistance for ● Sector Program Evaluation Japanese NGO Projects Evaluation of Assistance in Industrial Human Resource Development Sector Thailand
Tanzania ●Country Assistance Evaluation
10 2.1 Overview of FY2016 ODA Evaluation Operations Evaluations by JICA Evaluations by Other Ministries and Agencies in Japan
JICA conducts project evaluations of individual projects as Other ministries and agencies conduct self-evaluations of well as thematic evaluations which set certain themes such ODA-related policies mainly based on the GPEA. This chap- as region, issue sectors, and aid schemes and uses evaluation ter lists the evaluation studies conducted by other ministries criteria for each theme in projects related to these themes. and agencies in FY2016. Regarding the number of project evaluations commenced in FY2015,* JICA conducted 90 external ex-post evaluations by third-party evaluators, 60 internal ex-post evaluations Partner Country-led Evaluation that are mainly evaluated by JICA overseas offices, and as thematic evaluations for FY2016, a meta analysis of lessons In FY2016, as a part of partner country-led evaluations, learned in the energy sector (extraction of knowledge les- a consultant carried out an evaluation of Japan’s assis- sons) are conducted. tance in forestry industry in Uruguay with the support from In addition, impact analysis and statistical analysis of Administrative Management/Evaluation Bureau . This chap- external evaluation results along with new attempts such as ter presents an over- view of this evaluation. Chapter 2 Overview of FY2016 ODA Evaluation extraction of useful lessons in the development of the new port, and process analysis on “Delhi Mass Rapid Transport ● Sector Evaluation: Japanese ODA evaluation of forestry System Project in India” (also known as the Delhi Metro) industry in Uruguay process are conducted. Chapter 2.4 provides an overview of such operations evaluations conducted by JICA. The details of JICA’s individual evaluation results are available on the JICA website. * Number of evaluations commenced in FY2015 for which results were con- firmed in FY2016.
Paraguay
● Country Assistance Evaluation
Uruguay ● Sector Program Evaluation Evaluation of Japan’s Official Development Assistance to the Uruguayan Forestry Sector
2.1 Overview of FY2016 ODA Evaluation 11 2.2 Evaluations by MOFA Priority Issue Evaluations
Country Assistance Evaluation of the United Republic of Tanzania
Evaluators (Evaluation Team): •Chief Evaluator: Kiyoko Ikegami, Professor, Graduate School of Social and Cultural Studies, Nihon University •Advisor: Juichi Inada, Professor, Dept. of International Economics, Senshu University •Consultant: KPMG AZSA LLC Period of the Evaluation Study: June 2016 – February 2017 Field Survey Countries: the United Republic of Tanzania
http://www.mofa.go.jp/policy/oda/evaluation/FY2016/pdfs/tanzania.pdf
and the traffic sector, and Public Financial Management Background, Objectives, and Scope of the Evaluation (PFM) (sub-group of internal auditing), actively communi- The United Republic of Tanzania (hereinafter referred cated with the Government of Tanzania and other donors and to as “Tanzania”) is a geopolitically important area offer- reflected information attained on the assistance programs. ing access to the Indian Ocean to neighboring inland coun- The appropriateness of processes is rated “high”. tries. Recently, it has achieved rapid economic growth at a higher rate than the sub-Saharan Africa’s average and pos- ・ Diplomatic Viewpoints sesses abundant natural resources; however, the poverty rate Japan and Tanzania have an extensive strategic partner- remains high. Japan’s basic stance is to support economic ship and the leaders of the two countries frequently visit each and social development toward sustainable economic growth other; therefore, Japan’s ODA has considerable diplomatic and poverty reduction, with consideration of policy-planning importance. As Japan’s ODA is also contributing to strength- and environmental protection. The purpose of the evaluation ening the economic relationship and personal and cultural study is to evaluate Japan’s ODA policies and to obtain les- exchanges, it can be evaluated as having a noticeable diplo- sons learnt and make recommendations for future ODA pol- matic impact. icies. The scope of the evaluation is the Country Assistance Program for Tanzania (formulated in June 2000, hereinafter referred to as “Assistance Program (2000)”), the Country Assistance Program for Tanzania (formulated in June 2008, hereinafter referred to as “Assistance Program (2008)”), and the Country Assistance Policy for the United Republic of Tanzania (formulated in June 2012, hereinafter referred to as “Assistance Policy (2012)”).
Brief Summary of the Evaluation Results
Namanga OSBP ・ Development Viewpoints (1) Relevance of Policies Recommendations Japan’s ODA policies are consistent with Tanzania’s development strategies. The relevance of the policies is Reinforcement of economic growth foundation and rated “very high”. 1 promotion of industrialization The infrastructure support provided by Japan was signif- (2) Effectiveness of Results icant. Since industrialization and economic growth are the In terms of the priority areas, there were no outstanding priority areas in Tanzania’s new Five Year Development Plan obstacles to achieve the expected results. The results were that started in 2016, Japan needs to provide continuous sup- within the expectations; the effectiveness of results is rated port to contribute to the country’s economic growth. “high”. Strengthening support for economic integration and (3) Appropriateness of Processes 2 vitalization in East Africa Regarding the processes of policy formulation and imple- Projects that cover an extensive area across neighboring mentation, the following was confirmed: emphasis was country borders, including the Arusha-Namanga-Athi River placed on the policy dialogues through the donor meetings Road Development Project, had a positive contribution to and Japan, as the leading donor in agriculture, transportation the economic integration and vitalization in the East African
12 2.2 Evaluations by MOFA Chapter 2 Overview of FY2016 ODA Evaluation 13 ------2.2 Evaluations by MOFA Introduction of proxy indicators for quantitative of proxy indicators Introduction policies of ODA evaluation Enhancement of public relations to ensure Tanzanian Tanzanian relations to ensure Enhancement of public ODA understanding of Japan’s people to have better tion of regional tionof projects, basedon thedemands the of Tanzaniangovernment and the Country Development Cooperation Policy. requires period long to produce results through mea sures, such as appropriate use program of approach. has been recognized as important assis in Japan’s tance, and attention close pay to the revised Country Development Cooperation Policy. dinatespecificcoursesaction for cooperation of which can contribute to the achievement UHC of (Universal inHealth Tanzania. Coverage) according to changes in the situation, based on needs and theadequacy and effectiveness the of imple support. mented contribute develop to the achievement Tanzania’s of ment goals, while, example, for paying attention to quantitative targets set Tanzania. by relations, such as introducing by quantitativeaspects and safety control aspects Japanese of assistance, pri in Force Tanzania. Task ODA marily led Japan’s by sector, Japanese companies has been demonstrating the strengths high-quality of infrastructure. to the Country Development Cooperation Policy. There is no outcome indicator to evaluate the achieve to evaluate outcome indicator There is no It is important for Japan to organize more effective public public effective more organize Japan to for is important It Examples of response measures ●Explore ●Explore ways to effectively manage assistance that ●Continuously support the field of health, which ●Through activities of the Health Policy Advisor, coor ●Review possibilities of various types of support ●Continuously support Tanzania in order to further furthereffortsto●Continuouslymake strengthen public ●Continue infrastructure assistance as an important ●Continuouslysupporteconomic growth,the according ●Continuously explore the possibility of implementa 6 7
ment level of Basic Policy of Assistance, Priority Areas and Areas and Priority Assistance, of Basic Policy of ment level Assistance Country up for the set are Issues that Development are Proxy indicators Tanzania. for and Rolling Plans Policies Sustainable For example, the situation. useful to complement will choose can be Tanzania (SDGs) Goals that Development of Japan’s for evaluation indicators found and used as proxy to Tanzania. ODA communications of frequency proper a maintaining relations more con- with even Tanzania for the peoples of Japan and It is also import accuracy. and its timeliness for sideration and it will be public relations ant to conduct quality-related management, of safety particulars the publicize to effective is that securing com- etc., as well as outcomes. One example of detours in a munity roads and consideration for safety features of well-thought-out road project are characteristic ODA planning in Japan’s - - (Phase 2: image of digging for test well) Water supply planning in region near capital Water Effective use of program approach in areas where use of program Effective relatively slowly. outcomes emerge Review of long-term assistance and formulation of Review of long-term assistance and formulation exit strategy Enhancement of assistance for heath sector Enhancement of assistance for heath sector Assistance from Japan to contribute to Tanzania’s achieve Tanzania’s to contribute to Japan from Assistance been that has of assistance Needs and effectiveness Although there were sufficient outcomes at the project 5 4 3 extended over a long time need to be reviewed periodically to be reviewed need over a long time extended and formulated. and an exit strategy should also be assumed assis- of forms various re-examine to review is to way One and country target needs of the based on the changing tance and the sec- program evaluations sector by using JICA’s project to JICA’s in addition of the MOFA, tor evaluations evaluation. ment for local government where outcomes emerge after a where outcomes emerge government ment for local by using the program to be managed period needs certain approach effectively. (UHC) through the Coverage of Universal Health ment program is con- system enhancement administration health policies ODA Japan’s initiatives, with international sistent Thus, assistance Tanzania. needs of and the development needs to continue to contribute to Tanzania from Japan to sector. social development, particularly in the health level in the field of capacity development for local govern- on the that the goal was achieved ment, it cannot be said Plan for Areas) in the Rolling (Priority priority area level develop in such areas as capacity assistance The Tanzania. Community (EAC), livelihood improvement of residents in of residents in improvement (EAC), livelihood Community reduction. Such the road and poverty to the areas adjacent further expanded. projects should be region-wide 2.2 Evaluations by MOFA Priority Issue Evaluations
Country Assistance Evaluation of the Republic of Paraguay
Evaluators (Evaluation Team): •Chief Evaluator: Tatsufumi Yamagata, Director General, International Exchange and Training Department, Institute of Developing Economies •Advisor: Yoko Fujikake, Adviser to the President, Professor of Graduate School of Urban Innovation, Yokohama National University •Consultant: KPMG AZSA LLC Period of the Evaluation Study: June 2016 – February 2017 Field Survey Countries: Republic of Paraguay
http://www.mofa.go.jp/policy/oda/evaluation/FY2016/pdfs/Paraguay.pdf
(3) Appropriateness of Processes Background, Objectives, and Scope of the Evaluation Japan’s ODA policies for Paraguay have been formulated As one of the world’s largest soybean producers and export- through appropriate process, therefore, they are rated “high”. ers, agriculture is a key economic driver for The Republic However, there should be more communication with other of Paraguay. This sector has a significant impact on nation’s donors to enhance effectiveness of assistance as harmoniza- economy; however, production and international prices for tion among donors is encouraged today. produce have left the economy fragile resulting in lagging growth among other Latin American countries. There is a ・ Diplomatic Viewpoints wide disparity between the rich and the poor, which is par- Japanese immigrants and Japanese Paraguayans have ticularly significant in rural areas. Given this situation, Japan made a significant contribution to agriculture, which helped has set Country Assistance Policy for Paraguay. Its Basic strengthen bilateral relations. As Japan’s ODA has further Policy is to sustain economic and social development with- increased pro-Japan sentiments in Paraguay, it can be evalu- out disparities though the improvement of livelihood of the ated to have diplomatic importance. poor and social services. Under the Basic Policy, there are two Priority Areas, which are (1) reduction of disparities and (2) sustainable economic development. This evaluation ana- Recommendations lyzes the Japan’s overall assistance policy for Paraguay based on its significance of the assistace and aims to obtain lessons Continued Development Cooperation Utilizing and recommendations that will contribute to policymaking 1 Various Modalities and effective and efficient implementation to improve ODA Paraguay is experiencing steady economic growth. Japan’s management, and to fulfill accountability by publicizing the ODA perspective of selection and concentration indicates that evaluation results. it will eventually be depart from status of a recipient coun- try and become more important as Japan’s business partner. Brief Summary of the Evaluation Results Japan should continue to actively provide ODA to Paraguay to maintain a historically great relationship in diplomacy, economy and culture. A variety of modalities should be uti- ・ Development Viewpoints lized to increase efficiency of the assistance. (1) Relevance of Policies Japan’s ODA policies for Paraguay are consistent with More Strategic Approach to Reduce Disparities the development needs of Paraguay, high-level development 2 policies of Japan’s ODA and international priority issues, It is necessary to identify groups of people that tend to be therefore they are highly relevant. However, the target and left out of overall growth to solve disparities. Particularly, the means are not specified as to “reduction of disparities”, women should be more empowered.1. In order to solve dispar- and it should be improved when revising the policy. ities, policy should specify target groups that require support, including single mothers, rural women and indigenous women (2) Effectiveness of Results who tend to have no other choice but to fall into “pockets of Japan’s assistance has achieved certain level of outcomes. poverty”2. A strategic approach needs to be applied to directly It contributed to improvement of livelihood of the poor, respond to the issues those groups and communities face. social services, economic and social infrastructure and pub- *1 Edited by Research Unit for Policy Development in Latin America. Second lic administration capacity of central and local government. Therefore, the effectiveness of results is “high”.
14 2.2 Evaluations by MOFA Chapter 2 Overview of FY2016 ODA Evaluation 15 2.2 Evaluations by MOFA (Phase 2: full view) Paraguya at Hospital of National University of Asuncion Paraguya at Hospital of National University of (Phase 2: image of the newborn nursery of the mother-child center being used) (Phase 2: image of the newborn nursery of the mother-child Water supply facility for Coronel Oviedo City visited in field survey (rendering) facility for Coronel Oviedo City visited in field survey supply Water Plan for construction of Mother-Child Center of Friendship between Japan and Plan for construction of Mother-Child - - - Strategic Collaboration by Multi-stakeholders to Strategic Collaboration Assistance Infrastructure Promote High-Quality needs in the future, as necessary, through mutual con ing to the demands Paraguayan of government and the Countrypolicy of Assistance. Also, consider a method for improving efficientthrough mutual consultation between the Paraguayan development cooperation, on site. government Force Task and the ODA port the for needs in Paraguay, corresponding to the Paraguayan government and the Country policy of Assistance. sultation among Paraguayan government, the other donors, international authorities and on. so Although Paraguay is referred to as a developing country, country, to as a developing referred Although Paraguay is Examples of response measures ●Continue support for needs in Paraguay, correspond ●Continuously aim to reduce disparities, to sup ●Investigate cooperation regarding the methods and regions where certain progress in poverty reduction has been achieved. certain progress in poverty regions where Symposium on Latin America: Coexistence with Risk and Development in with Risk and Development America: Coexistence Latin Symposium on National University. Yokohama Advanced Sciences, of Institute Paraguay. 3
it is ranked as a middle-income country. Paraguayan govern- Paraguayan country. it is ranked as a middle-income ment already has a certain level of financial, technical and Japan has made for development. human resource capacity Development Inter-American with agreement cooperation a April 2016. high-quality assistance in Bank (IDB) to provide coop- of development effectiveness In order to maximize and communication strategic have also needs to it eration, in involved who are stakeholders with other coordination be regarded as an ODA This should development. Paraguay’s not just an issue in Paraguay. America, issue in Latin *2 The term refers to a situation when severe poverty still exists is some areas of poverty still exists is some to a situation when severe The term refers *2 2.2 Evaluations by MOFA Priority Issue Evaluations
Evaluation of Japan’s Assistance in the Pollution Control Field
Evaluators (Evaluation Team): •Chief Evaluator: Ryokichi Hirono, Professor Emeritus, Seikei University •Advisor: Shigeru Matsumoto, Professor, Aoyama Gakuin University •Consultant: International Development Center of Japan Inc. Period of the Evaluation Study: July 2016 – February 2017 Field Survey Countries: Mongolia
http://www.mofa.go.jp/policy/oda/evaluation/FY2016/pdfs/pollution.pdf/ Background, Objectives, and Scope of the Evaluation Pollution control is an important field in environmental ODA in the ODA Medium-Term Policy (February 2005) and other policies. In this evaluation, the Evaluation Team judged assistance through pollution control cooperation pol- icy (herein after referred to as the Policy) from development and diplomatic viewpoints, and drew recommendations and Image of water quality training for trainees in Dornogovi Province, Mongolia (Japanese training) lessons in the process. This evaluation was conducted to help propose and implement policy for future pollution control areas and some countries and regions (particularly countries cooperation, and to ensure accountability to citizens. that are still in early development stages), the state of pollu- tion did not necessarily showed improvement. However, it is notable to mention that there are limits to actions taken in Summary of the Evaluation Results response to external conditions, which have a major impact on the realization of improvement in the state of pollution. If ・ Development Viewpoints we exclude external conditions, it is fair to say that certain (1) Relevance of Policies outcomes were achieved from the pollution control coopera- The analysis of the relevance of the Policy implicates that tion. Therefore, the effectiveness of the improvement of the the Pollution control cooperation policy is extremely con- state of pollution in recipient countries was moderately high. sistent with higher policies of Japan. The Evaluation Team Based on the above discussions, we evaluated the effective- also confirmed that it is highly consistent with the need ness of the results of this pollution control cooperation policy for diverse socioeconomic development in many recipi- to be generally high. ent countries, primarily for the health of their citizens, and with global trends and challenges geared toward sustain- (3) Appropriateness of Processes able development. Furthermore, Japanese pollution control, The Evaluation Team found that the process of formulat- which helped the country overcome environmental deterio- ing the Policy involved many discussions and considerations ration in a relatively short period of time, has received inter- of relevant documents among relevant personnel, and the national acclaim, and Japan has comparative advantages in Policy ended up with reflecting a diversity of viewpoints and pollution control cooperation and scores highly on nearly all opinions, as a result. Therefore, the formulation process was evaluation items. In light of the above, we judge the rele- concluded as generally appropriate. As for the policy imple- vance of pollution control cooperation policy to be high. mentation process, each of the basic tenets of the Policy was proactively implemented; therefore, we concluded the appro- (2) Effectiveness of Results priateness of the policy formulation process as high. In regards to the effectiveness of pollution control coop- Although the “implementation system” and “collaboration eration, it is categorized generally high based on the DAC and coordination with relevant agencies and other donors, statistic data which shows Japanese achievement of the max- etc.” were implemented generally appropriately, we found imum amount of assistance (agreed amount base) among that “monitoring evaluation and feedback” and “review” DAC member countries during the evaluation period. Also, were not conducted at the policy level; therefore, we con- the projects that Japan has implemented during the evalu- cluded the appropriateness of the overall policy management ation period essentially produced the expected outcomes, process as moderate. Based on the above discussions, we which resulted in enhancement and improvement of pollu- evaluate the appropriateness of the processes of the Policy tion control in recipient countries. The implementation meth- as generally high. ods stipulated in the Policy were all carried out, and showed good contribution to the achievement of objectives regard- ・ Diplomatic Viewpoints ing the enhancement and improvement of pollution control. We identified plenty of diplomatic importance to the Policy Therefore, we concluded the effectiveness of the enhance- due to factors such as the significance of providing assistance ment and improvement of pollution control to be high. The to developing countries, and showing presence of Japan state of pollution in recipient countries improved to some through its comparative advantages. Concerning the diplo- extent, but outcomes varied widely, and in some assistance matic effects of the policy, it contributes to create a strong
16 2.2 Evaluations by MOFA Chapter 2 Overview of FY2016 ODA Evaluation 17 ------ODA has been, ODA 2.2 Evaluations by MOFA mental preservation/measurein developing countries, promotion the for a diversity involvement of stake of holders, improvement legal systems of environmen for tal preservation, environmental monitoring, cooperation to raise awareness the of residents living on environmen tal problems, and so will on. And continuously ODA be implemented according to the needs developing of coun tries in the future. measures, the strengthening environmental of measures in the local governments and in the central government is necessary. has been ODA supporting the promotion cooperationof between Japan and localgovernments through grass-roots technical cooperation, and, using these, will further promote local governmentalcooper ation in the field of environmentalfuture. management in the nesses/technologies in the private sector supporting the diffusion sophisticated of Japanese envi- ronmental technologies/knowhow to developing coun triesthrough the private cooperating schemes,and will continuously implement these in the future. ing policy documents the of environmental including ODA environmental pollution control measures, corresponding to adoption SDGs of (Sustainable Development Goals) which emphasize effortsin the environmental field. implementing cooperation on mainstreaming environ mental conservation and pollution control and will con tinuously implement cooperation including these items according to the needs developing of countries, in the future. urbandevelopment planning, including components in the field of environmentsewerage water treatment). will encourage ODA management the (waste control, other stakeholders who are in charge areas of outside of the environmental field to make this area mainstreamby widely sharing the necessity efforts of environmental for problems, including the above-mentioned cooperations. continuously investigate the sharing and coordination knowhowof which should beeffective implementing for the specific project based on the advantages, etc.of each society/organization. occurringquicker than environmental measures has often been seen in developed countries. will continu ODA ously advancecooperation based on the necessary mea sures in advance, while always analyzing factors which cause pollution. In this case, the same will as before, ODA investigate cooperation based on the points mentioned in “Recommendation 3”. pollution of internationalfield effortsof cooperationthe in implemented cooperation in areas suchas consolidating organizations and frameworks tomainstream environ Examples of response measures Examples of response ●In ●In order to mainstream environmental preservation and ●In addition, as part of the diffusion of environment busi - ● Perform the necessary discussions focused on formulat ●ODA, in the fieldof environment management, has been ●For example, cooperation is underway on formulating ●By using knowledge networks, ODA will continue to ●The phenomenon of economic growth and development willcontinuously proactivelyand●ODA transmit Japanese ●In ●In the field of environment management, the ODA has
Ger areas in Ulaanbaatar city have been expanding Ger areas in Ulaanbaatar - - - Broad Recommendations for ODA including Other Broad Recommendations for ODA Areas Recommendations for ODA Regarding the Recommendations for ODA Environment Recommendations 2 1 presence of Japan through Japanese comparative advantages. advantages. comparative Japanese through Japan of presence improve the Policy has helped impact, diplomatic As for the with relations amicable by strengthening relations bilateral with smooth communications building countries, recipient Asian Northeast the in (stability countries neighboring basic relations with sanctioned coun- region), and keeping Through these tries. benefits and other factors such as initia tives borne of the adoption of the Minamata Convention, the Convention, Minamata of the of the adoption borne tives of Japan in the improved presence to has contributed Policy Policy the evaluate Therefore, we community. international importance and impact. as having diplomatic [Regarding Viewpoints] Diplomatic global frame by creating effects (6)Enhance diplomatic [Regarding Policy Implementation] regarding network knowledge use of the the (4)Enhance Japanese pollution control cooperation environmental of state the improve to efforts (5)Enhance pollution (super goal) [Regarding Basic Orientation of Policy] environmental mainstreaming toward assistance (3)Provide conservation and pollution control analyze, collect, to properly (3-1)Capacity development data monitor and evaluate environment-related effective systems to promote institutional (3-2)Establish environ- transfer and develop and policy, environmental ment-related technology of stakeholders a variety to enable a framework (3-3)Build Propose, (3-4) conservation environmental in participate to environmen to related policies institutionalize and legislate tal conservation (3-5) Improve environmental awareness among people works and taking leadership in global discussions [Regarding Policy Formulation] on Japanese document policy the main (2)Consider drafting pollution control cooperation (1)Active approach on mainstreaming the environmental the mainstreaming on approach (1)Active policy conservation in in recipient country’s Air Pollution in Ulaanbaatar 2.2 Evaluations by MOFA Aid Modality Evaluation
Evaluation of Grant Aid for Promotion of Japanese Standards
Evaluators (Evaluation Team): •Chief Evaluator: Hiroshi Sato, chief senior researcher Inter-disciplinary Studies Center, Institute of Developing Economies •Advisor: Takuji Date, professor at Department of Healthcare Management, College of Healthcare Management, College of Healthcare Management •Consultant: Mizuho Information & Research Institute,Inc. Period of the Evaluation Study: July 2016 – February 2017 Field Survey Countries: Jordan, Sri Lanka http://www.mofa.go.jp/policy/oda/evaluation/FY2016/pdfs/grant_aid.pdf Background, Objectives, and Scope of the Evaluation medical equipment and disaster reduction equipment were included in the scheme without overseas deployment per- Since FY 2012, Japan had conducted the Grant Aid for spective on specific products and manufactures; and (3) lack Promotion of Japanese Standards (GAPJS), which provides of field-level predictability in budgeting for projects hinders made-in-Japan equipment and products to emerging and effective project formulation. For these reasons, an evalua- developing countries, not only for assisting the economic tion of “Marginal” may be considered suitable for appropri- and social development of developing partners but also for ateness of processes. supporting Japanese companies’ overseas expansion through enhanced awareness of and sustained demands for such ・ Diplomatic Viewpoints equipment and products. In this evaluation, a comprehension Because of such factors as grants being in a concrete form evaluation of the activities and initiatives based on GAPJS of Japanese products and the quick signing of E/Ns, our eval- was conducted. uation was able to identify such diplomatic benefits as the potential to bind execution of projects with such diplomatic Summary of the Evaluation Results activities as official exchanges. Also identified were such benefits as diversification of diplomatic tool. As for impact on bilateral relations between countries,
・ Development Viewpoints GAPJS was shown effective in enhancing familiarity with (1) Relevance of Policies Japanese products at the government and beneficiary levels. Though inconsistent with the international trend of aid untying, GAPJS is generally consistent with Japan’s higher ODA and economic policies and recipient countries’ devel- opment policies, while its fields of providing equipment and products are in alignment with international and domestic priorities. From this, the overall evaluation of relevance of policies, while not reaching “Very High”, can be designated as “High”
(2) Effectiveness of Results The sound operational status of grant equipment and prob- lem-free maintenance system earn positive marks. In terms of contributing to partner countries, equipment grants were in fields consistent with priority policies, direct benefits from operating equipment existed, and benefits for policy imple- mentation were observed. On the Japanese economic revi- talization front, although there are some contributions to the sales of contracting companies, the issue remained that no effective action targeting market development or promo- tion of Japanese standards, which is conclusive goal of this scheme, was found. Based on this, the overall evaluation of effectiveness of results is “Moderate”.
(3) Appropriateness of Processes Positive marks are earned from the fact found in the field studies that MOFA, supplier agencies, and partner country governments hold appropriate discussions. However, iden- tifiable problems include that: (1) insufficient consideration were given to categorical designation of providing equip- ment and products in the scheme-founding phase and to CT scanner supplied to hospital in Sri Lanka effective coordination with other existing aid schemes; (2)
18 2.2 Evaluations by MOFA Chapter 2 Overview of FY2016 ODA Evaluation 19 ------2.2 Evaluations by MOFA Create plans/goals as specific as possible,while coop erating with diplomatic establishments abroad to col lect/identify targeted,be needsspecify to andthe field while, at the same time, clarifying the positioning of the scheme and the goals to be achieved. Create a sys tematic evaluation process under the condition that the results be disclosed, and introduce the evalua ex-post tion system completed for projects in FY2017. Improve predictability through project at earlier planningperiod of the fiscal potential year. to realizeAlso, a higher support of level aim to implement the project, with a point of view on at the initiative diplomatic of the establishments abroad, specific effects and investigate the possibility cooperation of with the JICA projects. Identify the field/target equipmentwhich contributes to improving the recognition Japanese of technologies/ systems and to normalization/standardization, then specify an equipment grouping to connectwith project formation, while cooperating with relevant ministries and agencies, and relevant associations, according to the situation overseas of operations the of each indus try/field Japan.in This scheme specifies efforts that takeboth aspects in development of developing coun into account tries and economic vitalization in Japan, based on the Development Cooperation Charter, and externally instructs support in accordance with the international goals suchas Sustainable Development Goals (SDGs) example, Health, Education,(for Energy, Climate Change, to implement Biodiversity the etc.) individual project. Examples of response measures ● ● ● ●
Hybrid vehicle supplied to the Jordan Ministry of Environment Hybrid vehicle supplied to the - - Identification of Scheme and Project Objectives for Project Objectives for of Scheme and Identification a Feedback Mechanism the Purpose of Establishing Clarification of Positioning in Global Goals Selection of Priority Target Medical and Disaster Target Selection of Priority reduction Equipment Improvement to Predictability of Project Formulation and Improvement to Predictability Authority on Local Level Strengthening of GAPJS is intended for the strategic use of ODA to further further to use of ODA strategic for the GAPJS is intended With With respect to the automobile field, in coordination with Through the advance undertaking of individual coun- undertaking of individual Through the advance Input objectives should be given shape by organizing needs be given shape by organizing should Input objectives Recommendations 4 3 2 1 ence and technologies. the economic national interest of Japan and strongly favors strongly and of Japan interest national economic the in comparison to other development Japanese industrial is to address The proper role of ODA, however, schemes. and social for the economic issues and to aim international growth of developing countries, a point of concern because we point, on this improve To criticism. opens GAPJS to it propose redefining GAPJS as a scheme that contributes to environmental, issues, including international to solutions experi Japan’s and disaster issues, by exploiting medical, industrial groups, GAPJS specializes in a field having supe- the not is this However, aspects. environmental in riority effect To reduction equipment. and disaster case for medical groups equipment designate is necessary to it improvement, advantages. that can demonstrate Japan’s try studies premised on GAPJS execution and preparation on GAPJS try studies premised execution a framework projects, of candidate of such items as lists of priority target that enables selection should be created of projects in countries, coordination aimed at formulation advance at the field level, and effective coordination with other initiatives. tives should be considered about identification and system- and realistic monitoring. of effective atic implementation by territory, field, and so forth. Output and outcome objec 2.2 Evaluations by MOFA Sector Program Evaluation
Evaluation of Assistance in the Industrial Human Resource Development Sector in Thailand
Evaluators (Evaluation Team): •Chief Evaluator: Professor Izumi Ohno, National Graduate Institute for Policy Studies •Advisor: Associate Professor Yoshi Takahashi, Graduate School for International Development and Cooperation, Hiroshima University •Consultant: Mitsubishi Research Institute, Inc. Period of the Evaluation Study: July 2016 – February 2017 Field Survey Countries: Kingdom of Thailand http://www.mofa.go.jp/policy/oda/evaluation/FY2016/pdfs/Thailand.pdf Background, Objectives, and Scope of the Evaluation relevant agencies, and (3) implementation of monitoring and follow-up. Overall, the implementation of Japanese indus- Japan has provided assistance in the industrial human trial human resource development was found to be based resource development sector in various parts of the world, on appropriate processes. At the same time, regarding the with a focus on Southeast Asia. Over the years many Japanese assessment of needs and practical coordination, considering companies have been making inroads into Thailand, and as that there was an absence of a platform where a wide vari- the country has come to serve as an important supply chain ety of concerned parties from industry, government and aca- base to the Japanese economy, governmental and private demia could participate, before the Round Table Conferences actors have worked together on various activities in the field of Human Resources Development began in March 2016, it of human resource development. This evaluation reviews the is necessary to use the momentum of the Japan-Thailand initiatives from the 1980s onwards and provides recommen- Industrial Human Resource Development Cooperation dations for the planning and implementation of future ODA Initiative of December 2016 to strengthen comprehensive policies. efforts including the monitoring and follow-up of Japanese aid. Summary of the Evaluation Results ・ Diplomatic Viewpoints Japanese aid has simultaneously helped strengthen ・ Development Viewpoints Thailand’s industrial power by developing local Thai indus- (1) Relevance of Policies tries, and contributed to the support and promotion of man- Supporting industrial human resource development in ufacturing activities, mostly in the automotive industry, of Thailand is highly consistent with Japan’s high-level poli- Japanese companies that have been advancing in Thailand. cies (the old ODA Charter, the Development Cooperation From the viewpoint of economic diplomacy, it has benefited Charter and country-specific assistance policies) and the both countries. The growth and success of industrial human development needs of Thailand. Furthermore, Japan has a resources who is well informed of Japan is also important in comparative advantage over other donors in this sector in terms of diplomatic impact. terms of both quality and quantity, and has been involved in it ahead of international aid trends. On the other hand, until the announcement of the Industrial Human Resource Development Cooperation Initiative in November 2015, it had not been clearly defined and communicated as an inde- pendent sector, and in the future, it will be necessary to rein- force its status as a policy and the communication of related information. As a result, the relevance of policies was found to be moderate.
(2) Effectiveness of Results The effectiveness of results was evaluated through case studies in five different areas: (1) training policy-making personnel, (2) human resource development in the support- ing industries, (3) training of business support personnel, (4) developing private sector human resources through higher education and vocational schools, and (5) Thailand’s emer- gence as a donor in Triangular Cooperation South-South Cooperation.
(3) Appropriateness of Processes Appropriateness of processes was evaluated from three viewpoints: (1) understanding of the development issues of Company that has received training regarding education in automotive the sector in question, (2) aid implementation structure of the component industry
20 2.2 Evaluations by MOFA Chapter 2 Overview of FY2016 ODA Evaluation 21 ------up - 2.2 Evaluations by MOFA Creating a model from industrial human resource development Creating a model from industrial human resource development in other countries Thailand and its implementation assistance in Strengthening communication on Japan’s industrial human industrial on Japan’s Strengthening communication resource development assistance cussions and discussions between embassies and relevant ministries in the future. cooperation sive framework futurefor industrial human resourcedevelopment between Japan and Thailand, based on industrial issues and supply and demand labor, and of theof education sectors in Thailand. cooperationof between industry, governmentand aca demia, promotethe involvement in projectcreation and opportunities discussion of among the three parties. lishments abroad including strategic personnel selection trainees of abroadto Japan, andmonitoring and follow ter and foreign minister. other countries concerning the cooperation policy in Thailand. Also, based on the requirements Thailand, of consider cooperation that centers around Thailand with a third country. human resource developmentin speeches the of foreign minister regarding the important policies development of cooperation and international cooperation increasing for support industrial of human resourcedevelopment by Japan. DevelopmentCooperation Initiative” reached in December last year as an opportunity, promote and discuss the establishment system of environment for thesophistication industrial of human resources in Thailand,and utilizethe opportunities high of dis level on trainees returned who have home. multipleopportunities the of ASEAN Summit, foreign ministers’ meetings and so on, and introduce Japanese efforts industrial of human resources development by documents and include messages from the prime minis Compared to other donors, Japanese industrial human to other donors, Japanese industrial Compared human resource devel that an industrial It is recommended Examples of response measures ●Reach ●Reach a high-level agreement regarding the comprehen ●As for IHR development, concerning the importance ●Investigate strengthening of the role of diplomatic estab ●Advance industrial human resources development with ●Continuously indicate the significance of industrial ●With “Japan-Thailand Industrial Human Resource ●Strengthen the introduction of Japanese efforts using 7 6 strategically utilizes and fosters industrial human resources human resources fosters industrial and utilizes strategically personnel well informed about Japan be created (identifica tion and utilization of talented personnel, passing on infor personnel, passing of talented tion and utilization sharing it between human resources and to related mation etc.). organizations, and traits has distinguishing assistance development resource summariz a medium that It is recommended a long history. ing the defining characteristics of Japanese industrial human in utilized and produced be assistance development resource advantage in the sector, comparative Japan’s communicating to When doing so, it is important and in donor co-ordination. takes into con- information in a way that also communicate trends. sideration its relation to international aid and lessons learned on the based be developed model opment and that Thailand, gained from the assistance in experiences as in as well Thailand in future aid to the model be utilized in the form of South- South Thailand by aid implemented cooperation. - - - - - Strategic utilization and fostering of industrial human resources well informed about Japan Formulating, implementing, monitoring and evaluating a Formulating, implementing, monitoring and evaluating program aid comprehensive and effective Developing the institutional environment through intergovernmental dialogues further for sophistication industrial of Mainstreaming industrial human resource development in Japan’s development in Japan’s industrial human resource Mainstreaming development policies specific sector- aid and formulating Establishing systems and structures to support industrial human resource comprehensive and effective development assistance Industrial human resource development requires the Industrial human resource development It is recommended that in view of the scale of Japanese that It is recommended of and appropriateness In improving the effectiveness It is recommended that, in the future, seizing the oppor the seizing future, the in that, is recommended It Despite its comparative advantage, the status of Japanese the status of Japanese advantage, Despite its comparative Recommendations 5 2 3 1 4 involvement of a variety of actors from government, indus- involvement that a It is recommended institutions. try and educational aid structure be established and effective comprehensive and aca government of industry, the cooperation enabling assistance in Thailand, a comprehensive assistance plan that assistance a comprehensive Thailand, in assistance demand the supply and industry, Thai considers the issues of and future of the situation as the current as well of labor, localization and systematic formulated, be sector education of effectiveness in order to increase the measures be taken as well as the and evaluation, monitoring its implementation, of individual aid projects. effectiveness impact, the role played by Japanese aid and its diplomatic Thai industrial personnel well informed about Japan has been very significant. It is recommended that a system that demia on the policy level as well as in practice (continuously demia on the policy level as well as in practice holding roundtable discussions on human resource develop and government of industry, representatives involving ment pol- developing and Thailand, and Japan both from academia working-level a establishing outcomes, on their based icies etc.). support organization tance of industrial human resource development be continu resource development tance of industrial human for Development Policy Priority the within ously mentioned Cooperation 2) sector-specificindustrial human recipient for all aid policies be formulated development resource in this sector. assistance of expanding with the aim countries, Human Industrial Japan-Thailand by the provided tunity dialogues Cooperation Initiative, Resource Development be strength- Thailand the Governments of Japan and between with environment ened, in order to develop the institutional further sophisti- of aid and the aim of expanding the impact (increasing Thailand resources in human of industrial cation voca- and engineering of field the in applicants of number the shindan-shi etc.). tional schools, promoting the activities of industrial human resource development assistance as a pol- assistance development resource human industrial icy has not been sufficiently defined.growing need for industrial human that, based on the It is recommended impor the 1) various countries, in development resource 2.2 Evaluations by MOFA Ex-Post Evaluation
Ex-Post Evaluation on Grant Assistance for Japanese NGO Projects
Background The Grant Assistance for Japanese NGO Projects is a scheme to provide funding for development projects which have direct benefits for people in developing countries and are implemented by Japanese NGOs which meet cer- tain requirements (the disbursement through the scheme in FY2016 amounts to 4.34billion yen for 102 projects to 54 organizations in 29 countries and 1 region in total). With the increasing significance of development assistance by Japanese NGOs, MOFA has been implementing ex-post evaluation every year since FY2005 in order to enrich the evaluation of projects that have been implemented under the scheme.
Objective of the Evaluation Specified Non-Profit Corporation: JMAS (at Angola) The objective of the evaluation is to examine actual condi- Mine cleaning and restoration works in affected areas in Gombe State tions at the project sites after a certain period (3-4 years) fol- lowing the completion of the project. Evaluation results are reported to the NGOs who implemented the projects, and these results are used as reference when examining similar projects among the MOFA headquarters, embassies, and con- sulates as part of the PDCA cycle.
Evaluation Methods The staff of the embassies or consulates in charge of the administration management of each project implement stud- ies of the project 3-4 years after its completion. Studies are conducted to examine the situation from the viewpoints of the relevance of programs, the degree of goal achieve- ment, efficiency, impact, sustainability, social consideration, and Specified Non-Profit Corporation: CCP Japan (at Palestinian Autonomous Areas) environmental consciousness, using designated for- mats Reconstruction and consolidation in agricultural sectors in Gaza: Promotion of the human resources development and the agriculture of environmental conser- (Ex-Post Evaluation Sheets). Also, conditions such as main- vation type (3G) tenance and management of buildings and equipment, uti- lization of educational and training facilities and human resources, cooperation in publicity to ensure the visibility of Japan’s ODA, as well as the maintenance and management systems of local implementing agencies, are examined. The results are rated in three ranks (A, B, and C) and are reported to the MOFA headquarters.
Evaluation Results In FY2016, out of 92 projects for which contracts had been signed in FY2012, 28 projects (consisting of 23 organiza- tions in 17 countries) were evaluated during the fiscal year, excluding projects such as those which could not be eval- uated due to security considerations and those that are still ongoing in the following year. As a result, 21 projects were rated as “A” (high quality), 6 projects as “B” (acceptable), Specified Non-Profit Corporation: AMDA-Minds (at Honduras) Campaign of and 1 project as “C” (low quality). promotion by using the Maternal and Child Health Center
22 2.2 Evaluations by MOFA Chapter 2 Overview of FY2016 ODA Evaluation 23 2.2 Evaluations by MOFA ↓ ↓ Cabinet decision the year as necessary Signing of the E/N and Communications Releasing evaluation results
• Overall policy on economic Conducting ex-post evaluation every 2.2 Evaluations by MOFA by Evaluations 2.2 (GPEA) Act Policy Evaluations Government Based on Evaluation MOFA conducts policy evaluations in accordance with the in accordance conducts policy evaluations MOFA MOFA carries out the following evaluations of ODA of ODA carries out the following evaluations MOFA Each ministry and agency analyzes the impact of its pol- Each ministry and agency please of the policies, of the evaluations details Regarding http://www.soumu.go.jp/main_sosiki/hyouka/seisaku_n/ In Japan’s policy evaluation system, each ministry and ministry each system, evaluation policy Japan’s In 2. ODA Evaluation by MOFA Based on the GPEA Evaluation by MOFA 2. ODA 1. Government Policy Evaluations Act (GPEA) Policy Evaluations 1. Government *ODA evaluation based on the GPEA is self-evaluation. provisions of Article 6, Article 7, and Article 8 of the GPEA GPEA Article 8 of the Article 7, and Article 6, provisions of (formu- Evaluation Plan on Policy Basic and based on the basic matters con- lated once every 3-5 years) that stipulates implementing methodologies, including evaluation cerning as the well as of information systems, and the disclosure Operational Plan (formulated every fiscal year), which lists policies in accordance with the GPEA and its Order for Order its and GPEA the with accordance in policies is shown in The process for each evaluation Enforcement. the diagram below. (1) Policy-Level (Ex-Post Evaluation) icies based on whether their objectives and targets meet the meet targets and objectives their whether on based icies their whether (necessity), society and people of the needs with the cost compared when are adequate achievements (efficiency), andwhether the expected impactsare The results of the evaluations have been (effectiveness). achieved planning and formulating for reviewing policies and utilized new policies. by the Ministry refer to “Portal website of policy evaluation” below: Affairs of Internal portal/index.html agency is required to conduct a self-evaluation of the poli- of the self-evaluation a to conduct is required agency pursuant to the Government Policy cies under its jurisdiction Act Evaluations (GPEA). 2.2 Evaluations by MOFA Evaluation Based on Government Policy Evaluations Act (GPEA)
Ex-Ante Evaluations for Grant Aid Projects:40(Projects with grant more than 1 billion yen) Date of Signed on Country Project Contract (Japan time) Rwanda Project for Rehabilitation of Irrigation Facilities in Rwamagana District Mar 31, 2017 Project for Improvement of Battambang Provincial Referral Hospital Cambodia Mar 30, 2017 Project for Expansion of Water Supply System in Kampong Thom Kyrgyz Project for Avalanche Protection on Bishkek-Osh Road Mar 30, 2017 Papua New Guinea Project for Rehabilitation of Alotau Town Market and Fisheries Facilities Mar 27, 2017 Philippines Project for Consolidated Rehabilitation of Illegal Drug Users(Care) Mar 23, 2017 Mozambique Project for Construction of Bridges on N380 in Cabo Delgado Province Mar 15, 2017 Liberia Project for Reconstruction of Somalia Drive in Monrovia Phase 2 Mar 14, 2017 Cuba Proyecto para el mejoramiento de la technologia de produccion desemilla de arroz Mar 10, 2017 Tajikistan Project for Rehabilitation of Substations in Dushanbe Mar 9, 2017 Myanmar Project for Expansion of Broadcasting Equipment of Myanma Radio and Television Mar 3, 2017 Project for Improvement of Value Chain of Agriculture in Hera (Cooperation with UN and Afghanistan via Implementation of UNOP) Feb 27, 2017 Project for Imrovement of Agricultural Value Chains in Herat Nepal Pkhara Water Supply Improvement Project Feb 15, 2017 Bhutan Project for Reconstruction of Bridges on Primary National Highway No. 4 Dec 16, 2016 Afghanistan Project for Infectious Diseases Prevention for Children (Thru UNICEF) Dec 13, 2016 Myanmar Project for Improvement of Magway General General Hospital Dec 7, 2016 Maldives Digital Terrestrial Television Broadcasting Network Development Project Oct 27, 2016 Sudan Project for Improvement of Water Treatment Plant in Kosti City Oct 11, 2016 Timor Leste Project for Urgent Relocation of Ferry Terminal in Dili Port Sep 30, 2016 Project for Improvement of Transportation Capacity of Public Bus in Phnom Penh Cambodia Sep 27, 2016 Project for Improvement of Equipment for Demining Activities (Phase 3) Proyecto de Adquisicion de Equipos Medicos pala el Mejoramiento de Servicios de Cuba Sep 22, 2016 Atencion a la Salud en los Hospitales Principales Senegal Project Rehabilitation of The Third Wharf in Dakar Autonomous Port Sep 20, 2016 Tajikistan, Afghanistan Project for Strengthening Disaster Risk Reduction and Response Capacities Sep 7, 2016 Nepal Project for Improvement of Aviation Safety Facilities in Major Airports Aug 31, 2016 Project d’amenagement du site du debarcadere et de la construction du marche central pour Cote d’Ivoire Aug 17, 2016 le developpement de la zone commersiale de la commune de Sassandra Project for Procurement of Education and Research Equipment for Egypt-Japan University Egypt Jul 26, 2016 of Science and Technology (E-JUST) Mozambique Project for Construction of Bridges on the Road between Ile and Cuamba Jul 20, 2016 Kiribati Project for Reconstruction of the Nippon Causeway Jul 11, 2016 Sri Lanka Maritime Safety Capability Improvement Project Jun 30, 2016 Myanmar Project for Improvement of Foot-Mouth Disease Control Jun 2, 2016 Project for the establishment of Research and Training Complex at the Faculty of Sri Lanka May 18, 2016 Agriculture, University of Jaffna Project for the Construction Advanced Research Center for Infectious Diseases at Noguchi Ghana May 18,2016 Memorial Institute for Medical Research Project for Extension Equipment Provision for the National School of Public Health of Mauritania May 9, 2016 Nouakchott Laos Project for Reconstruction of the Bridges on the National Road No. 9 May 4, 2016 Uganda Project for Improvement of Gulu Municipal Council Roads in Northern Uganda Apr 29, 2016 Project for Emergency Assistance to Displaced Persons in Ethnic Areas (Coordination with Myanmar Apr 27, 2016 WFP) Project to Supply Stable Power According to Urgent Humanitarian Necessity in Syrian Communities That Have Been Affected by the Crisis (Coordination with UNDP) Syria Apr 15, 2016 Project for Transmission of Reliable Electricity to Respond to the Immediate Humanitarian Needs in crisis-affected Communities of Syria Togo Projet de renforcement du port de pache de Lome Apr 13, 2016 Micronesia Project for Power Sector Improvement for the State of Kosrae Apr 1, 2016
24 2.2 Evaluations by MOFA Chapter 2 Overview of FY2016 ODA Evaluation 25 - Contract Contract (Japan time) Date of Signed on Date of Signed on Date of Signed April 20, 2016 May28,2016 May 6,2016 Jun 29, 2016 Sep 27, 2016 Sep 30, 2016 Oct 10, 2016 Oct 26, 2016 Oct 24, 2016 Nov 15, 2016 Dec 22, 2016 Dec 23, 2016 Jan 10, 2017 Jan 18, 2017 Mar 21, 2017 Mar 29, 2017 Mar 31, 2017 Aug 18, 2011 2.2 Evaluations by MOFA ) Ⅲ to the Partner Government” completed”. Aid, “Remit to the Partner Government NOT Grant ) MOFA’s Policy Evaluation Report. In FY2017, ex-post eval FY2017, ex-post In Report. Evaluation Policy MOFA’s *1 : “Cabinet Decision” Aid, “Remitted Loan, “Loan implemented”. In case of Grant *2 : In case of ODA completed”. In case of Loan, “Loan complementing NOT *3 : In case of ODA uations based on the GPEA were conducted on 23 projects uations based on the GPEA 22 and begun been not had which project loan 1 ODA all, in which had not been completed. loan projects ODA Ⅱ Project Name of Project Urban Transportaion Line-3 Development Project(1) Transportaion Urban Ho Chi Minh City Urban Railway Construction Project (Ben Thanh – Suoi Tien Section (Line Section Tien – Suoi Thanh (Ben Project Construction Railway Urban City Minh Ho Chi 1)) (III) Improvement Project ( Environment Water Second Ho Chi Minh City Cross-Border Road Network Improvement Project (Bangladesh) Cross-Border Road Network Improvement Project development Project (2) Transit Dhaka Mass Rapid (2) Matarbari Ultra Super Critical Coal-FiredPower Project Disaster Risk Management Enhancement Project Laguna Colorada Geothermal Power Plant Costruction Project (Phase 2) Laguna Colorada Geothermal Power Plant Costruction Mass Transit SystemProject In Bangkok (RED LINE) (3) Transit Mass Electricity Sector Rehabilitation and Improvement Project Electricity Sector Rehabilitation and Improvement Grand Egypitan Museum Construction Project ( Anuradhapura North Water Supply Project Phase 2 Supply Water Anuradhapura North Maritime Safety Capability Rehabilitation and Improvement Project for PCG (Phase II) Maritime Safety Capability Rehabilitation and Improvement Projet de Construction de l’Usine de Dessalement de l’ eau mer des Mamelles de l’ Projet de Construction de l’Usine de Dessalement Project for Construction of Nagdhunga Tunnel Project for Construction of Nagdhunga Agreement with Nepal: Contributing to a more efficient Loan Signing of Japanese ODA first road tunnel trade network through the construction of Nepal’s Bago River Bridge Construction Project Electricity Sector ReconstructionProject (Phase 3) Electricity Sector ReconstructionProject (Phase 3) Regional Development Project for Poverty Reduction Phase 2 Regional Development Project Project Phase 1 (2) Railway Improvement Yangon-Mandalay (1) Supply Project Phase 2 Water Yangon Greater for Small-Medium Sized Enterprises Loan Project Two-Step Agriculture and Rural Development Development and Toamasina Port Development Project Port Development Toamasina Rentang Irrigation Modernization Project in East Java Province Rentang Irrigation Modernization (Phase 3) Komering Irrigation Project Project for Construction of Trans-Mumbai Bay Highay (Phase 1) Trans-Mumbai of Project for Construction Chennai Metro Project (V) Project Delicated freight Corridor Andhra Pradesh (Phase 2) of Irrigation and Livelihood in Project for Improvement 2) Nadu (Phase Tamil of Investments in "Program for Promotion Loan with the Government of India" Signing of Japanese ODA Continuing Assistance for Infrastructure Development for Socio-economic Development in Assistance for Infrastructure Development for Socio-economic Continuing Indonesia Country 2.2 Evaluations by MOFA by Evaluations 2.2 (GPEA) Act Policy Evaluations Government Based on Evaluation Country on Loan Based on the provisions of Article 7, Paragraph 2 of the Article Based on the provisions of Panama Viet Nam Viet Bangladesh Bolivia Thailand Egypt Sri Lanka Philippines Senegal Nepal Myanmar Iraq Myanmar Madagascar Indonesia India Indonesia Ex-Ante Evaluations for ODA Loan Projects:29(Projects with grant more than 15 billion yen) than 15 billion with grant more Loan Projects:29(Projects ODA for Ex-Ante Evaluations ) )(5 years past loan project not yet Started:1(ODA Projects Ex-Post Evaluations for (b)Ex-Post Evaluation MOFA Order for Enforcement, 2 of its Article and GPEA assistance economic the on evaluations ex-post conducts have not begun the provision of assistance that projects at 5 years past after the policy decision (*1), those which (*2) to achieve the have not started the necessary activities which (those projects unfinished the on and effects, intended (*3) at 10 years past effect) have not produced the intended based is conducted This evaluation decision. the policy after to order in evaluation policy the of Plan Operational the on of the projects in ques- consider whether the implementation The evaluation or discontinued. tion should be continued in and website MOFA on the publicized annually are results 2.2 Evaluations by MOFA Evaluation Based on Government Policy Evaluations Act (GPEA)
Ex-Post Evaluations for Unfinished Projects:22 (ODA loan projects only)(10 years past) Date of Signed on Country on Loan Name of Project Contract Indonesia PLN Operation Improvement System Project for Supporting Generation Facilities Mar 28, 2007 Indonesia Peusangan Hydroelectric Power Plant Construction Project Mar 28, 2007 Project for Capacity Building in Engineering, Science and Technology (C-BEST) Indonesia Mar 28, 2007 Hassanddin University in the Eastern Port of Indonesia Indonesia NSDI Project Mar 28, 2007 Indonesia Aceh Reconstruction Project Mar 28, 2007 Ho Chi Minh City Urban Railway Construction Project: Ben Thanh-Suoi Tien Section (Line Viet Nam Mar 30, 2007 1) India Andhra Predesh Irrigation and Livelihood Improvement Project Mar 30, 2007 India Tripura Sustainable Forest Management Project Mar 30, 2007 India Gujarat Forestry Development Project Phase 2 Mar 30, 2007 India Agra Water Supply Project Mar 30, 2007 India Amiritsar Sewerage Project Mar 30, 2007 India Orissa Integrated Sanitation Improvement Project Mar 30, 2007 Pakistan INDUS HIGHWAY PROJECT Dec 13, 2006 Bangladesh Karnaphuli Water Supply Project Jun 26, 2006 Egypt The Grand Egypitan Museum Construction Apr 30, 2006 Tunisia Jendouba Rural Water Supply Project Apr 29, 2006 Tunisia National Television Broadcasting Center Project Mar 12, 2007 Tunisia Water Saving Agriculture Project in Southern Oasis Area Mar 30, 2007 Morocco Sewerage System Development Project (II) Mar 30, 2007 Iraq Irrigation Sector Loan Jan 10, 2007 Iraq Al-Mussaib Thermal Power Plant Rehabilitation Project Jan 10, 2007 Iraq Samawah Roads and Bridges Construction Project Jan 10, 2007
26 2.2 Evaluations by MOFA Chapter 2 Overview of FY2016 ODA Evaluation 27 Self Self Self Self Self Self Self Self Self Self Self Self Self Self Self Self Self Self Self Self Self Self Self Self Self Self Self Evaluator type GPEA GPEA GPEA GPEA GPEA GPEA GPEA GPEA GPEA GPEA GPEA GPEA GPEA GPEA GPEA GPEA Others Others Others Others Others GPEA Evaluation GPEA/others GPEA/others GPEA/others GPEA/others GPEA/others 2.3 Evaluations by Other Ministries and Agencies 2.3 Evaluations by Other Ministries and Title Technical Assistance to Financial Supervisory Authorities in Emerging Authorities in Emerging to Financial Supervisory Assistance Technical Promotion of Sustainable Forest Management in Developing Countries Countries Developing in Management Forest Sustainable of Promotion Promoting Participation in and Cooperation to Activities of International of International Activities Promoting Participation in and Cooperation to Support of Fluorocarbon Management in Developing Countries Support of Fluorocarbon Management in Developing Promoting International Cooperation and Coordination Establishment of Comprehensive Food Security Support to overseas markets development The Support for the activities of the United Nations Statistical Institute for Institute Nations Statistical United the activities of for the Support The Affairs Cooperation in Legal Promotion of International Development Banks Assistance through Multilateral Promotion of International Exchange Promotion of International Cooperation Promotion of Participation in and Cooperation to Activities of International Activities of International Promotion of Participation in and Cooperation to by Conducted Projects Cooperation Technical to Contribution Organizations: WHO ,UNAIDS and Other International Organizations. the ★ ★ ★ Cooperation Projects toward Technical Contribution to Organizations: Labour International the by Conducted Work Decent of Realization (ILO) Organization ★ ★ under International Cooperation ★ Promotion of Global Strategy in the ICT Sector in the ICT Promotion of Global Strategy ★ Asia and the Pacific ★ ★ ★ ★ and Other Economies Asia Market Economies in Dissemination of Japanese Culture and Promotion of International Cultural of International Cultural Dissemination of Japanese Culture and Promotion Exchange Contribution to the Universal Postal Union Contribution to the Universal Promotion for Improvement of International Water Environment Water Promotion for Improvement of International Low Carbon/Recycle Oriented Society Building Reinforcement Program Promotion of International Environmental Cooperation and Reduction Gas for Greenhouse Approach of Co-benefits Promotion Asia Pollution Control in Contribution to Global Adaptation Network (GAN)/Asian Pacific Adaptation Network Asia Contribution for Promotion of the 3Rs in Membership Dues for International Union for Conservation of Nature and Membership Dues for International Union for Conservation of Nature and Natural Resources International Wetlands Membership Dues for Contribution to International Union for Conservation of Nature and Natural Fund of the United Nations Environment Programme of the International Establishment Fund for the Trust Cooperation Technical Centre in Japan Technology Environment Policy Policy Policy Project Project Project Policy/ Project Project Project Project Project Project Project Project Program Program Program Program Program Program Program Program Program Program Program Program Program Program/ 2.3 Evaluations by Other Ministries and Agencies and Other Ministries by 2.3 Evaluations Agency Finance Tourism Ministry Fisheries Agencies Economy, of Internal Education, Ministries/ Affairs and Affairs Ministry of Ministry of Ministry of Ministry of Ministry of Technology Science and and Welfare Agriculture, Forestry and Environment Transport and Transport Infrastructure, Ministry of the Health, Labour Culture, Sports, Ministries and agencies evaluate ODA policies, programs, and projects in accordance with the Government Policy Evaluations the Government Policy with and projects in accordance programs, policies, ODA and agencies evaluate Ministries Communications Ministry of Land, Financial Services Ministry of Justice Trade and Industry Trade Act (GPEA) in principle. Evaluations of policies, programs and projects performed in FY2016 are as follows. Those marked with Those marked follows. as FY2016 are in performed projects programs and of policies, Evaluations in principle. Act (GPEA) version of this report. in the Japanese a star (★) are summarized 2.3 Evaluations by Other Ministries and Agencies
Financial Services Agency
Technical Assistance to Financial Supervisory Authorities in Emerging Market Economies in Asia and Other Economies Evaluation type : GPEA Evaluation period : June,2017 Policy Program Project Evaluator : FSA http://www.fsa.go.jp/seisaku/index.html
and I really would like to utilize knowledges obtained for Contents of Policies, Programs and Projects future developments of my country.”, and “Participation to FSA conducts technical assistance training by the FSA the training gave me an opportunity for considering future staffs on regulatory and supervisory frameworks of banking, direction of the supervision.” securities and insurance industries to officials of each indus- try, who are invited to Japan, from Asian and other emerging ●Efficiency(Appropriateness) countries. While growing globalization of international activities and financial transactions, the sound development of financial Overview of Evaluation Results systems in the emerging countries is important to increase ●Comprehensive Evaluation the stability of the international financial systems including Seminars for the financial authorities in emerging coun- Japan. Also, in order to improve the development of compe- tries were held by FSA as technical assistance training, for tency of the financial authorities in the emerging countries as Bank supervisor in August, 2016, for Insurance supervisor well as personnel development, it is necessary that FSA plays in November, 2016 and for Securities supervisor in March, the main role in sharing knowledges and experiences about 2017 in Tokyo. These were valuable opportunities for the financial systems in Japan. financial authorities in emerging countries to improve their development of competency. Reflection/Countermeasures to Lessons/Policies
●Necessity(Adequacy) It is necessary to continuously and proactively tackle with Sound development of financial system in the emerging the development of competency of the financial authorities in countries which has close relationship with Japan is import- emerging countries as well as personnel development for the ant for the improvement of stability of international finan- establishment of financial and capital market in the emerging cial systems including Japan, and it is necessary to improve countries. In addition to Asian countries with which we have the development of competency of the financial authorities already established relationships, FSA appropriately selects in the emerging countries as well as personnel development other target countries, taking into consideration of needs of through sharing our experiences and technical assistance. the financial institutions in a timely manner. Implementation with enough consideration of cost-effectiveness must be ●Effectivity required. At the end of the each Seminar, questionnaire survey was conducted. The result includes the following good remarks. “I could get so many useful knowledges through the train- ing. Most of issues on the banking supervision in my coun- try were included in the presentations, therefore, it was very beneficial.”, “Seminar was entirely beneficial to our country,
Seminar for Bank Supervisors Seminar for Insurance Supervisors
28 2.3 Evaluations by Other Ministries and Agencies Chapter 2 Overview of FY2016 ODA Evaluation 29 - - - MIC GPEA August, 2017 : : : Evaluator Evaluation type Evaluation period 2.3 Evaluations by Other Ministries and Agencies 2.3 Evaluations by Other Ministries and SIAP to be operated by contributions of the countries and of the countries to be operated by contributions SIAP SIAP is the only specialized institution for statistics train- institution is the only specialized SIAP in establishment persons since staff statistic Governmental SIAP reflects the specific training needs (example: creat the international institutions, has need to strengthen its own- the international of the cash and kind contributions ership and to try to expand the response to in institutions, international the and countries planned has also SIAP Agenda. 2030 the as like issues new in MIC seminars cooperating with the Bureau of Statistics of and has been consulting case studies in Japan on diffusion Japanese statistic technologies and thoughts. ing in UN. SIAP performed trainings for 16,139 performed ing in UN. SIAP from 137 countries and regions, having 1970 through 2016, courses from the the training to attend hugely many requests and the number, countries and some courses had exceeded SIAP the persons by staff core and executive many produced to human resource trainings, and have been contributing Japanese countries. in the stage on statistic developments training project highly esteemed assistances to the SIAP technol Japanese statistic assume diffusing internationally, the of improvement with connecting and thought, and ogy world position of Japan on the statistic field. statistics creating data, governmental using the ing statistics of e-learn issues, expansion new policy the understand to conferences, international using course curriculums, in ing) reports of researching the needs in developing countries in staff executive networks with and attendants training has been Also, SIAP Bureau of Statistics in the countries. (cash/kind) of contributions advance requiring continuously the through institutions, international the and countries the to Japan has been conferences from Japan. MIC as international by for cost-saving on cash contribution making every effort and necessity of the training, an effect Japan, with checking of two estimations comparing and for procurement tendering or more parties. Reflection/Countermeasures to Lessons/Policies ●Effectivity ●Effectivity ●Efficiency(Appropriateness) - - Project Program 2.3 Evaluations by Other Ministries and Agencies and Other Ministries by 2.3 Evaluations Policy Ministry of Internal Affairs and Communications Affairs of Internal Ministry http://www.soumu.go.jp/menu_seisakuhyouka/kekka.html l Institute for Asia and the Pacific Asia and for l Institute Nations Statistica of the United for the activities The support SIAP has been contributing improvement of capacities of of capacities improvement has been contributing SIAP Many staff persons to be the executive key-person and core executive persons to be the Many staff SIAP has been implementing the projects to enforce the projects implementing has been SIAP creating statistics and human resource developments of lead developments resource and human statistics creating ing/core staff persons in Bureau of Statistics of the countries. of Statistics persons in Bureau staff ing/core of statistics formulating and improving capacities Recently, in Bureau of Statistics of the countries have strengthen to be 2030 of the Target the and Goal the for specifying required, of functions Therefore, in 2015. at UNGA Agenda adopted aggres- Such recognition. more been gaining have SIAP projects regarding human sive contributions to international of improvement to should contribute development resource of trust and the world position of Japan, and to securement proj- relevant the promoting results, As Japan. for confidence ects is continuously necessary. staff in Bureau of Statistics of the countries were produced in Bureau of Statistics staff trainings, and they have assumed formulating by the SIAP develop system and a human resource a modern statistic upskilling of creation of statistics and practice capacities in capacities and practice of statistics of creation upskilling developing countries of region of Asia and the Pacific. The and cash of contribution by operated been have projects and by fund- in ESCAP, countries kind from the member has been providing cash MIC agencies. ing of international outsourced and kind (facilities/equipment), (contribution) domestic governments, presenters and trainings at local opera- to be necessary on SIAP by MIC staff arrangements tions) as the partner who was invited by SIAP. ment. Significance of the contributions for formulating sta- SIAP of trainings which and effectiveness capacities tistic by many countries with high esteem had done, were regarded Statistical Nations United of conferences international the at to correspondence and Conference, ESCAP and Commission for indicator trainings Agenda, 2030 new needs based on the expansion Agenda and same the regarding method analysis And, providing high- required. courses were of e-learning to Assistances expected. continuously are trainings level with appreciation by Japan have been highly respected SIAP As observed for the continuous assistances. and requirement to have can be evaluated above, Japanese assistances to SIAP being effective. ●Necessity(Adequacy) Overview of Evaluation Results ●Comprehensive Evaluation Contents of Policies, Programs and Projects Contents of Policies, Programs 2.3 Evaluations by Other Ministries and Agencies
Ministry of Justice
Promotion of International Cooperation in Legal Affairs
Evaluation type : GPEA Evaluation period : August, 2016 Policy Program Project Evaluator : MOJ http://www.moj.go.jp/hisho/seisakuhyouka/kanbou_hyouka_hyouka01-03.html
network of personal contacts through the international con- Contents of Policies, Programs and Projects ferences are effect on using in the international trainings MOJ promotes performing trainings/studies cooperating and on promoting of international cooperation on criminal with UN on the field of criminal justice/treatment. MOJ, as investigations/prosecutions in Japan. Furthermore, the par- legal technical assistance, also promotes trainings/studies to ticipants and researchers invited to international trainings/ maintain and develop the legal system of recipient countries. conferences in response to the recipient country’s needs, are the legislation related persons, judges, prosecutors, lawyers, Overview of Evaluation Results etc.; the successful result of such training/studies is without ●Comprehensive Evaluation fail reflected to the maintenance and development of their MOJ has achieved great success on collecting the recent legal systems and capacity-building of legal professionals. international knowledge/information and strengthening Such achievements are effective as they contribute to the with UN and other institutions, and on planning and operat- enhancement of Japan’s position in the international com- ing the workshop of woman criminals at the 13th Congress munity as well. (Prevention of crime, detective judiciary), by attending the ●Efficiency international conferences and implementing the interna- Participating to important UN conferences regarding tional trainings which were instructing the International prevention of crimes has brought an invaluable asset for Standards and successful systems/operations in the countries Japanese criminal justice operations, and an effective net- in response to UN’s programs and efforts. Moreover, MOJ work of personal contacts was strengthened. MOJ selected has invited 193 criminal justice workers from 41 countries a theme in response to the recipient country’s actual situa- including Japan, and implemented 10 international training tion and needs to secure maximum effect of the assistance in all, mainly issued “Current Situation and Countermeasures and combined diverse methods organically e.g. dispatching of Cyber Crimes”, “Development of Following Criminal short-/long-term experts, hosting trainings and seminars in Justice Staff (correction/protection)”, “Multi-Cooperation in Japan and in their countries, holding expert conferences, sup- Social Treatment”. With regard to legal technical assistance, port from scholars and law practitioners, etc., in implement- the successful result of international trainings/invitation to ing efficient assistance. international conferences in response to the recipient coun- try’s needs, was reflected to the maintenance and develop- ment of their legal systems. In particular, the amended Civil Reflection/Countermeasures to Lessons/Policies Code was established in Viet Nam and new assistance on intellectual property began in Indonesia. As such, steady suc- MOJ continuously implements trainings/studies and cessful results have been obtained to achieve goals for pro- researches cooperating with UN in response to the agree- motion of international cooperation. ments with UN and “G8 Legal/Internal Affairs Ministerial Declaration for Assistance of Capacity Building”, and also aggressively develop new trainings including a bilateral ●Adequacy training. Developing the basic laws of the recipient countries Group training system is appropriate to comparing discus- and promoting capacity-building of legal professionals also sion upon current situation of as much as many countries, and contribute to enhancement of Japan’s position in the interna- to expanding and strengthening a network on trainings/stud- tional community. MOJ will continue to provide assistance ies and research cooperating with UN. Also, with regard to in response to the recipient country’s needs, respecting their legal technical assistance, assistance is provided in response independence and self-initiative, and by building trust. to the recipient country’s needs, respecting their indepen- dence and self-initiative through dialogues/discussions with their legislative and judicial related persons. It is an adequate measure to have the law and legal system, the fruit of our assistance, take root in recipient countries. View of Annual Conference on The 13th Congress Workshop Technical Assistance in the Legal Field. (April, 2015) ●Effectivity MOJ has made a close-relation with the relevant institu- tions on the regional seminars for Good Governance in the Southeast countries through discussions about issues of the countries to be tried in future. In addition, information and a The 160th International Training (May, 2015)
30 2.3 Evaluations by Other Ministries and Agencies Chapter 2 Overview of FY2016 ODA Evaluation 31 - - MOF GPEA March,2017 : : : Evaluator Evaluation type Evaluation period 2.3 Evaluations by Other Ministries and Agencies 2.3 Evaluations by Other Ministries and create the objective benchmarks based on the on based benchmarks objective the ④create have the excellent human resources, covering a resources, covering human the excellent ②have MOF continuously participates in t MDBs’ managing MDBs’ t in participates MOF continuously Based on the above MDBs’ advantages, Japan needs to advantages, above MDBs’ Based on the assistances development the Also, MOF widely introduces operations, actively as one of the main contributors, and as one operations, actively reflects Japanese policies/ ODA development mission to the and the effectiveness Also, MOF increases MDBs policies. efficiency of Japanese assistances by using human resources and expertise in MDBs. In addition, MOF assists actively MDBs ‘ works to increase effectiveness and efficiency by and institutions among collaboration/cooperation promoting between other assistant objects , clarificationfields, of the assistance strategic focused on results, promoting evalua contribute to the each MDB and to implement assistances assistances MDB and to implement to the each contribute promote to order Fund, in Trust Japan MDB’s each through of development the for actively cooperation international the countries. the stable economic society in developing and securing the diversities tions of assistance effectiveness, including the increase of Japanese staff. of staff through MDBs to the public. Reflection/Countermeasures to Lessons/Policies poverty reduction, climate change and disaster risk man- and disaster change climate reduction, poverty of the international challenges and on the critical agement, coop- of the international also with wide experience society, eration. various fields of the international cooperation, with innova- the world, ③have a good network tive expertise throughout the exact assistance needs by of information to understand having their many local offices and to enable assistances, the detailed of developing and the governances data of the debt situation consider countries, which allows to render the assistances these utilizing MDBs by through assistances The etc. it, ing advantages are very effective and efficient methods for the international cooperation. ●Necessity - - - and the new procurement system new procurement the and , Project Program ①have been working on the global issues of 2.3 Evaluations by Other Ministries and Agencies and Other Ministries by 2.3 Evaluations Policy Ministry of Finance Ministry http:// www.mof.go.jp/about_mof/policy_evaluation/ Assistance Extended through Multilateral Development Banks Development Multilateral Extended through Assistance MDBs MOF has been attempting to reflect, adequately and of the largest In 2016, Japan contributed to achievement been cooperating with MDBs to this, Japan has In addition Africa”, In the field of health, Japan has released “UHC in And in the field of disaster risk management, Japan has World Bank and MDBs (Multilateral Development Banks) Development MDBs (Multilateral Bank and World actively as a main share-holder, its opinions regarding the regarding opinions its share-holder, main as a actively management organizational and operations lending MDBs’ policies. to Japanese development mission and ODA Association Development for International increase capital (IDA) which engages in assistance to the poorest countries, by playing a leading role on the discussion. in the fields of infrastructures, health and disaster risk- man of field the in example, for Japan, in importance of agement, infrastructures, has been promoting the joint financing with developing for internationally AfDB and JICA ADB, IDB, infrastructure quality high World the in introduced has been level quality considering Bank. the at Africa, UHC in implementing of framework policy the with the in addition, has initiated August, 2016, VI in TICAD the UHC promo- 2017 to implement Bank in January, World Africa. tion specifically world-wide, not only in using Japanese expertise the assistances been implementing and technologies for earthquake, seismic surge, flood, etc., natural many where having mainly Asian countries to the Bank with Japan, through “World disasters and close relation in established which hub” management risk disaster Tokyo contribut actively been has Japan Office. Tokyo Bank World possess and experiences many human resources with wide assistance, and on the development professional expertise network of infor of using a wide-ranged have advantages assistances. MOF perform the effective mation, enabling to contributes actively and such advantages acknowledges well in interna as a responsible member to the MDBs activities tional In community. addition, MOF reflects Japanese ODA actively MDBs policies, the to mission policies/development as one of the main to managing operations participating contributory. implement to succeeded has and MDBs activities, such to ing expertise. assistances with using MDBs’ the effective ●Effectiveness and Efficiency ●Effectiveness Overview of Evaluation Results ●Comprehensive Evaluation Contents of Policies, Programs and Projects Contents of Policies, Programs 2.3 Evaluations by Other Ministries and Agencies
Ministry of Education, Culture, Sports, Science and Technology
Promotion of International Exchange
Evaluation type : GPEA Evaluation period : September,2016 Policy Program Project Evaluator : MEXT http://www.mext.go.jp/a_menu/kouritsu/detail/1375239.htm
Cabinet in June, 2013). Contents of Policies, Programs and Projects MEXT conducts educating Japanese to be active in inter- national society through the student exchange from foreign ●Effectivity countries, contributing a cultivation on human resources in Regarding the promotion of international exchanges on foreign countries, and establishing mutual understanding universities and colleges, a further expansion of scholarship and friendship and good will between Japan and foreign offer is necessary to resolve the economic burden which is countries. one of the major obstructive factors, because of increasing trend of foreign students in Japan but decreasing trend of Japanese students to be abroad. Overview of Evaluation Results ●Comprehensive Evaluation ●Efficiency MEXT has been consulting the strategic promotion of for- MEXT has promoted the developing momenta for eign student admission for further growth of Japan, and the Japanese students to be abroad, not only the economic assis- number of foreign students has been surely increased. On the tance of scholarship, and has tried the effective promotion other hand, indicating the trend fact of decreasing the num- of more fulfilling of international understanding education ber of Japanese students to be abroad, MEXT continues the at stage of high-schools, standing on mid-long term views promotion of developing momenta for Japanese students to within a limited budget. And, MEXT has allocated the plat- be abroad, and has necessary to promote the effort of envi- form coordinators for students to be abroad in Japan at the ronmental consideration for the overseas education which specified regions of on overseas countries for the strategic can carefully help Japanese students to be abroad, with con- foreign student admission. ducting improvement in the framework of public-private partnership. Reflection/Countermeasures to Lessons/Policies MEXT continuously and surely implements the each pro- ●Necessity gram, with having private cooperation, to promote the inter- MEXT has tried to implement surely constructing environ- active student exchange. mental consideration for the overseas education to assist the interactive student exchange, as a policy with higher priority Remarks about achieving goals on “Japan Revitalization Strategy” and The relevant policies and programs include the non-ODA “The 2nd Education Promotion Basic Plan” (both decided on projects.
32 2.3 Evaluations by Other Ministries and Agencies Chapter 2 Overview of FY2016 ODA Evaluation 33 - - - - GPEA MHLW MHLW September, 2016 September, : : : Evaluator Evaluation type Evaluation period 2.3 Evaluations by Other Ministries and Agencies 2.3 Evaluations by Other Ministries and All of the projects have been implemented within mini All of the projects have been implemented MHLW continuously confirms whether the projects are National Work Shop for stable formulation of labor-management relationship Shop for stable formulation of labor-management Work National mum necessary costs to achieve the project schedules and the schedules the project mum necessary costs to achieve planned goals also have been achieved. the by the methods of fully examining becoming effective, will conve- MHLW Also, by ILO/ROAP. reports written under project, the of details of readjustment perform niently annual the on regions, Asian in needs assistance the standing for reviewing the implement with ILO/ROAP consultation period of the imple at ending time ing situations. Finally, will 3 years), MHLW menting project (approximately the and project, of the of continuation a necessity consider be completed. project which achieved the desired aim, will Remarks budget. ODA ●The relevant projects partly include the ●Regarding further detailed information, please website. refer MHLW the - sched project designing using the detailed works, the decent and experiences ules/field surveys by experts of ILO/ROAP, studied by social safety net formulation and expertise on the Japan and ILO. ●Efficiency(Appropriateness) Reflection/Countermeasures to Lessons/Policies - - Project Program 2.3 Evaluations by Other Ministries and Agencies and Other Ministries by 2.3 Evaluations Policy Ministry of Health, Labour and Welfare Welfare and of Health, Labour Ministry http://www.mhlw.go.jp/wp/seisaku/hyouka/dl/jizen-hyoka_h28.pdf Promoting Participation in and Cooperation to Activities of International Organizations : Contribution to Technical Technical : Contribution to International Organizations Activities of to Participation in and Cooperation Promoting type Evaluation Labour Organization by the International Conducted Work of Decent Projects toward Realization Cooperation - their planned goals spec have achieved All of the projects MHLW has need to continue ongoing necessary projects, has need to continue MHLW MHLW has totally evaluated the cooperation with ILO, with cooperation the evaluated totally has MHLW MHLW implements the following projects, using the ILO the following projects, implements MHLW consolida system security of social (1)Assistance projects Assistance of Occupational Health and Safety Training to governmental officials Training Assistance of Occupational Health and Safety (engineers) for treatment of debris and landslide caused by the Nepal Great Earthquake ified on each project schedule, and contributed to realizing referring significance of the social safety net construction the for realizing conferences international in various pointed decent works (worthwhile humane works). which has been efficiently and in Japan and the the projects, using both of the experiences effectively implementing to for contribution institutions in international expertise govern- MHLW of good promotion and society international ment for internationalization. expertise by voluntary contribution. expertise by voluntary devel of infrastructure projects Assistance (2) Asian, in tion the Asia and the social safety nets in opment to construct AssistancePacific, projects (3) for sustainable and Inclusive Asia, so on. growth at the workplace and Industries in ●Effectivity ●Effectivity ●Necessity (Adequacy) Overview of Evaluation Results ●Comprehensive Evaluation Contents of Policies, Programs and Projects Contents of Policies, Programs 2.3 Evaluations by Other Ministries and Agencies
Ministry of Agriculture, Forestry and Fisheries
Establishment of comprehensive food security
Evaluation type : GPEA Evaluation period : August, 2014 Policy Program Project Evaluator : MAFF http://www.maff.go.jp/j/assess/hanei/sougo/index.html
Also, the system of emergency rice reserve in the East Asia Contents of Policies, Programs and Projects was established through the ASEAN Plus Three (ASEAN MAFF addresses unstable factors of international food sup- countries, Japan, China and Korea) Emergency Rice Reserve ply, by implementing international cooperation such as tech- (APTERR) Agreement which entered into force in July 2012. nical assistance, financial aid, and food aid to developing The Agreement aims to deal with extreme and unexpected countries including African countries, in order to establish calamities in this region from the humanitarian point of view. comprehensive food security. MAFF has been steadily contributing to strengthening global food security with these international cooperation. Overview of Evaluation Results ●Efficiency(Appropriateness) ●Comprehensive Evaluation MAFF has been implementing systematically-organized Contribution to strengthening global food security has been and appropriate policy measures. These are provision of steadily conducting, with programs related to implementa- funds to international organizations such as FAO, expansion of agricultural product in developing countries, assistance tion of international cooperation. ●Necessity to measures for fisheries technology and resources manage- ment, development and promotion of irrigation and drain- The implemented policy measures are adequate. age technology to address climate change, and promotion of Continuously strengthening global food security with pro- overseas cooperation for agricultural and rural development. moting agricultural and rural development in developing Through these measures, MAFF has contributed to increase countries is necessary, in order to secure food security in of food product in Africa and established emergency rice Japan, whose most food depends on other countries, under the reserve system in East Asian region. The certain effective- circumstance of forecasting mid- and long-term imbalance ness and efficiency of measures are recognized with these between supply and demand of global food with increase of government-based measures. global population and income in developing countries. ●Effectivity Reflection/Countermeasures to Lessons/Policies MAFF has implemented basic surveys, technical develop- ment and capacity building as well as international cooper- It is necessary to continuously and steadily implement ation through providing funds to international organizations measures for comprehensive food security, taking into in the sectors of agriculture, forestry, and fisheries. The account the recent increase of grain prices. examples are implementing assistance towards measures to increase rice product from 14 million tons to 28 million tons Remarks in 2018, as a result, the actual product reached 20 million The relevant policies and measures include non-ODA proj- tons in 2011, and assistance to increase product of beans and ects. The FY2016 evaluation of the measures is the outlines and potatoes. achievements of the policy/measures at the time of evaluation.
International cooperation and contribution for promotion of Evaluation type : GPEA sustainable forest management Evaluation period : August, 2017 Policy Program Project Evaluator : MAFF Contents of Policies, Programs and Projects a huge variety of frameworks, for promotion of sustainable MAFF promotes international cooperation, through a huge forest managements in the world, has been shown increase variety of frameworks, of multilateral /bilateral coordination, trend , and this program will be evaluated to have obtained a private-public collaboration and so on, using expertise and certain number of effectiveness. human resources in Japan to proceed the efforts for sustain- able forest managements in the world. Reflection/Countermeasures to Lessons/Policies MAFF continuously promotes international cooperation Overview of Evaluation Results through a huge variety of frameworks, using expertise and As the results of diffusing necessary information and tech- human resources in Japan. nology for the forest preservation activities in developing countries through seminars and so on, the numbers of preser- Remarks vation/planting projects have increased, and the international The relevant programs include non-ODA projects. cooperated projects which Japan has implemented, through
34 2.3 Evaluations by Other Ministries and Agencies Chapter 2 Overview of FY2016 ODA Evaluation 35 - ①China, METI GPEA August, 2016 : : : Evaluator Evaluation type Evaluation period ③ until of to each ② and triple 2.3 Evaluations by Other Ministries and Agencies 2.3 Evaluations by Other Ministries and METI, continuously in future, surely implements efforts of efforts METI, continuously in future, surely implements According to “Strategic efforts for acquisition of the efforts According to “Strategic Under tight circumstances of financial conditions, METI The relevant policies/programs include non-ODA projects. The relevant policies/programs include non-ODA 2020 from 2011, and specified the export amounts as indica as amounts export the specified and 2011, from 2020 tions on this program and also the aiming fiscal year/value. as new indication balance” investment And “Overseas direct has been set since 2014. and acquisition for trading/investing equipment environment domestic by needs to corresponding markets, world the of fields and international situations. overseas markets” on “Japan reconstruction strategy”, as overseas markets” on “Japan reconstruction the market developing aims, METI has specified Asia, Mid-East, Russia, CIS, ASEAN regions, ②South-West to above, of export amounts increase ③Africa, with desirable of ①and to each as double with focuses on its policies implemented has continuously the important partner countries/fields and so on. Reflection/Countermeasures to Lessons/Policies Remarks ●Effectivity ●Effectivity ●Efficiency(Appropriateness) “Strengthening advanced technology and knowhow”, to technology advanced “Strengthening demands infrastructure significant the aggressively introduce with pri- developing the market At the time, in the world. level economical an considering collaboration, vate-public of Japanese volume penetration a and market target the in On proceeded. be must countries, emerging in companies the following programs. this vision, METI conducts of overseas markets acquisition ·METI consults strategic high- Japanese to extend collaboration with private-public products/services to the and high-valuable level technology METI countries, emerging in Particularly world markets. sit- to corresponding markets for their developing conducts and volume penetration a level, economical an of uations so on. METI acquires the significantdemands of infrastruc- using tools of ODA/ countries, ture and so on in emerging trade insurance and so on, and responding to needs in partner country. acquisition the issues regarding following has the (2) METI pro- of this operation continuous and markets, of overseas gram is necessary to consult these issues. ·Swiftly and flexibly financing. and support lobbing validation, technology dialogue, ·Policy in addition, supporting business approach with delegations, for cul- support in overseas, matching advance accelerating ture conflict. of Japanese and expansion/enlightenment generation ·Rule for environ- appropriately products/services to be evaluated social issues. ment concerns and solution of aging and - - - Project Program 2.3 Evaluations by Other Ministries and Agencies and Other Ministries by 2.3 Evaluations Policy Ministry of Economy, Trade and Industry Trade of Economy, Ministry http://www.meti.go.jp/policy/policy_management/28fy-seisakuhyouka/32.pdf Support to overseas markets development to overseas markets Support METI has strengthened accelerated procedures of yen accelerated METI has strengthened In addition to these efforts, METI has contributed to contributed has METI efforts, these to In addition Technical assistance by the expert on site (Viet Nam) assistance by the expert on site (Viet Technical loans, yen loans for sub-sovereign and functions of trade loans, yen loans for sub-sovereign and on “High based terms, of prolongation as like insurance 2015)” and its (in May, partnership infrastructure quality specific measures (in November, 2015) which has declared the further exporting Abe to proceed Minister by Prime in addition to systems by Japanese companies, infrastructure on Meeting (decided Strategy Export System “Infrastructure Export and Economic Infrastructure on Strategy relating And, 2013, revised in June, 2015). Cooperation in May, of accept with the achievement METI has surely combined ing order of the large-scale power generation/water desali power generation/water large-scale of the order ing in May 2015, in Qatar by Japanese companies project nation fiscal last in sales top aggressive performing continuous with of the amendment METI has implemented In addition, year. April 2015 to estab- Act in and Investment Insurance Trade to perform sta- for Japanese companies lish an environment ble international project developments. of project in Japan by methods of export amount increase part- in resources developments of human F/S, assistance ner countries, assistance of public finances and talks among governments. ●Necessity (Adequacy) of the overseas markets” for acquisition efforts (1) “Strategic devel “International to of policies part as a has been raised METI strategy”, reconstruction “Japan of strategy” opment Japanese using markets, overseas the of acquisition conducts Overview of Evaluation Results ●Comprehensive Evaluation ■METI consults on acquisition of valued high the and technology high-level the expanding the overseas markets Japan to the world markets. products/services in environ- the and service information the implements ■METI using tools of ODA, for trading/investing, equipment mental trade insurance and so on. Contents of Policies, Programs and Projects Contents of Policies, Programs 2.3 Evaluations by Other Ministries and Agencies
Ministry of Land, Infrastructure, Transport and Tourism
Promoting International Cooperation and Coordination
Evaluation type : GPEA Evaluation period : March, 2017 Policy Program Project Evaluator : MLIT http://www.mlit.go.jp/seisakutokatsu/hyouka/
MLIT has been succeeding in obtaining significant proj- Contents of Policies, Programs and Projects ect orders and connecting with profitable project implemen- Through the decrease trend of the domestic markets in the tations, with continuous performing top-sales, JICA trainee mid-long term in Japan, a significant demand of infrastruc- admission, expert ture equipment and some in merging countries commencing delegation and surveys according to the needs in the part- with Asia is forecasted. Promotion of exporting the infra- ner countries and international situations. Therefore, these structure systems with technology and experiences grown policies are evaluated to have been producing a certain num- in Japan is the important issue to maintain in the Japanese ber of results. economic growth, MLIT specifically promote the efforts of ●Necessity(Adequacy) developing the top-sales with private-public collaboration by The fields of MLIT have significant importance particu- governmental leadership, raising projects and internationally larly at the stage of international cooperation, and construct- standardizing Japanese high-level technology/systems to ing the socioeconomic infrastructure is absolutely necessary. consult in promoting the overseas projects by private-public Therefore, MLIT has been promoting international cooper- collaboration. ation/coordination through assisting overseas projects, per- In addition, promoting the infrastructure equipment which forming talks on policies, technology transfer, and so on, includes technical transfer and job creation is surely useful using the knowledge and experience cultivated in Japan. in the partner countries and a Japanese advantage in global ●Effectivity competition in terms of conducting a market expansion to be By complementing international conferences, as ASEAN developed in the partner country, constructing international and Japan Transport Ministers Meeting, multilateral/bilateral friendships and strengthening cooperation. meeting, seminars, trainings and some, the numbers of proj- On these views, MLIT has been continuously implement- ects contributing to international cooperation/coordination ing the multilateral and bilateral meetings among the part- have shown an increase in trend and this policy is effective ner countries and international institutions, and has been for further strengthening coordination/cooperation among performing cooperation/assistances of seminars/trainings the partner countries and international institutions. to be connected with voluntary improvement in developing countries, trainee admission, expert delegation and variety ●Efficiency(Appropriateness) of surveys. MLIT has been efficiently implementing the projects, “Infrastructure System Export Strategy” (FY2017 revi- actively coordinating with domestic and international rel- sion) was decided (May 29, 2017) at the Infrastructure evant ministries and agencies. They are also planning to Strategy Economic Cooperation Meeting, and raised on implement a stricter selection in focusing on the target coun- “Japan Revitalization Strategy 2017” (decided by cabinet on try and field. June 9, 2017), as a part of international development strat- Reflection/Countermeasures to Lessons/Policies egy, and promotion that has been proceeded by the whole government. MLIT, effectively in future, complements continu- “Action Plan of the Ministry of Land, Infrastructure, ous efforts to promote international cooperation/coordi- Transport and Tourism for Overseas Expansion of nation which connects with the expansion of exporting Infrastructure Systems” (formulated in March 2016) which infrastructure. organizes/clarifies the overseas developing projects in MLIT In addition, MLIT will specifically try to strengthen inter- to be focused on each region/country, was amended in national cooperation/coordination by consolidating “quality March, 2017, according to the improvements of the situation infrastructure” as an advantage of Japan. in partner countries and political/economic situations. MLIT Specifically, MLIT will perform the efforts of ①partici- has recently confirmed to strengthen 6 issues of the MLIT pating/releasing information from “Upstream” of stage of promotions to be further effective as follows; strengthening developing top-sales and promoting significant projects, competitiveness of Japan, strengthening promotion, further ②reducing business risks on overseas expansion, ③support- application of private funds, use of advanced technology ing institutions development, human resources development or some, active participation to upstream of national land/ and constructing human networks in the partner countries. regions development plans and promotion to the third coun- Remarks try cooperation with other countries. This project includes non-ODA project.
Overview of Evaluation Results ●Comprehensive Evaluation 14th ASEAN and Japan Training support by the Training support by the Transport Ministers Meeting expert (Seaport Field) expert(Seaport Field) (November, 2016 in (Ibaraki Port) (Hakata Port) Philippines) 36 2.3 Evaluations by Other Ministries and Agencies Chapter 2 Overview of FY2016 ODA Evaluation 37 - - MOE GPEA June, 2017 : : : Evaluator Evaluation type Evaluation period (June 2016, Fiji) (September 2016, Mongolia) 2.3 Evaluations by Other Ministries and Agencies 2.3 Evaluations by Other Ministries and On-site confirmation of support project project support of confirmation On-site Asia Asia and Pacific gatheringconcerning protection of the ozone layer Especially for control discharge of fluorocarbons, institut Reduction/conversion of an ozone depletion substance substance of an ozone depletion Reduction/conversion in developing countries according to the Montreal Protocol Montreal the to according countries developing in world in the matters urgent to be the become have schedule by the reason of the HCFC reduction started in 2013. today, of to conversion in addition countries, Asian in Particularly of increase forecasting with substance, depletion ozone an fluorocarbons by economic growth in future, selecting the treat adequate the proceeding and substances alternative ments of fluorocarbons are extremely valid and effective on views of prevention of global warming. MOE And is important. system with technology ing social control discharge has need to provide a system of adequate and non-fluorocarbon technology, depending on a scale of coun- in each condition and a geographical activities social with international and continuously tries to coordinate try, understanding the of the efforts institutions and each country, needs and realizing the project are necessary. Reflection/Countermeasures to Lessons/Policies prompting Japanese technology to expand, connecting with connecting to expand, Japanese technology prompting and prevention of global warming, ozone layer protection and accord with Japanese benefits and international social need to proceed. needs, and have further ●Effectivity(Appropriateness) - - Project Program 2.3 Evaluations by Other Ministries and Agencies and Other Ministries by 2.3 Evaluations Policy Ministry of the Environment Ministry http://www.env.go.jp/guide/seisaku/index.html Support of Fluorocarbon Management in Developing Countries Management in of Fluorocarbon Support Additionally, the Kigali Amendment to Montreal Protocol, Montreal to Amendment Kigali the Additionally, for conversion Japanese proactive assistance/cooperation In 2011, the ozone hole (the largest ozone destruction on ozone destruction the ozone hole (the largest In 2011, Fluorocarbons are ozone depletion substances and strong and substances depletion ozone are Fluorocarbons MOE has been supporting the countermeasure against ade- against MOE has been supporting the countermeasure MOE has been supporting the countermeasure against against the countermeasure MOE has been supporting technology Japanese expanding has been far, MOE, so in which added HFC (a kind of greenhouse effect gases) was in which added HFC (a kind of greenhouse effect in adopted in 2016, and scheduled for its commencement by advanced assistances technical 2024, or 2028, therefore countries with Japan would be absolutely necessary. substance, of an ozone depletion treatment and adequate record) on the Arctic midair was observed by the international Arctic midair record) on the for Environmental Institute National including team research in Protocol Montreal of scheduling importance and Studies, future was absolutely reconfirmed. greenhouse gases, however, at the moment of 2015, over 4 2015, over of the moment at however, gases, greenhouse billion MT of CO2 volume of fluorocarbons were used for countries. developing in conditioners air and refrigerators Adequate treatment of fluorocarbons, which not available condition and air from refrigerators to re-use, discharged quate treatment of ozone depletion substances using Japanese substances using of ozone depletion treatment quate of reduction/conversion supporting has been and technology, on schedule the to corresponding substances depletion ozone Asia. in Montreal Protocol to developing countries adequate treatment of an ozone depletion substance using substance ozone depletion of an treatment adequate and has been supporting reduction/ Japanese technology, substance corresponding depletion conversion of an ozone coun- to developing Protocol on Montreal to the schedule tries in Asia. ers and expansion of no use of fluorocarbon products and contributing, been MOE has important, be must technology con- to discharge warming, of global views of prevention at using technology, fluorocarbon of use no introducing and trol Japanese experiences and technology. and experiences to developing countries, by supporting con- version knowhow to be the no use technology of fluorocar bons in Mongolia and introducing Japanese countermeasures against fluorocarbons in international conferences for Asia- Pacific regions. MOE has promotedthe plan of HCFC reduction management (a project regarding effort of support China and for Mongolia substance) depletion of ozone kind specific for meetings implementing and surveys site 2016, in promotions have been evaluated a certain number of effects ●Necessity(Adequacy) ●Comprehensive Evaluation Overview of Evaluation Results Contents of Policies, Programs and Projects Contents of Policies, Programs 2.4 Operations Evaluations by JICA
established the Advisory Committee on Evaluation, consist- Overview of Evaluation ing of external experts, and receives advice on the evaluation JICA evaluates individual projects of technical coopera- system, structure, and methodology. tion, ODA loans, and grant aid (implemented by JICA) using Furthermore, JICA makes its evaluation results available a common framework (project-level evaluation). In addi- on its website. This provides the public with easier access tion to project-level evaluation, JICA evaluates and analyzes to information on evaluation, as well as to those engaged in multi- ple projects from comprehensive and cross-sectoral project design, planning, implementation, and monitoring perspec- tives (thematic evaluation). and evaluation. (JICA’s evaluation page: http://www2.jica. In conducting evaluations, JICA not only promotes the go.jp/ja/evaluation/index.php) utilization (feedback) of evaluation results, but also makes Emphasizing Utilization of Evaluation Results efforts to ensure accountability by increasing the objectiv- ity and transparency of evaluations and disclosing evaluation JICA’s operations evaluations have a feedback function to results. reflect the results in the planning and implementation of sim- ilar projects in order to improve the quality of these projects. Specifically, in conducting an ex-ante evaluation prior to the Evaluation through Common Framework commencement of a new project, the division in charge of JICA aims to conduct evaluation based on coherent meth- the project refers to and utilizes the lessons learned from the odologies and to utilize the evaluation results. Considering ex-post evaluations of similar past projects and other sources. the characteristics of each ODA scheme (technical cooper- In order to summarize lesson information into a format ation, ODA loans, and grant aid) as well as the implemen- that can be more easily used, on a thematic evaluation in tation period and the timeframe for expected results, JICA FY2016 targeting the ex-past evaluations of approximately monitors and evaluates each stage of the individual projects 400 individual projects in the energy field, 19 highly general (pre-implementation, implementation, post-implementation, and practical lessons ( knowledge lessons) were indicated. and feedback) in line with the PDCA cycle, adopting a stan- dard evaluation framework. Ex-Post Evaluation for Verifying Outcomes In addition, JICA is committed to releasing clear and after Project Completion coherent evaluation results by using the five DAC Criteria established by the OECD-DAC (Chapter 1, p. 7), and by In FY2016, JICA summarized 90 project results as external adopting a rating system for external ex-post evaluation. evaluations (in principle, ex-post evaluations of projects with contributions of 1 billion yen or more). In the external eval- uation, to present evaluation results clearly, the results are Ensuring Objectivity and Transparency rated on a four-level scale. The overall ratings results were as For verifying project outcomes from an objective per- follows: 35 projects (39%) were A (highly satisfactory); 47 spective, JICA’s ex-post evaluation includes evaluation by projects (52%) were B (satisfactory); 5 projects (6%) were C third-party evaluators (external evaluation) according to (partially satisfactory); and 3 projects (3%) were D (unsatis- project size. factory).* Rating A and B together comprise approximately To improve the quality of evaluations, enhance feed- 90% of all projects, which shows that the expected results back, and ensure accountability related to evaluation, JICA have generally been achieved. Although rating is useful as a means of indicating an
PDCA Cycle and Evaluation and Monitoring at Each Stage
Monitoring Ex-ante evaluation Ex-post evaluation Feedback – Action (Promotion of project progress) Prior to project implementation, Regular monitoring (promotion After completion of the project, Evaluation results are reflected the relevance, details, and expect- of project progress) based on the its effectiveness, impact, efficien- in the present project for im- ed outcomes of the project are plan formulated at the project cy, and sustainability are exam- provement and also utilized as a examined, along with evaluation planning phase and examination ined and lessons learned and reference to plan and implement indicators. of cooperation outcomes on com- recommendations are offered. similar projects. pletion of the project. *May not apply depending on the scheme and size of the cooperation.
38 2.4 Operations Evaluations by JICA overview of the evaluation results, it does not take into account the difficulty of the projects. Thus, it does not reflect all aspects of implementation for development projects. Additionally, JICA conducted 68 internal evaluations (ex-post evaluations of projects with contributions of over 200 million yen and under 1 billion yen) whereby JICA’s overseas offices are the primary evaluators, and summarized its results in FY2016. The overall evaluation of the above projects indicates that the 2/3 of projects have succeeded in the achievement according to the expected level or higher on Electric transmission facility constructed by “Local Development Project” in ex-post evaluation stage as reflected in the plans. Afghanistan (External evaluation) The results of all of these ex-post evaluations were pro- vided as feedback for JICA staff and stakeholders in devel- oping countries and are available on JICA’s website. (Results of ex-post evaluations: http://www.jica.go.jp/ activities/eval- Chapter 2 Overview of FY2016 ODA Evaluation uation/after.html) * A trial ex-post evaluation was implemented for Development Policy Operations and they are not subject to rating.
Developing Sector Issues, Process Analysis, etc.
JICA has been proceeding to introduction of more useful View of inside of women only car of Delhi Metro of “Delhi High-Speed lessons with deeply developing and analyzing, using the eval- Transportation Construction Project” in India (Process analysis) uation results of the projects. In FY2016, JICA summarized, as specific and highly workable countermeasures in seaport sector, the considerations (forecast of demand and supply, policies for a new port, and concerns and lessons of opera- tion/maintenance/management) at the time when planned by internal staff who having technical expertise in the sector. JICA also has been organizing the methods of “Process Analysis” aiming for confirming an onset process and deep- ening of analysis, through a number of trial approaches of the analysis, obtaining technical advices by “Committee for Improving Quality of Ex-post Evaluation” formed mem- bers with external experts. “Project Ethnography”, as one A team member of the Partnership Village Collaboration Managing Network coffee plant of “Bidoup Nui Ba National Park Managing Capacity Strengthen of approaches of analysis, is the method of recording imple- Project” (Internal evaluation) menting process of developing projects with use of the ethnography which is a record method in the field survey of anthropology. In Fy2016, JICA applied an implement- ing process analysis of the project which simply using this method to the “Delhi High-Speed Transportation System Construction Project” in India. In addition to above, JICA has started the process analysis targeting for “Nyanza Province Health Management Strengthening Project” in Kenya. Furthermore, JICA has been recently proceeding to Implement projects based on the evidences to progress and View of container terminal of “Subic Seaport Development Project” in improve quality of projects. JICA has been proceeding its Philippines (Deepening sector issue) efforts using main tools for above, emphasizing “Impact evaluation” which policy project and development model to improve/resolve, using the methods statistics and economet- rics, verify the change caused in target society. JICA attempts ex-post evaluation for financial Assistance, and a rating is not available.
2.4 Operations Evaluations by JICA 39 2.5 Partner Country-led Evaluation
Evaluation of Japan’s Official Development Assistance to the Uruguayan Forestry Sector
Evaluators: Ag. Engineer Carlos Mantero – Mag. Leopoldo Font
Evaluation Period: October 2016 – March 2017
Evaluation Description Evaluation Results a. Evaluation Objective a. Overall Summary This study´s main aim was to gather useful knowledge and In general, technical cooperation projects and studies were recommendations for the South-South Cooperation strategy. satisfactorily carried out fully reaching objectives set regard- This evaluation considered Japan´s official development ing products and results. Objectives were achieved thanks to assistance(ODA) policy to Uruguay implemented through the quality of the technical assistance provided, the profile of project funding for the forestry sector. participants (mainly long-term ones), the technology trans- ferred and training activities. Japan´s Official Development b. Evaluation Object Assistance was aligned with locally prioritized needs from the forestry sector and global development objectives. From This evaluation considered Japan´s assistance policy to the effectiveness stand point, the projects and studies funded Uruguay implemented through project funding in the for- by ODA achieved the results and products planned, repre- estry sector from 1989 to 2003. The cooperation studies and/ senting a significant contribution to the development of the or projects were: Uruguayan forestry sector. Results have proven to be sus- (i) “Study for the Development of the Five-Year Forestation tainable in the short and mid-term. Plan” (1989-1991) b. Relevance of Policies (ii) “Study for the Basic Plan of Industrial Development of Japan´s cooperation to Uruguay´s forestry sector was Forest Products”. (1999). highly consistent with ODA´s policies and guidelines in (iii) “Project for the Development of Basic Technology of force during the analysis period and with changes made in Improvement of Forest Species” (1990-1993) the last years. It was also aligned with development needs (iv) “Project for the Genetic Improvement of Forest Species” proposed by Uruguay for the promotion of its forestry sector. (1993-1998) Besides, development assistance complied and was aligned (v) “Forest Products Testing Technology Project” with Japan´s forestry policies. Moreover, they were aligned (1998-2003) with main international environmental regulations, agree- ments and standards as well as with sustainable development c. Evaluation Methodology topics, as in the case of the Millennium Development Goals The evaluation criteria were Relevance of Policies, (MDGs). Effectiveness of Results, and Appropriateness of Processes. This evaluation was based on Guideline for Partner-Country c. Effectiveness of Results: Evaluation from the Ministry of Foreign Affairs of Japan. Japan´s ODA, in the period of reference (1989-2003), They also included lessons learned and best practices from made a significant contribution to the development of the past studies related to design, implementation and perfor- National Forestry Sector. Technical cooperation projects and mance evaluation conducted by the National Evaluation studies had a satisfactory performance fully achieving the Agency (AGEV)/the Planning and Budget Office(OPP) in objectives sets regarding expected results and products. The Uruguay. Activities conducted were: 1) Documentary analysis of all available documents related to cooperation initiatives; 2) Semi-structured interviews aimed at qualified informants with roles at different levels and related to initiatives and/or participating bodies; 3) Field visits to directly observe projects´ and/or studies´ achievements (such as equipment, infrastructure, etc.); and 4) Collection of available secondary information about the initiatives to perform evaluation. Source: Technological Laboratory of Uruguay (LATU)
40 2.5 Partner Country-led Evaluation Chapter 2 Overview of FY2016 ODA Evaluation 41 - - Debrief session 2.5 Partner Country-led Evaluation Presidency of the Republic Planning and Budget Office NationalPresidency of the Republic Planning and Budget Best Practices to Be Incorporated in Strategic South- to Be Incorporated Best Practices Cooperation Triangular South and/or Importance of strong national counterparts to implement implement to counterparts national of strong Importance countries; proposals between cooperation points before cooperation starting In-depth analysis of art, use of exist- of the state begin (baselines, initiatives capacities); ing information and the short, mid and long-term; Strategic planning in for the development recipes Absence of pre-established a need to there is As a consequence, of the forestry sector. and to revise best successful principles adapt technically sector; practices in the forestry technical of forestry provider Uruguay as potential assistance; time. Importance of cooperation sustained over Participants in a debrief session 4 The evaluation of Japan’s Official Development Assistance (MOFA) Affairs Ministry of Foreign the honor that It was a great was to gather useful of this evaluation The main objective This evaluation allowed us to discover the effects it had had in This evaluation allowed us to discover the effects The results show that, without a doubt, Japanese cooperation Column a. b. c. d. e. f. Evaluation of Japan’s Official Development Official Evaluation of Japan’s Sector Assistance to the Uruguayan Forestry (ODA) to the Uruguayan forestry sector called for a joint effort for a joint effort (ODA) sector called to the Uruguayan forestry Agency (AUCI, Cooperation between the Uruguayan International Agency Evaluation National the and Spanish) in for its name support with (OPP), Office Budget and Planning the from (AGEV) of Embassy of Japan in Uruguay. of Japan trusted the offices involved with the “Partner Country- as well as of working together, The experience led Evaluation”. of in the development the evaluation itself, marked a milestone international cooperation evaluation. Uruguay’s for South-South cooperation. and recommendations knowledge analyzing by towards Uruguay policy ODA Japan’s evaluated It five cooperation projects within the forestry sector implemented focused on “Relevance The methodology between 1989 and 2003. of Results” and “Appropriateness “Effectiveness of Policies”, Partner for the Guideline by MOFA’s of Processes”, per stated meth to the related aspects Furthermore, Evaluation. Country-led odology of Design, Implementation and Performance Evaluations odology of Design, Implementation incorporated. in Uruguay were AGEV/OPP by (DID) conducted who spe- of evaluators by a team was performed The evaluation in evaluat in the forestry sector and with vast experience cialize AUCI. and AGEV ing programs and projects and was overseen by we could sys- forestry sector over 30 years. Moreover, Uruguay’s projects cooperation the regarding information descriptive temize and lessons learnt. has made a significant contribution to forestry Uruguay’s sector’s At the same time, it has allowed us to present a suc- development. through the validated cooperation, cessful model of international input for the South- which will become an important evaluation, South cooperation strategy. ------Information Available for the Evaluation Available Information Support to Long-Term Sustainability Support to Long-Term Possibility of South-South Cooperation with Japan´s Possibility of South-South Cooperation with Support It is advisable to strengthen the record and systematization record and the strengthen to advisable is It . Long-term sustainability will probably depend on the sec- will probably depend on the sustainability Long-term The quality and quantity of the lessons learned and forestry learned lessons of the and quantity The quality Generally speaking, design processes for cooperation for cooperation processes design speaking, Generally stud- process of technical The satisfactory implementation Recommendations 3 2 1 of progress made in the field of cooperation. their about projects conducted, such as information relevant Particularly, achievements, progress reports and final evaluations tor and political management´s capacity to change in order to capacity management´s tor and political and possi- requirements to the forestry production the adapt to strengthen the it is advisable Thus, of each period. bilities analysis of actors the including practices, planning strategic strengths threats, to identify future opportunities, involved of appropri- implementation to the and weaknesses leading ate actions. gic partner (triangular cooperation mode). best practices identified in the reference period (1989-2003) for the into consideration they can be taken are satisfactory; actions with of joint South-South Cooperation development as a strate Japan participating countries with other regional human resource development, technical cooperation and the cooperation technical development, human resource to the contributions the main were of equipment provision thor Japan’s sector. forestry the in development successful
ough assistance for appropriate period (short, mid and long- period (short, mid and for appropriate ough assistance brought the results to the development. term) also effectively of Processes: d. Appropriateness for of the needs development the account into took actions estry sector in terms of the priorities defined by the national and was possible due to consultation This interlocutors. laborat throughout the process of creating participation Japanese and Uruguayan actors worked ed-proposals where thanks to the positive combi It was also possible together. by profession- knowledge and expertise of Japanese nation projects and studies the adapt and improve who helped als guidelines to local development needs. ies and cooperation projects led to the fulfillment of planned and the aspects institutional speaking, Generally objectives. a limita bodies did not represent systems of participating methodologies working fact, In implementation. its for tion work between the joint were highly valued and this enabled with long-term Japanese and Uruguayan experts (especially experts).
Chapter 3 Follow-up Efforts on FY2015 Evaluation Results
3.1 Country Assistance Evaluations...... 44 ● Country Assistance Evaluation of Viet Nam ● Evaluation of Japan’s Assistance for Pacific Island Countries ● Evaluation of Assistance for the South Caucasus ● Country Assistance Evaluation of Morocco
3.2 Priority Issue Evaluations...... 49 ● Evaluation of Japan’s Contribution to the Achievement of the MDGs ● Evaluation of Japan’s Education Cooperation Policy 2011-2015
3.3 Scheme Evaluation...... 52 ● Debt Cancellation
3.4 Other Evaluation...... 53 ● Evaluation of the Feedback Mechanism of Japan’s ODA 3.1 Country Assistance Evaluations
MOFA develops response measures to recommendations obtained from the third-party evaluations, and follows up on the status of the implementation of such measures. Chapter 3 describes the status of the measures taken in response to the main recommendations obtained from the third-party evaluations in FY2015 (as of July 2017). A summary of each evaluation report is available on the MOFA website (http://www.mofa.go.jp/policy/oda/evaluation/year/index.html#2016).
Country Assistance Evaluation of Viet Nam
1 Utilization of the assistance for Viet Nam as a front runner in international cooperation
Recommendations Status of Follow-up Efforts
Japan’s assistance has shown a number of char- ● Good practices of ODA's efforts in the project have been shared at acteristics which shall be a model for Japan’s meetings of JICA overseas office heads. Also, a study meeting has ODA in other countries. These shall be shared been held at the JICA headquarters and efforts in the agricultural sec- among responsible officers in charge of eco- tor of Viet Nam were shared as a case study. nomic cooperation at Japanese Embassies and JICA Offices in other developing countries as good practices of Japan’s ODA. In this regard, it will be vital to effectively formalize diverse tacit knowledge created by Japan through knowledge management.
※ Example of formalization:Compilation of reference documents, manuals etc.
2 Effective promotion of assistance in social sectors
Recommendations Status of Follow-up Efforts
Japan’s assistance performance in social sec- ● For Japan, “Project for the Establishment of Anti-Trafficking in Persons tors receives relatively little attention. (TIP) Hotline in Viet Nam” has been published on the website, and the Specifically, achievements in such fields as JICA newsletter regarding cooperation on climate change to Viet Nam environment and health care should be more has been issued. For Viet Nam, the press tour of “The Project for emphasized. It is considered to be noteworthy Strengthening Capacity for Measles-Rubella Combined Vaccine that Japan has played a leading role in mitigat- ing global warming in Viet Nam. Also Japan’s Production” has been conducted. contributions like as promotion of hub-hospital construction and so on, will have significance in publication to increase more visibility in domes- tic Japan and Viet Nam.
3 Continuous efforts for Anti-ODA-related Corruption Measures
Recommendations Status of Follow-up Efforts
It is necessary for the Government of Japan to ● The Government of Japan has been requiring the Government of Viet consistently implement improve and prevention Nam to take measures on fraud and corruption prevention on high-level measures for recurrence and to maintain alert- meetings as well as ODA policy consultation in December, 2016. ness among the parties concerned in order to eradicate fraud and corruption incidents between Japanese companies and the Government of Viet Nam. (Note: Regardless of any measures against recurrence, there is still possibility of recurrence, therefore it is neces- sary to be accountable that appropriate preven- tion measures have been taken in case of recur- rence .)
44 3.1 Country Assistance Evaluations Chapter 3 Follow-up Efforts on FY2015 Evaluation Results 45 - - - - 3.1 Country Assistance Evaluations 3.1 Country nical support mainly for developing policy and maintenance operation of maritime and port fields. contributed effectively equipment construction road the use To imple continuously be will cooperation technical aid, grant by main of capacity improving for Guinea New Papua in mented tenance and operation. Japan created Hybrid Island Initiative, which aims to provide stable power and to reduce fuel consumption, based on their ini- the Under areas. Island Pacific in experiences and findings for its power tiative, Japan supply has diver Tonga supported facil- solar-powered establishing by stabilization and sification ities, wind generator systems providing technical trainings. and system stabilizers and Policy advisers for planning and maintenance operation of social of operation maintenance and planning for advisers Policy infrastructures have been dispatched to PICs to provide tech In Pacific Assistance Education Leaders’ for Development of State(Pacific-LEADS), in additionlocal and government central Japanese in Programs Internship to master's programs, governments will be implemented to develope pro-Japanese group. create networks and The support based on the assistance policy stated at The sev- The at stated policy assistance the on based support The enth Pacific Islands Leaders Meeting 7) (PALM was- imple 8 planned in mented 2018. toward Japan PALM will contin- uously provide assistance consideration from of diplomatic relations, environment, climate broader perspective and so on. change, disaster prevention in to dispatched was Mission Economic Joint Public-Private The Samoa in 2016 cooperating with the Pacificwere Islandsseminars investment and Center. trade the and Matching Business held to strengthen business relations with PICs . Japan sup- SMEs through will sectors private among relations strengthen port for expansion of overseas business . Status of Follow-up Efforts Status of Follow-up Efforts Status of Follow-up Efforts Status of Follow-up Efforts
● ● ● ● ● For implementing the declaration of PALM 7 and for formulating the visions for PALM 8 PALM formulating the visions for 7 and for of PALM implementing the declaration For Implementation of assistance to encourage private sector involvement private sector Implementation of assistance to encourage Implementation of assistance that will have sustainable effects of projects Implementation of assistance that will Continuing the assistance to the PICs from a broader perspective a broader to the PICs from Continuing the assistance
Recommendations Recommendations Recommendations Recommendations In order to further enhance the effect of the assistance it is Given the chronic issues of the PICs such as draining of is it past, the in implemented projects infrastructure the For It is important for Japan and PICs to promote concrete com- and transaction promote to desirable particularly is It When considering the assistance to PICs, it is important to important is it PICs, to assistance the considering When important to carry out projects that “publicize Japan’s aid” as such assistance the improve qualitatively to seeking while human resource development. 4 human resources and insufficient government budgets, it is desirable to construct durable would make physical maintenance easier, and facilities implement an which assis- maintenanceand operation encourage would that plan tance by the private sector after the completion of the projects. strengthen that projects rehabilitation implement to effective resilience against natural disasters. efforts efforts of ODA that will serve as private the between catalysts relations tourism and investment, trade, to strengthen sectors. mercialization of the private businesses in trade, the investment fields and of tourism, in Pacific Islands cooperation Center with while the timely takingapplication. ODA advantage of continue assistance to small-scale PICs for which it is diffi- is it which for PICs small-scale to assistance continue cult to aim for economic self-reliance not only focusing on the efficiency of aid or the absolute scale of beneficiaries but also from a broader perspective including political and foreign policy. social significance to Japan’s 2 3 1
Evaluation of Japan’s Assistance for Pacific Island Countries(PICs) Pacific for Assistance of Japan’s Evaluation Evaluation of Assistance for the South Caucasus
1 Clarification of the Purpose of the Assistance for Agriculture and Rural Development (Azerbaijan)
Recommendations Status of Follow-up Efforts
In the present country assistance policy, pathways of ● The Rolling Plan revised in 2016 defines “strengthening of rural agricultural projects are relatively unclear, and the pos- development and industrial development for reducing dispari- sible effects of agricultural supports on the country ties” as a development issue and added detailed description of assistance policy are not clear. In order for the knowl- agricultural field. edge and technology of Japan to contribute fully to Azerbaijan, the role and the purpose of the projects for agriculture and rural development should be defined clearly in the assistance policy.
Fostering of the exchange of views and Coordination with the Implementing Agencies and other donor countries(Georgia, 2 Armenia)
Recommendations Status of Follow-up Efforts
Vigourous participation to the donor meetings, smooth ● JICA established the Georgia field office in May, 2016, and information services to the Prime Minister Assist dispatched a Japanese staff member. Additional Japanese staff Arrangement Unit (Georgia), and proactive contribu- member was dispatched there in May, 2017, in order to increase tion to the Support Partnership Meeting (Armenia) to efficiency in coordinating with the Caucasus countries. The cooperate smoothly in project creating/implementing staff attends donor meetings to share information and have depending on the other donors' trends, increasing Japanese presence for future, will be desired. smooth cooperation with other donors.
3 Strengthening Capacity of ODA Implementation of the Embassy of Japan (Armenia)
Recommendations Status of Follow-up Efforts
Strengthened systems to proceed the reporting adjust- ● MOFA has added a member to the embassy in Armenia since ment/decision smoothly with Japan has been required February, 2016. by Armenia ministries and the other donors, and also status of a manpower shortage has been reported by Japanese embassy in Armenia. Therefore, increasing the staffs of economics/development cooperation will be desired.
4 Promotion of Assistance for Common agenda among the Three Countries(All Caucasus Countries)
Recommendations Status of Follow-up Efforts
At the moment, the JICA Uzbekistan office has been ● A research on tourist development, which is the main industry implementing the projects of each 3 countries in joint for the three countries, was conducted in 2016. It surveyed the administration for grant aid and technical cooperation, policies, the systems the structures and the issues in the sector however, implementing cooperation projects as a body in each country. JICA enhanced its function of the Georgia of 3 countries is difficult so far because of systems and office, and it plays a central role to grasp the needs of each political background in each country. From now, regarding the themes of interest shared country and to strengthen the system in providing ODA to those items of disaster prevention, sightseeing, environmen- countries. tal field, so on, and mutually effective for 3 countries, opinion exchange/relationship among 3 countries with actual basis without any political interests, through implementing cooperation projects, trainings, seminars, symposiums in view of regional cooperation, will be desirable. And, if considering any strengthening of the ODA systems to the Caucasus countries, reviewing with focusing on the above will be expected.
46 3.1 Country Assistance Evaluations Chapter 3 Follow-up Efforts on FY2015 Evaluation Results 47 3.1 Country Assistance Evaluations 3.1 Country In case of any requests regarding South-South Cooperation by Cooperation South-South regarding requests any of case In consid- be will Cooperation South-South promoting Morocco, ered, based on its consistency with the country development cooperation policy. "Project for capacity Development of Human Resources in Transport Sector for French Speaking African Countries requested by the Moroccan " government in 2016, as a South- South Cooperation, was adopted as the early implementing project of 2015 requirement surveys The (Mid-year). detailed established. plan for flexible implementation is now being Status of Follow-up Efforts The above "Project for capacity Resources Development in Transport of Sector for Human French-Speaking African Countries" and "Project for Capacity Development of Human Resources in Fishery Sector projects, cooperation technical for as adopted being are Countries" French Speaking African train- the strengthen to projects training country third as just not ing capacity at the Morocco’s side. And, "Fishery Research Vessel Construction Project" (loan assistance) which signed designed been has 2017, January, in document the exchanged and with past grant aids and technical cooperation in Morocco by Japan. In the next revision of the country assistance policy currently of consideration in reviewed be will goals consideration, under industrial development needs. Morocco’s Status of Follow-up Efforts Status of Follow-up Efforts
● ● ● ● Combined Use of Multiple Schemes Further Emphasis on the Promotion of South-South Cooperation Emphasis on the Promotion Further Reconsideration of the Country Assistance Policy Assistance the Country Reconsideration of
Recommendations Recommendations Recommendations Since increasing assistance aiming at creating synergy South-South Cooperation for countries in Africa that Reconsideration of the wording of the Country with the combined use of multiple Japan, and Morocco of Governments the by anticipated schemes is both accepted further be approach this that recommended is it in the preparation for new assistance in the future. Japan has been large a had has and acclaimed highly been has Morocco promoting in diplomatic impact. Therefore, it collaboration is important to further with strengthen the contribution of Japan for the promotion of South-South Cooperation by Morocco, keeping in mind its contribution to the stabilization of the region. Assistance Policy for Morocco is necessary for the bet- Assistance Policy for Morocco especially readers, its by policy the of understanding ter for the Basic Policy of Assistance Considered. and In addition, Items it to is be recommended Development that Issues in the this policy be re-examined needs development industrial in the address better to order in Morocco. 3 2 1
Country Assistance Evaluation of Morocco Evaluation Assistance Country 4 Promotion of Information Sharing
Recommendations Status of Follow-up Efforts
Since Japan’s Country Assistance Policy for Morocco ● The French version of Country Assistance Policy was published is an important document which indicates the direction in February, 2016. It is used to disseminate Japan’s policies at of Japan’s assistance to Morocco, it should be translated the meetings between the embassy of Japan and the Government and disclosed for the relevant people involved.* In addi- of Morocco, international organizations and other donors. tion, it is recommended that a translated version of the Opportunities to discuss with the Moroccan government are Rolling Plan, which indicates the prospects of Japan’s assistance to Morocco for the next several years, be dis- shared among embassy, JICA offices and JETRO offices. closed as a means to disseminate the information of ● In order to share information and grasp Morocco’s needs, not Japan’s ODA to Morocco. Furthermore, further efforts only people from the embassy of Japan but also JICA and JETRO should be made to organize a meeting of relevant part- attend meetings with the Government of Morocco. ners from both Morocco and Japan in order to facilitate information sharing of Japan’s assistance and to identify the development needs of Morocco.
*Based on a report made at the Japanese embassy in Morocco following the completion of the field survey, a French-language version of the country assistance policy for Morocco was released in February 2016.
5 Improvement of Efficiency and Transparency of Processes
Recommendations Status of Follow-up Efforts
Efforts need to be made to speed up the project formu- ● The Government of Japan has explained about the process of lation and improve the transparency of the results of projects implementation to the Government of Morocco. Japan project selection. has been ensuring transparency by providing required informa- tion to the Moroccan government of Morocco.
6 Continuous Efforts to Strengthen Japan’s Project Implementation System in Morocco
Recommendations Status of Follow-up Efforts
It is recommended that continuous efforts be made in ● MOFA has been working on projects of regime enhancement. the future to further strengthen Japan’s ODA imple- The embassy has been engaged in other discussions on coop- mentation system in Morocco in order to facilitate rec- eration in addition to monthly ODA Taskforce meetings and ommendations (4)Promotion of Information Sharing other opportunities. and (5)Improvement of Efficiency and Transparency Of processes in this evaluation.
OCEANOGRAPHIC AND FISHERY RESEARCH VESSEL CONSTRUCTION Project for Human Resource Development in Fishery Sector for French PROJECT(Signing ceremony for exchange of notes,Jan.16,2017) Speaking African Countri (Closing ceremony,Nov.20,2016)
48 3.1 Country Assistance Evaluations 3.2 Priority Issue Evaluations
Evaluation of Japan’s Contribution to the Achievement of the MDGs in Environmental Sector
1 Integration of the developmental perspective and the environmental perspective
Recommendations
In the economic and social development field, mainstreaming of environmental perspective mentioned in n\various initiatives and efforts of including the contents of these initiatives to the Country Assistance Policy and the formulation of individual projects are nec- essary. At the same time, in the environment field, it is necessary to facilitate the break away from the thinking that environment blocks development, for example, by collaborating with poverty reduction projects and by involving the views of development actors who tend to oppose against the environmental protection.
Status of Follow-up Efforts
● Contribution to SDGs is highly reflected when surveying partner countries’ needs and formu- lating projects, considering not only develop- Strengthening the planning of country assistance policies for each recipient country in line with its development stage and consideration of an exit strategy ment but also sustainable environment. MOFA 2 has been cooperating with private companies that are environmentally friendly. Recommendations
Japan is formulating the Country Assistance Policy and the Rolling Plan for each recipient country and implementing the assistance
accordingly. It is also necessary to pay attention to the stage of devel- Chapter 3 Follow-up Efforts on FY2015 Evaluation Results opment of the recipient country and to consider the utilization of human and intellectual assets of the assistance in order to achieve self-reliance of the recipient country .
3 Broadening the effects of ODA projects in the environmental sector to wider contexts
Recommendations Status of Follow-up Efforts
MOFA should strengthen the policy impacts by expanding the ● MOFA considers measures to ensure financing, effects of each ODA project to regional and national level. It is also including from other donors, from project design- necessary to utilize the knowledge accumulated in a country where ing through implementing process. MOFA has Japan has supported for many years in the assistance to other coun- also putting efforts on human resource develop- tries. ment and policy/system designs in consideration of sustainable effects after projects are completed.
3.2 Priority Issue Evaluations 49 4 Effective cooperation with local organizations such as universities and NGOs and capacity building support
Recommendations Status of Follow-up Efforts
It is necessary for Japan to promote capacity building in ● After examining possibilities and feasibilities at project recipient countries by making better cooperation with local designing and implementing stage, Japan cooperates with universities and NGOs, both of which are connected deeply to local universities, research institutes and NGOs in the local people and are positive about addressing environ- mental project areas. issues and making social contributions. Effective cooperation seems to lead to a stronger impact on both ODA projects and recipient countries while supporting their autonomous post- ODA development.
5 To recognize the differences from other donors, including emerging donors, and demonstrate the strengths of Japan
Recommendations Status of Follow-up Efforts
Japan is demonstrating its advantages of activities at the site ● Japan collects information on other donors’ activities at on the natural environment preservation, and is supposed to be project designing and implementing stage and regularly possible to keep Japan’s presence, selecting a suitable country/ shares information with other donors to examine the region to support and specifying supporting methods. possibilities of cooperation. At the project sites, JICA Therefore, understanding statuses and supports of the other designs projects in consideration of balance and synergy donors, proceeding selection and concentration of supports to be able to demonstrate Japan’s competitiveness, are necessary. effects with other donors and results that bring effects in wider areas.
50 3.2 Priority Issue Evaluations Evaluation on Japan‘s Education Cooperation Policy 2011-2015
1 Recommendations for formulating and mainstreaming Japan’s education policies
Recommendations Status of Follow-up Efforts
Placing Japan’s future education ● ODA Taskforce remote seminar for educational assistance has been held in the cooperation policy as a higher policy site, and the new strategies have been explained to embassies and JICA site offices.
2 Recommendations for Japan’s education cooperation policies
Recommendations Status of Follow-up Efforts
Effectively disseminating and further ● As an effort to use Japan’s educational advantages for cooperation in education, strengthening Japan’s comparative MOFA has been cooperating with MEXT in EDU-Port Japan, a public-private advantage on practices at the ground platform initiative to disseminate Japanese-style education to the world, along level with METI, JICA, JETRO, etc.
Recommendations Status of Follow-up Efforts
Creating synergy effects through pro- ● A medium-term cooperation plan in primary math education in Zambia has been gramming (of project) and use of formulated. Cooperation combining a number of schemes, cooperating with the loans and multilateral assistance other donors, to support the basic arithmetic project by the Ministry of Education of Zambia in this plan, is under consideration. Chapter 3 Follow-up Efforts on FY2015 Evaluation Results Recommendations Status of Follow-up Efforts
Fostering common understandings of ● Continuing to hold meetings of the Networking and Consultative Committee on and interests towards Japan’s educa- International Cooperation in Education and Japan Education Forum continuously tion cooperation policy through peri- will increase the understanding and interest concerning the policy, through opin- odic meetings bringing together ion exchange among relevant ministries and agencies in Japan, Japan’s offices of wide-ranging stakeholders. international organizations, NGOs, private sectors, experts, etc.
3 Recommendation for monitoring and evaluating Japan’s education cooperation Policies
Recommendations Status of Follow-up Efforts
Implementing a third-party evalua- ● Implementing a third-party evaluation of this matter at the optimal timing is under tion of Japan’s future education coop- consideration. eration policy at the optimal timing
4 Recommendations from diplomatic viewpoints
Recommendations Status of Follow-up Efforts
Effectively disseminating information ● Japan Education Forum is annually held to promote the publicizing of its initia- on Japan’s education cooperation pol- tives to the domestic related parties. Also, Prime Minister Abe has stated Japan’s icy and its outputs/outcomes efforts of educational cooperation at the international meetings of G7 Summit, TICAD, ESCAP, etc. Japan will effectively keep disseminating good practices at international meetings and bilateral meetings.
3.2 Priority Issue Evaluations 51 3.3 Scheme Evaluation
Evaluation of Debt Cancellation
1 Stipulation of consistency with higher policies
Recommendations
In order to provide accountability to taxpayers and to ensure appropriate knowledge-sharing amongst the actors involved, it is recommended that a basic policy on debt cancellation is stipulated and that this policy clearly demonstrates its consistency with the Development Cooperation Charter and other aid policies.
Status of Follow-up Efforts
Improved transparency of the debt ● In the White Paper on Development 2 cancellation process Cooperation 2016, basic policy and process of Japanese government for debt cancellation and past results are written under the item Recommendations of "Efforts for Debt Issues", and they are also published on the website. The process over debt cancellation is highly confidential, and it is difficult for the general public or the people outside charge to clearly understand the specific steps leading up to debt cancellation. It is therefore recommended that the government communicates to the public the position and criteria on which Japan builds its decision over debt cancellation and what aspects are carefully considered when doing so.
3 Structual understanding of the effects and implementation of monitoring
Recommendations
Debt cancellation does not possess a measure of its own to analyze and monitor its effects. Therefore, it is recommended that certain indicators are prepared to observe its effect so as to help understanding the develop- mental effects provided to the given recipient. Moreover, to prevent habit- ual default on the part of the debtors, it would also be useful to identify the reasons why the debtor country had accumulated its debt to an unsus- Status of Follow-up Efforts tainable level. It must be emphasized that solving the fundamental prob- lem, underlying debt cancellation is just as important. ● Debt cancellation of ODA loans has not been implemented for yen-loan debt since 2013. Japan confirmed those countries’ Establishing a mechanism to ensure the recipients commitment to poverty reduction expenditure financial situations, repayment capacities, 4 economy and finance reform programs and poverty reduction efforts, referring to the Recommendations reports from IMF and World Bank when signing Exchange of Notes concerning Debt cancellation is a distinct form of aid in that it demands the debtors ODA loans to Myanmar and Cote d’Ivoire to commit to certain reform measures as an exchange to the debt treat- where debt cancellation was applied in ment. If debt cancellation is to be defined as a form of development assis- tance, its expected effect materializes only after the newly formed finan- 2013. cial sur- plus is used for poverty reduction. This is when a financial effect is translated to a developmental effect. However, it is difficult to actually prove this supposed cause-and-effect relationship. Therefore if debt can- cellation continues to be conducted as a part of ODA policy, it is recom- mended that Japan, together with other donors, establishes an innovative effective mechanism to encourage the recipient to commit to poverty reduction expenditure.
52 3.3 Scheme Evaluation 3.4 Other Evaluation
Evaluation of the Feedback Mechanism of Japan’s ODA Prioritizing the Objectives and Formulating a Medium-term Evaluation Plan for the Policy-level ODA 1 Evaluations as Third-party Evaluations
Recommendations Status of Follow-up Efforts
To maximize benefits that could be driven from poli- ● In July 2016, MOFA held a meeting between relative cy-level ODA evaluations conducted by third parties, parties to discuss how to utilize the recommendations. while there are constraints in time, finance, and human ● When selecting the evaluating projects for FY 2017, MOFA resources, the evaluation team recommends that the main made medium-term evaluation plan reflecting relative objective of the evaluations would be to “feedback to the parties’ opinions and requests. MOFA will also consider formulation of ODA policies,” while refining the scope and items of evaluations and improving the quality, the appropriate scale and budget for the each project. thereby aiming to further improve accountability. The for- mulation of a medium-term evaluation plan may be an effective measure to raise awareness among the relevant divisions in the International Cooperation Bureau of MOFA of the utilization of evaluation results and to adjust the timing of ODA evaluations at the policy level.
Further Improvement in Evaluability and Accountability by Strengthening the Usage of the “Objective 2 Framework (Logic Model)”
Recommendations Status of Follow-up Efforts
Formulating an “Objective Framework” at the policy for- ● ODA Evaluation Division, which implements ODA pol- mulation stage and verifying the achievements of policy icy evaluation, proposes utilization of logic model that implementation by evaluators based on the “Objective enhances quality of ODA and setting index to International Framework” can improve evaluability and strengthen Cooperation Bureau, which is in charge of policy making. accountability for the result performance compared to the ● MOFA proceeds reorganizing of Rolling Plans for each plan. This, in turn, is expected to help improve the quality partner country. In the revised rolling plans, the relations
of recommendations and evaluation results that can help Chapter 3 Follow-up Efforts on FY2015 Evaluation Results the feedback to ODA policy formulations. Additionally, between programs and projects will be defined more clearly. creating an “Objective Framework” of Country Assistance Policy and policy/initiative of each field and major issue at stage of formulating policy, by visualization, positioning a project to cooperation project, and which cooperation project relating to which political objective, will be clear.
Improvement of Verification at the assistance Program Level Coordination with JICA’s Operations 3 Evaluations and the Effective Usage of the Evaluation Results
Recommendations Status of Follow-up Efforts
In order to raise the quality and accuracy of assessment ● The revised ODA Evaluation Guidelines 10th edition(June and improve the evaluability of the “effectiveness of 2016) defines that "Effectively using data/information of results” in the policy level ODA evaluation, cooperation project evaluation results implemented by JICA, enhanc- between the policy level ODA evaluation and the proj- ing verification on Japan’s Assistance Program level, will ect-level ODA evaluation is necessary. With JICA’s col- be desirable."MOFA has been discussing this issue with laboration, it is necessary to effectively utilize the accu- mulated results of project evaluations conducted by JICA relative parties. Since FY2017, MOFA started inviting and to improve the verification of the “effectiveness of JICA staff from the evaluation division to share informa- results” at Japan’s Assistance Program level. Through tion on program-level evaluation. these, specifying/enhancing indexes to verify achieve- ments of major fields will be expected.
3.4 Other Evaluation 53 3.4 Other Evaluation
4 Recommendations regarding the ODA Evaluation Guidelines
Recommendations Status of Follow-up Efforts
In the ODA Evaluation Guidelines, it is necessary to indi- ● MOFA has been examining evaluation tools for evaluation cate more concrete points in the following areas: refine- from diplomatic viewpoint aiming for more improved ment of the scope and items of the ODA evaluations, clar- ODA evaluation system. The results from third-party ification of the evaluators’ status and qualifications evaluation, conducted based on followed the 10th ODA required for evaluators for third-party evaluations, Evaluation Guidelines, in FY 2016 will be reflected. strengthening the analyses on the effectiveness of results based on the Objective Framework formulated at the pol- icy formulation stage and appropriateness of the processes, standardization of quantitative analyses, improvement in the evaluation from diplomatic viewpoints, and improve- ment in evaluation quality by diversifying information sources.
5 Strengthening Feedback and Utilization of recommendations from the Policy-level ODA Evaluations
Recommendations Status of Follow-up Efforts
With the aim of utilizing the evaluation results, the evalu- ● Policy making parties are encouraged to utilize the results ation team recommends to formulate useful reference from past ODA evaluations posted on website. MOFA materials, which summarize the points of concerns will continue releasing information on website reflecting extracted from the cross-sectional analyses of the past users’ voices. ODA evaluation division has given detailed ODA evaluation results, and to organize feedback semi- feedback to relative parties of International Cooperation nars that promote the sharing of evaluation results with relevant people. Bureau of MOFA and JICA at the meetings of each proj- ect. Since FY2015, chiefs of third party evaluation teams have given the evaluation results and the feedbacks directly to the executives of the policy making department aiming for better utilization of recommendations. ODA Evaluation Division keeps checking the follow-up situation of past evaluation projects to make sure the recommendations are utilized among relative parties.
54 3.4 Other Evaluation Reference
List of Past ODA Evaluation Studies Conducted by MOFA (FY2004-FY2016)...... 56 Chronology of ODA Evaluation...... 61 List of Abbreviations and Acronyms...... 62 Related Websites and References...... 63 List of Past ODA Evaluation Studies Conducted by MOFA
For reference, this chapter lists ODA evaluations conducted by MOFA in the last decade, chronology of ODA evaluation, abbre- viations and acronyms used in this report and related websites. The evaluation reports by MOFA before FY2004 can be found on the MOFA website (http://www.mofa.go.jp/policy/oda/evaluation/index.html).
MOFA (FY2004-FY2016)
FY2004
Evaluation Title of Evaluation Study Evaluator Category Country Assistance Evaluation of Laos Third-party Country Assistance Country Assistance Evaluation of Uzbekistan and Kazakhstan Third-party Evaluation Country Assistance Evaluation of Bangladesh Third-party Country Assistance Evaluation of Ethiopia Third-party Mid-Term Evaluation on Japan’s Contribution to the Achievement of the MDGs in the Third-party Area of Education Priority Issue Mid-Term Evaluation on Japan’s Contribution to the Achievement of the MDGs in the Evaluation Third-party Area of Health Evaluation of Japan’s Anti-Personnel Mine Action Assistance Policy Third-party Joint evaluation with Morocco-UNICEF Country Programme Evaluation Sector Program other donor (UNICEF) Evaluation Evaluation of the Bridge Construction Program for Tegucigalpa and on Main Highways in Recipient government/ Honduras agencies “Review of Adjustment Lending Third-party -Overview of Structural Adjustment Loans and Sector Adjustment Loans” Joint evaluation with Evaluation of Grant Assistance for Japanese NGO Projects Modality Aid Modality NGOs Evaluation Joint evaluation with Program Assistance: The Democratic Republic of Timor-Leste other donor (USAID) Recipient government/ Evaluation of Grassroots Human Security Grant Aid for Bolivia agencies
FY2005
Evaluation Title of Evaluation Study Evaluator Category Country Assistance Evaluation of Cambodia Third-party Country Assistance Country Assistance Evaluation of Kenya Third-party Evaluation Country Assistance Evaluation of Tanzania Third-party Country Assistance Evaluation of Senegal Third-party Priority Issue Evaluation of Japan‘s ODA Contribution to Poverty Reduction Third-party Evaluation Evaluation of Japan‘s Peacebuilding Assistance Policy Third-party GOJ-GOB Programme Level Evaluation: Japanese Assistance to LGED Related Sectors Joint-evaluation with (Japan-Bangladesh Joint Evaluation) recipient country Viet Nam-Japan Joint Evaluation on the Japan‘s ODA Program for the Transport Joint-evaluation with Infrastructure Development in the Red River Delta Area of Viet Nam recipient country Sector Program Joint evaluation with Evaluation Evaluation Study on Japan‘s ODA to the Education Sector in the Philippines NGOs Evaluation on Japan‘s ODA for Mongolia: “To Construct General Education School Recipient government/ Buildings” Projects and Program “Grant Assistance for Grassroots Human Security agencies Projects” Evaluation of Japan’s Grant Assistance for Grassroots Human Security Third-party Aid Modality Review of General Budget Support (PRBS in Tanzania and PRSC in Viet Nam) Third-party Evaluation Recipient government/ Evaluation of the Non-Project Grant Aid Program in Zambia agencies
56 List of Past ODA Evaluation Studies Conducted by MOFA Reference 57 Evaluator Evaluator Third-party Third-party Third-party Third-party Third-party Third-party Third-party Third-party Joint evaluation with other donors (United States) Recipient government/ agencies Recipient government/ agencies Recipient government/ agencies Third-party Third-party Third-party Third-party Third-party Third-party Third-party Third-party Joint evaluation with NGOs Recipient government/ agencies Recipient government/ agencies Third-party Recipient government/ agencies Collaboration with DAC List of Past ODA Evaluation Studies Conducted by MOFA List of Past ODA Title of Evaluation Study of Evaluation Title Title of Evaluation Study of Evaluation Title Country Assistance Evaluation of Sri Lanka Country Assistance Evaluation of China Country Tunisia Assistance Evaluation of Country Assistance Evaluation of Nicaragua Country Assistance Evaluation of Mongolia Country TICAD Process Africa through the Assistance to Evaluation of Japanese Country Assistance Evaluation of Indonesia Country Evaluation of Japanese Educational Cooperation Policy “Basic Education for Growth Initiative (BEGIN)” USAID-Japan Joint Evaluation on “The US-Japan Partnership for Global Health” Assistance to Malaysia Project Evaluation of Japanese Development Africa in Relation on Consolidation of Peace and Security in ODA Evaluation of Japan’s African Development (TICAD IV) International Conference on Tokyo The Fourth to Eastern Region Evaluation of Japanese Cooperation in El Salvador’s Country Assistance Evaluation of Bhutan Assistance Evaluation Country Nam Viet of Assistance Evaluation Country of Madagascar Assistance Evaluation Country of Morocco Assistance Evaluation Country and its Contribution to Global Assistance for Forest Conservation Evaluation on Japan’s Issues Study of Central Case Cooperation—A Support for Regional Evaluation on Japan’s America— in the Independent State of Samoa to the Education Sector ODA Evaluation on Japan’s Sector in Sri Lanka to the Road and Bridge ODA Evaluation on Japan’s Assistance for Grassroots Human Security Grant Country-Led Evaluation on Japan’s Projects (Afghanistan) Country Assistance Evaluation of Zambia Assistance Evaluation Country Agriculture and Rural Development for ODA Evaluation of Japan’s Thailand Sector in to the Health ODA Evaluation Study on Japan’s Development Studies Evaluation on Japan’s (ECD) in Partner Countries Fact-Finding Survey on Evaluation Capacity Development Category Category Evaluation Evaluation Evaluation Country Assistance Evaluation Priority Issue Evaluation Sector Program Evaluation Country Assistance Evaluation Priority Issue Evaluation Sector Program Evaluation Aid Modality Evaluation Other Evaluation FY2007 FY2006 FY2008
Evaluation Title of Evaluation Study Evaluator Category Country Assistance Evaluation of Mozambique Third-party Country Assistance Evaluation of Ecuador Third-party Country Assistance Country Assistance Evaluation of Pacific Island Countries Third-party Evaluation Country Assistance Evaluation of Romania/Bulgaria Third-party Country Assistance Evaluation of Turkey Third-party Evaluation of Japan’s Assistance in Response to Tsunami Disaster Third-party Priority Issue Evaluation of Japan’s ODA in the Health Sector Third-party Evaluation Evaluation of “Initiative for Japan’s ODA on Water” and “Water and Sanitation Broad Third-party Partnership Initiative (WASABI)” Third party (joint Evaluation of Japan’s Assistance to the Education Sector in Laos evaluation with NGOs) Evaluation on “Japan’s ODA for Improvement of Management Capacity of Operation Sector Program Recipient government/ and Maintenance Regarding Water Supply in Egypt” and “Japan’s ODA for Water Supply Evaluation agencies development in Egypt" Recipient government/ Evaluation of Japan’s ODA on Consolidation of Peace in Timor-Leste agencies
FY2009
Evaluation Title of Evaluation Study Evaluator Category Country Assistance Evaluation of Bangladesh Third-party Country Assistance Evaluation of Ethiopia Third-party Country Assistance Country Assistance Evaluation of India Third-party Evaluation Country Assistance Evaluation of Brazil Third-party Country Assistance Evaluation of Ghana Third-party Recipient goverment/ Evaluation of Japan’s ODA for the Education Sector in Afghanistan Sector Program agencies Evaluation Recipient goverment/ Evaluation of Japan’s ODA in Guatemala’s Health and Water Sectors agencies Evaluation of Multilateral ODA: The United Nations Trust Fund for Human Security Third-party Other Evaluation Review of Japan’s ODA Evaluations Between FY2000-2007 Third-party
FY2010
Evaluation Title of Evaluation Study Evaluator Category Country Assistance Evaluation of Bolivia Third-party Country Assistance Evaluation of Egypt Third-party Country Assistance Country Assistance Evaluation of Malaysia Third-party Evaluation Country Assistance Evaluation of the Philippines Third-party Country Assistance Evaluation of Uganda Third-party Priority Issue Evaluation of Assistance for Peace-Building (Timor-Leste) Third-party Evaluation Aid Modality Evaluation of “the Grant Assistance for Japanese NGO Projects” Third-party Evaluation Recipient Evaluation of Japan‘s ODA in Bangladesh’s Transport Sector Sector Program governments/agencies Evaluation Recipient Evaluation of Japan‘s ODA in Senegal’s Water Sector governments/agencies Other Evaluation Evaluation of the Implementation of the Paris Declaration Case Study of Japan Third-party
58 List of Past ODA Evaluation Studies Conducted by MOFA Reference 59 Evaluator Evaluator Evaluator Third-party Third-party Third-party Third-party Third-party Third-party Third-party Third-party Third-party Third-party Third-party Third-party Third-party Third-party Recipient governments/agencies Third-party Third-party Third-party Third-party Third-party Third-party Third-party Third-party Third-party Third-party Recipient governments/agencies List of Past ODA Evaluation Studies Conducted by MOFA List of Past ODA Title of Evaluation Study Title Title of Evaluation Study of Evaluation Title Title of Evaluation Study of Evaluation Title Country Assistance Evaluation of Cuba Country Territories Assistance to the Palestinian Evaluation of Assistance Evaluation of the Republic of Malawi Country Cooperation Triangular Evaluation of Assistance Evaluation of Sri Lanka Country Assistance Evaluation of Colombia Country Nam Viet to the Health Sector in Evaluation of Japan‘s ODA Evaluation of “Human Resource Development in the area of Development” and “Supporting Development Education” Country Assistance Evaluation of Nepal Country Institutions that Promote Gender Equality Assistance for Policies and Evaluation of Japan‘s Team Evaluation of Japan Disaster Relief Assistance to the Health Sector in Cambodia Evaluation of Assistance Evaluation of Lao PDR Country under the Initiative for Disaster Reduction through ODA Assistance Evaluation of the Aid for Poverty Reduction Strategy Evaluation of Grant Nam Viet Sector in Transportation Assistance for the Urban Evaluation of Initiative Villages African Millennium Assistance to the Evaluation of Country Assistance Evaluation of Peru Assistance Evaluation Country Three In to a Market-oriented Economy Transition Assistance for the Evaluation of Asian Central Countries of Uzbekistan) Republic, Republic Kyrgyz (Republic of Kazakhstan, Aid Project (KR) Assistance for the Food Grant Evaluation of Japan’s Aid for Fisheries Evaluation of Grant in Mozambique to Education Sector ODA Evaluation of Japan’s Country Assistance Evaluation of Thailand of Assistance Evaluation Country Trade Aid for Evaluation of Dialogue Programs and Training Evaluation of Sector in Training) (Vocational Cooperation in the Education Evaluation of Japan’s Senegal Category Category Category Evaluation Evaluation Evaluation Evaluation Country Assistance Evaluation Priority Issue Evaluation Aid Modality Evaluation Sector Program Evaluation Country/Regional Assistance Evaluation Priority Issue Evaluation Aid Modality Evaluation Sector Program Evaluation Other Evaluation Country Assistance Evaluation Priority Issue Evaluation Aid Modality Evaluation Sector Program Evaluation FY2013 FY2012 FY2011 FY2014
Evaluation Title of Evaluation Study Evaluator Category Country/Regional Evaluation of Japan‘s Assistance for the Mekong Region Third-party Assistance Country Assistance Evaluation of Pakistan Third-party Evaluation Country Assistance Evaluation of Kenya Third-party Evaluation of Cooperation for Legal and Judicial Reform Third-party Priority Issue Evaluation of Humanitarian Assistance in Case of Emergency Third-party Evaluation Evaluation of Japan‘s Contribution to the Achievement of the MDGs in the Third-party Health Sector Aid Modality Review of Grand Aid for Countries with Relatively High Income Third-party Evaluation Sector Program Evaluation of Japan’s Official Development Assistance (ODA) to the Rural and Recipient Evaluation Agriculture Sector in Thailand governments/agencies Evaluation of the JICA Partnership Program Third-party Other Evaluation Review of Japan‘s ODA Evaluations from FY 2003 to 2013 Third-party
FY2015
Evaluation Title of Evaluation Study Evaluator Category Country/Regional Country Assistance Evaluation of Viet Nam Third-party Assistance Evaluation of Japan’s Assistance for Pacific Island Countries Third-party Evaluation Evaluation of Assistance for the South Caucasus Third-party Country Assistance Evaluation of Morocco Third-party Evaluation of Japan’s Contribution to the Achievement of the MDGs in Environmental Third-party Priority Issue Sector Evaluation Evaluation on Japan’s Education Cooperation Policy 2011-2015 Third-party Aid Modality Evaluation of Debt Cancellation Third-party Evaluation Sector Program Evaluation of Japan’s ODA to the Disaster Risk Reduction Management (DRRM) Sector Recipient government/ Evaluation in the Republic of the Philippines agencies Other Evaluation Evaluation of the Feedback Mechanism of Japan’s ODA Third-party
FY2016
Evaluation Title of Evaluation Study Evaluator Category Country/Regional Country Assistance Evaluation of the United Republic of Tanzania Third-party Assistance Evaluation Country Assistance Evaluation of the Republic of Paraguay Third-party
Priority Issue Evaluation of Japan’s Assistance in the Pollution Control Field Third-party Evaluation Aid Modality Evaluation of Grant Aid for Promotion of Japanese Standards Third-party Evaluation Sector Program Evaluation of Assistance in the Industrial Human Resources Development Sector in Third-party Evaluation Thailand Recipient government/ Sector Program Evaluation of Japan’s Official Development Assistance to the Uruguayan Forestry Sector agencies
60 List of Past ODA Evaluation Studies Conducted by MOFA Reference 61 Chronology of ODA Evaluation Chronology of ODA International Community International DAC advocated the five DAC Criteria Accra Action Plan adopted at the third Accra HLF in Accra Busan Partnership for Effective Development Co-operation established at the fourth HLF in Busan Millennium Development Goals (MDGs) adopted DAC Network on Development Evaluation established Paris Declaration adopted at the Second HLF in Paris DAC Development Evaluation Advisory Meeting on ODA External Quality Standards formulated Predecessor of DAC Network on Predecessor of DAC Network established Development Evaluation First high-level meeting of the Global Development Partnership for Effective Co-operation (GPEDC) held 2030 Agenda for Sustainable 2030 Development adopted JICA set up the Ex-post OECF Evaluation of ODA Loan Project Evaluation of ODA Feedback Committee Ex-ante evaluation began established New JICA Advisory Committee External Experts on Evaluation established Examples of standard indicators by Aid development issues for Grant projects published Ex-post evaluation began (former OECF) Ex-post evaluation evaluation section specializing in ex-post A established in former OECF project Section specializing in evaluation established Publication of Ex-Post Evaluation Loan Projects began Report on ODA (former OECF) Annual Evaluation Began publishing Reports Former Advisory Committee External Experts into on Evaluation reorganized Advisory Committee on Evaluation Evaluation Reviewing Committee Evaluation Reviewing established Ex-post evaluation began MOFA External Advisory Committee for ODA Advisory Committee for ODA External Evaluation Feedback established ODA Evaluation Division relocated from ODA International Cooperation Bureau to Secretariat Minister’s “Annual Evaluation Report on Japan’s Economic Cooperation” renamed “Annual Evaluation” ODA Report on Japan’s New Medium-Term Policy on ODA formulated on ODA Policy New Medium-Term Review (final report) announced ODA Fifteen Specific Measures for ODA Reform Fifteen Specific Measures for ODA announced Ex-ante evaluation started under Act(GPEA) Government Policy Evaluation Report on Reform of Japan’s ODA ODA Report on Reform of Japan’s Evaluation System submitted to the Foreign Minister enacted (implemented in 2002) GPEA Charter revised ODA Advisory Meeting on ODA External Evaluation terminated ODA Charter adopted by the Government of Japan Charter adopted by ODA formulated Policy on ODA Medium-Term ODA Evaluation Division established in ODA Bureau Economic Cooperation Economic Cooperation Evaluation Economic Cooperation in the Economic Committee established Cooperation Bureau Report onAnnual Evaluation Publication of Economic Cooperation began Japan’s Ex-post evaluation began Development Cooperation Charter formulated Sustainable Development Goals (SDGs) Promotion Headquarters established and SDGs implementation guiding principles formulated by the Government of Japan Chronology of ODA Evaluation of ODA Chronology 2011 2016 2014 2015 2013 2010 2008 2005 2003 2002 2001 1999 2000 1992 1995 1991 1984 1988 1982 1981 1975 List of Abbreviations and Acronyms
ADB Asian Development Bank ASEAN Association of Southeast Asian Nations DAC Development Assistance Committee DRRM Disaster Risk Reduction and Management E/N Exchange of Notes EvalNet Network on Development Evaluation FAO Food and Agriculture Organization of the United Nations GGP Grant Assistance for Grassroots and Human Security Projects GNI Gross National Income GPEA Government Policy Evaluations Act GPEDC Global Partnership for Effective Development Co-operation HLF High Level Forum ICT Information and Communications Technology ILO International Labor Organization IMF International Monetary Fund JCM Joint Crediting Mechanism JICA Japan International Cooperation Agency MDBs Multilateral Development Banks MDGs Millennium Development Goals MOPAN Multilateral Organisation Performance Assessment Network NGOs Non-governmental Organizations ODA Official Development Assistance OECD Organisation for Economic Co-operation and Development OECF Overseas Economic Cooperation Fund PDCA Plan, Do, Check, Act PPP Public Private Partnership SDGs Sustainable Development Goals TICAD Tokyo International Conference on African Development UHC Universal Health Coverage UNAIDS Joint United Nations Programme on HIV/AIDS UNDAC United Nations Disaster Assessment and Coordination UNDP United Nations Development Programme UNICEF United Nations Children's Fund UNODC United Nations Office on Drugs and Crime USAID United States Agency for International Development WHO World Health Organization
62 List of Abbreviations and Acronyms Reference 63 Related Websites and References Websites Related URL URL http://www.mofa.go.jp/policy/oda/page_000138.html http://www.mofa.go.jp/policy/oda/page_000017.html http://www.mofa.go.jp/policy/oda/assistance/index2.html http://www.mofa.go.jp/policy/oda/evaluation/basic_documents/ pdfs/guidelines2013.pdf http://www.mofa.go.jp/policy/oda/evaluation/index.html http://www.mofa.go.jp/policy/oda/data/index.html http://www.mofa.go.jp/policy/oda/index.html http://www.mofa.go.jp/policy/oda/evaluation/index.html http://www.soumu.go.jp/english/aeb/index.html http://www.jica.go.jp/english/our_work/evaluation/index.html http://www.oecd.org/dac/evaluation/ http://www.mopanonline.org/ http://www.japan.kantei.go.jp/97_abe/actions/201706/9article1. html http://www.mofa.go.jp/policy/oda/mdg/index.html http://www.mofa.go.jp/policy/oda/page22e_000793.html http://www.undp.org http://www.fao.org http://www.who.int http://www.unaids.org http://www.imf.org http://www.worldbank.org http://www.adb.org http://www.afdb.org http://www.usaid.gov http://www.dfid.gov.uk http://icai.independent.gov.uk/ http://www.afd.fr/lang/en/home http://www.bmz.de/en/index.html https://www.deval.org/en/home.html http://www.aecid.es/EN http://evaluationjp.org/english/index.html http://www.unic.or.jp/info/un_agencies_japan/siap/?lang=en http://www.aarjapan.gr.jp/english/ http://www.bhn.or.jp/official/english http://www.reborn-kyoto.org/en/ Websites References Related Websites and References and Websites Related Development Cooperation Charter Japan's ODA White Paper Japan's ODA Country Assistance Policies Evaluation Guidelines (8th Edition) ODA Annual Evaluation (former Annual Report on Japan's ODA Evaluation Report on Japan's Economic Cooperation) Data by Country Japan's ODA MOFA: Japan's ODA MOFA: MOFA: Japan's ODA Evaluation Japan's ODA MOFA: Bureau Administrative Evaluation MIC Evaluation JICA on Development Evaluation OECD-DAC Network Network Assessment Performance Multilateral Organisation Development Goals) Promotion SDGs (UN Sustainable Headquaters The 2030 Agenda for Sustainable Development The 2030 MDGs(UN Millennium Development Goals) MDGs(UN Millennium Development UNDP (United Nations Development Programme) (United Nations UNDP of the United Nations) Agriculture Organization and (Food FAO Health Organization) WHO (World HIV/AIDS) UNAIDS (Joint United Nations Programme on IMF (International Monetary Fund) Bank World ADB (Asian Development Bank) AfDB (African Development Bank) Agency for International Development) USAID (US DFID (UK Department for International Development) Aid Impact) ICAI (Independent Commission for Agency) AFD (French Development Cooperation and BMZ (Germany's Federal Ministry for Economic Development) DEval (German Institute for Development Evaluation) Agency for International Development AECID (Spanish Cooperation) JES (The Japan Evaluation Society) Asia and the Pacific) (United Nations Statistical Institute for SIAP Aid and Relief, Japan Association for AAR Japan BHN Association REBORN KYOTO Annual Report on Japan’s ODA Evaluation 2017
Edited and published by the Ministry of Foreign Affairs
Minister’s Secretariat
ODA Evaluation Division
2-2-1 Kasumigaseki
Chiyoda-ku, Tokyo 100-8919 Japan Tel:+81-3-3580-3311 Fax:+81-3-5501-8356