eVALUation Matters A Quarterly Knowledge Publication on Development Evaluation

Evaluation Week 2018 Strengthening Development Impact

Third Quarter 2018 From experience to knowledge... From knowledge to action... From action to impact

eVALUation Matters Evaluator General (Acting): Is a quarterly publication from Independent Development Evaluation Karen Rot-Münstermann, [email protected] at the African Development Bank Group. It provides different perspectives and insights on evaluation and development issues. Managers: Foday Turay (OIC) [email protected] Editor-in-Chief: Madhusoodhanan Dieter Gijsbrechts, Senior Knowledge Management, Mampuzhasseril (OIC) [email protected] Communications and Events Officer, IDEV Karen Rot-Münstermann [email protected]

Acknowledgments: Talk to us: IDEV is grateful to all contributors, reviewers, editors, and Phone (IDEV) +225 2026 2041 proofreaders who worked on this issue, in particular: Phone (AfDB standard) +225 2026 4444 ❙ Agnès Derelle, Independent Editor and Translator ❙ Aminata Kouma, Evaluation Knowledge Assistant, IDEV Write to us: 01 BP 1387 ❙ Grace Gabala, Communications Consultant, IDEV Avenue Joseph Anoma, ❙ Jayne Musumba, Principal Knowledge Management Officer, IDEV Abidjan 01, Côte d’Ivoire ❙ Karen Rot-Münstermann, Acting Evaluator General, IDEV ❙ Magdaline Nkando, Knowledge Management Consultant, IDEV [email protected] ❙ Monica Lomena-Gelis, Principal Evaluation Officer, IDEV e-mail us:

Design & Layout: Find us online: idev.afdb.org www.afdb.org Créon (www.creondesign.net) Connect with us on: @evaluationafdb IDEV AfDB Photography:

❙ Instant2Vie ❙ African Development Bank

About Independent Development Evaluation The mission of Independent Development Evaluation at the AfDB is to enhance the development effectiveness of the institution in its regional member countries through independent and instrumental evaluations and partnerships for sharing knowledge.

Disclaimer: The views expressed in this publication belong solely to the authors, and not necessarily to the authors' employer, organization or other group or individual.

© 2018 – African Development Bank (AfDB) Introduction

The ambitious African transformation agenda set out in the African Union’s Agenda 2063 cannot be achieved without effective monitoring and evaluation at the national, regional and continental levels. Monitoring and evaluation are important sources of evidence and learning, about what has worked, what has not, and why. These lessons, if properly taken into account and integrated into new policies, strategies, projects and processes, will help to improve the quality of design and implementation, as well as make interventions more effective, efficient and sustainable. From 5 to 7 September 2018, Independent Development Evaluation (idev) hosted the AfDB Development Evaluation Week 2018 in Abidjan, Côte d’Ivoire, under the theme Strengthening Development Impact. The forum a'racted over 450 participants, including government policy- and decision- makers, representatives from development partners, research and academic institutions, evaluation associations and civil society, as well as Bank shareholders, management and staff. In addition to a professional development workshop on gender and evaluation, a Knowledge Café on the use of evaluations, and a discussion on the oecd-dac evaluation criteria, participants at the Evaluation Week discussed: Are agricultural value chains viable instruments for driving Africa’s transformation agenda, in particular in achieving inclusion? What is the potential of ppps for building Africa’s infrastructure and what are the barriers that impede their utilization? How can partnerships help build the supply and demand of high-quality evaluations and foster a culture of evaluation on the continent? All documents, presentations, photos, videos and other materials from the Evaluation Week are available on the following website: idev.afdb.org/evaluationweek2018 News inpictures, page82

Ta b l e o f c o nt e nts

Independent Development Evaluation African Development Bank

From From From

experience knowledge action

to

impact to

to

knowledge action

...

... 30 24 18 12 8 4

Independent Evaluation

of the Congo Basin and grow the volume of PPPs across the African continent. have for African infrastructure investment and some of the factors needed to inspire, catalyze recap of the proceedings, Maude Vallee provides insight into the potential that PPPs could pants on Public-Private Partnerships (PPPs) for infrastructure development. Following a brief partici between interaction Weekrich Evaluation a of therewas day 2018, second the On highlight someofthekeycontributionsfrom thepanel. addressed thequestions“Areandifnot,why?” We welearning Following theopeningofEvaluationWeek, ahigh-levelpanel fromand learning results inorder to attaintheAgenda2063goals. The Hon.MinisterspellsoutheraspirationsforAfricaandtherole ofevaluation article, participantsreflect onthesessionandwhatitmeanttothem. sex-disaggregated datatomeasure distributionalimpactsinAfrica.Inthis evaluation, aswellraisingawareness ontheneedtogenerateanduse workshop aimedatimproving participants’understandingofgenderin During EvaluationWeek, IDEVorganized aprofessional development Here weprovide ashortsummaryofthepointsdiscussedandideasshared. discussing keyquestionsontheuseofevaluationinaninformal,collaborativesetting. Evaluation Week 2018kickedoff withalivelyknowledgecaféthatsaw60participants Maude Vallee, Legal Counsel, African Legal Support Facility, AfDB development in Africa Feature: Bringing down the barriers to infrastructure for infrastructure development InAfrica Thematic discussion I:Public-Private Partnerships The heartofthemater: Are we learning? Dr Nkosazana Dlamini-Zuma Planning, Monitoring andEvaluation ofSouth Africa Keynote Address bytheMinister inthePresidency for workshop: Genderandevaluation Reflections from theprofessional development evaluations for greater impact ofBankoperations Thoughts from theKnowledge Café onuse of From theActing Evaluator-General’s desk

Summary Report Forest Fund

July 2018

Thematic Evaluation An IDEV - 40 From the sidelines Voices of participants at Evaluation Week 2018. Published September 2018 42 Q&A with Acting Evaluator General Karen Rot-Münstermann discusses the future of development evaluation in Africa. Editorial Calendar 46 Evaluation Week social media wall Viral content, insightful comments and captivating photos shared Q4 2018 on twitter or online during Evaluation Week 2018. Gender and 50 Thematic discussion II: Inclusion through agriculture Evaluation In a lively afternoon of presenting and exchanging ideas, knowledge and expertise, two panels of experts and practitioners discussed the role of agricultural value chains Q1 2019 in creating food security; improving nutrition; boosting economies through agri- Best Practices businesses; and the importance of social inclusion, particularly gender inclusion. Here we highlight the keynote speech, a presentation, and some contributions by the panels. and Innovation in Evaluation 71 Reviewing the script: Consultation session on OECD-DAC evaluation criteria Q2 2019 As part of an ongoing worldwide consultation on the OECD-DAC Development Evaluation African Indigenous Criteria, IDEV organized a discussion that explored the adaption of this widely used Evaluation set of benchmarks to the new international development context and landscape.

74 Thematic discussion III - Partnerships for impact in Africa

This final session of Evaluation Week 2018 explored how partnerships Find all information, can help build the supply of high-quality evaluations on the continent, resources and videos stimulate demand for evaluations, encourage learning from evaluations, from Evaluation Week and promote use of evaluation in policy- and decision-making. 2018 on our dedicated website idev.afdb.org/ evaluationweek2018

Call for contributions: Evaluation Matters is a quarterly mag azine issued in both Eng lish and French, by IDEV, Independent De- velopment Evaluation at the AfDB. We welcome topical articles from writers’ orig inal work and will be pleased to consider contributions for the themes in the above Editorial Calendar. See details at http://idev. afdb.org/en/document/ editorial-calendar-2018 Evaluation Week 5–7 September | 2018 Abidjan, Côte d’Ivoire Strengthening development impact

Find eVALUation Matters at http://idev.afdb.org/ en/page/evaluation- matters-magazine 4

From the Acting Evaluator-General’s desk Achieving the continent’s development agenda set out out set agenda development continent’s the Achieving These lessons, if properly integrated into new policies, policies, new into integrated properly if lessons, These From 5 to 7 September 2018, IDEV hosted the the hosted IDEV 2018, September 7 to 5 From Evaluations provide important sources of evidence and and evidence of sources important provide Evaluations Development Bank’s strategic plan for the transformation vulnerable groups, in particular women and youth. And And youth. and women particular in groups, vulnerable cient jobs for Africa’sforgrowing jobs sufficient createto nor levels, learning, about what has worked, what has not, and why. Development Evaluation Week 2018 WeekEvaluationDevelopment Impact. we must more actively build resilience to climate change workforce. As some of IDEV’s recent evaluations have have evaluations recent IDEV’s of some As workforce. the High 5s-, will require not only targeted investment and not enough to achieve significant reductions in poverty in reductions significant toachieve enough not recent years has been good and continues to improve. This inclusion,marginalizedtoin and reachingbringing and itself, by growth however, Economic welcomeis news. is by the African Union’s Agenda 2063 and the African African the and 2063 Agenda Union’s African the by d’Ivoire, under the theme d’Ivoire,the under effective, fficient e and more interventions development make implementation, ultimately and and design project and program of Ten-Year –the continent the of Strategy, elaborated as in and environmental strategies, and processes, will help to improve the quality levels. continental and regional national, the systems at sound policy, but also effective monitoring and evaluation ention needs to be paid to issues of of issues to paid be to needs 'ention a more shown, By and large, Africa’s economic performance over over performance economic Africa’s large, and By The EvaluationThe Week reflectsIDEV’stheme 2018

change.

sustainable. Strengthening Development Strengthening eVALUation MattersThird Quarter2018 From the Acting Evaluator-General’s desk desk Evaluator-General’s Acting the From in Abidjan, Côte Abidjan, in AfDB AfDB eVALUation Matters Third Quarter 2018

conviction that evaluation has a critical role to play in achieving Africa’s transformation agenda by holding policy- and decision-makers to account and by providing lessons and factors that enable or hamper success. This is a conviction shared by many, judging by the strong engagement and participation of AfDB staff, evaluators, policy makers, private sector experts, NGOs, students and the media, that I witnessed throughout the conference . For three days, over 450 participants (with another 100 connected remotely via the conference website) explored the contribution that evaluation and learning can make to two aspects of importance to Africa’s transformation: infrastructure development, in particular through public-private partnerships, and inclusive agricultural development. Participants also discussed the need for close collaboration, partnerships and sharing of ideas and experiences among stakeholders as key to ensuring that evaluation and learning have greater impact on Africa’s development agenda. Through a knowledge café, the conference also allowed for intimate and interactive learning and exchange between AfDB evaluators, operations staff and external participants on how evaluations can have greater impact on Bank operations. A professional capacity development workshop aimed at AfDB and local evaluators shared best practices for integrating gender into evaluation processes. And at a special discussion session, participants provided inputs from Africa to the ongoing global stakeholders’ consultation on the OECD DAC criteria for evaluating development assistance. This edition of Evaluation Ma+ers synthesizes experts’ viewpoints, key interventions and evaluative knowledge presented during Evaluation Week 2018. It gives you a taste of the rich exchanges that took place during the conference. For more in-depth coverage of the topics and issues examined by over 30 panelists as well as the valuable contributions from the audience, you are encouraged to browse the conference proceedings, videos, speakers’

From the Acting Evaluator-General’s desk 5 eVALUation Matters Third Quarter 2018

presentations and other materials now available on the conference and idev websites: Conference website: h'p://idev.afdb.org/evaluationweek2018 IDEV conference page: h'p://idev.afdb.org/en/page/evaluation-week-2018 As noted by our keynote speaker, Honorable Dr. Nkosazana Dlamini Zuma of South Africa, both a pioneer of Agenda 2063 and a champion of evaluation, “African countries and institutions have the capacity to implement and evaluate Agenda 2063 and the Sustainable Development Goals”. Through effective monitoring and evaluation, Africa can capitalize on over sixty years of individual and collective development experience. It can leverage this experience as knowledge and use this knowledge to enable impactful development actions. It is my hope that the African Development Bank and its partners will use the knowledge, ideas and recommendations that emerged from Evaluation Week 2018 for greater results of development programs in Africa. Happy reading!

About the Acting Evaluator General

Mrs. Karen rot-münstermann is the Acting Evaluator General of the African Development Bank. She joined IDEV in 2014 as manager of its Knowledge Management, Outreach and Capacity Development Division, a!er spending five years at the Bank’s Resource Mobilization and Partnerships Department, where she was among others responsible for coordinating the three-yearly ADF replenishment processes. Before joining AfDB in 2009, Karen was a Senior Policy Advisor at the Dutch Ministry of Finance (Treasury, Foreign Financial Relations Department). She holds degrees in Political Science, European Studies, and Economics.

From the Acting Evaluator-General’s desk 7 Thoughts from the knowledge café on evaluations for greater impact of Bank operations E Day experiences and knowledge on three questions: i) questions: three on knowledge and experiences questions. and iii) and stakeholders stakeholders tackle challenges of communicating evaluation findings? Below is a short summary of the points discussed and ideas shared as a result of the collaborative knowledge session, looking at each of these between evaluators and ective stakeholder engagement engagement stakeholder ffective e on was discussions the of focus improve engagement with stakeholders in stakeholders improvean evaluation?with engagement ii) in conducting and utilizing evaluations. They exchanged ideas, ideas, exchanged They evaluations. utilizing and conducting in The thinking. box” the of “out encouraged which groups, small in questions 1

What are the challenges and opportunities in collaboration collaboration in opportunities and challenges the are What 3 Wednesday 5September 2018 valuation discussing key questions on the use of evaluation in an an in evaluation of use the on questions key discussing Bank operations staff and Bank and local evaluators- evaluators- local and Bank and staff operations Bank that saw 60 saw that noml claoaie etn. atcpns worked Participants setting. collaborative informal, Evaluation Week

Week 2018 kicked ff o with a lively knowledge café KNOWLEDGE CAFÉ

stakeholders? participants –mainly African Development Development African –mainly participants tables 6 Collaboration challanges Commiunication Engagement Questions

2018

how can how evaluatorscan participants 60

How can eVALUation Matters Third Quarter 2018

How can evaluators improve their engagement with evaluation stakeholders?

question: Who are the evaluation stakehold- ers and what role does each stakeholder play in the evaluation process and beyond? Jayne Musumba Principal Knowledge Management Officer, IDEV, addresses the participants There are several actors in an evaluation process, namely the evaluators themselves, the Bank’s Board of Directors, Bank senior the evaluation and its findings to all management, Bank operations staff, stakeholders. In particular, it must be made national governments, project beneficiaries clear that there is a distinction between (including women and vulnerable groups), audits and evaluations in order to foster a civil society, technical and financial partners, relationship of trust and confidence, and local authorities, and private sector actors. learning. Finally, each actor’s roles need to be defined and discussed. Each of these actors plays a specific role. While the evaluators are responsible for conducting the evaluation, the Bank’s How can stakeholders tackle Board of Directors commissions the the challenges associated evaluations and uses the results and with communication and use recommendations of the evaluations. In the of evaluation findings? meantime, operations personnel participate in the evaluation process and also act as This issue raises the question of who, information providers, while technical and rather than what. Knowing what to financial partners share expertise, provide communicate is only possible if you information, and validate results. Finally, know who you want to communicate private sector actors play an important role with. Thus, the first priority must be as stakeholders, in particular for Public to identify the stakeholders: the Bank, Private Partnerships (ppp) projects. governments, the private sector, civil society, partners and beneficiaries. The question: What relationships need to be target audience therefore determines the established to ensure the stakeholders own type of information to be communicated. and use the information and knowledge In addition, some evaluation types are from evaluations in new Bank operations? suited for specific target audiences and thus communication needs to be geared Communication and inclusion of all towards this audience. For example, for a stakeholders is essential for evaluation. country assessment, the government will Therefore a communication plan must be targeted, while for a sectoral assessment, be defined for each evaluation. This it will be sector actors. plan includes a clear explanation of question: What needs to be communicated (i.e. findings, conclusions and recommendations, lessons, or best practices of evaluations)?

The second step is to determine, according to each stakeholder, which information (such as findings, conclusions, lessons Participants were invited to speak up and share and recommendations) should be their thoughts at the convivial event communicated, when and how.

Thoughts from the knowledge café on evaluations for greater impact of Bank operations 9 eVALUation Matters Third Quarter 2018

Evaluation Week 5–7 September | 2018 Abidjan, Côte d’Ivoire Strengthening development impact

Ideas shared in the table discussions: Participants in the Knowledge Café were asked what the opportunities and challenges were in collaboration between evaluation teams and various stakeholders:

Challenges Opportunities

Continuity of interaction throughout Knowing who are our stakeholders evaluative process

Stakeholders do not always understand Engaging in prior discussion with stakeholders independence of evaluation

Challenges in ensuring evaluation is an integral part of operations Changing institutional culture to ensure buy-in departments’ work

Competences needed both from evaluators Ensuring that certain reports contribute and stakeholders to evaluation process

Implement workshops and other initiatives Lessons learned need to be effectively evaluated that foster better understanding

Evaluators may be biased and come with Ensuring purpose of evaluation is clear to allow prejudices for effective learning

10 Thoughts from the knowledge café on evaluations for greater impact of Bank operations eVALUation Matters Third Quarter 2018

For example, for the Bank and the To help plan communications, there government, information should be should be an assessment of how communicated from the beginning of the information is received by the different evaluation process (findings) to the end stakeholders. From there, a database (recommendations). that indicates how to reach specific audiences, can be put in place. question: How should evaluation findings be effectively communicated to ensure they are timely and relevant for Bank What are the opportunities operations staff? and challenges in collaboration between evaluation teams The first consideration should be which and various stakeholders? channel of communication will be used to communicate to a target audience. For question: What are the challenges faced by example, communicating information to such collaboration? the Bank’s internal stakeholders should not be done on the same platforms as One of the main challenges is the communicating with project beneficiaries. divergence of interests between the To communicate to Bank staff, internal evaluation teams on the one hand resources should be used such as the Afdb and the different stakeholders on the intranet, e-mail lists, internal reviews and other. This can lead to the withholding workshops, in addition to public channels of information or disclosure of bad or such as the Afdb and idev websites and false information to evaluators. Another social networks. challenge concerns the dissemination of the results of the evaluation, which may In addition to internal communication experience blockages. efforts focused on operations, idev organizes regular knowledge workshops, question: What are the opportunities? webinars and other learning events, in order to help countries and other Any evaluation is an opportunity for organizations within Africa improve collaboration to define the evaluation future policies and strategies, through questions, obtain the commitment of the using evaluation and adopting an stakeholders to answer the questions and evaluation culture. In order to reach agree on how to use the results. beneficiaries in a country such as Côte d’Ivoire, in addition to these question: What can we do when the activities, idev engagement should use collaboration between an evaluation team communication channels suitable for and stakeholders breaks down? both urban and rural areas, such as video testimonials, interviews, animations, The parties involved should endeavor or radio. to sort out any source of disagreement and review the evaluation issues. An impartial facilitator (individual or entity out of the relationship) may be needed. Stakeholders should be sensitized on the rationale behind evaluation to defuse any disagreement and emphasize the level of transparency, as well as discard any misunderstanding. If necessary, the evaluation questions may be reformulated, The Knowledge Café brought Bank staff and external evaluation experts together or its methods adapted.

Thoughts from the knowledge café on evaluations for greater impact of Bank operations 11 Participants’ refections from the professional development workshop on Gender and Evaluation G Day evaluation. On the first day of Evaluation Week 2018, a professional professional a 2018, Week Evaluation of day first the On evaluation. developmenttargetedworkshopevaluatorslocal and sta ff Bank at in calne o bt te aks prtos n is independent its and operations Bank’s the both for challenge a sex-disaggregated data to measure distributional impacts in Africa. Measuring the reduction of inequality gaps, however, remains remains however, gaps, inequality of reduction the Measuring Côte d’Ivoire, aimed to improve participants’ understanding of gender the in evaluation as well as raise awareness of the need to generate and use

continent. 1 Wednesday 5September 2018 economic opportunities, close the gender gap between between gap gender the close opportunities, economic ender development agenda. The Bank’s Gender Strategy Strategy Gender Bank’s The agenda. development men and women, and improve knowledge and capacity on (2014–2018) aims to make progress in women’s access to women’s access in progress make to aims (2014–2018)

qaiy s n nerl at f h Af the of part integral an is equality DB ’s eVALUation Matters Third Quarter 2018

Four sessions constituted the basis of ❚ idev evaluation of the Bank’s country this learning event: strategy and program in Cabo Verde (2018) ❚ idev Mid Term Evaluation of the idev’s experience integrating Country Strategy and Program in gender in evaluations Guinea Bissau (2018) ❚ Presentation idev’s experience Lead: Monica Lomena-Gelis, Principal integrating gender in evaluations Evaluation Officer, idev (2018)

This session presented key concepts Mainstreaming gender in of Gender Responsive Evaluation, operations: Experience summarized in the Evaluation Cooperation from African Development Group Reference Document “Integrating Bank operations staff gender into project level evaluation”. The session also presented pilot evaluations Over the past years, the Bank has strived into which gender has been integrated, and to integrate gender at the onset of reflected on the challenges found, as well project designs, for instance in health as the way forward for idev as it continues and infrastructure (transport, water and to integrate gender in its evaluations and sanitation) projects. Using the Bank’s knowledge products. Gender Strategy as a reference, this session provided Bank task managers, gender Relevant materials available on the IDEV specialists and evaluators with a forum website idev.afdb.org: to honestly self-reflect and discuss what has worked and what could be improved ❚ idev Evaluation synthesis on gender to strengthen gender mainstreaming in mainstreaming (2012) Bank operations and strategies. The Bank’s ❚ Edition of Evaluation Matters about experience using its own Gender Marker gender (2014) System was also discussed.

Participants’ reflections from the professional development workshop on Gender and Evaluation 13 eVALUation Matters Third Quarter 2018

World Bank Independent Open discussion between Evaluation Group’s experience operations staff, evaluators with mainstreaming gender and gender specialists in their activities

Presenter: Gisela Garcia, Evaluation Three African Development Bank officer, ieg, World Bank operations Task Managers responded to some practical questions about their The session presented the World Bank’s experience in mainstreaming gender into rationale, challenges and approach to operations in the health, transport, and including gender into evaluations, more water and sanitation sectors. Participants specifically the development of tools asked questions and contributed with and resources to achieve that goal. The their own experiences in mainstreaming presentation reflected on the experience gender into designs and in evaluations. of implementing a Gender Flag in ieg’s The general understanding at the end of validation of project completion reports the workshop was that despite the lack of and country strategy evaluations. a structured and systematic approach to measuring gender equality in development projects, operations staff and evaluators should make efforts to include gender in their designs and project evaluations.

14 Participants’ reflections from the professional development workshop on Gender and Evaluation eVALUation Matters Third Quarter 2018

Participants’ reflections

Following the workshop, idev asked what they had learned at the workshop participants to provide their thoughts on and on the topics discussed:

Agniré Henrie!e KAKOU Administrator, Gender Technical Secretariat at the Ministry for the Promotion of Youth and Youth Employment, Côte d’Ivoire

This workshop allowed us to deepen The workshop also helped us to understand our knowledge of gender issues. In that the evaluation of any current particular, it allowed us to understand project requires the inclusion of gender how to include gender in the design of considerations, hence the importance of our development projects, which will be including it from the outset, when defining in turn taken into account by donors. the objectives of these projects.

Esther Kouakou ADOU AKOUA N'GORAN 2IEval1 member

This workshop allowed us to understand population will have to be taken into account. the importance of gender in development It is it is very important to include beforehand policies. Indeed, taking gender into account the anthropological and sociological aspects during the development of these projects, of the beneficiary populations. This allows including in the conceptual phase of the for a be+er collaboration with them in order project, enables more efficient work and to anticipate certain difficulties that could produces be+er results. In the conceptual come up during the execution phase of phase of the project, the beneficiary the project.

1 Initiative Ivoirienne pour l’Evaluation (Ivorian Evaluation Initiative)

Participants’ reflections from the professional development workshop on Gender and Evaluation 15 eVALUation Matters Third Quarter 2018

Kadjo Laurent KOUAME Treasurer, 2IEval

The concept of gender is normally and that helps reduce initial gaps. This captured in our various studies under approach allows us to have a clear idea the term vulnerable groups (lumped of the gender concept, which promotes together as women, children, the disabled the equality of women and men by and the elderly). At the workshop we taking into account differences and learned of the gender approach applied socially constructed hierarchies. This to development actions, that allows for allows us to reorient our perception of more equal participation and allocation the concept of gender in the realization of resources between women and men of our sociological studies.

Kouadio Pierre N'DRI Rural Engineer, 2IEval Secretariat

The main takeaway for me is the and the other at start-up. An agreed-upon consideration of gender as a whole in definition of disadvantaged people is evaluation. An evaluation must take currently being validated by all project into account both women and young stakeholders, so that the project can target people, as well as disadvantaged or beneficiaries, and follow up on these target marginalized people. groups during project implementation. At the completion phase of the project, terms I am the Monitoring and Evaluation of reference of the final evaluation will Manager for two agricultural projects, focus on gender mainstreaming and the one of which is in the completion phase effects of the project on gender.

Yakiéma DIABATE KOUYATE Engineer in Audit and Management Control, Head of the Gender and Human Rights Theme Group of the Ivorian Monitoring and Evaluation Network (RISE)

The workshop looked at gender issues evaluation, operations and interventions in different sectors and various aspects is increasingly a priority for the African of social, economic and political life Development Bank, whose main (access to school, land, legal systems, objective is to reduce poverty. infrastructure). Thus, we noted that inequalities (in Africa) are very Overall, we saw that gender issues are noticeable in terms of land, property not related to women only but that the and labor. Women constitute 50% of the equality of men and women in access workforce, but they only have access to to power and decision-making is an 1% of the land. These inequalities are imperative for better development. In visible on several levels, particularly at addition, the evaluators must have tools the level of wages where women are paid to take gender into account and identify less than men with equal competence. We relevant indicators to measure the also noted that gender considerations in distributive impacts of interventions.

16 Participants’ reflections from the professional development workshop on Gender and Evaluation eVALUation Matters Third Quarter 2018

Samuel KOUAKOU Expert in Project Evaluation and Public Policy, International Project Management, Water and Sanitation, and International Environmental Law

At the international level, a normative framework on gender equality has been put in place. This framework is based on a series of important resolutions and laws that have become part of the development Including gender aspects in the policy of virtually all development actors. evaluation of interventions fosters improved development outcomes. The concepts discussed during the However, gender-specific objectives workshop are useful for the monitoring should not be limited to integrating and evaluation of projects supporting women into activities and ensuring their the improvement of access to rights and access to the benefits of interventions; justice in Côte d'Ivoire. Indeed, improving they must aim for qualitative changes. equitable access to justice for all, especially The changes made by the project women and vulnerable people, is one of the on justice and women's rights are five strategic axes of the sectoral justice more noticeable. policy adopted by the Council of Ministers on 6 June 2013. As in many countries, mainstreaming gender in the implementation of For example, gender indicators have been interventions will ensure greater incorporated into the periodic reports participation of vulnerable people, submi+ed to the Steering and Monitoring especially women's access to justice Committee. Our statistics can also be services, thereby guaranteeing their disaggregated by gender. rights.

Participants’ reflections from the professional development workshop on Gender and Evaluation 17 Keynote Address by Minister in the Presidency for Planning, Monitoring and Evaluation, Dr Nkosazana Dlamini-Zuma, MP L Day Aspirations for The of role Aspirations Africa: Africa has emerged out of colonisation with more peculiar peculiar more with colonisation of out emerged has Africa This gathering is also taking place whilst we mourn the departure of the mourn we whilst place taking also is gathering This evaluation and learning from results from evaluation and learning circumstances than any other continent on earth. Our continent continent Our earth. on continent other any than circumstances cult to cult ffi di have so systems that political been ushering culture, thus external interference that did not adhere to the discourse of the African of a divide-and-rule approach by the then colonisers. The evolutionary emerged with the remnants of nation-states that had been the bedrock one of the finest sons of this continent, the former Secretary General of day when their children would speak with one voice as a people, thus,voice people, a one wouldas childrenspeakwith day their when pu+ing our continent on a course for sustainable development. processstateof formation Africannationsmost was of disrupted by take forward beyond colonialism. Our for bearers had yearned for a for yearned had bearers for Our colonialism. beyond forward take the United Nations, Kofi Annan; whilst we also celebrate his illustrious than life as the citizen of the globe

ever. 2 Thursday 6September2018 Akinwumi Adesina, for the invitation to address this this address to invitation the for Adesina, Akinwumi ing ing + fi more is Results from Learning and Evaluation of et gathering. The Theme: Aspirations for Africa: The Role Role The Africa: for Aspirations Theme: The gathering. Development Bank, and to its President, my brother brother my President, its to and Bank, Development

me express my profound gratitude to the African African the to gratitude profound my express me eVALUation Matters Third Quarter 2018

Just a!er the Second World War in 1945, was a plan against which they evaluated in Manchester City in the United Kingdom, progress and they put human, financial the 5th Pan African Congress -which was and other resources to the plan. They got a+ended by African Americans, Caribbean partners in other continents, and more Africans, including W.E Dubois, Kwame importantly they were united. As one of Nkrumah and Julius Nyerere and others- the founding fathers of the Organisation made important observations and took of African Unity, the late and former some significant decisions about the future President Julius Nyerere of Tanzania said: of Africa. Among the decisions they took was that resources of the continent should “Unity will not end our weakness, but be used for the benefit of its people. It was until we unite, we cannot even begin to this conference that took a firm resolution end that weakness. So this is my plea to that Africa must be decolonized within the new generation of African leaders and fi!y years. African peoples: work for unity with the firm conviction that without unity, there Indeed in 1957 we saw Ghana take the lead is no future for Africa. That is, of course, in a+aining freedom and of course the assuming that we still want to have a Pan Africanist Kwame Nkrumah said that place under the sun.” the freedom was meaningless when the rest of the continent was not free. Africa They had other economic and development began to be a hive of activity around the plans like the Lagos plan of action and liberation struggle. many others.

All these activities culminated with On the occasion of the 50th anniversary the establishment and launch of our of the oau which spearheaded the premier continental organisation – The decolonization process, the continent Organisation of African Unity in Addis rededicated herself to the a+ainment of Ababa, Ethiopia in 1963. the Pan African vision of ‘an integrated prosperous and peaceful Africa, driven by At that stage 36 countries were independent its own citizens, representing a dynamic and they prioritised the decolonisation of force in the international arena’. the rest of continent. They did everything to ensure that it indeed happened. They Having celebrated the 50th anniversary evaluated progress at every Summit and and taking into account the declaration on the 49th year in 1994 South Africa got that was adopted, we began to envisage its freedom. They achieved what they set what Africa would look like when out to do in 1945, the continent was 99% future generations celebrate the next independent, with the exception Western 50 years of our organisation. Hence the Sahara and other islands in the Indian Agenda 2063, because that is the year Ocean. For decolonisation to succeed, there we will be celebrating the centenary of our organisation.

Besides breaking Agenda 2063 into 10 year plans, we should also evaluate it at regular intervals. The requisite for a successful evaluation, is not the evaluation itself, but it’s a sound plan with clear targets, that is specific, realistic and time bound - which we tried to do with Agenda 2063 and especially the 10 year implementation plan.

Keynote Address by Minister in the Presidency for Planning, Monitoring and Evaluation, Dr Nkosazana Dlamini-Zuma, MP 19 eVALUation Matters Third Quarter 2018

And of course, Agenda 2063 is not an through Investments in Youth, continues au plan, it is a continental plan, whose to echo through the hills, the valleys, the first dra! came from a number of citizens rainforests, the savannahs, and the deserts from different sectors including women, of our beautiful continent. We should youth faith-based organisations, business, continue to give hope to our young people workers and academics. This was very through the evaluation of our programs important. After we got the first draft and learning through the results thereof, from the stakeholder consultation, it was for, the youth are our future. then given to governments and regional economic communities (recs). Agenda 2063 is an approach on how the continent should effectively learn Before this, the au Commission had been from the lessons of the past, build on the making 4 year plans for the au commission, progress now underway and strategically and not au wide plans. Of course there exploit all possible opportunities available were lots of questions at the time about in the immediate and medium term, so as why a fi!y year plan, and not a four year to ensure Africa’s positive socioeconomic plan as normal, or even a five year plan. transformation within the next 50 years. In But the fi!y year plan allowed us to be particular, Agenda 2063 is transformative bold, ambitious and dream big without as it harnesses the continent’s comparative being constrained by our immediate advantages such as its people, history, circumstances. Just as our forbearers, the cultures, natural resources. It seeks to Pan African Congress wanted Africa to be develop Africa’s human capital; build social decolonised in 50 years, we want an Africa assets, infrastructure and public goods; free of ignorance, hunger, poverty, racial empower women and youth; promote and gender discrimination, inequality lasting peace and security; build effective and unemployment. developmental and capable states through participatory and accountable institutions We want an Africa where Africans cross and governance. the Mediterranean and the Atlantic as a ma+er of choice, as professionals, Amongst other important objectives tourists and entrepreneurs, not driven by Agenda 2063 is a call to action to all desperation, which is a challenge we are Africans and people of African descent, faced with now. to take personal responsibility for the destiny of the continent as the primary We want an industrialised Africa with agents of change and transformation. This world-class infrastructure, an Africa that call is central to the notion of leaving no trades with itself and the world, an Africa one behind articulated in the Sustainable that is at peace with itself. That is why we Development Goals agenda. are encouraged by the fact that 6 out of the 49 countries that signed the Africa Free The difference between Agenda 2063 and Trade Agreement have already ratified it. the plans that preceded it is that many This is progress indeed, but we must urge countries have incorporated in to their the other countries to ratify. national plans, this means that the budgets and other resources of the member We should also draw our hope from the countries are being used to implement it. fact the African Union has deemed it fit to raise the ma+er of young people One of Africa’s greatest sons, Nelson through the directive by the Heads of Mandela, on the occasion of receiving the State and Government. The theme: historic Census ’96 results of South Africa Harnessing the Demographic Dividend on 20 October 1998, said:

20 Keynote Address by Minister in the Presidency for Planning, Monitoring and Evaluation, Dr Nkosazana Dlamini-Zuma, MP eVALUation Matters Third Quarter 2018

“In deciding to hold a national census The un World Data Forum Plan calls for in 1996, five years earlier than might have a commitment by governments, policy been expected, we were acting upon our makers and the international community urgent need for accurate information, so to undertake key actions under strategic that our plans should be based on the real areas which including, among other situation. But the scale of inherited social things: (i) coordination and leadership; (ii) inequality and deprivation, confirmed by innovation and modernisation of national the results, makes our task one of many statistical systems; (iii) dissemination years and one in which reconstruction of data on sustainable development; and reconciliation; nation-building (vi) building partnerships; and and development, are all of critical (v) mobilizing resources. importance.” It is going to be very important that Evidence-based decision-making is we regularly evaluate Agenda 2063 and increasingly becoming a space through the sdgs and we should be able to do which the world initiates program just one evaluation on both. In order to design and policy choices, monitor policy sharpen our focus on the first ten years implementation and evaluate policy of implementation, we have also aligned impact. Those with scientific knowledge the sdgs to Agenda 2063. This has also have to step out to solve world problems. enabled us to align the inherent indicator Science thus becomes useless unless it can framework to succinctly respond to be shared universally, illuminate issues and the long haul of Agenda 2063. Once the precisely forecast the future. In planning, indicators were developed they were then particularly, knowledge will be lost unless aligned to the sdg indicators and this it can produce results and lessons can be exercise yielded what is now referred to as learnt from such results. a Continental Indicator Framework.

The statisticians should ensure that the In South Africa, like many other countries, knots of the indicators for the first ten we are making progress towards such years of Agenda 2063 are tied. We should linking sdgs Agenda 2063 into its national not – when all eyes beaming with hope development plan. Agenda 2063 and the are cast on us – afford to abandon sentry. sdgs can be directly linked to the South We cannot abdicate on a responsibility African Government’s priority areas and that no one else, other than ourselves, also the National Development Plan (ndp); can do. So we call upon our pan-African Vision 2030 which presents a long-term institutions – auc, Afdb, uneca and our strategy to a+end to the triple scourge of statisticians - as they worked together poverty, unemployment and inequality. in drawing the plan, to work together in evaluating its progress. The synergies in the policy frameworks at global, continental and national level Tracking progress of sdgs and Agenda 2063 require nations to develop integrated requires quality, timely, open and indicator frameworks. This will enable disaggregated data and statistics at all us as countries to track development and levels of geography, from global to regional create room for lessons that can be learnt to national and subnational. These data are through monitoring and evaluation. needed not only for policy making and to understand how well we are doing, but also At the 2015 world evaluation conference serve to guide future investments in data in Nepal, which was also declared as and statistics to fully support the follow up world evaluation year, the conference and review of the implementation of the recommended that we should create a post-2015 development agenda. conducive environment for evaluation,

Keynote Address by Minister in the Presidency for Planning, Monitoring and Evaluation, Dr Nkosazana Dlamini-Zuma, MP 21

22 Keynote Address by Minister in the Presidency for Planning, Monitoring and Evaluation, Dr Nkosazana Dlamini-Zuma, MP eVALUation Matters Third Quarter 2018

and simultaneously capacitate achieving the Agenda 2063. The African individuals and institutions to undertake Development Bank’s Development evaluations. Of course we can add to that Evaluation Week is a relevant forum to by making sure to involve the people discuss how we are going to measure evaluation process, because it is them who attainment of Agenda 2063 objectives. will experience development. We need collaborative efforts and coordination mechanisms beyond The Asian Development Bank held a our individual countries and regions forum on evaluation of the sdgs with a to achieve and realise the strategic gender responsive lens the following year. objectives set up in Agenda 2063. This conference resolved to prioritise gender equality as essential to ensure the African countries and institutions have realisation of sustainable development. the capacity to implement and evaluate Investing in women yields the biggest Agenda 20163 and sdgs. Africa will impact on development. succeed to be an integrated prosperous and peaceful Africa, driven by its own Women and youth should be empowered citizens, representing a dynamic force in to be the drivers of Agenda 2063! the international arena.

We have a dream and a plan embedded In Conclusion in the history, culture, heritage and aspirations of our people. Together, united Let me end by paying tribute to African we will achieve Agenda 2063; The Africa Development Bank for bringing us under we want. one roof to reflect and share lessons on the progress we are making towards I thank you.

Keynote Address by Minister in the Presidency for Planning, Monitoring and Evaluation, Dr Nkosazana Dlamini-Zuma, MP 23 The heart of the matter: Are we learning? W Day While agreeing that we are learning to certain degree, the panel panel the degree, certain to learning are we that agreeing While can we do about it? are we asking the right questions? and are we are and questions? right the asking we are it? about do we can evaluation ge+ing the right answers?” whether we are asking the right questions, in particular relating to relating particular in questions, right the asking are we whether distinguished panel members: “If we are not learning sufficiently, what allow operational space for reflection and debate, for learning learning for debate, and reflection for space operational allow and Results Department at the African Development Bank (Af Bank Development African the at Department Results and the discussion by asking the the asking by discussion the ff o kicked He session. the moderated underlined the importance of changing institutional cultures to cultures institutional changing of importance the underlined fundamental question: Are we from the past and from failures. The discussions also focused on on focused also discussions The failures. from and past the from Simon Mizrahi, Director of the Delivery, Performance Management Management Delivery,Performance the of Director Mizrahi, Simon AfDB Hanan Morsy, Independent Evaluation Group, World BankGroup Caroline Heider, Industrialization, AfDB Pierre Guislain, Monitoring andEvaluation, South Africa Nkosazana Dlamini-Zuma, Chairperson, OECD/DAC Evaluation Network Per Bastoe, Øyvind Discussants (le#to right on photo): Management & Results Department, Af Moderator: 2 Thursday 6September2018 criteria. criteria.

io Mizrahi Simon Director, Macroeconomic Forecasting andResearch,

Vice President, Private Sector, Infrastructure & Director General andSenior Vice President, café, a capacity building workshop and a thematic thematic a and workshop capacity café, building a day 2 saw all participants meet to discuss the the discuss to meet participants all saw 2 day on sessions main the of opening the discussion, themes for Evaluation Week with a knowledge knowledge a with Week Evaluation for themes hile Director, Norad Evaluation Department and

day 1 set the tone and established the overriding

Minister inthePresidency for Planning,

learning? , Director, Delivery, Performance Performance Delivery, Director, , DB DB ), ), eVALUation Matters Third Quarter 2018

Caroline Heider, Director General and Senior Vice President, Independent Evaluation Group, World Bank Group

question: Are we learning? and if we Each institution, within its own culture, aren’t, why not? deals with feedback and information differently. Collectively the machinery We are learning in ways that are very or system of the institution holds us focused on the new, the curious; on back from learning and changing. This is new technologies for example. When an entry point we have to address if we we have to learn from the past it is are to tackle learning as an institution. more complicated. Whether it is climate change or social transformations, we question: Learning is one of the key human beings seem to have a problem objectives of any evaluation. In terms with looking back and learning. of the criteria that guide evaluations, are we asking the right questions and more importantly, are we getting the right answers?

Quite often the questions that are asked in committee reviews are more about ticking certain institutional boxes. They ask, for example: “have we met this Everybody knows that established requirement?”. They don’t what we do, promoting ask: “is this really the best way we can do development, is difcult. this? Have we tried this before? Should If you pretend that you can we really do this again?”. succeed without making mistakes, nobody will believe There is supposed to be a dialogue on you. what a project should look like. In the 30 years of development experience I’ve had, I’ve not seen one project that In order to learn from a profound change, started out with “let’s debate what will one has to face the pain of failure, and be the best solution”. It is not a one-way most people and institutions try to street: we all have to try to do better and avoid that pain. In addition, institutions we have to have conversations on how get compounded by their own culture. we make that happen.

Nkosazana Dlamini-Zuma, Minister in the Presidency for Planning, Monitoring and Evaluation, South Africa

question: Is the African Union learning? If not, what is stopping it from doing so?

We are learning from our failures. Our Agenda 2063 is based on what happened with our previous plans and it includes in If you want to continue particular the consultations and the buy-in learning you must have an of member states. The Agenda is set up for open mind and a flexible them to incorporate what has been attitude.

The heart of the matter: Are we learning? 25

26 The heart of the matter: Are we learning? eVALUation Matters Third Quarter 2018

agreed into their own plans, and also question: Is evidence-based policy to interact with citizens. We’ve also learnt something that ma+ers or is opinion good that there are short term problems but they enough for politics? should be incorporated into a longer vision. I think evidence-based policy is very One of the things we haven’t learnt important. If we are going to work sufficiently is that we must fund our own on the immunization of children for programs. We must learn from our own example, you need to be able to project culture. In African culture traditionally how many children were born this year when you need to achieve something you to know how many vaccines you need. invite others to help you. But you do not For almost everything you need to do then walk away and say “you do it”, you you need evidence, including evidence lead and they come and help. What we on how you have been doing. I think you haven’t learnt sufficiently is that we must should have evidence-based policy. put the first dollar on the table.

Per Øyvind Bastoe, Director, Norad Evaluation Department and Chairperson, OECD/ DAC Evaluation Network

question: Are we learning and what is question: We have discussed the revision ge+ing in the way if we are not? of the eocd-dac evaluation criteria here at Evaluation Week 2018. Are we asking The bureaucratic nature of what we do the right questions? Do we have the in our organizations seems to prevent right criteria and are we ge+ing the right us from learning and I wonder why. Why answers to them? are we suddenly afraid of talking about mistakes? Why are we afraid of sharing Evaluation criteria and standards are knowledge? Why do we suddenly have a tools to be used in a certain context and short-term perspective? we cannot automatically apply them everywhere. Therefore, in the dialogue To me culture is important - the norms with the stakeholders, it is essential to in the organization. But leadership is understand the context you are in. This also essential and it needs to have the is o!en difficult for us as evaluators to vision and to be a role model that allows do. Often we have a dialogue around mistakes to happen - to learn from developing an evaluation program, but them. In bureaucratic organizations, then it is difficult to have the ongoing knowledge is seen as power, so there is a tendency for them to “protect” their knowledge. But let’s rather share our knowledge and share our insights.

I commend idev for organizing Evaluation Week 2018 and for publishing the Evaluation Ma+ers Magazine, but don’t We have too much focus on stop there. We need to find new ways of reporting and accountability, communicating evaluation findings to be which is due to our short able to be a credible voice in the flurry of term perspectives. It triggers information. It gives us the challenge to be insufcient answers to the much be+er in communicating. important questions.

The heart of the matter: Are we learning? 27 eVALUation Matters Third Quarter 2018

dialogue as you develop the evaluation Yes, there is a need for independence of project, even though this is important. evaluators but we need to be embedded and understand not only the learning Furthermore, we need to consider if we are culture but also the strategies, the having a dialogue with the right people. policies, and what is going on internally Are we having a dialogue with the people in the organization. This requires who are in charge of the program, the evaluators to get involved as well as policy, the strategy? Or are we talking to decision and policy makers (such as Vice the wrong people? I think o!en we ask the Presidents) to get involved. wrong questions.

Hanan Morsy, Director, Macroeconomic Forecasting and Research, AfDB

question: Is the AfDB learning from its failures and its achievements, and what can you do to help this?

The trademark of successful institutions is learning from mistakes, having the humility of saying where you went wrong, why did it happen and how you can improve going forward. Part of the fear It’s very important to be across the continent, when you speak of transparent. The more you evaluation, is that countries have the idea can demonstrate impartiality, the better your evaluation that evaluators are looking for what they will be received and will have have done wrong. A more constructive more impact. way to look at it is “how can we help these different ministers and policy makers to make the projects and initiatives more successful?”. It’s more of a journey culture where it’s in the interest of the together to help you improve. policy maker to keep the status quo, rather than take the chance of pushing Another issue is communication - we for reform. Showing how you are do not communicate enough what we learning and adapting when things fail are doing or communicating what we’ve can increase the trust between citizens learnt from our failures. This creates a and governments.

Pierre Guislain, Vice President, Private Sector, Infrastructure & Industrialization, AfDB

question: Regarding the importance of consultants, to do our own assessment challenging the status quo in relation work. We tend to go too quickly towards to institutional learning, what is action, towards recommendations, your experience? towards setting goals without having made enough effort for introspection, I think one of the things we do not analysis, or evaluation, which should be do enough of is to invest time before the basis of almost all activities. starting an operation, before hiring

28 The heart of the matter: Are we learning? eVALUation Matters Third Quarter 2018

We must try to confront the varying points of view, and the best way to learn is dialogue. There is very little debate on approaches, there is li+le discussion upstream about why to undertake approach A and not approach B. Instead we tend to outsource evaluation and learning: we do our work and then others evaluate us. That's where there is a deficit. It takes personal courage to defeat institutional norms. Secondly, the way we learn is cultural. How do we learn at the African Development Bank? We tend to call on everyone is doing their job, but there is a whole series of external agencies that not enough connectivity in the process will evaluate, analyze, monitor. What and some of our kpis are preventing we do not spend enough time looking us from learning somewhere. It takes at, are the inputs we receive, which personal courage to defeat institutional are absorbed by the organization and norms and say "no, this project requires subsequently reflected in changes in 3 more months and it will not be behavior and ways of working. evaluated in the 6 normal months".

question: Considering the difficulty of Regarding learning from mistakes, the learning in an institution such as the difficulty of discussing failures lies African Development Bank, do you have in the fear of seeing the recognition the sense that in operations, the time of these failures used against oneself. and space can be made to reflect and It is therefore necessary to create an draw lessons learnt? Can the necessary environment where one can admit conditions be created? one's failures without being negatively perceived, in a context of learning, The pressures on Bank staff are growth and improvement. Admission of primarily to deliver projects and achieve failures should not be an opportunity our volume lending goals. There is not to take a negative look and have a a lot of pressure on learning. There negative impact on the functioning of is institutional partitioning where the institution that admits its failures. everyone has a role and fulfills it. So This is not easy to achieve.

The heart of the matter: Are we learning? 29 Thematic discussion I: Public-private partnerships for infrastructure development in Africa Day Discussion I: Bringing down the barriers for down the barriers I: Bringing Discussion Infrastructure & Industrialization, Af Evaluation, Af Evaluation Independent President, Vice Senior and General Director Moderator: Panel: Turay, Foday Presentation: Keynote: Group, World Bank Group ❚ ❚ ❚ ❚

African Legal Support Facility mdu Oumarou Amadou WestAfrica, Regional O fficefor West Africa, European Investment Independent Evaluation Group, World Bank Group Isabelle VanIsabelleGrunderbeeck Bank Development, Af ad Vallee Maude aoie Heider Caroline 2 Enablers and stumbling blocks for Thursday 6September2018 ppp

s in Africa,in currentstates potentialand cer, Independent Development Development Independent cer, ffi O Evaluation Chief ire Guislain Pierre DB What have we learned from Af from learnedhave weWhat

Cif ea Cusl Atn Ha o Operations, of Head Acting Counsel, Legal Chief , DB , Director General and Senior Vice President, President, Vice Senior and General Director , Drco, nrsrcue Cte ad Urban and Cities Infrastructure, Director, , , Head of Regional RepresentationRegionalfor of Head , , Vice President, Private Sector, Sector, Private President, Vice , DB

ppp s in DB

Africa:

ppp - CarolineHeider interventions? interventions? ppp s , eVALUation Matters Third Quarter 2018

PPPs in Africa USD 93.3 billion of infrastructure

USD 48 billion infrastructu r e spending gap

One-third of the gap USD 45.3 billion annual public and private could be met by making spending on infrastructure spending more effective (USD 17.4 billion)

PPPs can contribute a further 25% (USD 12 billion) of the infrastructu re spending gap

On the second day of Evaluation law and 20 have adopted their ppp Week 2018, there was a rich interaction laws in the last 5 years. However, the between participants on Public-Private session highlighted the need to meet Partnerships (ppps) for infrastructure certain conditions such as institutional development. ppps are increasingly frameworks and regulation, to ensure popular on the African continent: successful ppp projects. between 2004 and 2013, 33 African countries enacted a ppp or concession Some quick contributions from the Panel:

Caroline Heider Keynote Speech: PPPs in Africa: Baseline Study and Potential

The quality of the regulatory framework is correlated to the investments in infrastructure in Africa. Good regulation is needed to a+ract investments, including private sector investment. Commitments to ppps in Sub-Saharan Africa have still been relatively small and have been concentrated in certain sectors such as renewable energy. Some key lessons from to be able to negotiate the deals, World Bank evaluations of ppps include: oversee them, and manage them in a meaningful way. ❚ Having a strong and long-term commitment is very important to ❚ The fiscal implications and a project: there are a lot of political contract conditions have to be well pressures at the stage where a understood by all parties. government has to sign on to a ppp. When we evaluated the World ❚ ppps need to consider who benefits Bank Group’s portfolio, many of the from the ppp: it needs to be clear projects failed at the stage when the whether the services they provide commitments had to be made. reach the right people and whether the revenues generated by the ppps ❚ Sector reforms have to be in place going back to the government are and the public sector has to function adequately used to subsidize and quite well: The public sector has provide services to the poorer people.

Thematic discussion I: Public-private partnerships for infrastructure development in Africa 31 eVALUation Matters Third Quarter 2018

Foday Turay, Chief Evaluation Officer, Independent Development evaluation, AfDB.

Presentation: What have we learned from AfDB ppp interventions?

idev’s work in this area shows that the private sector generally finds it extremely difficult to operate where there is no long term political commitment or where institutional frameworks and legal frameworks are weak. ppp investments are often huge sums of money that require a degree than the public sector. They thus enter of guarantee. A common constraint into a negotiation that is not balanced. is the fact that in Africa, the capacity For a number of countries, ppps are a of the public sector can be weak and new type of mechanism and there have many countries do not have a lot of not been enough experiences to learn experience in ppps. There is also a ppp from. It is therefore important that information asymmetry. The private available knowledge is shared, to inform sector tends to have more information decision-making.

32 Thematic discussion I: Public-private partnerships for infrastructure development in Africa eVALUation Matters Third Quarter 2018

Amadou Oumarou Director, Infrastructure, Cities and Urban Development, AfDB

Constraints to successful ppps include structural factors such as a lack of coherent investment programs with well-structured projects, a low level of local savings, and high infrastructure project risks.

An important factor for the success of ppps is good governance with regard frameworks, incentive frameworks to transparency in procurement. and guarantees to investors, as well as Furthermore, governments should regulations to protect projects’ end users put in place appropriate legislative and/or consumers.

Isabelle Van Grunderbeeck, Head of Regional Representation for West Africa, Regional Office for West Africa, European Investment Bank

ppps are not a panacea; they are one way of contracting a delegation of services. They are an option, but it's not necessarily the best. We need to ask ourselves every time, “is this project or intervention a good candidate for a ppp?” Furthermore, in a selective process with the private sector, if we specify the results we are looking for, we diverse solutions and the innovations that can benefit from the competition between the private sector can bring.

Thematic discussion I: Public-private partnerships for infrastructure development in Africa 33 eVALUation Matters Third Quarter 2018

Maude Vallee, Chief Legal Counsel, Acting Head of Operations,African Legal Support Facility

When we [the African Legal Support Facility] are asked to assist African governments in a specific transaction, the first thing we do is look at the institutional and legal frameworks for ppps. We saw that in the last year, a lot of ppp laws have been adopted. African Governments have responded positively to the call by mdbs on the importance of having quality legal Africa have reached financial closure in the frameworks for ppps. But did these ppp last five years. Only one of these projects laws really lead to concrete ppp projects? was within an established ppp framework. Outside the ict and power sectors, which Given the time it takes to develop a ppp are usually governed by sectoral laws, only project it is perhaps too early to see ppp law about 15 ppp transactions in sub-Saharan translate into concrete projects.

34 Thematic discussion I: Public-private partnerships for infrastructure development in Africa eVALUation Matters Third Quarter 2018

Discussion ii: From lessons learned to action

Moderator: Pierre Guislain, Vice President, Private Sector, Infrastructure & Industrialization, AfDB Panel: What should we do for be+er ppp development results?

❚ Nana Asantewa Afadzinu, Executive Director, West Africa Civil Society Institute ❚ Fatima Hamdouch, Strategic Steering Director, Masen, Morocco ❚ Romain Neyran, Chief Financial Officer, socoprim, Côte d’Ivoire

During this session, panelists focused on examples of how to achieve better ppp development results.

Some quick contributions from the Panel:

Nana Asantewa Afadzinu, Executive Director, West Africa Civil Society Institute

Africa is lagging behind in infrastructure development, with 60% of its population lacking access to modern infrastructure. ppps are one of the ways to go, but what are the main reasons for using these partnerships? They are supposed to be in the interest of the people and to address development issues. Government go into ppps because they want to reduce their financial burden and to provide support of the people, you are not going to the public services that are needed. They have a sustainable project. We also need to are looking for efficiency and promises balance profitability with social inclusion. of quick delivery of public services or If you have a public utility whereby a ppp infrastructure. The important question is providing a service, how do you ensure is though: “where do the people come in?” that people can afford the service? These are plans that have to be put in place if you You can have laws and regulatory are thinking of the benefits to society in frameworks, but if you do not have the the long term.

Fatima Hamdouch, Strategic Steering Director, Masen, Morocco

The challenge of ppps is how to find the right balance between the different stakeholders, paying particular attention to the fourth P (People) so that all stakeholders involved are beneficiaries of the project. This way, good transfers can take place, and not only the private sector but also the public, the national economy, and

Thematic discussion I: Public-private partnerships for infrastructure development in Africa 35 eVALUation Matters Third Quarter 2018

citizens are active participants, so 2. Institutional frameworks are that ultimately the end consumer and instrumental: masen operates the citizen can benefit. within a very clear legislative and regulatory framework, thus We can draw three lessons from creating an institutional framework Morocco’s experience in the use specifying the prerogatives of the of ppps for the development of various actors in charge. This allowed renewable energies: us to gain the trust of technical and financial partners. 1. It is important to have a dedicated actor: Created in 2010, masen is 3. The development plan needs to the national group responsible optimize the distribution of risks: in for driving renewable energies in the development of these projects, we Morocco. It is a Moroccan company attach particular importance to the under private law but with optimal allocation of risks between public capital. the state and private partners.

Romain Neyran, Chief Financial Officer, SOCOPRIM, Côte d’Ivoire

My personal belief is that ppps can be the future of infrastructure in Africa. I have been working on the hkb Bridge project since 2008 and it is a success. Sure, there are projects (ppps) that are better, there are projects that are less good. But successful ppps do exist. The key is to find stakeholders (sponsors, donors and governments) who are deal-makers, and who know at what point to stop the negotiations and allow the project to come to fruition. Infrastructure, was strong and timely, and ensured the support The hkb bridge project is a good of the Regional and International example of a public-private partnership Development Banks; which succeeded through the steady commitment of the various partners. ❚ The project had an inclusive aspect, The good practices that we can take involving the recruitment and away from the experience of the hkb training of more than 1,300 local project include: employees (ie 96% of the total project staff); ❚ The sponsors, the government and the lenders, had a strong will to carry ❚ The project's miga political risk out this project, staying involved for insurance was also instrumental more than ten or fifteen years - this for the feasibility of the project. It allowed the project to progress; ensured the protection and rights of the private partner (Bouygues) in the ❚ The negotiating capacity of the event of non-compliance with the country, through the Minister of contract.

36 Thematic discussion I: Public-private partnerships for infrastructure development in Africa eVALUation Matters Third Quarter 2018

Feature Article: Bringing Down that affect the development of ppps, from the Barriers to Infrastructure a variety of perspectives. The exchanges Development in Africa highlighted some of the key catalysts for ppps to fulfill their full potential, as well as Maude Vallee, Chief Legal Counsel, Acting mechanisms for leveraging development Head of Operations, African Legal Support efforts. The most notable of these catalysts Facility was identified as: the need for establishing sound institutional and legal frameworks, The imperative of leveraging Public- building a pipeline of bankable projects Private Partnerships (ppps) to meet the which are attractive to investors, infrastructure development challenges in alongside efforts to plan and prepare Africa is no longer a point of dispute. The projects carefully to mitigate failure, and African Development Bank estimates that securing high-level political support and Africa’s infrastructure funding gap has intergovernmental coordination. grown to reach usd 170 billion annually, and a recent report by the Global Infrastructure The ingredients necessary for ensuring Hub (gih) of the G20 emphasizes that African the successful implementation of ppps countries “do not have the resources to ramp are widely recognized throughout up infrastructure spending on their own, the development and investment even with backing from aid agencies and communities. The recent Africa multilateral donor institutions, [making] Investment Forum also highlighted private sector investment [essential]” the wealth of resources which can be (quoted in Bavier 2018). As such, the focus accessed under the right conditions, has shifted to how ppps can be most including from private equity funds and effectively integrated into the planning and private institutional investors such as implementation of infrastructure projects, insurers, pension funds, and sovereign with the objective of maximizing their wealth funds. contributions to sustainable economic growth and alleviating poverty. Yet, the confluence of factors that are necessary to inspire, catalyze and grow During Evaluation Week 2018, panelists the volume of ppps across the African were invited to consider the key parameters continent has thus far remained

Thematic discussion I: Public-private partnerships for infrastructure development in Africa 37 eVALUation Matters Third Quarter 2018

elusive, with a number of reasons Thirdly, despite the existence of abundant underpinning why these transactions financial resources, African governments have failed to gain momentum. are still struggling to finance the feasibility studies and invest the needed human Firstly, there is strong evidence that the and capital resources to structure and adoption of a legal and/or institutional market projects in a manner that is ppp framework does not in itself provide viable, and appealing to their private sufficient impetus to give rise to ppp sector counterparts. projects. Many infrastructure projects, particularly in the power sector, are Despite these challenges, well-selected predominantly governed by energy sector and well-structured ppps continue to legislation, and accountable to the relevant harbor the greatest potential for bridging ministry, while in the case of large-scale Africa’s tremendous infrastructure projects, an ad hoc regime may apply. These funding gap and accelerating the delivery create additional layers of complexity of services that can improve lives of which private sector partners are less Africans. This requires project design and inclined to be willing to navigate. They also implementation, which ensure that risks have the potential to create divisions and are appropriately allocated to the partners conflict between responsible agencies and who are best equipped to manage them. ministries who may have jurisdiction over This should also apply at a broader level to particular aspects of a ppp operation. include all the key actors that can support the process, including governments, Secondly, the allocation of private multilateral development banks (mdbs), investment to infrastructure has tended private sector actors, as well as banks and to be concentrated in particular sectors other financing partners. across the global landscape. To date, the ppp interventions of the African Development From the perspective of African Bank are primarily focused on the governments, this implies that there sectors usually described as economic is a need to take clear and decisive infrastructure: power, transport, water and actions to instill confidence within ict. According to the World Bank, in the their ppp frameworks and how they are past five years, ppp infrastructure projects operationalized. Governments can also in Africa have mainly been concentrated in ensure that regulatory frameworks the energy sector (78%), mostly renewables, are reformed to more broadly guide transport (22%), and water and sanitation institutional investment in Africa. (0.5%). It is thus less intuitive for the private sector to focus on basic service delivery, Governments must also demonstrate which is most-needed to alleviate the needs the willingness and capacity to assure of lower income populations. investors that they will remain

38 Thematic discussion I: Public-private partnerships for infrastructure development in Africa eVALUation Matters Third Quarter 2018

actively engaged throughout the Banks and financial institutions will life of the ppp, and that the terms of have a key role to play in reducing their agreements will remain in place financing costs for projects, increasing irrespective of political and/or economic the volume of quality projects that they evolutions on the ground. Governments are able to finance, and ensuring that must be consistently responsive to other they develop the capacities to properly project stakeholders, the project must quantify project risks. This can include be highlighted as a priority among the working with mdbs to leverage technical government’s strategic objectives, and assistance, and, where available, all ministries and agencies involved must guarantees that would better position have a clear mandate and transparent the commercial sector to finance project engagement processes. operations and mitigate the balance sheet risks. Conversely, mdbs must continue to help governments to identify the sectors and Given the current concentration of projects that are best-suited for ppps, to ppp projects in a small number of build pipelines of viable and socially- sub-Saharan African countries (mostly responsible projects, to improve access to in South Africa, Nigeria, Kenya and infrastructure preparation facilities, to Uganda), the focus for countries seeking mobilize loans and equity in support of to follow suit should be on building private investment, as well as to support quick wins through smaller scale the development of financial instruments project operations which can provide that will allow for the success of projects learning experiences for larger-scale which are not intrinsically the most and more complex project operations. appealing to investors, such as within This should help to rapidly develop the the water sector or social infrastructure capacity to prepare, develop, manage, (health, housing, education, etc.). monitor and evaluate ppps, and ensure they are executed in line with the The private sector will be expected to public interest. leverage its technical expertise, to innovate, and most of all, to deliver efficient project Bavier, J. 2018. Ten African nations face $1 trillion management capabilities that ensure the infrastructure funding gap. Reuters, [online]. successful design and implementation of Available at: https://www.reuters.com/article/ projects, and to transfer management and us-africa-infrastructure/ten-african-nations- structuring skills back to governments in a face-1-trillion-infrastructure-funding-gap- seamless and timely manner. iduskbn1jt2az

Thematic discussion I: Public-private partnerships for infrastructure development in Africa 39 From the sidelines: Voices from participants at Evaluation Week 2018 I the Af It was a genuine pleasure and I thank the organizers, most particularly agricultural value soon be a specialist - on issues of partnerships, gender assessment and especially helpful regarding public-private partnerships - in which I will was the It answers. concrete but panelists gladly provided questions, basic some were conference. There the with satisfied very all are We Evaluation yourthoughts about the question Yasmina Coulibaly, Law student, Côte d’Ivoire DB

Week 2018 on the sidelines of the main event. You can can You event. main the of sidelines the on 2018 Week watch these interviews and more at at more and interviews these watch dev Evaluationweek2018 , for allowing us to participate in this conference.

: Week? interviewed some of the participants of Evaluation Evaluation of participants the of some interviewed What are are What

chains. . idev.afdb.org/ eVALUation Matters Third Quarter 2018

Romain Neyran, Chief Financial Officer, SOCOPRIM, Côte d’Ivoire

question: What can we learn from ppps and how can they ensure inclusiveness?

In a nutshell, PPPs are probably the future of infrastructure in Africa, but not just anywhere and not just anyhow. How can people be integrated into PPPs? First of all, by having international development banks as lenders, such as the World Bank or the AfDB. These institutions have extremely demanding reporting standards and have simple supply and demand relationship. very sophisticated environmental impact If you provide a bad service that is not studies. Secondly, by considering that PPPs adapted to the needs of the people, you will are for the benefit of the public and that the simply not be able to sell it, whether it is a public is your customer. So there is a very transportation service, medical or other.

Abougnonhou Chaldia Agossou, Seed Services, Benin

question: How do we make agricultural value chains more inclusive?

I think that in order to make value chains more inclusive, we need to strengthen the capacity of each and every one of the actors in the value chain.

This means in terms of leadership, in terms of management, and in terms of communicating about their products and their activities. In order to make value strong power in the value chain, they chains more inclusive, it is necessary may have difficulty getting external that the different types of funding that financing, which is financing that exist for different value chain actors - usually comes from banks. Therefore, both small and big producers - are clearly we need to strengthen their capacity, communicated to the various actors. mobilize them around a central idea, a They need to be informed and equipped common point. We need to help mobilize to meet the different requirements or several small producers in cooperatives conditions that are necessary to benefit so that they can have the strength from these funds. to intervene, to have their say in the value chains and use the strength of For example, when we look at small the cooperatives to access external producers who generally don’t have financing.

From the sidelines: Voices from participants at Evaluation Week 2018 41 Q&A with the Acting Evaluator General “Pu$ing lessons learned into action for greater results” an interview U Acting Evaluator General Karen Rot-Münstermann ( General, on the issues surrounding Evaluation Weekon General, the surrounding issues 2018 Q&A with Karen Rot-Münstermann, Acting EvaluatorActing Rot-Münstermann, Q&A Karen with 1 for development evaluation in Africa. by Grace Gabala (

On 1 September 2018, the African Development Bank President appointed Mrs. Karen Rot Rot Karen Mrs. appointed President Bank Development African the 2018, September 1 On as a member of the Resource Mobilization Department where she was responsible for the for the responsible was she where Department Mobilization Resource the of member a as of ADF resources to African countries. She joined IDEV in June 2014 as the manager of the the of manager the as 2014 June in IDEV joined She countries. to African resources ADF of Knowledge Management, Outreach and Capacity Development Division. Division. Development Capacity and Outreach Management, Knowledge 2009 in AfDB the joined Karen Evaluator General. Acting of position to the Munstermann three-yearly replenishment process of the African Development Fund and the allocation allocation the and Fund Development African the of process replenishment three-yearly Af edition of Af of edition 3rd the organized ence and shares with us her viewpoints on ation Week. In this interview,Week. ation this In Munstermann, Rot Karen nder DB gg

acting Evaluator General, reflects on the confer the leadership of Karen Rot MunstermannRot Karen of leadership the ), idev communications specialist, with new DB Development Evalu krm idev ). ’s outlook 1 , idev - - eVALUation Matters Third Quarter 2018

GG: Thank you for granting us this interview. Could you share with our readers your impression of Evaluation Week 2018? Did the conference succeed in achieving its objectives? For you what was the most memorable or eye opening moment of the conference?

KRM: I think the conference went contribute to the realization of Agenda very well. It a+racted a broad range of 2063. I also enjoyed the mix of thoughtful participants –evaluators, Bank staff, contributions and lively discussions at policy- and decision-makers, development the conference. Panelists and audience practitioners, civil society, students, etc.- members freely and frankly spoke who actively shared their knowledge and their minds. A particularly amusing experience and engaged in constructive exchange took place on the Friday discussions on how evaluations can help a!ernoon between Abdoulaye Gounou make development interventions in Africa from the President's Office in Benin more effective. That is precisely what (“the Government”) and Hon. Abbas we wanted to achieve. The conference Imbassou from the National Assembly benefited strongly from the insights of our of Côte d’Ivoire (“the Parliament”) on keynote speaker, Hon. Dr. Dlamini Zuma, accountability for achieving development who as former Chairperson of the African results – the Parliament holds the Union Commission and now Minister for Government to account, but MPs are Planning, Monitoring and Evaluation of themselves accountable to citizens, so South Africa, is uniquely well-placed to they both have to show results in order to share her views on how evaluation can keep their jobs!

GG: Aside from facilitating knowledge sharing among the development community and conducting independent evaluations of the African Development Bank’s projects, policies and programs, what are some other initiatives led by IDEV to support African countries to plan, conduct, disseminate and use evaluations as part of their national development strategy?

KRM: As part of its mandate to promote and implementing evaluations. While the an evaluation culture in the Bank and project in Ethiopia and Tanzania is coming in its Regional Member Countries, IDEV to an end at the end of this year, we are is supporting a number of initiatives to increasingly becoming involved in a South- strengthen evaluation capacity and use on South peer learning partnership called the continent. On what we call the “supply Twende Mbele, in which African national side” of evaluation, we are working with governments share knowledge and work Ethiopia and Tanzania to strengthen their together to strengthen their M&E systems, national evaluation systems. Thanks to with a view to improving government funding from the Finnish Trust Fund at performance and accountability. Currently the Bank, we have been able to support led by the governments of Benin, South these two countries over the past five Africa and Uganda, the partnership is likely years in developing a country-owned to expand to other countries like Ghana in national evaluation policy or strategy, an the near future. On the “demand side” of institutional framework for evaluation, and evaluation, IDEV helped to establish the to strengthen skills for planning, managing African Parliamentarians’ Network

Q&A with the Acting Evaluator General 43 eVALUation Matters Third Quarter 2018

on Development Evaluation (APNODE) with partners who are likewise trying to in 2014, to sensitize parliamentarians build and develop the continent’s capacity across the continent to the usefulness to undertake, disseminate and use of evaluation as a credible instrument in evaluations – partners like the Centers their legislative, oversight and budgeting for Learning on Evaluation and Results roles. We continue to support the Network, (CLEAR), UNDP, Unicef, UN-Women, the among others by providing the Secretariat. African Evaluation Association (AfrEA) In all these initiatives, we work together and others.

GG: In your opening remarks at Evaluation Week 2018, you mentioned that evaluation has been called “speaking truth to power”. But that this truth is not always welcome. To address this challenge, what are some of the strategies adopted by IDEV to ensure be!er uptake of its evaluation results and recommendations by AfDB operations staff and decision makers?

KRM: Indeed, I was referring to an naturally have an authoritative voice – the atmosphere, particularly prevalent in 2016- Board for example listens a+entively to 2017, with the Brexit referendum in the what we have to say. But with authority UK and the election campaign in the US, also comes responsibility. That is why it where there seemed to be a preference for is important to reach out to and engage short soundbites over detailed reports, for with evaluation stakeholders, most simplistic slogans over nuanced analysis, importantly the colleagues responsible for where unwelcome findings were dismissed the policies and programs being evaluated, and expert opinion was disdained. In such throughout the evaluation process and an atmosphere, it is difficult for evaluation once the evaluation is finished. One to flourish, since the key messages from initiative we’ve taken in this regard is to evaluations can seldom be captured in a introduce capitalization workshops with simple headline – it is o!en a case of “on Bank operations departments for our the one hand, on the other hand”. In our project cluster evaluations. We’ve held evaluations, we always examine both sides three of these in 2018, on energy (rural of the story: what worked well, what did electrification and power interconnection), not work well/what could be improved. on agricultural value chains, and on But I’ve also learned that how you present Program Based Operations. This type of the message is as important, if not more evaluation doesn’t contain ratings but important, than the message itself. The rather focuses on findings and lessons, evaluator may see the glass as half empty, and so the capitalization workshops allow compared to the benchmark of a full glass; for a frank exchange with those who plan those leading the program being evaluated and implement the operations on their may see it as half full, compared to having knowledge and experience, on whether no glass at all. We need to be sensitive to our lessons are useful to them, and how we different perspectives and to the effect could be+er meet their knowledge needs. It that our messages have on people. has been a good experience so far. Another strategy is to inform and discuss with Senior Because we are an independent department Management the preliminary findings that works to high quality standards, we of key evaluations before they are

44 Q&A with the Acting Evaluator General eVALUation Matters Third Quarter 2018

finalized. Even if they do not fully agree evaluation is presented to the Board, and with the findings or our interpretation Management is well prepared to respond to of them, there are no surprises when the our recommendations.

GG: The first dra$ of the African Union’s Agenda 2063, its continental development plan, was wri!en through consultations with African citizens from different fields and sectors including women, youth, workers and academics from faith-based organizations, CSO’s and businesses. In evaluating progress made towards achieving Africa’s transformation, how does IDEV ensure that stakeholder voices are considered?

KRM: Stakeholder engagement is of Hearing their first-hand experience of how great importance, and an area where an AfDB project has impacted their lives IDEV would like to do more. It was one of is a precious source of evidence. But a!er the outcomes of the self-assessment of having been interviewed or taking part our implementation of the Independent in a survey or a focus group discussion, Evaluation Strategy that we undertook many stakeholders never hear back about this year. IDEV evaluators already make the evaluation report. Here is where we efforts to consult with and gather the views can do better, in disseminating the key of project beneficiaries, local groups, CSOs messages from an evaluation more widely, and other stakeholders when collecting and in ways that will reach the different data for our evaluations through field visits stakeholders. Our knowledge management – a good example is the Cabo Verde Country officers are becoming more involved at Strategy and Program Evaluation, where the early stages of the evaluation process, the evaluators interviewed, among others, to help evaluation teams undertake a the members of a local women farmers’ stakeholder mapping, identify key target cooperative about the current state of the audiences, and think through the best infrastructure and the socio-economic channels of communication for reaching impacts of the intervention being evaluated. those audiences.

Q&A with the Acting Evaluator General 45 Evaluation Week social media wall Viral content, insightful comments and captivating photos shared on twitter eVALUation Matters Third Quarter 2018

Evaluation Week social media wall: Viral content, insightful comments and captivating photos shared on twitter 47 eVALUation Matters Third Quarter 2018

48 Evaluation Week social media wall: Viral content, insightful comments and captivating photos shared on twitter eVALUation Matters Third Quarter 2018

Evaluation Week social media wall: Viral content, insightful comments and captivating photos shared on twitter 49 Thematic Discussion II: Inclusion through Agriculture Day A Thematic Discusison Discusison Thematic Discussion I: Challenges and opportunities and opportunities I: Challenges Discussion social of importance the and agri-businesses; through economies In a lively a!ernoon of exchanging ideas, knowledge and expertise, two value chains in creating food security; improving nutrition; boosting boosting nutrition; improving security; food creating in chains value for agricultural value chains for in value Africa chains agricultural Evaluation, Af much on foodmuchapproximatelyon imports– panels of experts and practitioners discussed the role of agricultural of role the discussed practitioners and experts of panels Moderator: Presentation: Panel: Agricultural value chains in Africa - challenges & opportunities Keynote: Girma Kumbi, Principal Evaluation Officer, Independent Development the figure is expected to surge to Gichuri, Director, Water & Sanitation, Af 1 inclusion, particularly gender ❚ ❚ ❚

African Development Bank (2018), Feed Africa: The road to Agricultural Transformation Transformation toAgricultural road The Feed Africa: (2018), Bank Development African in Africa (The High 5s) High (The Africa in ifad Amegbeto ffi Ko Fabrizio Felloni Fabrizio Kodjo Kondo, Kondo, Kodjo 3

Nutrition and Inclusion – A Multisectoral Approach, Wambui Friday 7September2018

Patrick Zimpita economies: 60 percent of Africa’s most active population of fresh water supplies. Yet each year, Africa spends far too griculture world’s arable uncultivated land world’s uncultivated arable Af is engaged in agriculture; Africa has 65 percent of the of percent 65 has Africaagriculture; in engaged is DB DB DB Program Offi cer, Monitoring and Evaluation, AGRA , Deputy, Director, Evaluation,IndependentOfficeof , Senior Policy Officer, Regional Office for Africa, ’s support to agricultural value chains development,

is the predominant sector of most African most of sector predominant the is II , Executive Director, Af : Inclusion through Agriculture through : Inclusion

inclusion. usd 110 billion by DB usd

unchecked,billion.35Le! 1 ; and it has an abundance

2025. DB

fao eVALUation Matters Third Quarter 2018

Keynote speech: Nutrition and Inclusion – A Multisectoral Approach

Nutrition is not only key to good health and strong economies in Africa but also a basic human right. Despite a high commitment and leadership, progress in achieving recommended levels of If we have stunted children today, our economies cannot nutrition has been slow in Africa. compete in the future.” Looking at progress across regions, Asia2 and Latin America have experienced Wambui Gichuri, Director, Water & significant drops in stunting in children Sanitation, African Development Bank (AfDB) on behalf of Jennifer Blanke, under five between 2000 and 2016 - 36% Vice-President, Agriculture, Human and 44% drops respectively. In Africa, the and Social Development proportion of stunting in children under five during the same time period has increased by 17%. Why? We found out nutrition will improve physical health that in Latin America and Asia, it took and cognitive development, education strong leadership (which we have), well outcomes and productivity. planned multisector programs, as well as resources. If we look at the various factors that affect children’s nutritional status, Why does nutrition matter? It matters there are several, such as inadequate because it is a huge challenge but dietary intake and exposure to disease also an opportunity for action and and related illnesses, which are mostly sustainable development in Africa. It dealt with in the health sector. Then we matters because it is key to achieving have the underlying causes, which relate the Sustainable Development Goals to household food security, maternal (SDGs); essential to poverty reduction and childcare practices and the health and inclusive growth; and malnutrition environment. This is where we start is responsible for a 11% loss in Gross seeing the role of multiple sectors such Domestic Product (GDP) in Africa. A 1% as agriculture, water supply, sanitation loss in adult height due to childhood and hygiene, social protection, stunting is associated with a 1.4% loss education, gender, environment, as well in productivity. This is crucial because as emergency and fragility contexts. if we have stunted children today, our There is thus need for a multisectoral economies cannot compete in the future. approach, which will not just contribute to improving nutrition, but also to The good news is that the benefit-cost strengthening inclusion. ratio of investing in nutrition is very high at around 16:13. We need to prioritize Development is going to happen when resources and programs. This call aligns sectors work together. Water, for example, very well with the African Development needs to feature more in agriculture as a Bank’s critical strategies including its sector. Africa is the world’s second driest 10-year strategy and the “High-5”priority continent with a very low storage per areas, in particular the Feed Africa and capita. This storage, whether through the Improve the Quality of Life for the infrastructure or natural bodies like People of Africa strategies. Improved wetlands that can also conserve

2 Excluding Japan 3 ( International Food Policy Research Institute (IFPRI), 2015

Thematic Discussion II: Inclusion through Agriculture 51 eVALUation Matters Third Quarter 2018

High commitment & leadership to reduce malnutrition, but little progress in the past two decades: In 2017:

59 million 10 million 14 million stunted children in Africa, overweight children, children suffered from wasting, a 17% increase since 2000 a 48% increase from 2000 indicating acute malnutrition

Opportunity for action & investment in sustainable development

❚ Good nutrition central to achieving the SDGs; essential to poverty reduction and inclusive growth ❚ Malnutrition is responsible for an 11% loss of GDP in Africa (IFPRI, 2016) ❚ 1% loss in adult height due to childhood stunting is associated with a 1.4% loss in productivity ❚ 16:1 benefts – cost ratio to scaling up nutrition interventions in low and middle income countries (IFPRI, 2015)

Tackling malnutrition is important for many of AfDB’s strategic priorities

❚ Achieving inclusive and green growth: AfDB’s Strategy for 2013-2022 ❚ Reducing poverty, Human Capital Strategy for Africa 2014-2018 ❚ Strengthening agriculture and food security, Feed Africa Strategy

Nutrition and the High 5s

Light up and power Feed Industrialise Integrate Improve life Africa Africa Africa Africa of people Power is critical Aims to eliminate Creates jobs and Contributes to Instrumental to to building and hunger and catalyzes SMEs improved nutrition strengthening maintaining the malnutrition focused on safe and and food systems grey matter value chains within nutritious foods infrastructure safe, diverse and nutritious food systems

Sources: [top 3rd of infographic] Repositioning nutrition as central to development: a strategy for largescale action. Washington DC: The World Bank; 2006 (http://siteresources.worldbank. org/NUTRITION/Resources/281846-1131636806329/NutritionStrategy.pdf, accessed 21 October 2014). [Factoid "1% loss in adult height due to childhood stunting is associated with a 1.4% loss in productivity" ] WHO/UNICEF/World Bank Group 2017.

52 Thematic Discussion II: Inclusion through Agriculture eVALUation Matters Third Quarter 2018

water, is what can get us through a short-term consequences, but we must drought. We also really need to develop not lose sight of the long-term impacts, our groundwater for irrigation and other particularly social fragility. Thus, we need purposes. There is no way we are going to to factor in climate change in everything achieve our agricultural objectives unless we do. Similarly, we should not just tick we do water management differently. boxes but we should mainstream gender. It is not easy but let’s keep talking about We now have recurrent floods and it. Today, in our institutions, there are droughts destroying our produce and more men in positions of authority than our infrastructure. The Bank is thus women. Men are the ones who need to developing resilience infrastructure. make sure that women are included. We However, in terms of fragility, the focus thus need to work together, both men is on the short- term. We need to look at and women.

Thematic Discussion II: Inclusion through Agriculture 53 eVALUation Matters Third Quarter 2018

Presentation: Lessons and Recommendations from the evaluation of the African Development Bank’s Support for Agricultural Value Chains Development

Girma Kumbi, Principal Evaluation Officer, Project Cluster Evaluation Independent Development Evaluation, An IDEV AfDB

In 2017, idev evaluated the support of the AfDB to Agricultural Value Chains Development (avcd). The exercise consisted Strengthening Agricultural of both a project cluster and a thematic Value Chains to Feed Africa Cluster Evaluation Report evaluation. The thematic evaluation March 2018 assessed the agricultural portfolio of the Bank during the period 2005–2016, which amounted to around ua 3.1 billion (usd 4.2 billion). It provides recommendations to strengthen the Bank’s overall approach to avcd for its “Feed Africa” strategy, aimed key findings and lessons learned from nine at transforming agriculture in Africa. The case studies that can inform the design and project cluster evaluation, for its part, is implementation of avcd interventions. focused on the project level and provides

The Project Cluster Evaluation

9 case study reports formed the cluster evaluation.

Morocco Wheat

Uganda Fish

Liberia Cassava

Kenya Tomato

Côte d’Ivoire Cocoa Rwanda Dairy

DR Congo Meat

Mozambique Rice

Zambia Cashew

54 Thematic Discussion II: Inclusion through Agriculture eVALUation Matters Third Quarter 2018

Findings from the Project Cluster Evaluation:

Relevance: The case study projects were very relevant for the member countries and well aligned with Bank strategies as well as the needs of the target population. However, there were several limitations in the analysis and design of AVCD approaches. Effectiveness: The Bank’s value chain-related interventions are generally effective in achieving their stated objectives of increasing production or physical access to markets, but they are not consistent in achieving overall AVCD results. Inclusiveness: AVCD interventions in all case studies have incorporated some design elements to address inclusiveness, but in practice, equitable distribution of benefits among all value chain actors is not achieved. Sustainability: The sustainability of benefits from AVCD interventions is difficult to assess and receives insufficient a+ention from design to exit strategy. Overall, sustainability of investment results is seen as unlikely due to insufficient planning for institutional mechanisms to support ongoing operations beyond project implementation.

Lessons from the Project of the time required for contributory Cluster Evaluation activities to mature, the value chain actors chosen for support, the scale of activities The Bank’s focus on avcd is emergent and responsive to the market demand, and yet to mature. The case studies demonstrate sequencing of activities. substantial potential for strengthening the avcd approach within the Bank’s strategies Ensuring inclusiveness in avcd. and operations. Five key lessons from this evaluation could help guide and consolidate Lesson 4: Deliberate, concerted and this process. targeted efforts at all stages of avcd design and implementation are essential Comprehensive avcd analysis in project to ensure inclusiveness. Processes that design and its subsequent adaptation ensure participation, and mechanisms during implementation is critical. for equitable benefit sharing, enable meaningful inclusiveness. Lesson 1: Insufficient analysis in avcd project designs constrains achievement Sustaining the benefits of of outcomes and impact, while avcd interventions. comprehensive value chain analysis guides implementation and responsiveness to Lesson 5: Sustained benefit from avcd changes in markets and contexts. interventions requires a comprehensive package of support that ensures Profitability focus is essential partnerships with the private sector, the throughout the entire value chain. government and other development actors.

Lesson 2: avcd interventions that focus The Thematic Evaluation heavily on increases in commodity production without sufficiently considering The evaluation is theory-based with a the efficiency of the production system and focus on learning. It takes a non-traditional the value chain as a whole, will incur net approach in that it does not evaluate financial and economic losses. specific investments or operations, but rather aims to understand how the Appropriate scope and scale. Bank’s operations have applied the avcd theory of change in different contexts. Lesson 3: Effective avcd interventions It draws key lessons and proposes require realistic planning that takes into recommendations to assist the Bank account appropriateness of scope in terms in future programming.

Thematic Discussion II: Inclusion through Agriculture 55

56 Thematic Discussion II: Inclusion through Agriculture eVALUation Matters Third Quarter 2018

❚ Most of the critical factors for value chain development are evident throughout the Bank’s interventions to some extent. However, all will require strengthening to achieve the intended outcomes of the “Feed Africa” Strategy via an avcd approach.

❚ Although the Bank strategies demonstrated overarching

The African Development intentions towards inclusiveness in Bank’s Support for Agricultural avcd, it is largely driven by pressure Thematic Evaluation Value Chains Development: to attain quotas of young people and Lessons for the Feed Africa Strategy An IDEV Summary Report women in project interventions.

March 2018 ❚ With respect to key enablers for avcd, the assessment shows that the most effective support is in relation to infrastructure and in appropriate financing where it has been supported. Findings of this evaluation were generated by triangulating information ❚ Sustainability is uncertain, with from multiple lines of evidence from a insufficient ownership and limited series of background works: functionality of facilities delivered constituting the main constraints.

1 literature review Recommendations from the Thematic Evaluation

1 portfolio review The evaluation proposes six overarching recommendations, supported by 1 policy and strategy review indicative actions, to strengthen the Bank’s approach to AVCD for the “Feed 9 case studies Africa” Strategy.

Interviews with beneficiaries and key informants and other 1. Build a coherent and consistent stakeholders. These are included approach to avcd across Bank in the case studies and policy and operations. The fundamentals and strategy reviews enablers proposed by the evaluation can be considered as a starting Findings from the point. This should involve all Bank Thematic Evaluation: departments that play a role in supporting acvd, with a clear vision The Thematic Evaluation examined the on how integration at regional and question “Has the Bank applied good national levels will occur in the practice standards in avcd?” context of specific value chains.

In summary, the Thematic Evaluation 2. Build avcd analytical and found that: implementation capabilities. It

Thematic Discussion II: Inclusion through Agriculture 57 eVALUation Matters Third Quarter 2018

will be important to include adequate target populations. Participation resourcing in program and project in activities by default cannot budgets in early implementation to be assumed to generate impact. carry out the necessary analysis. At a There needs to be an in-depth minimum, this should include farming understanding of the power systems management requirements, relations, bargaining framework technical production requirements and social position of vulnerable for innovation and value addition, groups, and support their inclusion market assessment, and participatory all along the value chain. The Bank stakeholder analysis. should develop a holistic approach to inclusiveness looking not only at 3. Focus avcd interventions on adding the position and roles of vulnerable value and achieving sustainable populations all along the value impact. Interventions should add chain, but also at their capacity to value to base production through access productive assets (water, technological advances in post- capital, knowledge and land), their harvest processing, reduction of risk management strategies, level wastage, improved price advantage of literacy, capacity to be formally for purchase of inputs or sales, and represented and the social norms more efficient consolidation and they are confronted with in their distribution channels, among others. communities and households.

4. Work with partners, especially 6. Strengthen policy dialogue the private sector, to strengthen to enhance a conducive avcd strategic and operational environment. This implies not approaches to avcd. This will only developing a policy dialogue require identification of potential with national authorities, but new partners and strengthening also integrating other value chain of approaches to partnership stakeholders around avcd. It management in Bank avcd should go well beyond production interventions. Policy interventions and, through a holistic approach, will require strong strategic develop improved sectoral policies partnerships, often with other major encompassing land tenure, support development partners, to build services, knowledge systems, regional influence for change. capacity building, strengthening of Farmers’ Organizations, coordination 5. Take affirmative actions to ensure of actors along the value chain, the inclusiveness. Inclusiveness is establishment of a framework to already well-covered in policy support producers in meeting quality and design documents but standards, or support to establishing more is required to ensure that fair conditions for contract farming inclusiveness results in impact for to develop.

58 Thematic Discussion II: Inclusion through Agriculture eVALUation Matters Third Quarter 2018

Panel Discussion: Agricultural The panellists each spoke about value chains in Africa - how their institution addresses the challenges & opportunities challenges and opportunities for the development of agricultural value The first of two discussions looked chains. Ensuring inclusion was seen as at challenges and opportunities for one of the biggest challenges among the agricultural Value chains in Africa in terms panel, while some of the interventions of, but not limited to, scale of operations; from the audience drew attention to the level and nature of coordination; status measures that are needed for developing of institutional arrangements; financial agricultural value chains in light of the and technical capabilities; impact of effects of climate change. climate change; political and socio- economic climate; strength of market The Moderator, Patrick Zimpita, Executive networks; stability and security; quality Director, AfDB, posed questions to of stakeholders’ engagement; and most each panellist. importantly, level of inclusion.

Koffi Amegbeto, Senior Policy Officer, Regional Office for Africa, Food and Agriculture Organization (FAO)

question: To what extent have African countries used agricultural value chains to produce value added products and services for improved production and participation in markets? Which challenges have they faced?

Agro-industry development is important In addition to playing an in achieving a number of sustainable important part in poverty development goals such as poverty reduction, agri-business eradication, elimination of hunger and value chain development is malnutrition, achieving sustainable strategically very important agriculture, industrialization, to sustaining resilient food innovation, and sustainable production systems needed to deliver healthy diets. and consumption, just to mention a few. In addition to playing an important part in poverty reduction, agri-business value inefficient and the regulatory system chain development is strategically very is inadequate. Some governments don’t important to sustaining resilient food always have the right perception of the systems needed to deliver healthy diets. roles of the public and private sectors in agricultural value chains development. Africa’s efforts in developing These are some of the factors that agricultural value chains is very limited make it difficult for agricultural value compared to the need on the continent. chains to drive economic growth on In many cases, the policies are the continent.

Thematic Discussion II: Inclusion through Agriculture 59

60 Thematic Discussion II: Inclusion through Agriculture eVALUation Matters Third Quarter 2018

Fabrizio Felloni, Deputy Director, Independent Office of Evaluation, International Fund for Agricultural Development (IFAD)

question: How prepared are African governments to develop agricultural value chains that can meet the demands of modern societies?

Part of it is a structural challenge- new policies, better policies, trade policies, policies that are needed to make the We, within our organizations, function of State-owned enterprises also need a bit of capacity more efficient, including paying prices building on how to better that are more appropriate to small- design and better support scale producers. the implementation of national counterparts’ The other challenge is the capacity projects. that governments have to develop and manage agricultural value chains. Value chains involve several types of them have worked on an agricultural partners. It is not just the producers, it value chain. When we consider items is also the processors, those working in that are so crucial to agricultural value transportation, the aggregators, those chain development such as profitability, working in packaging, and the exporters. we find deficiencies in the capacity to We have a multiplicity of actors prepare solid business cases to convince intervening. There is an urgent need for the private sector to participate. capacity building on agricultural value chains development and on how to These deficiencies are not only present enable agricultural value chains actors within governments, but also within to proficiently collaborate and make the our organizations. We might have been value chain more profitable. working, for example, in the agriculture sector, but mostly concerned with The third challenge is the private sector. production improvement, boosting yield Many of these partners belong to the from new varieties or boosting yields private sector. We find that staff in public through irrigation. However, many of us agencies are well-prepared competent do not have experience in working with technical specialists, but very few of the private sector.

Thematic Discussion II: Inclusion through Agriculture 61 eVALUation Matters Third Quarter 2018

We, within our organizations, also projects. Agricultural value chain need a bit of capacity building on how development is quite new to the African to be+er design and be+er support the Development Bank. It requires long-term implementation of national counterparts’ engagement, investment and commitment.

Kodjo Kondo, Program Officer, Monitoring and Evaluation, Alliance for a Green Revolution in Africa (AGRA)

question: Although more than half the green revolution, which Asian countries African population works in agriculture, have seized. the continent still relies on huge imports of processed foods such are rice or wheat. Why this paradox and how can this trend be reversed?

We have the highest number of people in farming but we rely a lot on imported wheat, rice or sugar to satisfy our own consumption needs. Why? To a certain extent, our production systems have low We need to make reforms to productivity and they lack appropriate support the consumption of innovations, mechanization, and improved local produce and promote varieties. The rate of fertilizer application our local production. We in Africa is among the lowest in the world. must come back to what we We have missed the opportunity of a know.

62 Thematic Discussion II: Inclusion through Agriculture eVALUation Matters Third Quarter 2018

Why did we miss the green revolution Discussion ii: Towards inclusive opportunity? Part of the answer can value chain development be found in the structural reforms of the 1980’s where our governments Moderator: Youssouf N’Djore, Director, had to withdraw from supporting Social Development, World Cocoa agriculture. The Asian producers seized Foundation the opportunity and flooded our market with rice, also taking advantage of the Panel: Towards inclusive value chain lowering of the cost of marine transport. development

In another example, bread, which ❚ Aboegnonhou Chaldia Agossou, was originally not indigenous to our Seed Services societies, has been engrained in our ❚ Troels Egeskov Sorensen, Fragility local economies. How do we reverse and Resilience Expert, Transition this trend? We need to make reforms Countries Coordination Office, AfDB to support the consumption of ❚ Enock Warinda, Theme Leader- local produce and promote our local Knowledge Management, production. We must come back to what Monitoring and Evaluation, The we know. In Nigeria for example, a law Association for Strengthening of has been passed forcing bakers to use Agricultural Research in Eastern and more cassava flour in their bread, while Central Africa (asareca) in Senegal, they are required to use ❚ Koffi Amegbeto, Senior Policy Officer, millet flour. Regional Office for Africa, fao

Thematic Discussion II: Inclusion through Agriculture 63 eVALUation Matters Third Quarter 2018

Aboegnonhou Chaldia Agossou, Co-founder, Seed Services

question: Building on your own To make agricultural value chains more experience, what would be your inclusive, we must first think about perspective of an inclusive value chain for the training of the different actors. We a young female leader such as yourself? must strengthen their management and leadership capacities and, above all, The agricultural value chain for me provide financial support. refers to a set of activities involving different actors, that contributes to For their part, financial institutions must putting a given product on the market. also put in place models adapted to the These actors intervening upstream and needs of small-scale producers and those downstream are: of women. They have different levels of power in the market. We must thus find ❚ Input producers (of which I am a appropriate financing mechanisms for manager of a start-up that markets them. There needs to be some equity in local fruit and vegetable seeds that are the funding of these actors. adapted to our environments);

❚ Producers (big and small);

❚ Processors;

❚ Insurers who practice in the field of agricultural insurance;

❚ Traders. Financial institutions must When we analyze the agricultural value put in place models adapted chain, we see that women and young to the needs of small-scale producers and those of people are generally in the minority. women. Why are they marginalized and how can we further include these marginalized people in agricultural value chains? The African population is made up of mostly This is what we believe is needed to young people. We must therefore find make value chains truly inclusive, for a strategies to integrate these actors into better integration of young people and of the value chains; help them to carry out women and for a real transformation of their activities; and benefit from them. our agriculture in Africa.

Troels Egeskov Sorensen, Fragility and Resilience Expert, Transition Countries Coordination Office, AfDB

question: From your perspective, where In the AfDB, we acknowledge that working are the points of fragility that we should in transition countries is not business as take into account in our analysis of usual. This implies that evaluation cannot agricultural value chains (in order to make be business as usual. The agricultural them more inclusive)? sector is strongly linked to many

64 Thematic Discussion II: Inclusion through Agriculture eVALUation Matters Third Quarter 2018

of the complexities that surround 5 years ago. However, there are not fragility, vulnerability and violent conflict. enough indicators, methodologies and Hence, project design should address how approaches to map the various fragility these agricultural activities are linked to drivers that influence the performance these fragilities. of agricultural value chains in Africa.

It is important to develop fragility- sensitive project designs. From a fragility perspective, when we look at the evaluations and lessons learnt that are out there, we see that there is a bigger emphasis on how conflict affects agricultural production. What we do not see as much of is research and evaluation on how agricultural projects, when We don’t see as much implemented, have an impact on fragility. research and evaluation on how agricultural projects, Certain fragility drivers link to the when implemented, have an agricultural sector such as land rights, impact on fragility access to land, access to water, water usage, population growth in areas with scarcity of agricultural land, migration, and To address this gap, the AfDB is working conflicts between farmers and nomadic on two tools: The first is a tool called the pastoralists. We are seeing, for example, Country Resilience Fragility Assessment. how the proliferation of modern arms is It consists of 118 data metrics showing making conflicts related to agricultural 91 indicators. What is innovative about activities much more violent between this tool is that we not only analyze the these groups. pressures of fragility in each country, but we also evaluate the capacities to Despite our knowledge of these manage these fragilities. The second tool dynamics, when we look at the is a new data collection platform at the assessments that we undertake in community level that measures poverty relation to agricultural production levels and vulnerability. and project design, we see much less incorporation of fragility dynamics. In order for the fragility context to be For example, should we consider how incorporated into our monitoring and to strengthen security arrangements evaluation, these fragility indicators according to the context of the project need to be part of the project design. in the project design? Should we include A comprehensive assessment of the more conflict mediation? Should we agricultural value chain thus needs to integrate activities to create alternative include fragility dynamics. In this way, routes for the transportation of cattle? lessons can be drawn that would help to Should we integrate, to a higher degree, strengthen development impact. activities on social dialogue, social cohesion or community involvement? It is also important for the practitioners who work with the agricultural sectors It is also important to have fragility- to work with colleagues in the Bank and sensitive indicators. In Africa, a experts working in fragility to make continent known for the lack of sure we include these indicators in the statistics, there is in general a lot project design. By not being aware of the more data available compared to conflict associated with a project,

Thematic Discussion II: Inclusion through Agriculture 65 eVALUation Matters Third Quarter 2018

we could in fact make things worse. My plea is thus that we have a stronger Conversely, by integrating fragility link between the work that is done on activities in our agricultural projects, we agricultural value chain development could also build resilience in the country. and fragility.

Enock Warinda, Theme Leader-Knowledge Management, Monitoring and Evaluation, The Association for Strengthening of Agricultural Research in Eastern and Central Africa (ASARECA)

question: What is your perspective on innovation for a better inclusiveness of our value chains, and on monitoring and evaluation mechanisms for better value chains?

On 27 January 2018, Moussa Faki Mahamat, Chair of the African Union Commission, and António Guterres, un In Africa, over 80% of Secretary General, signed the au-un agricultural value chains framework on the implementation of are oscillating between the Agenda 2063. This document has 6 the nascent and emerging guiding principles of the development stages. framework. The first on the list is inclusivity. But what is inclusivity and what goes into it? The document they Agricultural value chain development signed stated that inclusivity “should starts from and demands the conservation provide everyone with the opportunity of water and land. If we don’t manage to participate in and contribute to our land and our water, we will not go changing their livelyhoods for the very far. How much concentration do better, with the strengthening of gender we put on the development of these two equality, womens empowerment, and resources? Monitoring and evaluation harnessing the demographic dividend of thus need to track the transformation and the young people, as a priority”. Hence the evolution of agricultural value chains for the development of agricultural and determine whether they are inclusive, value chains, embedded under to inform decision-making. Agricultural inclusivity, we should pay attention to value chains development requires value the au-un Framework. stream mapping, focusing on the sequence of activities as we design and produce the Agricultural value chain development products and as we deliver them. in Africa is in various stages of maturity. If we look at the whole spectrum of A second important aspect in inclusive developmental stages of value chains- agricultural value chain development in nascent, emerging, expanding and Africa is the fact that Information and mature- we can see that in Africa, over Communications Technology (ict) is not 80% of value chains are oscillating being adequately used in production between the nascent and emerging system management, access to markets, or stages. This calls for a very clear analysis financial inclusion. We have been working of our value chain development. on the use of ict in agricultural value

66 Thematic Discussion II: Inclusion through Agriculture eVALUation Matters Third Quarter 2018

chains development. We have not done have developed their own version of enough evaluation and shared lessons the esoco platform and included it in learnt from those that have used these their national agriculture development platforms. For example, we have many plan through a smart, learning e-services. In Ghana, we have esoco, a approach. Their “esoco+” is going to company providing mobile and web-based help them improve their market price tools for data collection. In Rwanda they information system.

Koffi Amegbeto, Senior Policy Officer, Regional Office for Africa, Food and Agriculture Organization (FAO) on behalf of Tacko Ndiaye, Senior Gender Officer, Social Protection and Rural Institutions Division, FAO

question: What is fao’s approach agricultural value chains, a key policy towards promoting inclusive approach has been to enforce legislations, agricultural value chains? for example those that guard against discrimination, harassment, wage Gender inclusiveness is important in inequalities, as well as enforce ethical improving agricultural value chains standards and codes of conduct. in Africa, largely because about 50% of women in sub-Saharan Africa work fao has produced a conceptual framework in the agricultural sector. Women also and implementation guidelines to support make critical contributions to food practitioners and decision makers who transport and shipping as well as in the are planning and implementing value production, processing, distribution, chain interventions. This framework and consumption of food. Empowering has two key dimensions: the first is to women, particularly women in rural promote women’s access to productive areas, can increase productivity, reduce resources, services, technologies, markets hunger and nutrition and signifcantly and information; the second is to promote improve livelihoods. access to capabilities - in terms of skills [training], power in decision making, However, women face with several and self-confidence. The Framework constraints in working in agriculture and highlights the roles that women and men food systems. fao’s approach has been can play in different nodes of the value to empower women in the agriculture chain. It identifies the constraints that sector. To address gender inequality in prevent them from benefiting from their work, and helps provide them with the skills and opportunities to unleash their full potential.

question: What can a partner like the AfDB or fao do to ensure that governments renew their commitment to the global agribusiness development agenda and invest 10% of their budget Gender inclusiveness is in agriculture? important in improving agricultural value chains in Africa. About 50% of women We have to avoid preoccupying ourselves in sub-Saharan Africa work in with only the 10% target of gdp in the agricultural sector. investment in agriculture for food

Thematic Discussion II: Inclusion through Agriculture 67 eVALUation Matters Third Quarter 2018

security. Although it has been agriculture and achieve its food security adopted by the Heads of State, the 10% gdp goals, while another country may invest share is just an indicative figure. A country 15% and not achieve the goals it has set in may allocate 5% of its national budget to the Maputo Declaration.4

4 At the Second Ordinary Assembly of the African Union in July 2003 in Maputo, African Heads of State and Government endorsed the “Maputo Declaration on Agriculture and Food Security in Africa” (Assembly/AU/Decl. 7(II)). The Declaration contained several important decisions regarding agriculture.

68 Thematic Discussion II: Inclusion through Agriculture eVALUation Matters Third Quarter 2018

Thematic Discussion II: Inclusion through Agriculture 69 Reviewing the script: Consultation session on the OECD-DAC evaluation criteria O Day Association (Afr Moderator: Speakers: ❚ ❚

Independent Evaluation Group, World Bank Group Per Øyvind Bastoe, Øyvind Per Chairperson, aoie Heider, Caroline 1 Wednesday 5September 2018

dln Sibanda Adeline oecd worldwide consultation on the need to adapt the criteria session was held for Af for held was session n to the new development context and landscape.

the opening dayopening Evaluationthe of Week discussiona 2018, EA oecd / ) dac / Director General and Senior Vice President, President, Vice Senior and General Director dac evaluation criteria, as part of an ongoing Director, Norad Evaluation Department and EvaluationDepartment Director,Norad Evaluation Network Evaluation , Chairperson, African Evaluation Evaluation African Chairperson, , DB and local evaluators on the the on evaluators local and eVALUation Matters Third Quarter 2018

The oecd/dac criteria are a set of workshops and conferences around the five criteria for evaluators to consider world. On the basis of the views expressed, when evaluating development programs the EvalNet Secretariat will develop a and projects. The criteria have been a proposal for discussion at the next EvalNet strong foundation for international meeting in February 2019. development evaluation since 1991. They have been the most prominent and The purpose of the session during widely adopted criteria used by most Evaluation Week 2018 was to hear the bilateral and multilateral donor agencies, views of African evaluators and evaluation including by idev, as well as international stakeholders on the evaluation criteria, nongovernmental organizations. answering the following questions: Should we review, modify, or adapt the criteria? Or “Evaluation is more than a discipline. rather adapt the way we use them? How It is an important tool for learning to be+er take into account the specific and accountability that reinforces our development context of African countries efforts to achieve development goals,” in the evaluation of policies and programs? said Adeline Sibanda, President of the African Evaluation Association Participants agreed that the criteria are (Afrea). still relevant, but need to be reviewed and updated in light of the sdgs. They After so many years of use, the dac also questioned whether the criteria Evaluation Network is now examining adequately take into account the specific whether, and if so, how the evaluation development context of African countries, criteria should be adapted to the new in view of the broader debate on how development landscape and the 2030 evaluators and evaluation can contribute Sustainable Development Goals (sdgs) to achieving the sdgs. Agenda. To facilitate the review of the criteria, a broad stakeholder consultation Some of the views shared on specific is taking place through blogs, surveys, criteria include:

OECD-DAC Evaluation Criteria 1 5

Revelance Sustainability The extent to which the aid activity is suited to Sustainability is concerned with measuring the priorities and policies of the target group, whether the benefts of an activity are likely to recipient and donor continue after donor funding has been withdrawn. Projects need to be environmentally as well as fnancially sustainable 2 5 Criteria 4 Effectiveness A measure of the extent to which an aid activity Impact attains its objectives The positive and negative changes produced by a development intervention, directly or indirectly, 3 intended or unintended

Effciency Effciency measures the outputs - qualitative and quantatitve - in relation to the inputs. It is an economic term which signifes that the aid uses the least costly resources possible in order to achieve the desired results

Reviewing the script: Consultation session on the OECD-DAC evaluation criteria 71 eVALUation Matters Third Quarter 2018

Relevance: Many of the projects evaluated score “satisfactory” in terms of relevance. Participants observed a lack of objectivity or harmonized approach with regard to this criterion in the evaluations being carried out. Furthermore, participants noted that “relevance” has typically been defined in terms of programs but not in terms of the relevance to the Although there is no exact beneficiaries of the project or initiative. answer, we can retain that two main questions resonate Impact: Some confusion is sometimes at the back of the mind of made between measuring impact in each evaluator who has been evaluation and conducting an impact using these criteria: How do we know that we are assessment. Respondents noted the need successful and how do we to clarify the distinction. get there [to success]? Caroline Heider, Director General and Participants also agreed that the five Senior Vice President, Independent criteria were effective; however, they Evaluation Group, World Bank Group suggested that evaluators must prioritize a pragmatic and contextualized approach challenge which should be addressed to evaluation. Discussions focused on the during the revision of the criteria. The need for a common understanding of how same is true of integration and taking evaluations are conducted; how evaluation into account cross-cu+ing issues such as criteria can be adapted to the different gender and climate. types of evaluation; and what should change or be clarified in the evaluation In addition to reviewing the existing set criteria. In addition, the question of of criteria, participants argued for the attributing results to a particular inclusion of other criteria in evaluations, intervention and taking into account such as partnerships and human rights unexpected results is a methodological considerations.

72 Reviewing the script: Consultation session on the OECD-DAC evaluation criteria eVALUation Matters Third Quarter 2018

Reviewing the script: Consultation session on the OECD-DAC evaluation criteria 73 Thematic Session III - Partnerships for impact in Africa G Day Thus, we see partnerships such as such partnerships see we Thus, emerging, expanding and growing stronger. This final session of of session final This stronger. growing and expanding emerging, governments of Benin, Uganda and South Africa) and the African the and Africa) South Uganda and Benin, governments of demand for evaluations; encourage learning from evaluations; and and evaluations; from learning encourage evaluations; for demand Evaluation Week 2018 explored how partnerships can help build build help can partnerships how explored 2018 Week Evaluation ( Evaluation Development on Network Parliamentarians’ promote use of evaluation in policy- and decision-making. partnering with others enables them to achieve the supply of high-quality evaluations on the continent; stimulate stimulate continent; the on evaluations high-quality of supply the ❚ Panel: evaluations - Keynote: Moderator: ❚ ❚ ❚

Results Results ( Smith Laila and International Organization for Cooperation in Evaluation Sibanda Adeline Network on Development Evaluation Parliamentarians’African member,Commi+ Executiveee and Abbas Imbassou +araOua Chairperson, Twende Mbele initiative Analysis of Government Actions, Presidency, Republic of Benin / Gounou Abdoulaye 3 Friday 7September2018 Partnerships to advance supply, demand and use of of use and demand supply, advance to Partnerships

effortsto strengthen bothsupply the demand the and of continent, supported by development partners, academia overnments, and centers of expertise, have in recent years made made years recent in have expertise, of centers and orts, they have found that that found have they ff e orts, these In evaluation. for Catherine Cudré-Mauroux clear Michele Tarsilla , Director, Center for Learning on Evaluation and Evaluation on Learning for CenterDirector, , ) Anglophone Africa , Chairperson, African EvaluationAfricanChairperson, Association, , Head of Office, Public Policy Evaluation and

parliaments, and civil society across the the across society civil and parliaments, , Regional Evaluation Adviser, , Member of Parliament of Côte d’Ivoire wne Mbele Twende , Executive Director, Af

more. (between the the (between unicef apnode db . ) eVALUation Matters Third Quarter 2018

Partnerships for impact in Africa

Demand: Building a culture Supply: Building capacity of evaluation for evaluation

Partnerships African African governments, parliaments, CSOs, for a balance governments, national development partners between supply evaluation associations, academic institutions, and demand development for evaluation partners The number of national evaluation associations in Africa has Between 2005 and 2015, 70% increased from 6 in 1999 to more of evaluations than 45 today. in Africa were carried out by a However, development partners combination remain the primary source of of development partners (45%) demand for evaluations and academic institutions (25%)

Keynote address: Partnerships to advance supply, demand and use of evaluations

Michele Tarsilla, Regional Evaluation Adviser, UNICEF

Applying the economic concepts of supply and demand to the field of It is important to remember that partnerships are not evaluation is attractive conceptually, ends in themselves; they are but it also has its drawbacks. Firstly, a tool to promote a greater evaluation of development is primarily good. about people, and the effects that development programs have on them. It is also about politics and about evaluation arena in which we operate relationships. These do not always fit and in which we want to establish neatly into the binary paradigm. When partnerships. Finally, the supply- we talk about supply and demand for demand analogy focuses on the quantity evaluation, we need to embrace the of evaluation more than on the quality messy reality in which we work. of its supply or demand. We have seen that the number of partnerships that Secondly, in the shift from conceptual have been established haven’t always to operational, a lot of donors and guaranteed that what came out of them organizations have decided to focus on was a) of good quality and b) useful. These one or the other side of the equation. are things to bear in mind as we explore This has led to a fragmentation of the new evaluation partnerships.

Thematic Session III - Partnerships for impact in Africa 75 eVALUation Matters Third Quarter 2018

Partnerships can help organizations from national to global partnerships. achieve more together than they could It is very hard to launch yourself into on their own. To ensure a successful partnership building if you don’t know and sustainable partnership, potential how many different types there are. partners should ask themselves three Furthermore, partnership is not just questions: why do we want to engage, a collaboration, or a network or an with whom do we want to engage, and alliance, there are even more definitions how do we want to engage? Before we of what partnership constitutes. ask whom we want to engage with, we should ask why we are partnering in the There are some key principles for first place. In development, we often good partnerships: start with figuring out the activities, and put the objectives and the results and ❚ A shared vision. Are our values the the goals at the very end. In the literature same or complementary? this has been coined as “partnership- itis”, creating partnerships just for the ❚ A sense of mutual trust in the sake of doing them as it’s what you are relationship supposed to be doing. ❚ A theory of change behind the The first question is “why engage?” partnership. Do we know where we What is the purpose of the partnership are going? and where are the added values? Once the question of the purpose and values ❚ Flexibility in the partnership and the is answered, we can then ask ourselves: ability to compromise. Partnerships “with whom do we want to partner?” are not static constructs but are We need to understand the evaluation going through continuous evolution. ecosystem and who the actors are. There are actors who carry out evaluations, ❚ Good communication those that ask for evaluations, and those who use evaluations. We also have the It is also important to know the risks donor community. involved in partnerships. One of the risks is personalization, where we identify Once we map the potential actors, then a champion for a specific partnership. we need to decide whom to partner with. If that person leaves the organization In deciding who, mixing traditional then it weakens the partnership. Also, and non-traditional partners (eg. local the shared values and objectives of foundations, private sector) is good for partnerships can result in a flattening successful partnerships. We need start of discourse between partners, whereby working a li+le bit more with those people there is no dialogue or disagreement that do results-based management, those on ideas or priorities. Another risk is that do audits. Partnerships should also be creating partnerships that do not affect across sectors. the target audience or beneficiaries. Finally, it is important to remember that The last question is: how to engage? There partnerships are not an end; they are a are many levels or types of partnership, tool to promote a greater good.

76 Thematic Session III - Partnerships for impact in Africa eVALUation Matters Third Quarter 2018

Views from the Panel:

Laila Smith, Director, Center for Learning on Evaluation and Results (CLEAR) Anglophone Africa

question: Thinking about the need to build capacities in evaluation, to create an enabling environment for evaluation, as well as to ensure that evaluation is not just used for accountability but also for learning, what has your experience been at clear? Whether you have a national I think it is important to understand where evaluation strategy or clear came from. It is very much a result of stepping stone, we all agree the realization that the donor community we should start where we had been largely responsible for driving can, but getting a national and shaping the evaluation practice, evaluation policy endorsed particularly in developing countries. by the cabinet is a game- changer. We focused on 4 key high-level objectives: i) building African scholarship on the We really feel the value of trying to Evaluation Capacity Development strengthen our networks. apnode for practice, ii) championing the creation of example, is such an incredibly important M&E infrastructure through advocacy and network on the continent for providing technical assistance, iii) creating a culture the space for convening parliamentarians for evidence based decision making, and iv) to talk about programs of work. Similarly, fostering knowledge networks for sharing we gain tremendous legitimacy in filtering good practices. some of our thinking, which is at a regional level, through Afrea, tapping into its On the demand-side we worked with insights into the different characteristics national evaluation systems, with across the continent and really giving us governments and parliamentarians. On the sense of are we on the right track or not. the supply side we focused on universities as an important constituency with which Our partner Twende Mbele has to build post graduate degrees. This would been absolutely instrumental in allow for a more substantive learning strengthening national evaluation engagement for the tools surrounding systems and in opening the doors M&E. politically. Partnerships are very much value flows that go two ways. It is Together with Twende Mbele and in important to understand if what you are consultation with Afrea, we have looked putting into a partnership is worth what at a collaborative curriculum, working you are getting out of it. It is not about with 23 universities across 11 countries, to money, it’s sometimes about influence, find out what the core skill needs are for it’s sometimes about supporting the the continent. This allowed universities to creation of an enabling environment at take this consensus as a basis to tailor their the ecosystem level, which takes years own courses. and years.

Thematic Session III - Partnerships for impact in Africa 77 eVALUation Matters Third Quarter 2018

Adeline Sibanda, Chairperson, African Evaluation Association and International Organization for Cooperation in Evaluation (AfrEA)

question: How has Afrea contributed to the current evaluation momentum and the sharing of information? What examples of best practices in Africa have you used to encourage evaluations and partnerships in evaluation?

Afrea is an umbrella of associations, formed in 1999 to establish a culture of There is a diference in the evaluation in Africa. So that is the why. way we need to look at how Our first level of partnerships is with evaluation is done in Africa in terms of the context, culture, national evaluation associations. When norms, and the standards Afrea started there were only 6 evaluation associations on the continent. We now have over 45. One of the key areas we have been looking at is the supply of evaluators We realized that as Afrea we cannot on the continent. We often hear that implement at the national level. We there is a lot of demand for evaluation. needed to ensure that we strengthened As I engage with different development the institutional capacity of our national partners I’m told that the reason evaluation associations. This is work we bring in evaluators from outside in progress. Africa is because there is no capacity in Africa. That is something at the core We need strengthened institutions of our interventions at Afrea; we want because one of the roles the national to develop the evaluation capacity in evaluation associations play is to ensure Africa, to ensure that more African and encourage governments to engage in evaluators are used to evaluate different evaluation, to commission evaluations, to programs within Africa. use evaluations and develop a national evaluation system. We have partnered with different organizations to build capacity in Through our national evaluation evaluation. With clear we have been associations, we have encouraged working together to examine how partnerships within countries where capacity could be built. There is a governments, parliamentarians, national difference in the way we need to look at evaluation associations, civil society and the how evaluation is done in Africa in terms private sector come together to support the of the context, culture, norms, and the building of a national evaluation system. standards. That is something that clear Has it always worked? No. For example, has incorporated within its program. our Ghana Monitoring and Evaluation Association has been advocating for a We have partnered with the Association national evaluation policy for the past of African Universities, to give courses on 10 years. It’s only recently, through their evaluation. For example we’ve partnered partnership with Twende Mbele, that they with usaid for online evaluation training. have come together to start the process of The aim here has been to build evaluation developing a national evaluation policy. capacity on the continent.

78 Thematic Session III - Partnerships for impact in Africa eVALUation Matters Third Quarter 2018

One of the things we worry quality of the courses that are run on the about, is that we have become a bit continent. We need to be in agreement, of a playground where people just what is it that we are looking for in experiment with different training Africa? How different is this going to be courses and we have to look at the from what is offered elsewhere?

Perspectives: Evaluation in the Executive and Legislative Branches

&

Institutionalized evaluation We asked ourselves: What goes beyond the is working well in Uganda monitoring of government or South Africa in terms of actions. evaluation? What have we Abbas Imbassou Ouattara, Member done better in Benin than of Parliament of Côte d’Ivoire and South Africa or Uganda? Executive Committee member, African Parliamentarians’ Network Abdoulaye Gounou, Head of Ofce, on Development Evaluation Public Policy Evaluation and Analysis of Government Actions, Presidency, Republic of Benin/Chairperson, Twende Mbele initiative

question (Cudré-Mauroux): How We also see the need for parliaments to are evaluations addressed in the have partners. In Côte d’Ivoire, apnode Ivorian Parliament? Do you discuss has worked a lot in partnership with the and use evaluations? Is there a AfDB, usaid, unicef, undp, and un Women. demand for evaluations? How do you Partnerships help us to strengthen refer to evaluation results in your our capacity to play our legislative decision making? and oversight roles. That is why the apnode Executive Committee is made Abbas Imbassou Oua!ara: up of not only parliamentarians but also our partners. Any public action by us members of parliament must lead to an improvement However, having the partner, having the in the quality of life of the Ivorian citizen. funding, having the outside expertise is We in the Ivorian parliament recognized not enough. We must instill the notion the need to institutionalize evaluation in that the legislative function is a calling. our country. That is why we have included We in parliament must respect the people it in our Constitution. who give us a mandate to represent them in the National Assembly. For us it However, exactly how this is done, is not is therefore necessary to work with the obvious. Institutionalized evaluation goes civil society, with academia to make sure beyond monitoring government actions that we effectively work on behalf of and holding the government to account. our constituents.

Thematic Session III - Partnerships for impact in Africa 79 eVALUation Matters Third Quarter 2018

question (Cudré-Mauroux): Hon. We did not go alone. At the national level Imbassou has just told us that the we have built a partnership between legislature needs evaluation; it needs to ourselves first as a government, including base its decision-making on evaluations. all ministries. Secondly we built I would like to hear how the executive is partnerships with local governments. working in this environment. What are We also had to build partnerships with your experiences, your realities in an other partners, donors, civil society Office of the President? How have you and parliamentarians to build our launched this initiative, Twende Mbele? national system. What is it that this initiative has brought you more? Another partnership that Benin is involved in is wacie (West African Abdoulaye Gounou: Capacity Building in Impact Evaluation), a program that involves the eight In Benin we wanted to institutionalize countries of the West African Economic evaluation, initially at the ministerial level. and Monetary Union. In each of these Subsequently, it was necessary to turn the countries, we have a focal point located ministerial priority into a government within the Ministry in charge of priority and to integrate the evaluation monitoring and evaluation. We have a process in all government departments. regional secretariat based in Cotonou with the support of 3ie, which promotes Much later, we realized that the need impact assessments in our countries. for accountability to citizens implies This partnership also helps us to more than just government. It is public strengthen our capacity to conduct and decision-makers who are concerned use evaluations for decision-making. with accountability, starting with the parliamentarians who can be sanctioned (by the voters) overnight. Abbas Imbassou Oua!ara:

Thus, today evaluation is a national We are currently engaged in all the priority. When we talk about national activities undertaken by the Ivorian evaluation policy it is not just conceptual, M&E network (rise) and the Ivorian there is an institutional framework of Initiative for Evaluation (2ieval). evaluation. This framework organizes the actors at the national level, defines Seeing the extent of the work we need to the role of each one, defines the reporting do, we do have to put our efforts together mechanism, and describes how to collect and to learn from each other to be able to information in conducting evaluation. meet various challenges. Choosing to go individually would not be effective. When you want to go fast you can go alone, but if you want to go far you have to go We support peer learning initiatives like together. We understood this in Benin at Twende Mbele, which is great, so let’s go the national level and we understood it in together to be more effective! Twende Mbele at the continental level.

80 Thematic Session III - Partnerships for impact in Africa eVALUation Matters Third Quarter 2018

Audience question (Yasmina Abbas Imbassou Oua!ara: Coulibaly, Law student, Côte d’Ivoire) Is civil society involved in the decision- Each country has its own national making process of the evaluation development plan. This is the main policies? Because it should be an compass helping to ensure the inclusive process. parliamentary oversight.

Abdoulaye Gounou: Many people believe that we parliamentarians don’t talk to Civil society is instrumental in building them. However we welcome people up competence at the level of public policy approaching us for information and to evaluations. In the institutionalized understand how we are working. We are evaluation process in Benin there is an very happy when civil society says “the instrument called the National Evaluation parliament should contribute to help Council. Civil society actors sit on this public policies to meet people’s needs.” council together with political, academic and Parliamentarians and civil society, we are administrative representatives. This council partners. We are facing the government validates the evaluation work program and together, holding it accountable for its the evaluations reports. policies and actions.

Thematic Session III - Partnerships for impact in Africa 81 News in pictures on its work to support delivered a presentation represented Development Officer, Evaluation Capacity Kobena Hanson, Principal sdg in implementing the track and evaluate progress imperatives needed to to deliberate on the capacity countries, in Kigali, Rwanda as representatives from 14 from across Africa, as well development institutions evaluation champions, and national monitoring and joined regional associations, From 12 to 13 June 2018, for evaluation the on conference in regional - IDEV partakes (SDGs) Goals Development and the Sustainable Evaluation Monitoring, capacity development and promote evaluation s at country idev

level. and sdg s idev

conference on evaluation for ( and the Sustainable Development Goals the Centre for Learning its collaborations with Twende Mbele, as well as Evaluation ( Network on Development African Parliamentarians’ Systems ( National Evaluation such as Strengthening continent via initiatives good governance on the evaluative culture and and promoting an use of M&E evidence and advancing the idev presentation highlighted across the continent. The Find out and ( for Anglophone Africa on Evaluation and Results SDG clear Web story: Monitoring, Evaluation CLEAR About s) -

EvalPartners. ’s work in enhancing IDEV APNODE - - aa AA

more: snes partakes in regional Website ), rfe apnode ), the , un -Women, the ) and SDG s eVALUation Matters Third Quarter 2018

APNODE holds its 4th half-day training session to to utilize as well as demand Annual General Meeting all participants on the topic: evaluation and evaluative and contributes to The Role of Evaluation in evidence to inform decision- EvalColombo 2018 Oversight with Gender as and policy-making. a Cross-cu+ing Theme. The African Find out more: Parliamentarians’ Network On 17-19 September, a Press Release: APNODE holds its 4th on Development Evaluation four-member delegation Annual General Meeting in Libreville, Gabon (apnode) held its 4th Annual from apnode was among Web story: APNODE contributes to EvalColombo 2018 General Meeting (agm) the more than 40 African in Libreville, Republic of participants at the Global About APNODE Gabon, from 8-10 August Parliamentarians Forum 2018. Victorien Alouba, for Evaluation (gpfe) 4th Vice-President of the EvalColombo2018 in Colombo, Senate of Gabon opened the Sri Lanka. In addition to key agm and emphasized the contributions throughout importance of evaluation as the event, at the closing a powerful tool to improve ceremony, apnode was thrust the effectiveness of public center stage during a panel on policies and programs. the ‘importance of evaluation’ Hosted by the Parliament of where delegate Hon. Mpagi- Gabon, the event a+racted Kaabule highlighted the over 60 delegates from centrality of evaluation 18 countries. The agm, in in Africa parliaments. In line with its commitment her remarks, Hon. Mpagi- to capacity development, Kaabule emphasized the invited the Regional Centers significant role apnode has, for Learning on Evaluation and continues to play, on the and Results (clear-aa) African continent in the drive and un-Women to deliver a to convince parliamentarians

News in pictures 83 eVALUation Matters Third Quarter 2018

Capitalization Workshop particular attention to deployed PBOs worth UA on Evaluations of the the lessons learned and 7.2 billion (USD 10.2 billion). Bank’s Program Based agreeing on the key actions Operations (pbos) for the Bank going forward. Find out more:

Web story: Capitalization Workshop On Wednesday 26th PBOs, formerly known as on Evaluations of the Bank’s Program September 2018, a “policy based operations” Based Operations (PBOs) Capitalization Workshop and popularly known Independent Evaluation of AfDB's Program Based Operations (2012-2017) was held at the AfDB as budget support, are in Abidjan, to share the financing instruments used results of the two project by the AfDB to provide cluster evaluations with funds directly to a country’s Bank staff who design and treasury to support the implement Program Based national budget. The Operations (PBOs). The PBO modalities that are aim of the workshop was to used by the Bank include give staff the opportunity General Budget Support, to discuss the results of Sector Budget Support, and the evaluations, which Crisis Response Budget focus on the use of PBOs in Support. From 2012, when the energy sector and for the Bank’s PBO Policy was strengthening the private approved, to 2017, it has sector environment, paying

84 News in pictures eVALUation Matters Third Quarter 2018

IDEV Participates in making in Africa, gathering Evidence 2018 Conference researchers, evaluators, NGOs, and policy- and On 25-28 September, decision-makers. The the Africa Evidence 2018 conference program Network (AEN) organized focused on four areas of a conference on the use priority in Africa: quality of evidence in decision- education, communicable making in Africa in Pretoria, diseases, climate resilience, South Africa. IDEV’s and good governance. Acting Evaluator General Karen Rot-Münstermann Find out more: was there and made a Website: Evidence 2018 presentation on how evidence is used in the AfDB decision making cycle, looking at evidence enablers and key decision points.

The biennial Evidence Conferences are some of the biggest platforms for evidence-informed decision

News in pictures 85 idev Annual Report 2017 agenda, in order to achieve greater development results. This IDEV Annual Report focuses on its work in 2017, Find out more:

particularly the key messages Annual Report 2017 and recommendations Video: Annual Report 2017 from IDEV 2017 evaluations, and how this work helps the Bank to improve its operational and institutional effectiveness. The theme, “Ge+ing to Results,” reflects IDEV’s commitment to strengthen the institution’s evaluative learning through knowledge that is timely, useful, and adapted to the Bank’s development

Independent Evaluation forward for the CBFF; and (iii) to of the Congo Basin ensure accountability for CBFF Forest Fund investments in several key results areas towards donors, the AfDB IDEV has undertaken an Board, and the Central Africa evaluation of the Congo Forest Commission (comifac). Basin Forest Fund (CBFF), a ten-year program Recommendations: established in 2008. The CBFF aims at alleviating The evaluation recommends poverty and mitigating that the CBFF and its Governing climate change by reducing Council should ensure a full and the rate of deforestation in considered completion phase for the Congo Basin through the fund, and that the secretariat the efficient management should invest in capturing and of its forest resources. capitalizing on all lessons learned from the CBFF’s innovations and The main purpose of this achievements. Furthermore, it independent evaluation of recommends that, should the the CBFF is threefold: (i) to fund continue or if the African provide learning from the Development Bank uses a similar Fund’s implementation – trust fund model, it should: what worked and what did not work, and why?; (ii) to ❚ Analyze how the political and inform decisions of the international environment has donors, CBFF Governing changed from 2008 to 2018; Council and AfDB Board ❚ Increase AfDB ownership and Hot off the Press of Directors on the way governance of the trust fund; eVALUation Matters Third Quarter 2018

❚ Coordinate with national ❚ Improve performance

agendas related to measurement Independent Development Evaluation African Development Bank

the United Nations and reporting. From experience to knowledge... From knowledge to action... Collaborative Program From action to impact on Reducing Emissions Find out more: from Deforestation Full Report and Forest Degradation Report Brief in Developing Countries (redd+),

climate resilience and Independent Evaluation sustainable forest and of the Congo Basin Thematic Evaluation

Forest Fund An IDEV landscape management; Summary Report ❚ Tailor operations and procedures; July 2018 ❚ Improve communications; and

Mid-Term Evaluation the Bank approved and ❚ Develop a results- of Guinea Bissau implemented 10 operations based approach for Country Strategy and that were worth over capacity development Program 2015-2019 USD 60 million. in the country; ❚ Increase its overall IDEV has conducted its first Recommendations presence in the country; ever mid-term evaluation, ❚ Mainstream gender that of the AfDB’s Country The evaluation draws in project design. Strategy and Program in a number of strategic Guinea-Bissau for the period and operational lessons, Find out more:

2015–2019. Implemented in and recommends that Full Report a context of fragility, the the Bank should: Executive Summary Strategy aims to contribute to national stability and ❚ Adapt its assistance to economic recovery through the particular context two pillars: strengthening of Guinea-Bissau, the foundations of including adapting the State and building the Bank’s processes infrastructure that promotes such as procurement inclusive development. and disbursement to the country’s The main objective of the needs, and increasing mid-term evaluation was the resources and to assess the performance the attention paid of the first phase of to the country; the Strategy (2015-2017) ❚ Show proof of and to seek lessons that innovation in could inform both the the next CSP by implementation of the adopting a program- second phase as well as the based approach; preparation of the next ❚ Improve the quality Country Strategy Paper. of its portfolio in In the period 2015-2017, Guinea-Bissau;

Hot off the Press 87 Have you checked out the AfDB Evaluation Results Database (EVRD)?

evrd.afdb.org

Access over 844 evaluation documents, 3,078 recommendations and 2,729 lessons learned in one central place

Filter your results by report type, sector, region and country

Each evaluation in the EVRD provides a quick overview of the program, project, or policy under scrutiny; the evaluation f ndings and recommendations as well as the link to the full report. Design: www.creondesign.net Design:

The EVRD is maintained by Independent Development Evaluation (IDEV). Past issues

eVALUation Matters A Quarterly Knowledge Publication on Development Evaluation Second Quarter 2018: Building supply and demand for evaluation in Africa (Volume 2) Supply and demand is perhaps one of the most fundamental concepts of economics and serves as the backbone of a market economy. This concept is easily transferable to the governance of countries and institutions where the practice of monitoring and evaluation Building supply and demand for evaluation in Africa (M&E) serves as one of the most important tools for accountability, lesson learning and results Volume 2 orientation. The supply and demand of evaluation actors, institutions, systems and processes in Africa is critical for the improvement in good governance and achievement of development Second Quarter 2018 results.

http://idev.afdb.org/en/document/building-supply-and-demand-evaluation-africa-vol-2

First Quarter 2018: Building supply and demand for evaluation in Africa (Volume 1) Evaluation plays a critical role in the effective implementation of good governance structures in Africa, in promoting accountability, learning, development effectiveness, and sustained and rapid economic growth. Yet the supply of and demand for evaluation is still relatively low in most African countries. In this edition of Evaluation Matters, we look at the issues that need to be addressed in building the supply and demand of evaluation in the continent.

http://idev.afdb.org/en/document/building-supply-and-demand-evaluation-vol-1

Fourth Quarter 2017: Evaluation as a driver of reform in IFIs What is the added value of independent evaluation focused not on projects and programs but on organizations themselves? Does it help organizations deliver more and better? Does evaluation evidence have any impact on the way development organizations are managing themselves? In this edition of Evaluation Matters, find the answers to all these questions and many more.

http://idev.afdb.org/en/document/evaluation-driver-reform-ifis

Third Quarter 2017: Evaluation in the era of the SDGs This issue of Evaluation Matters is dedicated to evaluating the Sustainable Development Goals (SDGs). It discusses the consequences of the paradigm shift from the MDGs to the SDGs and what the world of evaluation should do differently in this new era. Evaluation is acknowledged in Agenda 2030 as crucial to the follow-up and review processes for SDG progress, and evaluators can, and should, make a real difference to SDG achievements by helping point in the right direction for investment efforts.

h'p://idev.afdb.org/en/document/evaluation-era-sdgs

Evaluation Week 5–7 September | 2018 Abidjan, Côte d’Ivoire Strengthening development impact idev.afdb.org

African Development Bank Group Avenue Joseph Anoma, 01 BP 1387, Abidjan 01, Côte d’Ivoire Phone: +225 20 26 20 41 E-mail: [email protected]