Agenda Evaluation 2030

Empowered lives. Resilient nations. EVALUATION FORAGENDA2030 PROVIDING EVIDENCE ON PROGRESS AND SUSTAINABILITY Rob D. van den Berg Indran Naidoo Susan D. Tamondong Editors M E N T E P V A L O L E U V A E T I D O L N A A N S O S I O T C A I N A R T E I O T N N I IDEAS KNOWLEDGE CAPACITY DEVELOPMENT NETWORKING Evaluation for Agenda 2030 Evaluation for Agenda 2030 PROVIDING EVIDENCE ON PROGRESS AND SUSTAINABILITY EDITORS Rob D. van den Berg King’s College London and International Development Evaluation Association (IDEAS), Leidschendam, the Netherlands Indran Naidoo Independent Evaluation Office, United Nations Development Programme, New York Susan D. Tamondong UN Women Global Evaluation Advisory Council, New York, and International Development Evaluation Association (IDEAS), Manila, Philippines M E N T E P V A L O L E U V A E T I D O L N A A N S O S I O T C A I N A R T E I O T N N I IDEAS Empowered lives. KNOWLEDGE CAPACITY DEVELOPMENT NETWORKING Resilient nations. © 2017 International Development Evaluation Association (IDEAS) Exeter, United Kingdom Email: [email protected] All rights reserved. Any views expressed in this book are those of the authors. They do not necessarily represent the views of IDEAS, the editors, the authors’ institutions, financial sponsors, or reviewers. This book is distributed under the terms of the Creative Commons Attribution 4.0 International License (CC BY NC-ND 4.0), https://creativecommons.org/licenses/ by-nc-nd/4.0/. This license permits any noncommercial use, duplication, adaptation, dis- tribution, and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source. Please cite the work as follows: Rob D. van den Berg, Indran Naidoo, and Susan D. Tamondong, eds. 2017. Evaluation for Agenda 2030: Providing Evidence on Progress and Sustainability. Exeter, UK: IDEAS. ISBN (paper): 978-1-9999329-0-9 ISBN (electronic): 978-1-9999329-1-6 Cover design: Anne Marie Mascia Interior design/layout: Nita Congress Contents FOREWORD . ix Achim Steiner A READING GUIDE . xi Michael Quinn Patton ACKNOWLEDGMENTS . xix INTRODUCTION . 1 Rob D. van den Berg, Indran Naidoo, and Susan D. Tamondong, editors Part I. Overview and Introduction.............. 7 1 . EVALUATING SUSTAINABLE DEVELOPMENT . 9 Vinod Thomas 2 . NO ONE LEFT BEHIND - A FOCUS ON GENDER AND SOCIAL EQUITY . 23 Marco Segone and Florencia Tateossian 3 . EVALUATION FOR IMPROVING PEOPLE'S LIVES . 35 Mallika R. Samaranayake and Asela Kalugampitiya vi Evaluation for Agenda 2030: Providing Evidence on Progress and Sustainability Part II. Capacities and Capabilities ............49 4 . INCORPORATING THE SUSTAINABLE DEVELOPMENT GOALS IN NATIONAL EVALUATION CAPACITY DEVELOPMENT . 51 Indran Naidoo and Ana Rosa Soares 5 . PROFESSIONALIZING EVALUATION - A GOLDEN OPPORTUNITY . 65 Linda Morra Imas 6 . FROM EVALUATION CAPACITY BUILDING TO EVALUATION CAPACITY DEVELOPMENT - A PARADIGM SHIFT . 81 Michele Tarsilla 7 . MENTORING EMERGING EVALUATORS - SHARING EXPERIENCES FROM THE GLOBAL SOUTH . 103 Awuor Ponge, Taiwo Peter Adesoba, Ahmed Tammam, and Tara Devi Gurung Part III. Regional Perspectives ...............117 8 . EVALUATING SUSTAINABLE DEVELOPMENT IN SIDS - LESSONS FROM THE PACIFIC AND THE CARIBBEAN . 119. Juha I. Uitto, Jeremy Kohlitz, and David Todd 9 . EVALUATION STANDARDS FOR LATIN AMERICA AND THE CARIBBEAN - EXPERIMENTATION AND EVOLUTION . 135 Ana Luisa Guzmán and Warren Crowther 10 . THE ROLE OF MONITORING AND EVALUATION IN THE MENA REGION, WITH A FOCUS ON THE ARAB UPRISING COUNTRIES . 155 Sonia Ben Jaafar and Awny Amer 11 . LEVERAGING MONITORING AND EVALUATION SYSTEMS FOR GOOD GOVERNANCE . 169 Rashmi Agrawal, Asela Kalugampitiya, Jigmi Rinzin, and Kabir Hashim Contents vii 12 . INTEGRATING FEMINIST APPROACHES TO EVALUATION - LESSONS LEARNED FROM AN INDIAN EXPERIENCE . 187 Rajib Nandi and Rituu B. Nanda 13 . EVALUATION COOPERATION IN WEST AFRICA . 205 Abdoulaye Gounou Part IV. Safeguards and Resettlement .......217 14 . ENVIRONMENTAL AND SOCIAL SAFEGUARDS IN INDIA - A CRITICAL ASSESSMENT . 219 Shekhar Singh 15 . THE IMPERFECT USE OF THE PAST IN RESETTLEMENT . 239 Inga-Lill Aronsson 16 . EVALUATING THE BENEFITS AND COSTS OF RESETTLEMENT PROJECTS - A CASE STUDY IN THE PHILIPPINES . 257 Marife M. Ballesteros 17 . LIVELIHOODS IN DEVELOPMENT DISPLACEMENT - A REALITY CHECK FROM THE EVALUATION RECORD IN ASIA . 273 Susanna Price Part V. Toward Sustainability of Impact......291 18 . NEW FRONTIERS FOR EVALUATION IN A FAST-CHANGING WORLD . 293 Chris Barnett and Rachel Eager 19 . RISING TO THE CHALLENGES OF IMPACT EVALUATION - INSIGHTS FROM PILOTING A SYSTEMIC AND PARTICIPATORY APPROACH . 311 Adinda Van Hemelrijck viii Evaluation for Agenda 2030: Providing Evidence on Progress and Sustainability 20 . EVALUATING MITIGATION PROJECTS THROUGH A THEORY OF NO CHANGE . 335 Takaaki Miyaguchi 21 . THE WICKED CASES OF EDUCATION AND CLIMATE CHANGE - THE PROMISE AND CHALLENGE OF THEORY-BASED IMPACT EVALUATIONS . 347 Emmanuel Jimenez and Jyotsna Puri 22 . MEASURING THE IMPACT OF THE EXTRACTIVE INDUSTRY'S DEVELOPMENT PROJECTS . 371 Gwendolyn Wellmann CONTRIBUTORS . 389 Foreword ince 2015, when the Sustainable Development Goals (SDGs) were adopted and the Paris Agreement was concluded, the concept of devel- Sopment has transformed in two major directions. First, the old distinction between “developing” and “developed” countries has disappeared in the face of global threats, particularly of climate change. All countries are now per- ceived as “developing” toward a sustainable, equitable, and inclusive future. Second, the scope and ambition of development in the coming decades has grown dramatically, and has now integrated the peace and conflict agenda as well as humanitarian efforts in response to natural disasters, including a focus on ecosystem services that are essential for humankind to survive. To tackle these issues, the traditional social and economic development agendas are changing beyond recognition, with innovation, new partnerships, and efforts focused on green societies and economies taking shape. Into this mix of change and ambitious perspectives, evaluation is challenged to provide evidence on what works, where, for whom, and under what circumstances in a labyrinth of new policies, program, and interventions. This book provides inspiration for an emerging new role for evaluation in the global push toward a sustainable, equitable, and inclusive world. The Independent Evaluation Office of the United Nations Develop- ment Programme (UNDP) and the International Development Evaluation Association (IDEAS) are to be applauded for their initiative to start up the discussion on the role of evaluation in the SDGs just a month after these goals were approved. They organized two conferences that took place in parallel, with joint keynote addresses and special sessions: one from the perspective of governments, the other from the perspective of the profes- sional development evaluator. These conferences took place in Bangkok, Thailand, in October 2015. They ended with the Bangkok Declaration on National Evaluation Capacity for the Sustainable Development Goals, which was subsequently included in the Global Evaluation Agenda 2016–2020. While conference proceedings were published in 2016, IDEAS and UNDP’s Independent Evaluation Office also approached the most innovative and x Evaluation for Agenda 2030: Providing Evidence on Progress and Sustainability forward-thinking contributors to the conference to update their insights for this book, which provides a stimulating array of subjects. This is of the utmost importance. We need to understand the way forward on the many challenges in the SDGs. If we truly want to “leave no one behind,” we need to learn from our mistakes and from efforts to build inclusive and equitable societies that can sustain themselves, not just economically, but in an endurable relationship with nature. While achieving insight is not just an effort of evaluation, it is one of the few systematic and independent assessments of interventions and innovations that we have. In its best incarnation, it includes perspectives from civil society, the private sector, government at all levels, and academia. In Agenda 2030, evaluation has a rec- ognized role to play in understanding the progress that is made toward the SDGs. It is therefore crucial that the discussion started in Bangkok continues, and this book provides fuel to this fire. This book provides an overview of some of the crucial transforma- tions we see in development, and how evaluation plays an important role in these changes. First and foremost is the shift from donor-centric evaluation to country systems for monitoring and evaluation that can provide evidence for decision making in these countries. The chapters in part I make important points on how evaluation contributes to some of the most significant issues of our time, such as inclusive societies, reducing the carbon footprint of our economies, and gender and equity. Capacities and capabilities for evaluation of progress toward the SDGs are explored in part II. Part III is devoted to regional and national perspectives, underscoring that evaluation is becoming increasingly relevant to countries’ development priorities in many regions of the world. Part IV deals with safeguards and resettlement, and demonstrates the negative impacts of development displacement that governments need to be aware of. The book’s last part addresses some of the enduring prob- lems of evaluation: how to evaluate impact

Load more