Good Practices for Integrating Gender Equality and Human Rights in Evaluation
Total Page:16
File Type:pdf, Size:1020Kb
Good practices for integrating gender equality and human rights in evaluation Working Group on Gender Equality and Human Rights Cover Photo: Joseph Barnes/ImpactReady Foreword Photo: Pathumporn Thongking/UN Women Foreword The UNEG Working Group on Gender Equality and Human Rights has been working to support UNEG members to enhance integration of gender equality and human rights in evaluation systems and practice. We have now reached a point where many good practices are being employed across UNEG members and this publication on Good Practices for Integrating Gender Equality and Human Rights in Evaluation is an effort to capture these and facilitate learning. This publication on Good Practices was designed to provide a snapshot of the good practice and point readers to the evaluation report for more information. The guide identifies 17 good practices from 12 UNEG members representing a variety of UN organizations (i.e. Secretariat, Funds and Programmes, etc.). Although this guide does not capture all the good practices being employed by UNEG Prepared for the UNEG Working Group members, it is a useful tool for raising on Gender Equality and Human Rights awareness on different approaches and will hopefully contribute to a common April 2017 understanding on how to integrate gender equality and human rights in evaluation Designed and written by practice within the UN system and beyond Joseph Barnes – particularly important in the context of ImpactReady LLP achieving the Sustainable Development Goals. Contact Sabrina Evangelista I wish you an enjoyable read! Co-Chair UNEG Working Group on GE&HR & Evaluation Specialist, Independent Marco Segone Evaluation Office, UN Women UNEG Chair [email protected] Contents TERMS OF REFERENCE METHODS & TOOLS Mainstreaming gender in evaluation 6 Examining policy norms and operational 17 policy objectives for gender Including specific gender questions in 7 Having a team member dedicated to 18 every terms of reference community consultation Quantifying gender equality to bridge 19 world views Mixing bottom-up and top-down analysis 20 FINDINGS, CONCLUSIONS SCOPE & INDICATORS & RECOMMENDATIONS Including a specific background section 9 Applying gender analysis across 22 on gender equality all findings, conclusions and recommendations Mixed qualitative and quantitative 10 indicators on gender equality Examining institutional requirements to 23 support gender mainstreaming Thematic indicators responsive to 11 gender equality CRITERIA & QUESTIONS EVALUATION SYSTEMS Mainstreaming gender in efficiency 13 Meta synthesis of gender in centralised 25 evaluations Mixed teams with intersectional diversity 14 Independent assessment of the quality 26 Using gender-disaggregated 15 of decentralised evaluations administrative data in evaluation Towards a checklist for the UN-SWAP 27 evaluation performance indicator 3 Introduction The UNEG Working Group on Gender Equality and Human Rights (GE & HR) supports UNEG members to enhance integration of GE & HR in evaluation in accordance with the Norms and Standards for Evaluation in the UN System. The UNEG Taskforce developed Guidance on Integrating Human Rights and Gender Equality in Evaluation (2014) and supports reporting on the Evaluation In 2016, the UNEG Working Group on GE Performance Indicator (EPI) of the United & HR published an Independent Review Nations System Wide Action Plan for Gender of UN-SWAP Evaluation Performance Equality and Empowerment of Women Indicator Reporting (2016) that (UN-SWAP) through the development independently assessed 46 evaluation of the Technical Note and Scorecard, reports from across 23 UN entities against annual reporting trends, other supporting the UN-SWAP EPI criteria and identified good documents, and facilitating learning via practices. The current publication on Good webinar and during the annual UNEG Practices is a follow-up to the Independent evaluation week. Review. It provides a snapshot of good practices, links to the evaluation reports, and The UN-SWAP constitutes the first is organized around the current EPI criteria accountability framework for gender for assessing evaluation reports (see Table mainstreaming in the UN system and is 1) as a means for further supporting UNEG mandated by the Economic and Social members to “meet requirements”. Council (ECOSOC). In 2016, UN-SWAP 2.0 was finalized, which will result in a Although this publication does not capture revised UN-SWAP framework to be rolled all the good practices that have been out in 2018. The UN-SWAP framework is employed by UNEG members, it provides an accompanied by a set of Technical Notes for overview of different types of actions being each Performance Indicator. The Technical undertaken by the diverse members that Note and Scorecard for the Evaluation constitute UNEG. It aims to facilitate learning Performance Indicator aims to support within UNEG and beyond and contribute to a more systematic and harmonized reporting common understanding on how to integrate through a common tool that allows for gender equality in evaluation practice within improved comparability across UN entities the UN system and beyond. Hopefully, this based on assessment of the evaluation will be the first of a series of Good Practice report. publications. UN-SWAP Evaluation Performance Indicator criteria for assessing evaluation reports GEEW is integrated in the evaluation scope of analysis and evaluation indicators are designed Criteria 1 in a way that ensures GEEW-related data will be collected. GEEW is integrated in evaluation criteria and evaluation questions specifically address how Criteria 2 GEEW has been integrated into the design, planning, implementation of the intervention and the results achieved. A gender-responsive methodology, methods and tools and data analysis techniques are Criteria 3 selected. Criteria 4 The evaluation findings, conclusions and recommendations reflect a gender analysis. 4 Terms of Reference • The TOR indicates both duty bearers and rights holders (particularly women and other groups subject to discrimination) as primary users of the evaluation and how they will be involved in the evaluation process. • The TOR spells out the relevant instruments or policies on human rights and gender equality that will guide the evaluation process. • The TOR includes an assessment of relevant human rights and gender equality aspects through the selection of the evaluation criteria and questions. • The TOR specifies an evaluation approach and data collection and analysis methods that are human rights based and gender sensitive and for evaluation data to be disaggregated by sex, ethnicity, age, disability, etc. • The TOR defines the level of expertise needed among the evaluation team on gender equality and human rights and their responsibilities in this regard and calls for a gender balanced and culturally diverse team that makes use of national/regional evaluation expertise. UNEG Checklist for Terms of Reference Photo: Dana Smillie/World Bank “The Terms of Reference specifies how a human rights and gender perspective will be incorporated in the evaluation design.” 5 Working with the in- house Gender, Equality and Diversity Branch 1 to mainstream gender across all evaluation ILO policy guidance THE CHALLENGE HINTS & TIPS With a small and newly-independent central In addition to ensuring that gender is evaluation function, ILO needed to find a means mainstreamed in the standards and guidance to ensure that a large number of decentralized for evaluation managers (which are quality independent evaluations were integrating gender assured by senior evaluation officers during equality commitments. the evaluation process), the joint work with the gender branch led to further collaboration – including representing the evaluation THE RESPONSE work of ILO to the wider UN-SWAP process, and mainstreaming gender into a specialist evaluation manager training programme offered Working with the Gender, Equality and Diversity to ILO constituents and social partners by the Branch of ILO, the Evaluation Office ensured International Training Centre, Turin. that all new guidance – including checklists for terms of reference – included mainstreaming of gender equality in practical requirements that could be understood by non-specialist evaluation managers. “Include specific reference to cross-cutting gender issues, I-eval Resource Kit International Labour Organization – Evaluation Unit Checklist 1 addressing: A brief overview of the political, economic and social environment within which the evaluation will be taking place. • Relevance: How the intervention’s design and Reference to any previous evaluations and reviews. implementation contributed (or not) toward the ILO goal 3. PURPOSE AND OBJECTIV ES OF THE EVALUATION Clear statement of why the evaluation is being conducted and justification for its timing. of gender equality, international and regional gender Identification of the expected outcomes of the evaluation. equality conventions, and national gender policies and Identification of the primary and secondary users of the evaluation (key users and target audiences; clients and main audience). strategies; Brief statement of how the evaluation will be used. Ensure that issues and inputs from stakeholders / tripartite constituents are being adequately covered in the objectives of the evaluation. See Guidance Note 7: Stakeholder participation for further information on this. • Effectiveness: Extent to which intervention results 4. EVALUATION SCOPE were defined,