Terms of Reference of the

Type of evaluation Project title Project number Country Month Year

Please use the Guidelines for Evaluation ToR on IEU’s website: https://www.unodc.org/unodc/en/evaluation/normative-tools.html consult the IEU Handbook: https://www.unodc.org/unodc/en/evaluation/evaluation-handbook.html or contact IEU directly for more guidance.

Please delete the highlighted parts in yellow in the final version of these ToR – as such are for your guidance and assistance only. Keep all standard text.

Contents Please update the page numbers only Page I. Background and Context 2 II. Disbursement History 5 III. Purpose of the Evaluation 5 IV.Scope of the Evaluation 6 V. Key Evaluation Questions 6 VI.Evaluation Methodology 7 VII. Timeframe and Deliverables 10 VIII. Evaluation Team Composition 13 IX. Management of the Evaluation Process 13 X. Payment Modalities 15 ANNEX I. Terms of Reference for Evaluators 16 ANNEX II. List of background documents for the desk review 22 ANNEX III. List of Sustainable Development Goals and Targets 24 ANNEX IV. List of stakeholders 25

1 I. BACKGROUND AND CONTEXT

Project number: Project title: Duration (dd/mm/yyyy-dd/mm/yyyy): Location: Linkages to Country, Regional and Thematic Programmes: To which UNDAF1 is the project/programme linked to (if any) Executing Agency: Partner Organizations: Total Approved Budget: Total Overall Budget Donors: Project Manager/ Coordinator: Type and time frame of evaluation: (Independent Project Evaluation/In- depth Evaluation/mid-term/final) Time frame of the project covered by the evaluation: Geographical coverage of the evaluation: Budget for this evaluation in USD:

Number of independent evaluators planned for this evaluation2: Type and year of past evaluations (if any): Core Learning Partners3 (entities):

1 United Nations Development Assistance Framework 2 Please note that the minimum for any UNODC evaluation is two independent evaluators, i.e. one lead evaluator and one team member. 3 The CLPs are the main stakeholders, i.e. a limited number of those deemed as particularly relevant to be involved throughout the evaluation process, i.e. in reviewing and commenting on the TOR and the evaluation questions, reviewing and commenting on the draft evaluation report, as well as facilitating the dissemination and application of the results and other follow-up action. Stakeholders include all those to be invited to participate in the interviews and surveys, including the CLPs.

2 Project overview and historical context MAXIMUM LENGTH: 1 PAGE Please also include how gender as well as human rights aspects have been mainstreamed into the project

TextTextText Write your text on top of this in order to create the correct format and style. Main challenges during implementation MAXIMUM LENGTH: 0.5 PAGEs.

TextTextText Write your text on top of this in order to create the correct format and style. Project documents and revisions of the original project document Year Please provide general information regarding the original project document. Project document

Project Year Reason & purpose (max. 2 sentences per Change in revisio revision) (please check) n4

1  Budget  Timefram e  Logframe 2  Budget  Timefram e  Logframe Main objectives and outcomes Please also describe whether or not baselines have been established and used.

TextTextText Write your text on top of this in order to create the correct format and style.

Objective of the project/programme (as per project document/revision): Objective: Performance indicators:

4 Please add further rows as needed

3 Outcomes of the project/programme (as per project document/revision) 5

Outcome 1: Performance indicators: Outcome 2: Performance indicators: Outcome 3: Performance indicators: Outcome 4: Performance indicators: Outcome 5: Performance indicators: Outcome 6: Performance indicators: Contribution to UNODC’s country, regional or thematic programme Contribution to the following UNODC country and regional programmes: 1. TextTextText Write your text on top of this in order to create the correct format and style 2. TextTextText Write your text on top of this in order to create the correct format and style

Contribution to the following thematic programme(s): 1. TextTextText Write your text on top of this in order to create the correct format and style

Linkage to UNODC strategic framework, UNDAFs and to Sustainable Development Goals Kindly specify which target and performance indicator of the SDGs this project or programme contributes to. Further specify, if at all, whether this project has made a contribution to nationally agreed indicators or strategies and how this project is positioned in light of the 2030 agenda. For reference, please use the list of indicators related to SDG goals and targets of which UNODC is the custodian agency in Annex III of this guidance note. In case the project or programme contributes to other SDG targets or indicators other than those listed in Annex III of this guidance note, please

5 Please delete or add rows below as needed for the different outcomes. Do not include outputs.

4 use the classification of SDG targets and indicators included in Annex III of the ECOSOC Report of the Inter-agency and Expert Group on Sustainable Development Goal Indicators (E/CN.3/2017/2*). MAXIMUM LENGTH: 0.5 pages

The Project/Programme contributes to the following Sustainable Development Goals, Targets and Performance Indicators: Relevant UN Sustainable Development Goals6 Target(s) Indicator(s)7 1 - End poverty in all its forms everywhere 1.4 1.4.2 2 - End hunger, achieve food security and improved nutrition and 2.1 2.1.2 promote sustainable agriculture 2.3 2.3.1 2.3.2

Moreover, the Project/Programme contributes to the following UNDAF: XXX

TextTextText Write your text on top of this in order to create the correct format and style. TextTextText Write your text on top of this in order to create the correct format and style.

II. DISBURSEMENT HISTORY Time periods throughout the life time of the Total Approved Expenditur Expenditure in project Budget e % (MMYYYY – MMYYYY) (add the number of rows needed)

Time period Total Expenditure Expenditure in that will be Approved % covered by Budget the evaluation

6 All SDGs and targets can be found here: http://www.un.org/sustainabledevelopment/sustainable-development- goals/ 7 All SDG indicators can be found here: https://unstats.un.org/sdgs/indicators/Global%20Indicator%20Framework_A. RES.71.313%20Annex.pdf

5 (MMYYYY – MMYYYY)

III. PURPOSE OF THE EVALUATION Please outline the reasons behind the evaluation taking place, how the evaluation results will be used (e.g. inform the future development of the project or similar projects, for organizational learning, assess the success and areas of improvement of the project etc.) and include the main users of the evaluation results (e.g. senior management, programme management, stakeholders, beneficiaries, donors etc.). MAXIMUM LENGTH: 0.5 pages

TextTextText Write your text on top of this in order to create the correct format and style

The following DAC criteria will be assessed during the evaluation: relevance, efficiency, effectiveness, impact and sustainability. In addition, established partnerships and cooperation as well as aspects of human rights and gender mainstreaming will be assessed. The evaluation will specifically assess how gender aspects have been mainstreamed into the project. Furthermore, lessons learned and best practices will be identified and recommendations based on the findings formulated. IV. SCOPE OF THE EVALUATION Unit of analysis (full project/programme/ parts of the project/programme; etc.) Time period of the project/programme covered by the evaluation Geographical coverage of the evaluation

V. KEY EVALUATION QUESTIONS Evaluation Criteria The evaluation will be conducted based on the following DAC criteria: relevance, efficiency, effectiveness, impact and sustainability, as well as design, partnerships and cooperation, human rights, gender equality and leaving no one behind as well as lesson learned and best practices. The questions will be further refined by the Evaluation Team.

Please formulate evaluation questions (max 1-2 per criteria) that are both comprehensive as well as specific and relevant to the project/ programme. Consider which information is required to satisfy the purpose of the evaluation; take into

6 consideration if this is a mid-term (formative) or final (summative) evaluation; etc. Please also note that the evaluation questions should be worded in a gender-responsive manner, e.g. asking for sex-disaggregated information.

Design The Design of a project or programme measures the extent to which the logical framework approach was adopted. 1. 2. Relevance Relevance is the extent to which the activity is suited to the priorities and policies of the target group, recipient and donor. 3. 4. To what extent are the outputs, outcomes and objectives of this project/programme relevant to implementing the Sustainable Development Goals? Efficiency Efficiency measures the outputs - qualitative and quantitative - in relation to the inputs. 5. 6. Effectiveness Effectiveness is a measure of the extent to which an aid activity attains its objectives. 7. 8. Impact Impact is the positive and negative changes produced by a development intervention, directly or indirectly, intended or unintended. 9. 10. To what extent did the project/programme contribute to the Sustainable Development Goals? Sustainability Sustainability is concerned with measuring whether the benefits of an activity are likely to continue after donor funding has been withdrawn. 11. 12. Partnerships and cooperation The evaluation assesses the partnerships and cooperation established during the project/ programme as well as their functioning and value. 13. 14. To what extent is the project/programme cooperating with other potential partners (including UN agencies, CSOs, academia, etc.) to contribute to the achievement of the SDGs? Human rights, gender equality, and leaving no one behind The evaluation needs to assess the mainstreaming throughout the project/programme of human rights, gender equality, and the dignity of individuals, i.e. vulnerable groups.

Human Rights

7 15. To what extent were human rights considerations included in the project design and implementation? 16. Gender Equality 17. To what extent were gender equality considerations included in the project design and implementation? 18. Leaving no one behind (optional) 19. To what extent were under-represented and vulnerable groups included in the project design and implementation? Lessons learned and best practices Lessons learned concern the learning experiences and insights that were gained throughout the project/ programme. 20. To what extent did the project/programme implement recommendations of relevant previous evaluation(s)? 21.

VI. EVALUATION METHODOLOGY All evaluations of the United Nations system are guided by the principles of human rights, gender equality, and leaving no one behind. Gender-sensitive evaluation methods and gender-sensitive data collection techniques are therefore essential in order to identify key gender issues, address marginalized, hard-to-reach and vulnerable population, as well as to define strategies for developing appropriate data bases for better gender analysis in future project planning. Please adapt, if needed, the below standard text to your specific project/programme.

The methods used to collect and analyse data This evaluation will use methodologies and techniques as determined by the specific needs for information, the questions set out in the TOR and the availability of stakeholders. In all cases, the evaluation team is expected to analyse all relevant information sources, such as reports, programme documents, thematic programmes, internal review reports, programme files, evaluation reports (if available), financial reports and any other documents that may provide further evidence for triangulation, on which their conclusions will be based. The evaluation team is also expected to use interviews, surveys or any other relevant quantitative and/or qualitative tools as a means to collect relevant data for the evaluation. While maintaining independence, the evaluation will be carried out based on a participatory approach, which seeks the views and assessments of all parties identified as the key stakeholders of the project/ programme, the Core Learning Partners (CLP).

The present ToR provide basic information as regards to the methodology, which should not be understood as exhaustive. It is rather meant to guide the evaluation team in elaborating an effective, efficient, and appropriate evaluation methodology that should be proposed, explained and justified in the Inception Report.

In addition, the evaluation team will be asked to present a summarized methodology (including an evaluation matrix) in the Inception Report outlining the evaluation criteria, indicators, sources of information and methods of data collection. The

8 evaluation methodology must conform to the United Nations Evaluation Group (UNEG) Norms and Standards as well as the UNODC Evaluation Policy, Norms and Standards.

While the evaluation team shall fine-tune the methodology for the evaluation in an Inception Report, a mixed-methods approach of qualitative and quantitative methods is mandatory due to its appropriateness to ensure a gender-sensitive, inclusive methodology. Special attention shall be paid to an unbiased and objective approach and the triangulation of sources, methods, data, and theories. Indeed, information stemming from secondary sources will be cross-checked and triangulated through data retrieved from primary research methods. Primary data collection methods need to be gender- sensitive as well as inclusive.

The credibility of the data collection and analysis are key to the evaluation. Rival theories and competing explanations must be tested once plausible patterns emerge from triangulating data.

The limitations to the evaluation need to be identified and discussed by the evaluation team in the Inception Report, e.g. data constraints (such as missing baseline and monitoring data). Potential limitations as well as the chosen mitigating measures should be discussed.

When designing the evaluation data collection tools and instruments, the evaluation team needs to consider the analysis of certain relevant or innovative topics in the form of short case studies, analyses, etc. that would benefit the evaluation results.

The main elements of the evaluation process are the following:  Preliminary desk review of all relevant project documentation, (Annex II of the evaluation ToR), as provided by the Project Manager and as further requested by the evaluation team, as well as relevant external documents (e.g. UNDAFs; SDGs; UN and global/regional strategies; etc.);  Preparation and submission of an Inception Report (containing preliminary findings of the desk review, refined evaluation questions, data collection instruments, sampling strategy, limitations to the evaluation, and timetable) to IEU for review and clearance before any field mission may take place;  Initial meetings and interviews with the Project Manager and other UNODC staff as well as stakeholders during the field mission;  Interviews (face-to-face or by telephone/skype), with key project stakeholders and beneficiaries, both individually and (as appropriate) in small groups/focus groups, as well as using surveys, questionnaires or any other relevant quantitative and/or qualitative tools as a means to collect relevant data for the evaluation;  Analysis of all available information;  Preparation of the draft evaluation report (based on Guidelines for Evaluation Report and Template Report to be found on the IEU website http://www.unodc.org/unodc/en/evaluation/index.html). The lead evaluator submits the draft report to the Project Manager for the review of factual errors (copying IEU) and the Project Manager shares with IEU for review, comments and clearance. Subsequently the Project Manager shares the final draft report with all CLPs for comments.  Preparation of the final evaluation report and an Evaluation Brief (2-pager). The evaluation team incorporates the necessary and requested changes and finalizes

9 the evaluation report in accordance with the feedback received from IEU, the Project Manager and CLPs. It further includes a PowerPoint presentation on final evaluation findings and recommendations;  Presentation of final evaluation report with its findings and recommendations to the target audience, stakeholders etc. (in person or if necessary through Skype).  In conducting the evaluation, the UNODC and the UNEG Evaluation Norms and Standards are to be taken into account. All tools, norms and templates to be mandatorily used in the evaluation process can be found on the IEU website: http://www.unodc.org/unodc/en/evaluation/index.html.

The sources of data The evaluation will utilize a mixture of primary and secondary sources of data. The primary sources include, among others, interviews with key stakeholders (face-to-face or by telephone), the use of surveys and questionnaires, field missions for case studies, focus group interviews, observation and other participatory techniques. Secondary data sources will include project documents and their revisions, progress and monitoring reports, external reports and strategies (e.g. UNDAFs; SDGs; country/regional/global strategies; etc.) and all other relevant documents, including visual information (e.g. eLearning, pictures, videos, etc.).

Desk Review The evaluation team will perform a desk review of all existing documentation (please see the preliminary list of documents to be consulted in Annex II of the evaluation ToR). This list is however not to be regarded as exhaustive as additional documentation may be requested by the evaluation team. The evaluation team needs to ensure that sufficient external documentation is used for the desk review.

Phone interviews / face-to-face consultations The evaluation team will conduct phone interviews / face-to-face consultations with identified individuals from the following groups of stakeholders:  Member States (including recipients and donors);  relevant international and regional organizations;  Non-governmental organizations working with UNODC;  UNODC management and staff at HQ and in the field;  Etc.

Questionnaire A questionnaire (on-line) is to be developed and used in order to help collect the views of additional stakeholders (e.g. trainees, counterparts, partners, etc.), if deemed appropriate.

VII. TIMEFRAME AND DELIVERABLES Duties Time Location Deliverables frame

10 Desk review and DDMMYYYY – Home base Draft Inception report in drafting of Inception DDMMYYYY line with UNODC Report (XX working evaluation norms and days for lead standards8 evaluator and XX for team member) (minimum 12 working days for lead evaluator and 10 for team member) Review of draft DDMMYYYY – Comments on the draft Inception Report by DDMMYYYY Inception Report to the IEU (1 week for evaluation team IEU review)

Incorporation of DDMMYYYY – Home base Revised draft Inception comments from IEU DDMMYYYY Report (can entail various (XX w/d for rounds of comments lead evaluator from IEU) and XX for team member) (minimum 3 w/d for lead evaluator and 2 for team member) (1 week for IEU review) Deliverable A: Final By Final Inception report Inception Report in DDMMYYYY to be cleared by IEU at line with UNODC (overall XX least one week before evaluation norms, w/d for lead the field mission can standards, evaluator get started guidelines and and XX for templates team member) 4-6 weeks Evaluation mission: DDMMYYYY – UNODC/HQ; Interviews and data briefing, interviews DDMMYYYY collection with staff at UNODC (XX w/d for Countries/Cit HQ/FO (including by lead evaluator ies phone/skype); and XX w/d observation; focus for team groups; presentation of member) preliminary observations (if

8 https://www.unodc.org/unodc/en/evaluation/normative-tools.html#Inception_Report

11 applicable)

Drafting of the DDMMYYYY – Home base Draft evaluation report evaluation report; DDMMYYYY submission to Project (XX w/d for Management and IEU; lead evaluator and XX for team member) (minimum 15 w/d for lead evaluator and 13 for team member) Review of IEU for DDMMYYYY – Comments on the draft quality assurance and DDMMYYYY evaluation report to the Project Management (2 weeks for evaluation team for factual errors review)

Consideration of DDMMYYYY – Home base Revised draft evaluation comments from the DDMMYYYY report project manager and (XX w/d for incorporation of lead evaluator comments from IEU and XX for (can entail various team member) rounds of comments (minimum 6 from IEU) w/d for lead evaluator and 4 for team member + 1 week for IEU review) Deliverable B: Draft By Draft evaluation Evaluation Report DDMMYYYY report, to be cleared by in line with UNODC (overall XX IEU evaluation norms, w/d for lead standards, evaluator guidelines and and XX for templates team member) 9-13 weeks IEU to share draft DDMMYYYY – Comments of CLPs on the evaluation report with DDMMYYYY draft report Core Learning Partners (2 weeks) for comments

Consideration of DDMMYYYY – Home base Revised draft evaluation

12 comments from Core DDMMYYYY report Learning Partners and (XX w/d for preparation of draft lead evaluator Evaluation Brief and XX for team member) (minimum 3 w/d for lead evaluator and 1 for team member) Final review by IEU; DDMMYYYY – Home base Revised draft evaluation incorporation of DDMMYYYY report; draft Evaluation comments and (XX w/d for Brief finalization of report lead evaluator and Evaluation Brief and XX for (can entail various team member) rounds of comments (minimum 3 from IEU) w/d for lead evaluator and 2 for team member + 1 week for IEU review) Presentation of Tentative: Presentation of evaluation evaluation results (to be DDMYYYY results reviewed and cleared by (XX w/d for IEU) lead evaluator) (minimum 1 w/d for lead evaluator) Deliverable C: Final By Final evaluation evaluation report; DDMMYYYY report; Evaluation presentation of (overall w/d Brief and presentation evaluation results; for lead of evaluation results, Evaluation Brief (2- evaluator both to be cleared by pager) and XX for IEU team member) 4-6 weeks

Project By Final Evaluation Follow- Management: DDMMYYYY up Plan to be cleared by Finalise Evaluation 4-6 weeks IEU Follow-up Plan in ProFi

Project By Final evaluation report Management: DDMMYYYY disseminated to internal Disseminate final and external stakeholders evaluation report

13 IEU: facilitate the external Evaluation Quality Assessment of the Final Report

The UNODC Independent Evaluation Unit may change the evaluation process, timeline, approach, etc. as necessary at any point throughout the evaluation-process.

VIII. EVALUATION TEAM COMPOSITION Kindly specify the number and the respective role of the evaluators (lead evaluator, team member/second evaluator/expert, international/national etc.). International as well as gender balanced teams are recommended. Minimum number for any evaluation is one lead evaluator and one team member. The lead evaluator must have expertise in evaluation and one of the team members expertise in the subject area of the project to be evaluated. At least one of the evaluators must have expertise in human rights and gender equality.

Please note that IEU must be consulted regarding the composition of the evaluation team. IEU will provide the evaluator data base to be used and will review proposed candidates as well as clear the final selection before any recruitment can take place.

The evaluation team will report exclusively to the Chief or Deputy Chief of the UNODC Independent Evaluation Unit.

Role Number of consultants/ Specific expertise required10 evaluators9 (national/international) Team 1 (international/national Evaluation methodology leader consultant) Team XXX (international/national XXX; expertise in Gender Equality members consultant) and Human Rights

The evaluators will not act as representatives of any party and must remain independent and impartial. The qualifications and responsibilities for each evaluator are specified in the respective job descriptions attached to these Terms of Reference (Annex 1). The evaluation team will report exclusively to the chief or deputy chief of the UNODC Independent Evaluation Unit, who are the exclusive clearing entity for all evaluation deliverables and products.

Absence of Conflict of Interest

9 Please note that an evaluation team needs to consist of at least 2 independent evaluators – at least one team leader and one team member. 10 Please add the specific technical expertise needed (e.g. expertise in anti-corruption; counter terrorism; etc.) – please note that at least one evaluation team member needs to have expertise in human rights and gender equality.

14 According to UNODC rules, the evaluators must not have been involved in the design and/or implementation, supervision and coordination of and/or have benefited from the programme/project or theme under evaluation.

Furthermore, the evaluators shall respect and follow the UNEG Ethical Guidelines for conducting evaluations in a sensitive and ethical manner.

IX. MANAGEMENT OF THE EVALUATION PROCESS Please carefully read the information below in order to be informed about your role during the evaluation process. Roles and responsibilities of the Project Manager The Project Manager is responsible for:  (for Independent Project Evaluations: managing the evaluation process)  drafting and finalizing the ToR,  selecting Core Learning Partners (representing a balance of men, women and other marginalised groups) and informing them of their role,  recruiting the evaluation team following clearance by IEU, ensuring issued contracts ahead of the start of the evaluation process in line with the cleared ToR. In case of any delay, IEU and the evaluation team are to be immediately notified,  providing desk review materials (including data and information on men, women and other marginalised groups) to the evaluation team including the full TOR,  liaising with the Core Learning Partners,  reviewing the draft report for factual errors only,  developing a follow-up plan for the usage of the evaluation results and recording of the implementation of the evaluation recommendations (to be updated once per year),  disseminate the final evaluation report and communicate evaluation results to relevant stakeholders as well as facilitate the presentation of evaluation results;  ensure that all payments related to the evaluation are fulfilled within 5 working days after IEU’s request - non-compliance by Project/Programme Management may results in the decision to discontinue the evaluation by IEU.

The Project Manager will be in charge of providing logistical support to the evaluation team including arranging the field missions of the evaluation team, including but not limited to:  All logistical arrangements for the travel (including travel details; DSA-payments; transportation; etc.)  All logistical arrangement for the meetings/interviews/focus groups/etc., ensuring interview partners adequately represent men, women and other marginalised groups (including independent translator/interpreter if needed); set-up of interview schedules; arrangement of ad-hoc meetings as requested by the evaluation team; transportation from/to the interview venues; scheduling sufficient time for the interviews (around 45 minutes); ensuring that members of the evaluation team and the respective interviewees are present during the interviews; etc.)

15  All logistical arrangements for the presentation of the evaluation results;  Ensure timely payment of all fees/DSA/etc. (payments for the evaluation team must be released within 5 working days after the respective deliverable is cleared by IEU). Roles and responsibilities of the evaluation stakeholders Members of the Core Learning Partnership (CLP) are identified by the project managers. The CLPs are the main stakeholders, i.e. a limited number of those deemed as particularly relevant to be involved throughout the evaluation process, i.e. in reviewing and commenting on the TOR and the evaluation questions, reviewing and commenting on the draft evaluation report, as well as facilitating the dissemination and application of the results and other follow-up action. Stakeholders include all those to be invited to participate in the interviews and surveys, including the CLPs. Roles and responsibilities of the Independent Evaluation Unit The Independent Evaluation Unit (IEU) provides mandatory normative tools, guidelines and templates to be used in the evaluation process. Please find the respective tools on the IEU web site http://www.unodc.org/unodc/en/evaluation/evaluation.html. Furthermore, IEU provides guidance, quality assurance and evaluation expertise, as well as interacts with the project manager and the evaluation team throughout the evaluation process. IEU may change the evaluation process, timeline, approach, etc. as necessary at any point throughout the evaluation-process.

IEU reviews, comments on and clears all steps and deliverables during the evaluation process: Terms of Reference; Selection of the evaluation team, Inception Report; Draft Evaluation Report; Final Evaluation Report and an Evaluation Brief; Evaluation Follow- up Plan. IEU further publishes the final evaluation report and the Evaluation Brief on the UNODC website, as well as sends the final evaluation report to an external evaluation quality assurance provider. Moreover, IEU may decide, in consultation with Project Management, to upgrade any Independent Project Evaluation to an In-Depth Evaluation considering e.g. an unforeseen higher involvement of IEU staff in the evaluation process.

X. PAYMENT MODALITIES

The evaluation team will be issued consultancy contracts and paid in accordance with UNODC rules and regulations. The contracts are legally binding documents in which the evaluation team agrees to complete the deliverables by the set deadlines. Payment is correlated to deliverables and three instalments are typically foreseen:

1. The first payment upon clearance of the Inception Report (in line with UNODC evaluation norms, standards, guidelines and templates) by IEU;

2. The second payment upon clearance of the Draft Evaluation Report (in line with UNODC norms, standards, evaluation guidelines and templates) by IEU;

3. The third and final payment (i.e. the remainder of the fee) only after completion of the respective tasks, receipt of the final report, Evaluation Brief (in line with

16 UNODC evaluation norms, standards, guidelines and templates) and clearance by IEU, as well as presentation of final evaluation findings and recommendations.

75 percent of the daily subsistence allowance and terminals is paid in advance before travelling. The balance is paid after the travel has taken place, upon presentation of boarding passes and the completed travel claim forms.

IEU is the sole entity to request payments to be released in relation to evaluation. Project/Programme Management must fulfil any such request within 5 working days to ensure the independence of this evaluation-process. Non-compliance by Project/Programme Management may results in the decision to discontinue the evaluation by IEU.

17 ANNEX I. TERMS OF REFERENCE FOR EVALUATORS Title: Independent Evaluator (Team Leader) Organisational Section/Unit: Name and title of Supervisor: Duty Station or home-based: Duty station/Home-based/with travel to xxx (all and any travel should be specified here) Proposed period: [from – to] Actual work time: [days or months] Fee Range: [A through E – ST/AI/2013/4 Annex III refers]

1. Background of the assignment:

Please provide a short background of the project/programme to be evaluated in line with the main body of the ToR.

TextTextText Write your text on top of this in order to create the correct format and style

2. Purpose of the assignment:

Please provide a short information on the purpose of the assignment for the evaluator in line with the main body of the ToR.

TextTextText Write your text on top of this in order to create the correct format and style

3. Specific tasks to be performed by the evaluator:

Under the guidance and supervision of the Chief or Deputy Chief of the Independent Evaluation Unit, the key responsibilities of the evaluator include (i) development of the evaluation design with detailed methods, tools and techniques that are gender- inclusive and gender-sensitive, generating information from and about men, women and other marginalised groups as well as about key gender as well as human rights issues (ii) ensuring adherence to the United Nations Evaluation Group (UNEG) Norms and Standards, UNODC evaluation norms, standards, guidelines and templates and the full evaluation Terms of Reference (ToR), and (iii) ensuring that all deliverables are submitted in a timely and satisfactory manner and in line with the quality criteria checklist.

4. Expected tangible and measurable output(s)/deliverable(s):

Tangible and measurable outputs, objectives and targets of the work assignment, as well as specific activities to achieve the required outputs and targets. As per ST/AI/2013/4, Section 3.2 (a)

The evaluator will be responsible for the quality and timely submission of his/her specific deliverables, as specified below, interacting with the Independent Evaluation Unit throughout the evaluation process. All products should be well written, inclusive

18 and have a clear analysis process. The evaluation team will report exclusively to the Chief or Deputy Chief of the UNODC Independent Evaluation Unit.

 Draft inception report, containing: initial observations of the desk review, refined evaluation questions, data collection instruments (including surveys/questionnaires and interview guides), sampling strategy, evaluation matrix and limitations to the evaluation; in line with UNODC evaluation norms, standards, guidelines and templates.

 Presentation of preliminary observations and recommendations to internal and possibly external key stakeholders (if applicable).  Draft evaluation report in line with UNODC evaluation norms, standards, guidelines and templates, including an analysis of the performance of the project to adequately address gender equality as well as human rights issues, with concrete findings, conclusions and recommendations.  Revised draft report based on comments received from the various consultative processes (IEU, internal and external).  Final evaluation report and an Evaluation Brief, in line with UNODC evaluation norms, standards, guidelines and templates.  Final presentation of evaluation results to stakeholders.

According to UNODC rules and UNEG Norms and Standards, the evaluator must not have been involved in the design and/or implementation, supervision and coordination of and/or have benefited from the programme/project or theme under evaluation.

The evaluation team will report exclusively to the chief or deputy chief of the UNODC Independent Evaluation Unit, who is the sole clearing entity for all evaluation deliverables and products.

The evaluator shall respect the UNEG Ethical Guidelines.

5. Dates and details of deliverables/payments:

Deliverabl Output Working To be e Days accomplished by (date) A. Inception Report

B. Draft Evaluation Report

C. Final Evaluation Report, Evaluation Brief and presentation

Payments will be made upon satisfactory completion and/or submission of outputs/deliverables as assessed by IEU. Project Management is requested to release all payments only after IEU clearance.

19 Please note that last payment must coincide with the end of the contract and must be identical to payment phases in the engagement of consultant/IC request.

6. Indicators to evaluate the evaluator’s performance:

Timely, satisfactory and high-quality delivery of the above mentioned outputs as assessed by IEU (in line with UNODC norms, standards, guidelines and templates as well as UNEG Standards and Norms).

7. Qualifications/expertise sought (required educational background, years of relevant work experience, other special skills or knowledge required):

Please note that the evaluator should demonstrate: extensive knowledge of, and experience in applying, qualitative and quantitative evaluation methods; professional technical competence and experience in the area of evaluation (please include the number of years of experience and the degree required, e.g. advanced university degree), including a track record of conducting various types of evaluation at the international level, preferably with experience in conducting evaluations for the United Nations; excellent communication and drafting skills in English; proven by previous evaluation reports. Knowledge of another language relevant to the evaluation might be an advantage.

Please also note that the evaluator(s) should have experience and knowledge on gender equality and women’s empowerment, gender mainstreaming, gender analysis and the related mandates within the UN system – as well as experience and knowledge on human rights issues, the human rights based approach to programming, human rights analysis and related mandates within the UN system.

TextTextText Write your text on top of this in order to create the correct format and style

The independent international evaluator (lead evaluator) should possess the following technical qualifications:

 University degree in ………………………………or related field and preferably formal training/education on evaluation methodologies and principles;  A minimum of ten (10) years of professional technical experience in the field of evaluation or related field, including a track record of conducting various types of evaluation at the international level, preferably with experience in conducting evaluations for the United Nations;  Experience in leading a team;  Knowledge and experience of the UN System and in particular of UNODC;  Sound knowledge in the thematic areas of …………………;  Familiarity with ……………………………..;  Knowledge of quantitative and qualitative methods;  Knowledge of ………………………………………;  Experience in gender sensitive evaluation methodologies and analysis, and understanding of human rights and ethical issues in relation to evaluation;

20  Experience in presenting and communicating complex evaluation or research results in a structured manner (in reports, briefs, presentations, etc.);  Fluency in English and excellent English report writing skills;  Knowledge of …………………….. would be an advantage.

21 Title: Independent Evaluator (Team member/expert) Organisational Section/Unit: Name and title of Supervisor: Duty Station or home-based: Duty station/Home-based/with travel to xxx (all and any travel should be specified here) Proposed period: [from – to] Actual work time: [days or months] Fee Range: [A through E – ST/AI/2013/4 Annex III refers]

1. Background of the assignment:

Please provide a short background of the project/programme to be evaluated in line with the main body of the ToR.

TextTextText Write your text on top of this in order to create the correct format and style

2. Purpose of the assignment:

Please provide a short information on the purpose of the assignment for the evaluator in line with the main body of the ToR.

TextTextText Write your text on top of this in order to create the correct format and style

3. Specific tasks to be performed by the evaluator:

Under the guidance and supervision of the Chief or Deputy Chief of the Independent Evaluation Unit, collaborating with the lead evaluator throughout the evaluation process, the key responsibilities of the team member include (i) development of the evaluation design with detailed methods, tools and techniques that are gender- inclusive and gender-sensitive, generating information from and about men, women and other marginalised groups as well as about key gender as well as human rights issues (ii) ensuring adherence to the UNEG Norms and Standards, UNODC evaluation norms, standards, guidelines and templates and the evaluation TOR, and (iii) ensuring that all deliverables are submitted in a timely and satisfactory manner and in line with the quality criteria checklist; (iv) contributing with substantive expertise on the topic under evaluation to the whole evaluation process and all deliverables.

4. Expected tangible and measurable output(s)/deliverable(s):

Tangible and measurable outputs, objectives and targets of the work assignment, as well as specific activities to achieve the required outputs and targets. As per ST/AI/2013/4, Section 3.2 (a)

Collaborating with the lead evaluator throughout the evaluation process, the team member will be responsible for the quality and timely submission of his/her specific deliverables, as specified below. All products should be well written, inclusive and have a

22 clear analysis process. The evaluation team will report exclusively to the Chief or Deputy Chief of the UNODC Independent Evaluation Unit.

The team member will support the Lead Evaluator and be involved throughout the entire evaluation process, providing written inputs to all evaluation deliverables as well as provide substantive inputs relating to the topic under evaluation and will therefore, in consultation with the lead evaluator contribute to the:

 Draft inception report, containing: initial observations of the desk review, refined evaluation questions, data collection instruments (including surveys/questionnaires and interview guides), sampling strategy, evaluation matrix and limitations to the evaluation; in line with UNODC evaluation norms, standards, guidelines and templates.

 Presentation of preliminary observations and recommendations to internal and possibly external key stakeholders (if applicable).  Draft evaluation report in line with UNODC evaluation norms, standards, guidelines and templates, including an analysis of the performance of the project to adequately address gender equality as well as human rights issues, with concrete findings, conclusions and recommendations.  Revised draft report based on comments received from the various consultative processes (IEU, internal and external).  Final evaluation report and an Evaluation Brief, in line with UNODC evaluation norms, standards, guidelines and templates.  Final presentation of evaluation results to stakeholders.

According to UNODC rules, the evaluator must not have been involved in the design and/or implementation, supervision and coordination of and/or have benefited from the programme/project or theme under evaluation.

The evaluation team will report exclusively to the chief or deputy chief of the UNODC Independent Evaluation Unit, who is the sole clearing entity for all evaluation deliverables and products.

The evaluator shall respect the UNEG Ethical Guidelines.

5. Dates and details of deliverables/payments:

Deliverabl Output Working To be e Days accomplished by (date) A. Inception Report

B. Draft Evaluation Report

C. Final Evaluation Report, Evaluation Brief

23 and presentation

Payments will be made upon satisfactory completion and/or submission of outputs/deliverables as assessed by IEU. Project Management is requested to release all payments only after IEU clearance.

Please note that last payment must coincide with the end of the contract and must be identical to payment phases in the engagement of consultant/IC request.

6. Indicators to evaluate the evaluator’s performance:

Timely, satisfactory and high-quality delivery of the above mentioned outputs as assessed by IEU (in line with UNODC norms, standards, guidelines and templates as well as UNEG Standards and Norms).

7. Qualifications/expertise sought (required educational background, years of relevant work experience, other special skills or knowledge required):

Please note that the evaluator should demonstrate: extensive knowledge of, and experience in applying, qualitative and quantitative evaluation methods; professional technical competence and experience in the area of evaluation (please include the number of years of experience and the degree required, e.g. advanced university degree), including a track record of conducting various types of evaluation at the international level, preferably with experience in conducting evaluations for the United Nations; excellent communication and drafting skills in English; proven by previous evaluation reports. Knowledge of another language relevant to the evaluation might be an advantage.

Please also note that the evaluator(s) should have experience and knowledge on gender equality and women’s empowerment, gender mainstreaming, gender analysis and the related mandates within the UN system – as well as experience and knowledge on human rights issues, the human rights based approach to programming, human rights analysis and related mandates within the UN system.

TextTextText Write your text on top of this in order to create the correct format and style

The independent international evaluator (team member) should possess the following technical qualifications:

 University degree in ………………………………or related field and preferably formal training/education on evaluation methodologies and principles;  A minimum of 10 years professional technical experience in ….(please add the most relevant substantive topic under evaluation)  Professional technical experience in the field of evaluation or related field, including a track record of conducting various types of evaluation at the international level, preferably with experience in conducting evaluations for the United Nations;

24  Experience in working in a team;  Knowledge and experience of the UN System and in particular of UNODC;  Knowledge in the thematic areas of …………………;  Familiarity with ……………………………..;  Knowledge of quantitative and qualitative methods;  Knowledge of ………………………………………;  Experience in gender sensitive evaluation methodologies and analysis, and understanding of human rights and ethical issues in relation to evaluation;  Experience in presenting and communicating complex evaluation or research results in a structured manner (in reports, briefs, presentations, etc.);  Fluency in English and excellent English report writing skills;  Knowledge of …………………….. would be an advantage.

25 ANNEX II. LIST OF BACKGROUND DOCUMENTS FOR THE DESK REVIEW Please note that the list may be further refined by the evaluation team Please also note that the desk review list should include data and information on men, women and other marginalised groups This list is indicative only and will be further refined by the evaluation team.

 Project document;  Project revisions;  Progress reports;  UNODC organigram;  UNODC mandate;  Donor reports;  Project logframe;  Relevant audit reports;  Relevant evaluation reports of donors, UNODC, etc.  Relevant United Nations Development Assistance Framework (UNDAF);  Relevant “Voluntary National Reviews” of the SDGs;  Please include further documents;  Please include further documents;  Please include further documents;  UNODC website: UNODC and the Sustainable Development Goals11  UNODC brochure: UNODC and the Sustainable Development Goals12  UNODC brochure: Better Data to monitor violence, trafficking, corruption and access to Justice (2017)13  ECOSOC Report of the Inter-agency and Expert Group on Sustainable Development Goal Indicators (E/CN.3/2017/2*)  UNODC Independent Evaluation Unit: Meta-Analysis 2011-201414  UNODC Independent Evaluation Unit: Meta-Analysis 2015-201615

11 https://www.unodc.org/unodc/en/about-unodc/sustainable-development-goals/sdgs-index.html 12 https://www.unodc.org/documents/SDGs/UNODC-SDG_brochure_LORES.pdf 13 http://www.unodc.org/documents/data-and-analysis/Crime- statistics/Brochure_goal16_2017_web.pdf 14 http://www.unodc.org/documents/evaluation/Meta-Analysis/UNODC_Evaluation_Meta- Analysis_2011-2014.pdf 15 http://www.unodc.org/documents/evaluation/Meta-Analysis/UNODC_IEU_Evaluation_Meta- Analysis_2015-2016.pdf

26  UNODC Independent Evaluation Unit: Evaluation-based analysis of good practices in UNODC's approach to capacity building16  UNODC Position Paper on Human Rights (2011)17  Guidance Note on Gender Mainstreaming in UNODC (2013)18  UNODC evaluation guidelines, templates, handbook, policy19  UNODC Inception Report Guidelines and Template20  UNODC Evaluation Report Guidelines and Template21  UNODC Evaluation Quality Assessment22  UNEG: Integrating human rights and gender equality in evaluation23  UNEG Norms and Standards for Evaluation (2016)24  UNEG Ethical Guidelines for Evaluation25  United Nations Development Assistance Framework Guidance (2017)26

16 http://www.unodc.org/documents/evaluation/Knowledge-Products/UNODC_IEU_Evaluation- based_Capacity_Building_Analysis_final_October_2017.pdf 17 http://www.unodc.org/documents/justice-and-prison- reform/UNODC_Human_rights_position_paper_2012.pdf 18 http://www.un.org/womenwatch/directory/docs/UNODC-GuidanceNote-GenderMainstreaming.pdf 19 http://www.unodc.org/unodc/en/evaluation/normative-tools.html 20 https://www.unodc.org/unodc/en/evaluation/normative-tools.html#Inception_Report 21 https://www.unodc.org/unodc/en/evaluation/normative-tools.html#Eval_Report 22 http://www.unodc.org/unodc/en/evaluation/Evaluation-based-knowledge-products.html#EQAs 23 http://www.uneval.rgdetail/980 24 www.unevaluation.org/document/download/2601 25 www.uneval.org/document/download/548 26 https://undg.org/document/2017-undaf-guidance/

27 ANNEX III. LIST OF SUSTAINABLE DEVELOPMENT GOALS AND TARGETS

28 ANNEX IV. LIST OF STAKEHOLDERS Please note that the list may be further refined by the evaluation team Please make a distinction in the list below for the CLPs (Core Learning Partners) – please include all donors, key partners, other relevant UN agencies, Resident Coordinator, etc. Please also include stakeholders that you did not yet engage with but are relevant for the project/programme or who you would like to engage with in the future. Please also note that the CLPs should represent a balance of men, women and other under-represented groups. The list of stakeholders will be further refined by the evaluation team, in consultation with project/programme management and IEU. The evaluation team should also request interviews with other relevant stakeholders. Type27 CLP28 Organisation29 Name Designation30 Location Email (mark with X)

UNODC HQ X UNODC XX Chief, Regional Section XXX

UNODC HQ X UNODC XX Chief, Financial Resource Management Service

Donor X

UNODC UNODC XX Project Manager

UN UN Country Team Xx Resident Coordinator

27 Please include the information, if this person is e.g. an implementing partner, donor, recipient, UNODC HQ, UNODC field, UN agency, etc. 28 The CLPs are the main stakeholders, i.e. a limited number of those deemed as particularly relevant to be involved throughout the evaluation process, i.e. in reviewing and commenting on the TOR and the evaluation questions, reviewing and commenting on the draft evaluation report, as well as facilitating the dissemination and application of the results and other follow-up action. Stakeholders include all those to be invited to participate in the interviews and surveys, including the CLPs. 29 Please include the name of the organisation the person is working for. 30 Please include the designation/job title of the person.

29 30