Monitoring & Evaluation

Location: [Africa] [Swaziland] Town/City: Hhohho Category: Programme Effectiveness Job Type: Fixed term, Part-time

World Vision

Technical and Area Programmes

Evaluation Consultant

Terms of Reference

January, 2020

Page 1/11 © World Vision Eswatini

CONTENTS

1. PURPOSE OF TORs 4

2. BACKGROUND 4

3. STUDY TYPE 4

4. STUDY PURPOSE 5

5. STUDY APPROACH 7

6. SCOPE OF WORK 7

7. SUMMARY OF TECHNICAL PROGRAMS TO BE EVALUATED AND PROGRAMMING AREAS 7

8. METHODOLOGY 8

9. SAMPLING 9

10. DATA COLLECTION AND MANAGEMENT 9

11. STUDY DELIVERABLES 10

12. STUDY PRINCIPLES 11

13. BUDGET 12

Page 2/11 14. MAIN ROLES AND RESPONSIBILITIES 13

15. REPORT FORMAT 14

16. PROJECT TIMELINE 14

17. EVALUATION CONSULTANT COMPETENCIES 14

18. LIST OF DOCUMENTS TO BE MADE AVAILABLE TO THE CONSULTANT 14

19. REQUESTS FOR BIDS 15

ACRONYMS

Area Programs AP Caregiver Survey CGS Community Engagement and Sponsorship CESP Plan Community Health Committees COMM Maternal and Newborn Child Health and MCHN Nutrition Focus Group Discussions FGD Key Informant Interviews KII Mobile Data Collection MDC National Office NO Orphans and Vulnerable Children OVC Statistical Package for the Social Sciences SPSS Technical Program Evaluation TPE Technical Program TP World Vision Eswatini WVE Youth Healthy Behaviour Survey YHBS

Page 3/11 1. PURPOSE OF TORs

The purpose of these terms of reference (TOR) is to outline the requirements of leading the WVE Technical Program and CESP Evaluation processes. The main processes in the document include the design process, ensuring quality of data collected, and training of data collectors, analysis, report writing and dissemination.

2. BACKGROUND

World Vision is an international partnership of Christians whose mission is to follow our Lord and Saviour Jesus Christ in working with the poor and oppressed, to promote human transformation, seek justice and bear witness to the good news of the Kingdom of God. As a Christian relief, development and advocacy organisation, World Vision works with children, families and communities to overcome poverty and injustice. Inspired by Christian values, the organisation is dedicated to working with the world’s most vulnerable people. World Vision serves all people regardless of religion, race, ethnicity or gender.

World Vision Eswatini (WVE) started operating in 1992, focusing mainly on emergency relief after a drought that had hit Eswatini. In 1996 the focus shifted from relief to disaster mitigation, rehabilitation, and transformational development. Initially, WVE, used the community development project (CDP) approach, this moved to Area Development Programme (ADP) approach to ensure greater impact and sustainability of community-based development interventions. Through the ADPs, WVE was implementing interventions to address education, HIV and AIDS, health, infrastructure development, and economic development, changing the lives of the poor in the process.

Page 4/11 In 2015, WVE transitioned to full LEAP 3 implementation adopting a new 5 year strategy (FY2016–20) with the overall strategic goal of making significant and measurable improvements to sustained well-being of children and their families, especially the most vulnerable. The strategy had 4 strategic objectives; 1) Improved household livelihoods and resilience; 2) Improved socio-legal status of children; 3) Improved health and nutrition status of children as well as access to safe water, whilst reducing the impact of HIV/AIDS; 4) Improved access to quality education. In 2018, WVE conducted a strategy mid-term review to align the field office strategy with the global strategy called Our Promise. This process resulted in a streamlined sector focus where a decision to transition from the education sector was reached reducing the strategic objectives to Livelihood's, WASH, Health/HIV and Child Protection.

WVE is currently operating in 18 Area Programmes (AP’s) across the country, implementing four technical programs, namely; WASH, MNeCHN, HIV and AIDS, Livelihoods and resilience whilst Child protection, Sponsorship management and Faith and development is mainstreamed across all Area Programs together.

3. STUDY TYPE

This is an end of Strategy (FY16-20) and Technical Programmes evaluation. The end of strategy/technical programs evaluation is undertaken at least after three years of implementation, which is sufficient to measure change. The baseline survey was conducted in 2016.

4. STUDY PURPOSE

Page 5/11 The overall purpose of the Eswatini Technical Programs and CESP Evaluation is to build an evidence base that will enable WVE to improve programme effectiveness. The evaluation will focus on measuring effectiveness, relevance, sustainability and benchmarking (new indicators and new APs). The specific objectives of the evaluation are as follows;

1. Effectiveness: To understand the changes in child well-being (including child well-being targets)

2. Relevance: To assess the extent to which the technical programs responded to the beneficiaries' needs and priorities.

3. Sustainability: To measure progress towards the sustainability of programme outcomes in the Area Programmes.

4. Benchmarking: To generate benchmark indicators for assessing the effectiveness of the upcoming WVE strategy, new AP’s and new indicators. Furthermore, the evaluation will establish the status of additional relevant Eswatini Country context indicators in alignment to SDGs and Our Promise.

The evaluation findings will be compared with baseline findings to determine the effectiveness of WVE interventions over the 5 year strategic period and also inform target setting for a new strategy to be adopted in FY2021- 2025. Additionally, the evaluation will help in identifying priority areas across technical programming, increase WVE accountability with its key stakeholders and use the evidence generated to advocate for change in policy for improved child well-being. The specific evaluation objectives and evaluation questions are highlighted in the table below;

Page 6/11 Table 1: Evaluation Objectives

Evaluation Objectives Evaluation Questions Effectiveness: To Understand the changes in child well-being (including child well-being targets). 1. To what extent have TP targets and outcomes been achieved?

2. To what extent has CWB changed?

3. For whom and how did the programme achieve these results?

4. In what ways did the TPs contribute to these achievements and changes?

5. Are there any positive and negative consequences from these results?

6. What were the enablers and barriers to success?

7. To what extent has the TP contributed to improvements of the wellbeing of RCs and RC families?

Relevance: Understand the extent to To assess the extent to which the technical which objectives were consistent with programs responded to the beneficiaries' recipient needs, needs and priorities.

Page 7/11 Most vulnerable children: Understand the To what extent have the TP’s affected the impact on the most vulnerable children by lives of MVCs? How? separating out data concerning different types of vulnerability. Gender: Understand how the Programmes To what extent have the TP’s addressed or projects have enhanced or diminished gender equity and equality? How? gender equality by separating out and analysing data relating to gender. Sustainability: Measure progress towards To what extent have the TPs contributed to the sustainability of Programme outcomes the sustainability of Programme (using drivers and indicators of outcomes? What structures, processes and sustainability). systems did the programmes put in place to ensure sustainability? In what ways did the programmes contribute to the sustainability of programme outcomes? How did the programmes contribute to local capacity to sustain the outcomes? Collaborate with partners and To what extent have partners contributed communities: Identify and acknowledge to TP achievements? What can be the contributions that partners have made ascertained and improved on for the to any results achieved. Evaluations must performance and health of the include an assessment of the health of the partnerships? To what extent are partners partnerships or networks, and their capable to sustain the benefits of the potential ability to sustain the benefits of Programmes? the Programme into the future. Advocacy: Consider the effectiveness of To what extent have the TP’s advocacy any advocacy initiatives in changing the initiatives at local, regional and national local or national policy environment. level been effective? Sponsorship: Consider the inclusion of To what extent the TP’s have included

Page 8/11 sponsorship considerations in TPs. The sponsorship considerations in their design effect of TPs on RCs and RC families. and implementation? To what extent have the TP’s contributed to improvements of the wellbeing of RCs and RC families? Benchmarking: Identify selected To establish priority areas and estimate indicators for New AP’s to be collected current status of indicators for the new during the evaluation. strategy and programme indicators. What are the prevalence rates for the new strategy indicators? What are the prevalence rates of indicators in New APs? What are the contributing factors behind the current prevalence rates? Which sectors are most appropriate and relevant in which Areas?

1. STUDY APPROACH

This is an integrated modular evaluation that will be measured through a household survey, school survey, YHBS, focus group discussions, key informant interviews and review of relevant secondary data. The main modules for the quantitative method include the care giver survey (CG), Youth Health Behaviour Survey (YHBS), and WASH in Schools. There is need to pay particular attention to the need for triangulation and complementarity of data through the use of both qualitative (focus group discussions, key informant interviews) and quantitative (household survey questionnaire) methods and the recognition that tools and methods do not stand alone but need to be analyzed as a whole as well as individually.

2. SCOPE OF WORK

Page 9/11 Review draft evaluation design and propose the most suitable methodology, sampling and design processes.

Review the proposed data collection tools and ensure that they are relevant, valid and will produce reliable and quality data.

Lead the training of data collectors and ensure quality of collected data

LEAD report writing including lessons learnt and recommendations, and addressing comments from all stakeholders.

1. SUMMARY OF TECHNICAL PROGRAMS TO BE EVALUATED AND PROGRAMMING AREAS

The survey will be undertaken in all the 18 APs covering 20 constituencies in Eswatini. These are situated in all the 4 regions of Eswatini, focusing mainly in the rural areas. A total of 111 indicators will be measured.

Table 2: APs and Technical Programmes

Cluster AP WASH MNCHN Livelihoods CESP HIV Lubombo Lubulini Sithobela Mpolonjeni Shewula Shiselweni Matsanjeni East

Page 10/11 Mhlosheni Mantambe Ngwavuma Shiselweni West Mahlalini Gege Mtsambam a Manzini/ Mahlangats Hhohho ha Maphaleni Ekukhanye ni Mandlange mpisi

Old AP’s New AP’

Page 11/11

Powered by TCPDF (www.tcpdf.org)