Final Evaluation Report Final Evaluation Report Evaluation of UNICEF’s response to the Water, Sanitation and Hygiene Needs in Jordan as a result of the Syrian refugee crisis (July 2012 to July 2017) PREPARED BY INTERNATIONAL SOLUTIONS GROUP An IMC Worldwide Company PREPARED FOR UNICEF Jordan 16 April 2019 Evaluation Timeframe This evaluation covers UNICEF’s WASH programme activities between July 2012 and July 2017. The evaluation was conducted between November 2017 and September 2018. Data collection activities took place during July and August 2018. Geographic Scope This evaluation covers UNICEF Jordan WASH activities in the four camps of Za’atari, Azraq, Cyber City (closed in September 2016) and King Abdallah Park, as well as Rukban and Hadalat (abandoned in September 2017) at the Syrian/Jordanian border. Although there are Syrian refugees registered in all 12 Governorates of Jordan, the evaluation focused on the refugees registered in Zarqa, Irbid, Mafraq and Amman Governorates, which represent 90 percent of registered refugees. Organizations and Consultants conducting the evaluation This evaluation was conducted and led by International Solutions Group, a division of IMC Worldwide, and its partner, the Interdisciplinary Research Consultants, a research firm based in Amman, Jordan. UNICEF Jordan was the evaluation’s commissioning organization. 1 Table of Contents THE WASH PROGRAMME AND CONTEXT ...........................................................................6 DESCRIPTION OF THE WASH PROGRAMME ..................................................................................6 PROGRAMME HISTORY ..................................................................................................................... 6 WASH PROGRAMME PURPOSE, COMPONENTS, AND MANAGEMENT ........................................................ 8 WASH PROGRAMME LOGIC MODEL AND RESULTS FRAMEWORK ............................................................. 9 PROGRAMME CONTEXT......................................................................................................... 12 MANAGING AN INFLUX OF REFUGEES FROM A RELATIVELY WATER-SUFFICIENT AREA .................................... 12 PRE-EXISTING POLITICAL ATTITUDES TOWARD REFUGEES ........................................................................ 13 LEGAL AND INSTITUTIONAL FRAMEWORK OF THE WASH SECTOR IN JORDAN ............................................ 13 ECONOMIC TENSION ...................................................................................................................... 13 FUNDING ENVIRONMENT ................................................................................................................ 14 DESCRIPTION OF THE EVALUATION ................................................................................. 15 PURPOSE AND OBJECTIVE ...................................................................................................... 15 SCOPE .............................................................................................................................. 15 EVALUATION METHODOLOGY......................................................................................... 15 DESK REVIEW ..................................................................................................................... 15 QUANTITATIVE ANALYSIS....................................................................................................... 16 PRIMARY RESEARCH: QUALITATIVE DATA COLLECTION METHODS AND SAMPLING ................................ 16 COVERAGE IN INTERVIEWS AND FOCUS GROUPS .................................................................................. 16 RAPID ASSESSMENTS AND USER INTERVIEWS ...................................................................................... 17 WASH MESSAGING AND PRACTICES ................................................................................................ 17 PARTNER INTERVIEWS .................................................................................................................... 17 DUTY BEARERS AND STAFF .............................................................................................................. 17 STAKEHOLDER INTERVIEWS.............................................................................................................. 17 ANALYSIS METHOD........................................................................................................................ 17 LIMITATIONS TO THE EVALUATION............................................................................................ 18 ETHICAL PRINCIPLES IN CONDUCTING THE EVALUATION ................................................................. 18 FINDINGS ....................................................................................................................... 19 RELEVANCE ........................................................................................................................ 19 EVALUATION QUESTION 1 ............................................................................................................... 19 EVALUATION QUESTION 2 ............................................................................................................... 26 EVALUATION QUESTION 3 ............................................................................................................... 27 EFFECTIVENESS ................................................................................................................... 29 EVALUATION QUESTION 4 ............................................................................................................... 29 EVALUATION QUESTION 5 ............................................................................................................... 53 EFFICIENCY ........................................................................................................................ 63 EVALUATION QUESTIONS 6 AND 7 .................................................................................................... 63 EVALUATION QUESTION 8 ............................................................................................................... 69 EVALUATION QUESTION 9 ............................................................................................................... 70 EVALUATION QUESTION 10 ............................................................................................................. 72 SUSTAINABILITY .................................................................................................................. 72 EVALUATION QUESTION 11 ............................................................................................................. 72 EVALUATION QUESTION 12 ............................................................................................................. 74 EVALUATION QUESTION 13 ............................................................................................................. 74 EVALUATION QUESTION 14 ............................................................................................................. 75 EVALUATION QUESTION 15 ............................................................................................................. 75 EVALUATION QUESTION 16 ............................................................................................................. 76 1 COVERAGE ......................................................................................................................... 77 EVALUATION QUESTION 17 ............................................................................................................. 77 EVALUATION QUESTION 18 ............................................................................................................. 79 COORDINATION .................................................................................................................. 79 EVALUATION QUESTION 19 ............................................................................................................. 79 EVALUATION QUESTION 20 ............................................................................................................. 80 CONCLUSIONS ................................................................................................................ 80 LESSONS LEARNED AND RECOMMENDATIONS ................................................................ 84 LESSONS ........................................................................................................................... 84 RECOMMENDATIONS ............................................................................................................ 86 WORKS CITED ................................................................................................................. 89 ANNEX A: EVALUATION TERMS OF REFERENCE................................................................ 92 ANNEX B: ANONYMIZED LIST OF INTERVIEWS ............................................................... 104 ANNEX C: LIST OF SITES VISITED .................................................................................... 105 ANNEX D: DOCUMENTS CONSULTED ............................................................................. 106 ANNEX E: DATA COLLECTION TOOLS ............................................................................. 112 ANNEX F: TEAM DESCRIPTION....................................................................................... 119 ANNEX G: EVALUATION MATRIX