Independent evaluation of the ILO’s strategy to address HIV and AIDS and the world of work For more information: International Labour Offi ce (ILO) Tel.: (+ 41 22) 799 6440 Evaluation Unit (EVAL) Fax: (+41 22) 799 6219 OCTOBER 2011 4, route des Morillons E-mail: [email protected] CH-1211 Geneva 22 http://www.ilo.org/evaluation Switzerland EVALUATION UNIT Independent evaluation of the ILO’s strategy to address HIV and AIDS and the world of work International Labour Office September 2011 Copyright © International Labour Organization 2011 First published 2011 Publications of the International Labour Office enjoy copyright under Protocol 2 of the Universal Copyright Convention. Nevertheless, short excerpts from them may be reproduced without authorization, on condition that the source is indicated. For rights of reproduction or translation, application should be made to ILO Publications (Rights and Permissions), International Labour Office, CH-1211 Geneva 22, Switzerland, or by email: [email protected]. The International Labour Office welcomes such applications. Libraries, institutions and other users registered with reproduction rights organizations may make copies in accordance with the licences issued to them for this purpose. Visit www.ifrro.org to find the reproduction rights organization in your country. Henry, Carla; Zegers, Mei Independent evaluation of the ILO's strategy to address HIV and AIDS and the world of work /Carla Henry, Mei Zegers; International Labour Office, Evaluation Unit. - Geneva: ILO, 2011 1 v. ISBN print: 978-92-2-125422-5 ISBN web pdf: 978-92-2-125423-2 International Labour Office; Evaluation Unit HIV / AIDS / technical cooperation / ILO Programme / project evaluation / evaluation technique / developed countries / developing countries 15.04.2 ILO Cataloguing in Publication Data The designations employed in ILO publications, which are in conformity with United Nations practice, and the presentation of material therein do not imply the expression of any opinion whatsoever on the part of the International Labour Office concerning the legal status of any country, area or territory or of its authorities, or concerning the delimitation of its frontiers. The responsibility for opinions expressed in signed articles, studies and other contributions rests solely with their authors, and publication does not constitute an endorsement by the International Labour Office of the opinions expressed in them. Reference to names of firms and commercial products and processes does not imply their endorsement by the International Labour Office, and any failure to mention a particular firm, commercial product or process is not a sign of disapproval. ILO publications and electronic products can be obtained through major booksellers or ILO local offices in many countries, or direct from ILO Publications, International Labour Office, CH-1211 Geneva 22, Switzerland. Catalogues or lists of new publications are available free of charge from the above address, or by email: [email protected] Visit our website: www.ilo.org/publns Printed in Switzerland ii PREFACE This final report was prepared by the evaluation team, Mei Zegers, lead international evaluation consultant, and Carla Henry, Senior Evaluation Officer in the ILO Evaluation Unit. A detailed desk review was prepared by ILO Research Assistant, Agata Standa. Louis Jackett contributed to initial data collection and analysis. The evaluation was launched in February 2011 under the guidance of Guy Thijs, Director of ILO‘s Evaluation Unit and in consultation with Sophia Kisting, Director of the ILO/AIDS programme. The report has benefited from input from many inside and outside the ILO. The evaluation team expresses its appreciation to the Director and officials of the ILO/for their cooperation during the evaluation process. Thanks also go to the ILO officials in Ethiopia, Zambia, South Africa and Zimbabwe who supported case study missions. iii Table of Contents ABBREVIATIONS ............................................................................................................ VII EXECUTIVE SUMMARY ................................................................................................ XI Operational approach .................................................................................................... xi Findings, conclusions ................................................................................................... xii Recommendations ........................................................................................................ xv 1. OBJECTIVES AND SCOPE OF THE EVALUATION ........................................... 1 1.1 Rationale ................................................................................................................. 1 1.2 Scope ...................................................................................................................... 1 1.3 Evaluation methodology ......................................................................................... 1 1.4 Key performance criteria/questions for evaluation ................................................ 3 1.5 Challenges and limitations noted ........................................................................... 4 2. MAJOR STRATEGIES AND PROGRAMMATIC LOGIC ................................... 4 2.1 Background ............................................................................................................ 4 2.2 Demographical aspects of HIV and the world of work .......................................... 6 2.3 ILO history and HIV/AIDS mandate ..................................................................... 8 2.4 Objectives and major strategic orientations ......................................................... 10 2.5 Results-based strategy on ILO/AIDS and main means of action ......................... 11 2.6 Organizational approach and external partners .................................................... 16 2.7 Tripartite constituents and UNAIDS .................................................................... 16 2.8 Resources, governance and management set-up .................................................. 17 3. ANSWERS TO EVALUATION QUESTIONS ....................................................... 20 3.1 Relevance ............................................................................................................. 20 3.2 Effectiveness ........................................................................................................ 27 3.3 Coherent, complementary collaborations created within a results framework .... 43 3.4 Efficiency ............................................................................................................. 52 3.5 Impact ................................................................................................................... 67 3.6 Sustainability ........................................................................................................ 75 4. CONCLUSIONS ........................................................................................................ 82 Relevance, responsiveness and added value ................................................................ 82 Effectiveness ................................................................................................................ 82 Coherence and complementarity .................................................................................. 83 Efficiency ..................................................................................................................... 83 Impact .......................................................................................................................... 84 Sustainability ................................................................................................................ 84 5. RECOMMENDATIONS ........................................................................................... 85 6. SYNTHESIS JUDGEMENT ..................................................................................... 90 7. LESSONS LEARNED ............................................................................................... 91 8. ILO MANAGEMENT RESPONSE ......................................................................... 95 8. ANNEXES .................................................................................................................. 97 Annex 1. Terms of reference ....................................................................................... 97 1 Introduction ............................................................................................................... 97 2 Background on the ILO‘s strategy to address HIVAIDS within the context of the world of work ............................................................................................................... 97 iv 3 Users of the evaluation ............................................................................................ 100 4 Purpose and scope ................................................................................................... 100 5 Evaluation methodology ......................................................................................... 101 6 Outputs .................................................................................................................... 102 7 Timeframe and management arrangements ............................................................ 103 Annex 2. Overview of the ILO Status in the 2008-2009