Evaluation of ETF Activities in Egypt May 2008
Total Page:16
File Type:pdf, Size:1020Kb
Evaluation of ETF Activities in Egypt May 2008 1 ETF activities in Egypt placed within the general context of HRD/VET and LM reforms in Egypt during the period 2000-2007 2 ETF activities in Egypt placed within the general context of HRD/VET and LM reforms in Egypt during the period 2000-2007 ETF activities in Egypt placed within the general context of HRD, VET and LM reforms in Egypt during the period 2000-2007 An ETF funded project The Evaluation Partnership & Gruppo Soges are the contractors of this evaluation. Two EU experts, Mr Ton FARLA (Team leader, and evaluation specialist), Mr Ali DASTGEER (international expert) and two Egyptian experts, Mrs Ghada AMIN (local expert 1) and Mrs Heba NAIEM (local expert 2) comprised the external evaluation team and prepared this report. The views and opinions expressed in the report are those of the evaluators and, as such; do not necessarily reflect those of the European Training Foundation. The European Training Foundation does not guarantee the accuracy of the data included in this report and accepts no responsibility for any consequences of their use. 3 ETF activities in Egypt placed within the general context of HRD/VET and LM reforms in Egypt during the period 2000-2007 TABLE OF CONTENT 3 ACKNOWLEDGEMENTS 6 LIST OF ABREVIATIONS 7 RELEVANCE, ADDED VALUE, EFFECTIVENESS AND IMPACT 9 1. EXECUTIVE SUMMARY 10 1.1. PURPOSE OF THE EVALUATION 10 1.2. BACKGROUND OF THE EVALUATION 10 1.3. METHODOLOGY 10 1.4. SUMMARY OF THE MAIN FINDINGS 11 1.4.1 THE INDIVIDUAL PROJECTS 11 1.4.2. THE OVERALL EVALUATION 13 1.4.3. RECOMMENDATIONS 15 2. INTRODUCTION 16 2.1. OVERVIEW OF ETF ACTIVITIES IN EGYPT 16 2.2. THE GENERAL TVET CONTEXT IN EGYPT 17 2.3. PURPOSE OF THE EVALUATION 19 3. METHODOLOGY 20 3.1. OVERVIEW 20 3.2. EVALUATION TOOLS 21 3.3. EVALUATION ACTIVITIES 21 3.3.1. DESK WORK 21 3.3.2. INTERVIEWS 22 3.3.3. CASE STUDIES 22 3.3.4. THE ANALYTICAL PHASE 22 4. THE ASSESSMENT 23 4.1. THE EVALUATION OF INDIVIDUAL PROJECTS 23 4.1. P1. MANAGEMENT AND ENTREPRENEURSHIP TRAINING FOR SME GROWTH WITHIN THE MEDA CONTEXT 23 4.1. P2. CONFERENCE ON INNOVATIVE PRACTICES IN VOCATIONAL EDUCATION AND TRAINING STANDARDS IN THE MASHREQ REGION” 24 4.1. P3. PROJECT IDENTIFICATION, FORMULATION AND CONTENT MONITORING 26 4 ETF activities in Egypt placed within the general context of HRD/VET and LM reforms in Egypt during the period 2000-2007 4.1. P4. DRAFTING OF THE POLICY STATEMENT ON THE REFORM OF TVET28 4.1. P5. COUNTRY OVERVIEW ON LABOUR MARKET POLICIES IN EGYPT 30 4.1. P6. HRD OBSERVATORY FUNCTION (OF) 32 4.1. P7. THE ‘COUNTRY ANALYSIS 2005’ OF EGYPT 34 4.1. P8. THE ‘TRANSITION FROM EDUCATION TO WORK’ PROJECT 35 4.1. P9. FINANCING OF VET SYSTEMS PROJECT 37 4.1. P10. INNOVATIVE PRACTICES IN TEACHER AND TRAINER TRAINING IN THE MASHREQ REGION 39 4.1. P11. PATTERNS OF MIGRATION AND HUMAN RESOURCES DEVELOPMENT ISSUES 40 4.1. P12 NATIONAL QUALIFICATION FRAMEWORK IN EGYPT 43 4.1. P13. CAREER GUIDANCE POLICIES AND PRACTICES IN EGYPT’ 44 4.2. CASE STUDIES 47 4.2.1. THE OBSERVATORY FUNCTIONS 47 4.2.3. COORDINATION WITH OTHER DONORS 47 4.3. OVERALL EVALUATION 48 4.3.1. RELEVANCE 49 4.3.2. EFFECTIVENESS 50 4.3.3. EFFICIENCY 52 4.3.4. IMPACT 53 4.3.5. ADDED VALUE 55 5. CONCLUSIONS AND RECOMMENDATIONS WITH RESPECT TO THE EVALUATION56 6. ELABORATION ON RECOMMENDATIONS (POST-ETF DEBRIEFING) 64 ANNEXES ANNEX 1. Terms of reference ANNEX 2. Matrix of ETF activities 2001-2007 ANNEX 3. Case studies on Observatory Function and Donor cooperation ANNEX 4. List of persons and organisations consulted 5 ETF activities in Egypt placed within the general context of HRD/VET and LM reforms in Egypt during the period 2000-2007 ACKNOWLEDGEMENTS This report draws on the results of extensive deskwork visits to ETF in Turin, and field visits within Egypt. During the evaluation, the evaluation team interviewed a large range of Egyptian stakeholders, all of whom have been willing and helpful contributors. The team would like to thank the staff of ETF for their open and constructive approach to the questions and challenges we have posed to them, and for the practical assistance they have provided to us by making available project information, annual work programmes, activity plans, mission reports, project documents and other relevant information and documentation. Moreover, ETF supported the evaluation team in compiling a list of stakeholders and experts it had worked with during the period 2000-2007. In particular, we would like to thank Outi Karkkainen and Elena Carrero Perez for their continuous support and efforts. 6 ETF activities in Egypt placed within the general context of HRD/VET and LM reforms in Egypt during the period 2000-2007 LIST OF ABREVIATIONS BCTC Building and Construction Training Council CAPMAS Central Agency for Public Mobilisation and Statistics CBC Cross Border Cooperation EC European Commission EETEO Egyptian Education, Training and Employment Observatory EFT Egyptian Federation for Tourism (The official Initials are ETF) EFBC Egyptian Federation for Building and Contractors EMIS Education Management Information System ERSAP Economic Reform and Structural Adjustment Programme ET Evaluation Team ETCP Egyptian Technical Colleges Project ETF European Training Foundation EU European Union GoE Government of Egypt GTZ German Technical Cooperation HRD Human Resource Development IB Institution Building IC Italian Cooperation IDSC Information and Decision Support Centre ILP Innovation and Learning Project ITC Industrial Training Council ITF Italian Trust Fund LDV Leonardo da Vinci LLL Life Long Learning 7 ETF activities in Egypt placed within the general context of HRD/VET and LM reforms in Egypt during the period 2000-2007 LM Labour Market MEDA Euro-Mediterranean Partnership MoE Ministry of Education MET Management and Entrepreneurship Training MTI Ministry of Trade and Industry MoMPeI Ministry of Manpower and Immigration MS Member States OF Observatory Function OFN Observatory Function Network PIP Project Implementation Plan PVTD Productivity and Vocational Training Department SDP Skills Development Programme SME Small & Medium Sized Enterprise SWAP Sector Wide Approach SWOT Strength Weakness Opportunities Threats TAP’s Technical and Administration Provision TTC Tourism Training Council ToR Terms of Reference TVET Technical Vocational Education and Training USAID US Agency for International Development WB World Bank WP Work Plan 8 ETF activities in Egypt placed within the general context of HRD/VET and LM reforms in Egypt during the period 2000-2007 RELEVANCE, ADDED VALUE, EFFECTIVENESS AND IMPACT Five key evaluation criteria have been applied to the assessment of ETF interventions in Egypt: relevance, effectiveness, efficiency, value added and impact. The ET assessed: The relevance of ETF activities to the country’s needs and priorities and to the EC objectives Relevance has been interpreted as the extent to which the intervention’s objectives are consistent with beneficiaries’ requirements, partners’ needs and priorities and EC policies and in line with the new ETF recast Regulation functions. It relates to the original design of the activities as well as to adjustments made in response to changing circumstances (e.g. in politics, policy, institutional, economic, social and environmental settings). It also seeks to ascertain if programme implementation was flexible enough to adapt to problems and challenges faced. Effectiveness in terms of how intended outputs and results were achieved Effectiveness had been interpreted as the extent to which the intervention’s objectives were achieved, taking into account their relative importance. It is measured by how much the intended beneficiaries actually benefited from the programmes, products or services; assessing the extent to which the programme’s results were achieved or their potential benefits were realised. Efficiency in terms of how economically ETF resources were converted to results Efficiency has been interpreted as the extent to which the project finances and human resources produced the intended results, added greater value or impact; to what extent ETF donor-coordination contributed to economies of scale and complementarities of the use of ETF resources in Egypt. However, it should be noted that the ETF was not able to provide the evaluation team with the details of human resources and budgets expended for individual projects which undermines the assessment of efficiency. The value-added of ETF compared to possible alternative options of implementing ETF activities Value added has been interpreted as the extent to which the setup of ETF as an Agency (specialised expertise, know-how, stakeholder involvement, networks and flexibility) delivering its services and activities benefited the HRD/TVET reform. Simply, to what extent do the stakeholders perceive an added-value of the ETF? To what extent co-funding with other donors brought added-value to the ETF initiatives. The intended and unintended impact of the ETF role, activities and presence in Egypt Impact has been interpreted as the positive and negative, primary and secondary long-term effects produced by the intervention, directly or indirectly, intended or unintended. Assessing the extent to which benefits received by direct beneficiaries had a wider overall effect and, on a wider scale, in the sector, the region or the country. It addresses the relationship between the project purpose and the overall objective. Such analysis also takes into consideration that the project is one of a number of influences contributing to the wider outcome. 9 ETF activities in Egypt placed within the general context of HRD/VET and LM reforms in Egypt during the period 2000-2007 1. EXECUTIVE SUMMARY 1.1. PURPOSE OF THE EVALUATION S1 The aim of the evaluation is to provide ETF with an objective assessment of its activities in terms of relevance, effectiveness, efficiency, impact and added value as regards Egyptian system level HRD/TVET reform.