BMZ EVALUATION REPORTS 007 Country Case Study “Tanga Integrated Rural Development Programme (TIRDEP), Tanzania” Summary Ex-Post Evaluation – sustainability of Regional Rural Development Programmes (RRD) COUNTRY CASE STUDY “TANGA INTEGRATED RURAL DEVELOPMENT PROGRAMME, TANZANIA” COUNTRY CASE STUDY “TANGA INTEGRATED RURAL DEVELOPMENT PROGRAMME, TANZANIA” Preface This study was commissioned by the BMZ (Divi- obtain a “local perspective”. Altogether the key sion for Evaluation of Development Cooperation). objectives of the evaluation were: It is an independent evaluation, which was car- l the widening and deepening of our under- ried out by Stoas International, Dar Es Salaam, standing of the outcome and long-term Tanzania, by the consultants Winnie Bashagi, impact of German cooperation projects Raymond Mnenwa, Mary Liwa and George and of the underlying conditions for Lulandala. The views and opinions expressed in success; the report do not necessarily correspond to those l the introduction of a different vantage of the BMZ. However, a comment by the BMZ can point for the analysis of the outputs, out- be found at the end of the summary. come and impact of German cooperation projects by charging local research institu- The present document is part of a series of four tions and/or consultants with the actual ex-post evaluations on Regional Rural Devel- evaluation work; and opment Programmes in Indonesia, Sri Lanka, l the further refinement of the ex-post evalu- Tanzania and Zambia which were implemented ation methodology. between the 1970s and the 1990s. The evaluation In addition to the four country case studies a syn- itself was carried out in 2003 and 2004 applying thesis report is available (see inner cover page for specific questions and methods. One character- contact details). istic of the evaluation is that the BMZ commis- sioned professional local consultants, in order to Division for Evaluation of Development Cooperation COUNTRY CASE STUDY “TANGA INTEGRATED RURAL DEVELOPMENT PROGRAMME, TANZANIA” Summary of Evaluation The views presented in this study are opinions TIRDEP realized that provision of materials was held by the independent external experts. not enough to solve grassroot problems but that workers’ skills also affected quality, quantity and 1. Introduction timelines of what was being produced. The Federal Republic of Germany (FRG) through Institutional support phase (1977 – 1983) thus, its Federal Ministry for Economic Cooperation emphasized on improvement of planning as well and Development has cooperated with the Gov- as operational capabilities of executing depart- ernment of the United Republic of Tanzania (URT) ments, and improvement of local talents The fol- in a range of development assistance activities lowing offices were supported in this endeavor: since independence in 1961. Tanga region has Regional Development Director’s office; Regional been one of the focus for the bilateral co-opera- Agricultural Development office; Regional tion between the two countries. As part of the Ujamaa and Cooperative Development office; co-operation, Tanzania implemented the Tanga Regional Livestock Development office; Regional Integrated Rural Development Programme Water Department Office; and Regional Educa- (TIRDEP) between 1972 and 1991. TIRDEP was one tion Office. of the biggest development projects by that time. The guiding principle during Target Group A team of experts from FRG started working on Orientation phase (1983 onwards) was the bot- the Tanga Integrated Regional Development tom up approach in planning, implementation Plan in December 1972 and, by February 1975, and management of development projects. This the team completed preparation of TIRDEP Five focus was geared towards giving opportunity Years Development Plan (1975 – 1980). The overall and guidance to people to formulate their own goal of the bilateral agreement for implementing projects based on their perceived needs and TIRDEP was to improve the living standards of the problems. This approach envisaged stimulating rural population of Tanga Region. In order to real- self-help spirit and ownership of projects by the ize this general objective, the following outlined target group through effective participation of activities were implemented in three phases. the target group. The infrastructural support phase (1975 – 1979) The Federal Republic of Germany (FRG) commis- emphasized on construction of physical infra- sioned Stoas International Tanzania to carry out structure, supply of services, equipment and mate- TIRDEP Ex- post Evaluation. The Ex-post Evaluation rials to respective sectoral regional departments. was carried out between October 2003 and May During this phase, TIRDEP supported the follow- 2004 with the aim of exploring changes that have ing projects: Provision of Pangani Ferry; Rehabili- taken place from the time of phasing out to date. tation of Rural Roads in Handeni; Construction of schools and teachers’ houses; Construction of Approach and Methodology of the study rural godowns as well as village stores; Provision of materials for water supply; Rehabilitation of The analysis of data and information for this regional veterinary services; and Rehabilitation Ex-Post Evaluation followed the funnel approach of Mombo Irrigation scheme. After this phase as stipulated in a guide for ex post evaluations COUNTRY CASE STUDY “TANGA INTEGRATED RURAL DEVELOPMENT PROGRAMME, TANZANIA” prepared by Prof Dr Stockmann. The funnel . FINDINGS approach requires that an impact assessment proceeds from observable changes that have Project cycle occurred in the programme environment, that is, executing agency, the target group and within Project cycle entails project preparation, imple- as well as between sectors. Then causes for these mentation, follow-up and end of project pro- changes are analyzed in a broad perspective in motion. The quality of preparation of TIRDEP order to find out if they are directly attributable projects was considered good and fair. The qual- to the project intervention or some other factors. ity of preparation of 34% of the TIRDEP projects is Through this approach, the assessment systemati- categorized as good while that of 50% is catego- cally identifies both intended and unintended; rized as fair. Projects that had good preparations positive and negative impacts as well as underly- were preceded by adequate technical personnel, ing causes. financial, framework conditions and target group analysis. In turn, most of the projects, which had Information was collected on various aspects at good preparations met their objectives during three TIRDEP times that is time of project start, the implementation. On the other hand, 15% of time of project completion and time of this ex the projects were poorly prepared. Projects that post evaluation to determine the impacts of had good preparations are characterized by good TIRDEP projects. Extensive literature review technical assistance; adequate staff, financial with: government authorities, the private sec- resources, policy back up and target group tor, community leaders and households in 30 participation. selected villages were carried out. The empirical component of the study was based on the analysis The cross-section evaluation of TIRDEP projects’ of data from 156 households, 120 village repre- implementation shows that the implementation sentatives, and 450 people involved in PRAs in of 47% of the TIRDEP projects is rated as good the 30 selected villages. Data were also collected while 16% of the projects was good and very good, from the District Departments and information respectively. On the other hand, the quality of end from Ex-TIRDEP staff (local and expatriates) who of project promotion for TIRDEP projects is rated responded to the questions sent to them by email as rather good. About 39% and 8% of the TIRDEP or through personal contacts. projects had respectively good and very good end of project promotion. About 8% of the projects The analysis of qualities on various TIRDEP had fair end of project promotion. The overall aspects involved making judgments. Data on the assessment by the consultants of the follow up quality of TIRDEP features and extent of TIRDEP activities shows that 39% of the TIRDEP projects effects were generated through rating on the lik- had very poor follow up, while 34% and 13% of the ert scale of 1 to 5 (1 being for very poor or very low, projects had good and very good follow up. 2 for poor/ low, 3 for fair, 4 for good/ high and 5 for very good/ very high). Criteria used in this process included people’s participation; performance in Project design the sectors; observed changes in various sectors; continuity of projects after end of promotion; TIRDEP innovations were on the whole suitable in contribution of the executing agency including terms of needs of people, compatibility to social target group; and success stories. The scores were settings and environment. About 50% and 39% then weighted, condensed and used to compile were rated as good and very good, respectively, an overall assessment of the programme projects. by the time of project start, most of the innova- COUNTRY CASE STUDY “TANGA INTEGRATED RURAL DEVELOPMENT PROGRAMME, TANZANIA” tions continued to be sustainable. At the project Generally, there were some project achieve- completion time, the suitability of 21% of the ments under various projects. For example, the projects is rated as poor and very poor, while 26% school buildings constructed under TIRDEP are of the projects are