World Health Organisation African Programme for Onchocerciasis Control

Assessment of the self-sustainabitity of the Taraba CDTI project

i:'

: . ,,i,1, ::'ir May 2002

Oladele Akogun Yemi Fayomi Edith Nnoruka Joseph Okeibunor Chulcwu Okoronlrwo Detlef Prozesky i. Phittip Sanlrwai Index

Abbreviations/ acronyms and acknowledgements J

Executive summary 4 lntroduction and methodology 6

Findings and recommendations 1. State level 9 2. LGA level t4 3. Disrict/ health centre level 18 4. Village level 2l 5. Overall self-sustainability grading for the project 23

Advocacy activities and planning workshops 24

Appendix 1 State level workshop programme 27 Appendix 2 The SOCT and LGA workshop processes 29 Appendix 3 State level plan for self-sustainability 32 Appendix 4 LGA level workshop prograrnme 37 Appendix 5 LGA level plans for self-sustainability 40 Appendix 6 Detailed findings 56 1. State level 56 2. Health district/ LGA level 60 3. Sub-district/ first line health facility level 63 4. Communiw level 66 . Abbreviations/ acronyms

APOC African Programme for Onchocerciasis Control CBIT Community Based Ivermectin Treatment CBM Christoffel Blindenmission . CDD Community Directed Distributor (of Ivermectin) CDTI Community Directed Treatment with Ivermectin CHEW Community Health Extension Worker - CHo Community Health Offrcer LG local government LGA Local Government Authority LOCT Local Government Onchocerciasis Control Team MITOSATH Mission to Save the Helpless MoH Ministry of Health NGDO Non-Governmental Development Organisation NGO Non-Governmental Organisation NOCP National Onchocerciasis Control Programme NOTF National Onchocerciasis Task Force PHC Primary Health Care SOC State Onchocerciasis Co-ordinator SOCT State Onchocerciasis Control Team WHO World Health Organisation ZOC Zonal Onchocerciasis Co-ordinator UTG Ultimate Treatment Goal

Acknowledgements

- We would like to thank the following persons for their help: -r . The staffat APOC Headquarters in Ouagadougou: Dr S6kdteli, Dr Amazigo, Mr Aholou . StaIf of NOCP/ MoH in Lagos and Abuja, for undertaking all the arrangements - . Staffof the MoH in Bauchi and Taraba: Princess Ogbu-Pearce, Dr Apake and the SOCT . The CBM team: Mr Ogoshi and the branch staff; the MITOSATH staff: Mrs Olamiju and her administrative assistant . Staffat the WHO offices in Lagos, Abuja and Taraba . Health workers and community members in the , and LGAs. 4

Executive summary

The Taraba CDTI project has been supported by APOC for the past 4 years, and is in its last year of agreed funding from APOC. An evaluation of the self-sustainability of ttre project was carried out in ApiU May 2002, by a team of seven evaluators (six form and one from South Africa). The evaluators were charged with three tasks: . Evaluating the self-sustainability of the project. ' Working with local stakeholders to plan for self-sustainability, based on the findings of the evaluation. ' Advocacy with local political and civil service leaders, regarding their future role in the self-sustainability of the project.

The evaluation was carried out over a period of eleven days. Information was collected by document study, interview and observation, at sampled sites at four levels of the health service: State, LGA, district/ health centre, and village/ community.

The overall judgement of the team is that the Kaduna CDTI project is not far from being sustainable. Regarding the six elements of sustainability, the situation is broadly as follows: ' Effectiveness: The project is effective at all levels (although some geographical areas are performing less well).. ' Effciency/financing: Many activities are not properly targeted, resulting in ineffrcient use of scarce resources. Lower levels (LGA and district/ health centre) are not yet fully empowered to carry out tasks at their level, and such tasks are often carried out by higher level staff. ' Simplicir): Routines are generally simple and easy to carry out (except the key area of village census). ' Integration:The programme is by now well integrated into the official health system. ' Attitude: Although stakeholders have accepted the project as part of their routine work, some key players have not yet accepted the fact that they will have to cope without outside resources in the near future. ' Resources: In this key area the project still relies too heavily on APOC. There are however cases were altemative sources are being used, but this is not yet the rule.

Regarding the position of the different levels of the project, the CDTI activities of the most peripheral level (the village) appear to be sustainable, even now. The three higher levels however will have to sort out the key issues of planning, funding, transport, and delegation of responsibility, if they are to be self-sustaining.

Detailed recommendations were drawn up, based on the findings of the evaluation at the four levels. The recommendations were prioritised, and indicators and deadlines were suggested for each. The most important recommendations concern: ' Determining the exact funding that will be available, and mobilising additional sources of funding if necessary. ' Tailoring activities (mainly training and supervision) to fit the budget. ' Empowering the LOCTs and district level staffto take full charge of activities at their levels - all in all, rationalising activities to achieve maximal efficiency. Advocacy activities were carried out at the level of the State (Deputy Govemor, Commissioner for Health and other senior MoH civil servants) and LGAs. Particular attention was paid to the State Onchocerciasis Co-ordinator, Ers a key player in future remedial action.

Three feedback/ planning workshops were held - one for the SOCT, and two for teams from each LGA/ LOCT (six such teams attending each workshop). In each case the evaluation team gave feedback on its findings, which were discussed in depth. The evaluators and other facilitators then guided the participants to draw up realistic'Plans for self-sustainability' for their respective areas of operation.

The workshop process worked well and considerable enthusiasm was generated. There is considerable agreement between the plans produced in this way, and the recommendations that the evaluators have made in this report. However most of the plans still need to be refined, and possibly adapted, in the light ofthe evaluators' recommendations. Finally, the plans need to be meticulously implemented, if the self-sustainability of the Taraba project is to be assured. National, zonal and State level staffhave ayear in which to work with local stakeholders, to take the necessary action. Introduction and methodology

l. Introduction

The African Programme for Onchocerciasis Conhol (APOC) approved the Project for funding of CDTI implementation in July 1997. The project has however been distributing Mectizan since 1994, using the mobile system and later the Community Based Ivermectin Treatnent (CBIT) shategy. When APOC funding for the project was agreed, the Community Directed Treatment with Ivermectin (CDTI) strategy was finally adopted. Treatments have risen from a few thousands to over 880,000 persons by 2001 with the Ultimate Treatment Goal (UTG) currently put at 980,000.

The State contains hyper endemic foci with high prevalence of blindness. The project was initially supported by A&icare, and after its withdrawal by CBM and a local NGDO, MITOSATH. The two supporting organisations have an exciting relationship, in which the intemational NGDO mentors the local one and agrees to transfer certain responsibilities to the indigenous NGDO within a given timeframe - as a way of promoting progftlmme sustainability. This has resulted in the devolution of support for three LGAs by CBM to MITOSATH during 2001, and will later result to the transfer of support for the entire project area to the local NGO.

As part of its plan to achieve sustainability of programme operations APOC management commissioned a team of consultants to develop an instrument to assess the self-sustainability of projects. This having been completed, it was decided that all projects in or about to enter their fifth year of APOC funding should be assessed, to find out their levels of self- sustainability. Hence the current assessment of the self-sustainability of the Taraba project.

2. Methodology

2.1 The'John the Baptist'visit

Building on the Kaduna experience where the instruments were field tested and revised, a 'John the Baptist' was sent to the Taraba Project a few days to the commencement of the exercise to: . [ntroduce the instrument to the Project team . Negotiate times and dates for all interviews with government offrcials . Plan initial planning and feedback meeting with all relevant staff . Sample sites for the evaluation . Ensure that all necessary documentation are made available to the team . Select local team members

2.2 Sampling

Sample sites were chosen according to the guidelines using coverage rates and where needed accessibility as parameters. Three LGAs were selected (one with high coverage, another having medium coverage and the third with low coverage). Two health facilities were selected for each L.G.A (one with high coverage, one with low coverage) and two communities were selected for each health facility chosen (one with high coverage, one with low coverage). This resulted in the selection of the following:

S/no. LGA Health facilitv Communitv I Yono (high Lankaviri Lankaviri'E' coverage) Napu'B' Kajong Kaione Shompah'B' 2. Ardokola Tau Answan Sauda (medium Gadaguru coverage) Ardo-Kola Ardo-Kola Kasakuru 3. Takum (low Fete Fete'II' coverage) Aeba Dogongawa Campo Ilcyor Total 3 LGAs 6 Health Facilities L2 Communities

It was pointed out by some team members that this sample was not representative of endemic communities in the State as a whole, since it did not reflect the level of endemicity. Since appointments had already been made which would be difficult to change, the team leader decided to continue with the present sample. It was accepted however that this aspect of representativeness be strongly considered in sampling in future evaluations, in addition to the coverage rate.

2.3 Protocol

, Research question: How self-sustainable is the Taraba CDTI project? . Design: Cross-sectional, descriptive. . Population;T"be Taraba project, including: its SOCT with relevant MoH officials; its NGDO partners; its LGAs with their LOCTs and policy makers; the project villages, their leaders and CDDs. . Instrument: * A record sheet, structured as a series of indicators of self-sustainability. The indicators are grouped into 9 categories. * The instrument assesses self-sustainability at 4 levels of operation. * The instrument guides the researcher to collect relevant information about each indicator. . Source of information;Yerbal reports from persons interviewed, supplemented by documentary evidence and observations. . Analysis: * Data from all sources is aggregated, according to level and indicator (Appendix 6) * Based on the information collected, each indicator is graded on a scale of 0-4, in terms of its contribution to self-sustainability. * The sunmary findings for each group of indicators were given at the end of each group. * The average'self-sustainability score'for each group of indicators is calculated, for each level. * A qualitative description of problem areas is given. 2.4 Team composition

The team was composed of the following:

l. Detlef Prozesky, University of Pretori4 South Africa (team leader) 2. Edith Nnoruka, University of Nigeria Teaching Hospital, Enugu. 3. Oladele Akogun, Federal University of Technology, Yola. 4. Joseph Okeibunor, University of Nigeri4 Nsukka. 5. Yemi Fayomi, NOCP 'C' Znnal Office, Federal Ministry of Health, Kaduna. 6. Phillip Sankwai, Ministry of Health, Kaduna State, Kaduna. 7. Chukwu Okoronkwo, NOCP, Federal Ministry of Health, Lagos.

This team was divided into three sub-teams to evaluate operations at the various levels. The team met twice to familiarize themselves with the instruments and to agree on the tentative sub team compositions and schedule. Initial meetings were also held with the State team members to acquaint them with the objectives and expected outcome of the evaluation.

2.5 Advocacy visits and 'Feedback/ planning' workshops

Advocacy visits were to be paid to relevant persons at each level (State, LGA, community) and officials were to be debriefed at the end of the field visits.

Finally, planning meetings were to be conducted for State and LGA levels which involved relevant officers at those levels. During these planning meetings the evaluation team would give feedback on its findings; based on these sustainability plans were to be developed and agreed on.

2.6 Limitations

The routine data collected at project level did not contain aggregations for the health facility level, which made sampling for communities and the health facilities a little bit difficult. a The documentations required in an LGA were not available despite prior information. ! ln spite of initial briefings some project staffwith the evaluation team took the evaluation as an examination and were expressly concemed when they felt the necessary information and/or documentation was not forthcoming. Treatments in some areas were huniedly concluded in order to pass the 'examination'. A community in Takum had to be substituted as it was reportedly deserted following inter-ethnic clashes. Another community in Ardo-Kola also had to be substituted due to the deliberate absence of the CDD and unavailability of the community records. The problem with representativeness of the sample is discussed above. 9

Findings and recommendations

1. State level l.l Overall grading (on a scale of 0-4)

Taraba project: selfsustainability at State/ project level

3.5

t E z.s .9 o32 @ P r.s (D G'1

0.5

0

.o'^9" od a."""" """"". .""""* $""i.o"-f-'"""'..""""'"f """"t group of indicators

1.2 Main findings

The situation regarding self-sustainability is fair, but there are significant problem areas. The major findings are:

. Coverase is high and well maintained. Coverage figures are being incorrectly calculated though.

' Planning is thorough and detailed at project level, because of the APOC requirements. All partners participate in the planning, and are allocated clear responsibilities. At State level CDTI is planned for like other programmes, but the plan is not detailed. There has been no specific planning for sustainability, although managers are aware of the problem.

' Leadership: there is a senior official allocated to the onchocerciasis control programme, and he has enough time for this task. He has an adequate team of field workers. There is evidence of political commitment, but only up to the level of the Commissioner for Health. There have been no disbursements from the State for two years running. 10

Supervision and monitoring takes place within the government system. NGDO partners also carry out monitoring, but this is not always integrated with that of the State. Supervision/ monitoring is routine but not always targeted, and is sometimes carried on to lower levels than the LGA. Successes and problems are identified but not always noted and dealt with.

Mectizan ordering, storage and dishibution are dependent on activity and funding from NGDOs and APOC. Stock control is mainstreamed and effective, using a unique system which is an improvement on the Ministry procedure. The NGDO involvement in Mectizan supply, while not ideal for sustainability, is probably dependable.

Training and sensitisation activities are conducted more or less appropriately. However mobilisation is not fully targeted, and SOCTs are inappropriately involved in training at district and community level: delegation/ empowe(ment of LOCTs and CHEWs (to take charge fully of training and mobilisation) remains to be completed.

Finances and funding: budgeting for CDTI is routinely done in detail. Adequate but inappropriate amounts are budgeted - inappropriate in the sense that the current level is not sustainable. The proportion of funds released by the State is decreasing. Management is not fully awareof the size of the shortfall and has no specific plans to remedy it - there is a sense however that partner NGDOs will not wholly abandon their investment of the years, and may probably be depended on for targeted assistance in critically important areas. The financial control system is excellent.

Transport and material resources: transport is plentiful but dependent on APOC. It is well managed but used below LGA level. Other material resources are sufficient, but staffis sometimes obliged to use the resources of other programmes. There is no dependable plan for replacement of transport or equipment, although there is little doubt that partner NGDOs will continue a measure of support forthis aspect.

Human resources: staff at this level are skilled and knowledgeable, but their number is too great. Personnel are stable and replacements could easily be trained on the job. The NGDO input in human resources is constant and significant.

1.3 Recommendations

Recommendation Implementation Planning: Priority; HIGH r { plan and budget must be drawn up, Indicators of success: for the 2003 round of distribution. Each r I detailed plan and budget exists fof 2003, activity has to be specified and fully as described on the left. costed, and the total budget has to fall r I detailed 5 year plan exists, as described. within the amount that will be available . Attendance register of the plannins exercise. (see'Financial resources' below). . Who to take action: As part of the same exercise, a 5 year . State PHC Coordinator - Dr Ajai plan of the same kind must prepared. . be ' SOC - Dr Apake These planning exercises must be . ZOC - Princess Ogbu-Pearce participatory, including SOCT members . NGDO partners (CBM and MITOSATH) and NGDO staff. De adl ine for comple t ion: . November 2002 ll

Financial resources: Prioritv: HIGH . The funds that will be available for the Indicators of success: 2003 distribution must be accurately l. Written breakdown of assured frurds for determined (from the State; from 2003. remaining APOC funding; from 2. The fundraising plan exists. NGDOs, from the public - any realistic 3. Official documents exist which pledge the source). amount and duration of future financial . If there is not going to be enough money suoport from outside. for the minimwn number of activities Who to talce action: that need to be caried out during 2003, . State PHC Coordinator- Dr Ajai the same planning team (see 'Planning' . SOC -DrApake above) must make a very specific plan . ZOC - Princess Ogbu-Pearce for raising additional funds. . NGDO oarbrers (CBM and MITOSATH) . This plan must be implemented, Deadline for completion: resulting in firm promises of additional 1. May 2002 funds from other sources being obtained 2. May 2002 as soon as possible, in writing. 3. November 2002 . The same must be done for each of the remainins vears,of the proiect. Providine leadership: PrioriU: HIGH : ftl order to secure political commitment Indicators of success: to CDTI at the top level, there should . A report of the advocacy events that were be targeted and innovative, high- conducted powered advocacy at the level of the . Adequate counterpart funds have been Governor of Taraba State released. Who to take action: . APOC management at Ouagadougou . NOCP (involving SOC and his team, NGDOs- State MoH manasement) De adline for completion: . December2002, repeated as needed (e.g. when Govemor shanges, or when counterpart fundins is not forthcomine) Transport and other material resources: Priority: HIGH r I specific, realistic, dependable plan must Indicators of success: be made for ensuring the continued l. A realistic written plan exists for provision of adequate transport, once APOC assuring fufure transport as described on funding comes to an end. This plan should the left. include a strict maintenance schedule, and 2. A written document from APOC, funds for it; funds for fuel and repairs; speciffing the nature and timing of the replacement of present project vehicles 'alimony' that mav be orovided. when these come to the end of their life (and Who to talce action: considering cheaper altematives); using . State PHC Coordinator - Dr Ajai altemative forms of transport (e.g. public . SOC - Dr Apake transport). . ZOC - Princess Ogbu-Pearce . APOC must be requested to consider . NGDO partners (CBM and MITOSATH) meeting some pressing capital needs (in , APOC HO manasement t2

transport and equipment) which are Deadline for completion: expected to exist at the end of the funding l. May2002 period - this as a form of 'alimony' for 2. December 2002 when the proiect has to soldier on by itself. Monitoring and supervision: Priority: MEDIUM . Monitoring data from 2001/ 2002 must be Indicators of success: used to identiff LGAs with low coverage 1. A supervision timetable for 2003,which and other problems. When planning for the takes account of all the requirements on 2003 distribution these LGAs should the left. This timetable should be part of receive particular supervision, and not those the overall detailed year plan. which are going well. 2. A report of the steps taken to commend . LGAs which are doing well should be LGAs which perform well. publicly commended for the good job they 3. A report of the successfully completed are doing - e.g. by receiving a letter of LOCT training, as described on the left. commendation signed by the State 4. Written guidelines on problem Govemor. identification and management (for . LOCTs should receive practical training in LOCTs) exist. problem identification and management, in Who to takc action: order to empower them to supervise the . SOC - Dr Apake - and his team lower levels more effectively, and to . ZOC - Princess Ogbu-Pearce identifu and deal with problems at district Deadline for completion: level as they crop up. 1,2,3 Dec,ember2002 . Guidelines on problem identification and 4. July 2002 management (for LOCTs) should be drawn up, for use during the above-mentioned training and afterwards. Human resources: Priority: MEDIUM r fu view of the fact that SOCT activities Indicators ofsuccess: overall are being targeted and decreased, the r I report describing the redeployment of number of SOCT members should be SOCTs rationalised. Their number could be pruned Who to take action: to 4-6, or alternatively the present number . SOC - Dr Apake could and be given other responsibilities to . PHC coordinator - Dr Ajai occupy them when they are not involved in . Permanent Secretary- Dr Mohammed CDTI. D e adl ine for c o mpl e t i on: December 2002 Trainine and sensitisation/ mobilisation: Priority: MEDIUM . Training conducted by SOCT members must Indicators of success: continue to be targeted. Only LOCT members 1. A training timetable for 2003, who clearly lack skills, or who are new to the job, which takes account of all the should be trained. LOCT members who are requirements on the left. known to be performing well do not need further 2. A mobilisation/ advocacy timetable training. for 2003, which takes account of r fu particular LOCT members should receive the requirements on the left. training, where needed, to be able to train 3. Reports on the training and CHEWs at the district level entirely by mobilisatio nl adv ocacy visits themselves, and to conduct mobilisation within conducted during 2003 the districts entirely by themselves. Note: the timetables should be part of . Training should move to the LGA level. SOCT the overall vear plan for 2003. 13

members should travel to a given LGA to Who to take action: supervise the training there - this will be cheaper . SOC - Dr Apake and his teamMr than bringing LOCT members to Jalingo. Sankwai . Mobilisation/ advocacy conducted by SOCT . ZOC - Princess Osbu-Pearce members must be targeted, to include only LGAs D e adl ine for c o mpl e t ion: known to be in need of advocacy, or districts/ 1,2 December2002 communities for which LOCTs request help. 3. December 2003 Mectizan procurement and distribution: Priority: MEDIUM The responsibility for fetching Mectizan Indicators of success: annually from the UNICEF store in Lagos, and 1. The plan and budget mentioned distributing it to the LGAs, must be transferred to under'Planning' above must show the SOCT. The costs of this exercise must be met that the State will do the from self-sustainable resources - preferably from transporting mentioned on the left, State counterpart funds. If other resources are to using self-sustainable resources. be used written pledges must be obtained. 2. Signed pledges of non-State, self- The responsibility for ordering and storing sustainable resources being used. Mectizan should be devolved to the State as soon 3. A report of training empowering as possible, while maintaining the present unique SOCT to order Mecrtizan annually. system of stock control: 4. A letter indicating that the State has * CBM and MITOSATH should immediately provided a suitable room, or from start teaching the SOCT to do the annual NGDOs pledging their provision of ordering, so that the June 2003 order will be the same. * made by the SOCT independently. Who to tal@ action: The State should provide an adequate, lock-up . SOC - Dr Apake room for storing Mectizan. Altenratively, , NGDOs - CBM and MITOSATH NGDOs must provide written confirmation Deadline for completion: that they will do so for the foreseeable future. December 2002 t4

,, LGA level

2.1 Overall grading (on a scale of 0-4)

Taraba projecfi self-sustainability at LGA level

S3

E, ''u i2o o gED 1.5 (D1 (E 0.5

0 *9" .o' odr -""'f -ftt.*"-f"'""""'"."-"'/ $".""'""'" group of indicatorc

2.2 Main findings

The situation regarding self-sustainability at this level is reasonably good, although there is considerable variation in LG support, from area to area. The main findings are:

' Coverage: Both geographical and therapeutic coverage are affected by numerous inter- and intra-communal conflicts in several parts of the State. Some LG teams do not have a list of communities they should be treating. In some cases the therapeutic coverage is being incorrectly calculated (using the eligible population as denominator) - as a result coverage rates are spuriously high.

' Planning: There is no documented routine planning at the LG level, and they only start planning when prompted by the SOCT. [n one case plans were written, contained all the necessary elements and were drawn up in a participatory way, but in others one or more of these desirable aspects of planning was lacking.

. Leadership: [n each LG the LOCT was in place, and had a designated team leader. Some LOCT leadership was rather passive, depending on SOCT stimulation to galvanise it into action. The level of political commitment of LG leadership appeared satisfactory, although there was some local variation.

' Monitoring and supervision: [n some LGA areas the LOCT does 2-3 visits to each community during each distribution; in others it is not clear how many visits take place (if any). Routine data collection takes place within the PHC system, but in some instances 15

LOCTs have to go to the village level to collect it (which is less sustainable). Visits for monitoring/ supervision at this level are not documented in report form, nor are supervisory checklists used. However problem solving by LOCTs appears satisfactory.

Mectizan supply: Mectizan is stored in acceptable space at this level. The State team delivers Mectizan to the LGs. However this is not the method of procurement of other drugs by the LG and is therefore not sustainable.

Training and mobilisation: CFIEWs are actively involved in CDD training and mobilisation, but LOCTs still do a lot of mobilisation. Training and mobilisation activities do not have any specific larget or focus and therefore are routine and ineffrcient. The CDTI raining manual is not available at the LOCT level.

Finances/ funding: In many instances (but not all) LGAs make some funds available for CDTI activities at this level. The LOCTs do however depend on the small yearly disbursement from APOC. [n some cases funding is inadequate, and as a result some LOCTs occasionally use some of their own money. There is no specific LGA budget for CDTI, thus making annual planning difficult.

Transport: In general this is adequate, although some instances were reported where distribution was delayed due to lack of transport. LG funds are commonly made available for fuel and maintenance, and in most cases transport at this level is used in an integrated fashion. Maintenance of vehicles is not systematically carried out.

Human resources: LOCTs are stable and well trained. Their level of motivation varies.

2.3 Recommendations

Coverage Priority: MEDIUM 1. SOCT must make special arrangements to Indicators ofsuccess: treat those displaced by communal strife, 1. Update of absentees in the register who are now returning. 2. All LOCTs have lists of communities they 2. SOC must ensure that all LOCTs have an should treat up-to-date list of the communities they 3. Rates are calculated with the correct should be treating denominator 3. SOC must ensure that the therapeutic Who to take action: coverage rates are being correctly . Dr Apake and SOCT members calculated, using the total population as Deadline for completion: denominator (not the eligible population) . July 2002 Plannins Prioritv: HIGH . LGA PHC co-ordinators, LOCT leaders Indicators of success: and Supervisory Councillors for Health . Availability of written plan (as described draw up a detailed plan and budget for on the left) at the LG office CDTI in the LGA, for 2003. Who to take action: . The plan contains a timetable of all . LOCTs (leaders and members); LG PHC activities, and details of all resources co-ordinators; Supervisory Councillors for needed (human, material, financial). Health . The plan addresses local needs . SOC Dr Apake and SOCT members specifically and systematically. encourase and enable LOCTs t6

Deadline for completion: . December2002 Leadership Priority: HIGH . The leadership at LGA level needs to be Indicators ofsuccess: informed more fully about CDTI, and . LGA leadership ensures that CDTI is motivated to take a more active interest in properly resourced and supported. it. ('Leadership'means political - the ll'ho to take action: health councillor, and technical - the PHC . SOC Dr Apake and the SOCT members co-ordinator). . LGA Supervisory Councillors for Health . Such sensitisation should be targeted to De adl ine for c o mpl e tion: those LGs where leadership is known not . December20l2 to take an active interest in CDTI - LGs which are not allocatine fundine to CDTI. Financing/ funding Priority: HIGH . LOCTs must be helped to obtain the funds Indicators of success: needed for the yearly distribution: making . Written confirmation of financial support application firstly to their LGs, but also if from donors (LG, NGDOs etc.). necessary to parhrer NGDOs and other Who to take action: local philanthropic groups. , LOCT leaders, LG PHC co-ordinators, LG Supervisory Councillors for Health D e adl ine for c ompl e t ion: . December20A2 Traininq and mobilisation Priority: MEDIUM 1. The LOCT should be enabled to train the Indicators of success: CFIEWs at the district level. SOCT 1. 2003 training and mobilisation of district members should only support and level stafffully undertaken by LOCTs supervise such training. 2. LOCTs are not involved in the 2003 2. LOCT members should restrict their training of CDDs/ mobilisation of training and_mobilisation activities to the communities district level, unless CHEWs specifically 3. Clear operational need exists for all ask them to attend to problems at training conducted by LOCT in 2003 community level. 4. Each LOCT Dossesses a trainins manual 3. Such training and mobilisation should be Who to take action: targeted - i.e. particularly focused on 1,4 SOC Dr Apake and SOCT members those districts which really need it. 2.3 LOCT - leader and members 4. SOC must ensure that every LOCT De adl i ne for c ompl e tion: has at least one copy of the CDTI training . December2002 manual. Supervision and monitoring Prioritv: MEDruM 1. Statistics must be aggregated in such a Indicators of success: way that it is possible to get coverage l. Availability of coverage drtaaggregated at figures for each district. district level 2. The 2001/ 2002 statistics must be used to 2. 2003 year plan shows that monitoring is identift districts with low coverage. When targeted, with problem districts receiving planning for the 2003 distribution these special attention districts should receive targeted 3,5 2003 year plan shows that LOCTs focus supervision. their monitoring at the district level 3. LOCTs should not routinely visit 4. Supervision reports exist which show that communities - that is the responsibilitv of LOCT members are usins the checklist t7

the health centre CHEWs. Who to take action: 4. LOCTs should use the prescribed . SOC Dr Apake and SOCT supervisory checklist systematically, at . LOCT - leader and members each visit. D e adl ine for c o mp I e tion: 5. Health centre CHEWs (not LOCTs) 1. July 2002 should be primarily responsible for 2,3,4 December 2002 collecting community level reports/ 5. June-July 2002 statistics Mectizan procuremenU distribution Prioritv: MEDIUM LGs should arrange to collect their own Indicators ofsuccess: batch of drugs from the State office using ' LG collects Mectizan from Jalingo along the same system for procurement of other with the collection of other essential drues drugs (such as the essential drugs.) Who to takc action: , LOCT leader. LG PHC co-ordinator Deadline for completion: . December2002 Transport Priority: HIGH 1. LOCTs must be enabled to negotiate for Indicators of success: sufficient hansport to conduct the yearly l. Written undertakings by partners to distribution - negotiating for the use of support transport needs of CDTI for each vehicles, and for the funds to operate LG, for 2003 them. The following may need to be 2. Written evidence of the control system approached: other programmes at the 3. Written evidence of systematic LGA level (for use of their vehicles); the maintenance LG (for fuel and maintenance); partner 4. A written plan for replacement of transport NGDOs (for fuel and maintenance). exists; written undertaking from partners 2. A system of strict control of the to assist when the present vehicle needs prograrnme motorcycle needs to be reolacement instituted: authorisation of every trip and Who to take action: every expenditure (fuel, tyres and . SOC Dr Apake and SOCT repairs); a log book; and monthly ' LOCT - leader and members reconciliation of trip authorisations and . LG PHC co-ordinator logbook entries. Deadline for completion: 3. LOCTs must be enabled to carry out . December2OO2 vehicle maintenance systematically. 4. A specific, realistic, dependable plan must be made for transport, for when the present programme motorcycle comes to the end of its life. This could be finding funds for a new vehicle; using public transport: usins LGA pool vehicles etc. Human resources Prioritv; MEDIUM . SOCTs must ensure that new LOCTs Indicators of success: members are adequately trained and . All LOCT members are fully trained orientated.. Who to take action: . SOC Dr Aoake and SOCT Deadline for completion: . December 2002 l8

3. Health centre/'district' level

3.1 Overall grading (on a scale of 04)

I i faraba proiect: self-sustainability at health centre level

i

3.5 {3 E ,C E!2 o P r.s o .E

0.5

.r4"" od {o""" ..r"--*--.":"-""-:""'"t """"t,""^"."""j.? """' group of indicators

3.2 Main findings

It is clear from the diagram above that much more needs to be done to safeguard self- sustainability at this level. The core ofthe problem is that LOCTs tend to do too much at community level themselves, rather than empowering/ enabling health centre staff to take over. In two out of three areas the district level staff was at least involved in the progftunme, which is good for sustainability. In the third however they were hardly involved at all, with LOCT members taking almost all the initiative.

. Coveraqe: Generally health centres succeed in covering the communities allocated to them. In some districts the staffdo not know how many villages they should be covering, nor do they know the therapeutic coverage rate that has been achieved in their catchrnent area - there is no documentation on coverage rates at this level.

. Plannins: This is done by the LOCT and passed on of the health centre staff- it does not therefore address the specific needs of the health centre area. Planning is not written but ommitted to memory by the staff.

' Leadership: Although health centre staffare willing to play their part, there is little room for them to take the initiative - it is the LOCT that takes the lead throughout. t9

Supervision and monitorins: [n two LG areas health centre staffare performing well: actively supervising and monitoring community level activity; collecting CDDs' statistics and reports; and solving the problems that arose at community level. [n the third LG area health centre staff was hardly involved in these activities at all.

Mectizan procurement and distribution: Generally this is working well. In most cases there is adequate storage spirce for the Mectizan at the distribution centres, and the CDDs themselves fetch the drug from there. In a few cases it is the LOCT members (not the local CHEWs) who work out how much Mectizan in needed for a given area. [n one case it was even reported that the SOCT delivers Mectizanto villages.

Training and sensitisation/ mobilisation: In most cases training of CDDs is primarily undertaken by LOCT (and even SOCT) members, with the local CtIEWs in attendance. CDD training takes place routinely, and is not targeted at all. Local CHEWs are routinely involved in commtrnity mobilisation however, and have suffrcient IEC materials for this purpose.

Financine and fundine: Financing of CDTI activities at this level is adequate and there is integration into other health centre activities. There is no budget for CDTI at this level, but none is really required.

Transport: Accessibility of the health centre to the catchment communities is generally good. However in some cases this is a major problem, affecting effective supervision of communities around the health facility area. There is some integration, where the same limited transport available is used for different programmes.

Human resources: Generally personnel at the health facility are willing to participate in CDTI and there is some stability at this level.

3.3 Recommendations

Coveraqe Prioritv: HIGH . Copies of records from the health Indicators ofsuccess; centre area should be retained by the . Copies of community and district level CDTI health center. data exist at the health centres. . LOCTs should enable district staff . District staffare able to interpret the data from to calculate the coverage rates for their area and to use it for plannine. their areas, as a tool for monitoring Who to take action: their own performance and planning . LG PHC co-ordinator and LOCTs their work. . District level staIl D e adline for c ompl e t i on: . December2OO2 Planning Priority: HIGH . LOCTs should enable health centre staffto Indicators ofsuccess: compile written year plans for CDTI in their . The plan exists, as detailed on the left. catchment areas. Who to tql@ action: . Such plans should contain a timetable of all . LG PHC co-ordinator and LOCTs activities; details of all resources needed . Health centre staff (human, material, financial); and take local De adl ine fo r c o mpl e t i o n: realities and problems into account. , December200? Leadership Priority: HIGH . LOCTs should Indicators of success: enable health centre , Health centre stafftake charge of 2003 distribution in their areas staff to assume Who to take action: responsibility for ' LG PHC co-ordinator and LOCTs managing the CDTI , CHEWs in charge of health centres prograrnme in their D e adl ine for c ompl e ti on: catchment areas. . December2002 Supervision and monitoring Priority: MEDIUM . CFIEWs in charge of CDTI at health centres must Indicators of success: analyse village coverage figures for 2001/ 2002, . Each district has a supervision and identiff those that are struggling. When timetable for 2003, which takes planning for the 2003 distribution these villages account of the requirements on should recrive particular supervisiorq and not those the left. This timetable should be which are going well. part of the overall year plan. . LOCTs must identifu districts where health centre Wo to toke action: staff is not taking responsibility for supervising and , LG PHC co-ordinator and LOCTs monitoring CDDs (collecting statistics and reports; . CHEWs in charge of health visiting communities during distribution). ln these centres districts staffneeds (and to be encouraged trained if De adl ine for c omple tion: necessary) to perform this function effrectively. ' December2002 Mectizan procurement and distribution Priority: HIGH . LOCTs must identify districts where health Indicators of success: centre staffare not taking fi.rll responsibility . Health cenhe staffmake correct orders, for ordering and supplying the correct based on census results ofthe previous arnounts of Mectizan for their communities. year . In these districts the staff needs to be Who to take action: encouraged (and ifnecessary trained) to . LG PHC co-ordinator and LOCTs perform this function effectively (estimating . CHEWs in charge of health centres amounts based on previous census results; Deadline for completion: making the order accordingly). , December 2002 Training and sensitisation/ Priority: MEDIUM mobilisation: Indicators ofsuccess: ' Training of CDDs should be l. There is a training plan for the year conducted by CHEWs working in 2. Sub-district CFIEWs are in charge of the training. the health centres, not by higher 3. Training is only done for CDDs who really need it levels (e.g. SOCT members). Who to take action: LOCT members may be present to . LG PHC co-ordinator and LOCTs support and supervise. . CI{EWs in charge of health centres . Yearly training of CDDs should be De adl ine for c ompl e tion: targeted - i.e. particularly focused 1. December 2002 on those who really need it. 2,3 knmediately before the 2003 distribution Transport and material resources Priority: MEDIUM . LOCTs must identiff districts Indicotors ofsuccess: where the distribution is being . Availability of means of transport durins supervision hampered by a lack of Who to take action: transport, and must work with . LG PHC co-ordinator and LOCTs the local CHEWs to plan . CFIEWs in charge of health centres effectively to overcome this Deodline for completion: problem. . December2002 4. Village level

4.1 Overall grading (on a scale of 0-4)

Taraba proiect self-sustainability at community/ village level

4

3.5

t 3

2.5 -9o 3 2 o ED .E 1.5 o 1

0.5

0 e& .@' odr a*o'"" "*."a.." -!*.r-:..""..:"""."" "-."ta+o ""t' Group indicators

4.2 Main findings

Overall, the programme appears highly sustainable at this level. Communities appreciate the cost and benefit of the drug and accept that distribution will continue for a very long time. They are willing to meet their responsibilities within the resources available at the community level.

. Coveraqe: Generally therapeutic coverage is good (although in some cases it is falsely high, since'eligible population'was used as denominator). A few communities have low rates, indicating major problems.

. Planning: Universally the census is done separately from, and preceding, the distribution. This effectively doubles CDDs' workload.

. Leadership: [n almost all communities the local leadership actively supports the distributioru and helps to solve problems as these appear.

. Monitoring: In the majority of cases community reports were submitted in time to the district. In about half of the communities the village register was not well kept.

. Mectizan procurement and distribution: In the majority of cases enough Mectizan is received, on time. In a few cases CDDs are only given small amounts at a time, and have to fetch more as the distribution progresses. 22

Mobilisation/ sensitisation: In almost all communities this is proceeding satisfactorily, although IEC materials are sometimes lacking.

Finances/ fundine: tn the majority of cases villagers appreciate the programme, and support CDDs in cash or in kind. Some few still remain apathetic though, leaving CDDs to struggle by themselves..

Transport: All communities visited collect their Mectizan from collection centres themselves. No cases were reported where lack of transport led to the drug not being collected.

' Human resources: CDDs are well traine4 and new CDDs easily get the faining and orientation they need. Communities and CDDs are generally prepared to continue supporting the programme in the long terrn, although this motivition depends to some extent on how much a community has suffered from the disease.

4.3 Recommendations

Planning: Priority: HIGH . CDDs undertake only one visit to Indicators of success; each family during each distribution - l. CDDs combine the census and distribution in a i.e. the census and Mectizan single home visit in the 2003 distribution. distribution are done at the same time. 2. The reports of the refresher training in the new . LOCTs and health centre staffshould method exist. suggest this way of doing CDTI to Wo to take action: CDDs and villagers - since in the . SOC and SOCT spirit of CDTI they have to make the . LOCT and district Ievel staff decision . De adl ine for c ompl e t ion: This new method needs to be l. February-April 2003 included in refresher CDD haining. 2. December 2002 Mectizan ordering and distribution Priority: HIGH . The amount of drug required should be Indicotors of success: estimated on the basis of the community , District staffmake the 2003 order based on population that is updated during each the 2002 updated census. annual treatment. This is done from 2003 Wo to take action: onwards. . SOC and SOCT . LOCT and district level staff Deodline for completion: . December2002 Mobilisation/ sensitisation Priority: HIGH . Where the programme is not doing Indicators of success; well (low coverage rate, poor support . Reports of specific mobilisation of .problem' for CDDs etc.) LOCTs and district villages exist. level staffneed to conduct specific Wo to take action: and focused mobilisation of ' LOCT and district level staff. communities, to improve their Deadline for complet ion: support for CDDs. . December 2002 23

5. Overall self-sustainability grading for the Taraba project

Following on the analysis above, the level of self-sustainability of the Taraba project is judged to be as follows:

Level of Description sustainabilitv High This project is not far from being sustainable. With feedback from the team before departure, the project staffshould be able to undertake the required remedial action.

Reasons for this judgement: . Money - there should be sufficient money available to undertake strictly necessary tasks . Transport -it should be possible to make provision for the running, maintenance, repair and eventual replacement of vehicles. . Supervision - it should be possible to conduct the necessary monitoring and supervision at all levels. . Mectizan supply - the supply system is currenfly dependable, and should continue to be so. . Political commit?nenr- although there are some gaps, it should be possible to remedy these with intensive advocacy. 24

Advocacy activities and planning workshops

The team planning the evaluation and APOC management decided together that each evaluation team would have two tasks: . Assessing the self-sustainability of the project concerned. . Using the findings of the evaluation in apractical way, to help local stakeholders to plan for optimal sustainability of their projects. It was felt that this would b much more powerful than sending yet another report a few weeks later. This section describes how the evaluation team went about frrlfilling the second task.

l. Advocacy

The team undertook the following advocacy activities:

1.1 State level

Involving the State Onchocerciasis Co-ordinator Throughout the evaluation there was constant communication with the SOC, and he was encouraged to be involved with all steps of the evaluation. This was done to make him fully aware of the issues around self-sustainability, and to increase his commitment to the changes which he and his team would have to plan and implement in the near future. He used this opportunity to the full, and appeared to have gained a clear vision of the present situation and futtre needs. [n order to strengthen this motivation, he was approached to become a member of the evaluating team for the Cross River (the same had been done with the Kaduna SOC, who was now a member of the Taraba evaluation team). He agreed enthusiastically.

Visits to officials of the State Department of Health * Courtesy calls were made at the beginning of the evaluation, to the Hon. Commissioner for Health, Permanent Secretary and the Director of Disease Control/ PHC. The purpose of the evaluation was explained to them, and their co-operation was requested. * At the end of the evaluation meetings were held with the same persons. The findings were surlmarised to the Commissioner, who was delighted at the evaluation and promised renewed commitment. He promised to make attempts to fix an appointment with the Governor to meet the team of evaluators. He noted that the State had not made plans for sustainability acknowledging it as an oversight which would be put aright immediately by the MoH.

Visit to H.E. the Deputv Governor of Taraba State * The evaluation team had met the Commissioner for Health, whose political commitment for the sustainability of the programme was explained. The State however has not met its obligations despite the requests to the govemment for counterpart funding. The Commissioner for Health arranged an appointment for the team to meet the State Govemor but the Governor delegated the Deputy Govemor to receive the team. * The Evaluation team visited the Deputy Governor in company of Commissioner for Health, the Permanent Secretary, Director of Disease Control and representatives of 25

the NGDOs working in the State oncho control. The Deputy Governor expressed appreciation for the reminder effect that the visit has had on the government and promised to ensure that the State meets its obligations and pay the counterpart funds. He also promised to persuade the LGs to pay their own counterpart fi.rnds as well.

1.2 LGA level

In each of the three LGAs where field work was done, efforts were made to inform and motivate the authorities. This was done in three ways: . Courtesy visits upon arrival in the area: to LGA offrce bearers (whoever was available); Supervisory Councillor for Health; Director of PHC. . Collecting information about the programme from these persons. . Giving detailed personal feedback to these persons, at the end of the data collection period.

2. Feedback/ planning workshops

2.1 State level

This workshop was held on Monday 6ft May, at the CBM office in Jalingo. In attendance were: the evaluation team; the SOC Dr Apake and the whole SOCT; the Director of PHC for Taraba State, Dr Aji; the zonal onchocerciasis coordinator Dr Ogbu-Pearce; and local staff of the two NGDO partners, CBM and MITOSATH.

The full programme is given in Appendix 1, and the detailed proceedings in Appendix 2. The following is a summary of the workshop process:

. Introduction to the workshop process . Presentation: what is self-sustainability? . Brief report of evaluation team's findings at the community, health facility/ district and LGA levels . Detailed report of the evaluation team's findings at State/ project level. . In-depth open discussion on the findings and their implications. . Group work: 'Preparing broad recommendations for action at State/ project level'. Each small group made suggestions conceming two of the nine groups of indicators. This was followed by group report back and discussion. . Group work: 'Planning for self-sustainability at State/ project level'. Groups had two tasks: making a plan for 2003, and identifuing resources for 2003. Again this was followed by group report back and discussion. . Open discussion: 'The way forward: implementing self-sustainability in the Taraba CDTI proiect'.

Since time ran out before the plan thus produced could be finalised in detail, it was decided that half the SOCT would meet on the following day, assisted by team member Mr P Sankwai, to complete the task. The resulting plan is given in Appendix 3.

The workshop process was successful. There was a lively exchange of views throughout the day, with the final plan being very much a consensus document. It was therefore decided to use the same process at the LGA level workshop on the following day. 26

The 'Taraba State self-sustainability plan' now exists - but it clearly still needs to be put into practice. This is primarily the responsibility of the SOC and local NGDO staff, and these persons need to be actively encouraged by the NOC, ZOC and national NGDO coordinators. In particular, the project leaders need to look critically at the evaluation team's recommendations as they appear in this report. They may wish to incorporate some of these in the 'Taraba State self-sustainability plan' which was prepared at the

2.2 LGA level

Two identical workshops were held, on Tuesday 7tr and Wednesday 8ft May 2002. The locale was the conference room at the State secretariat. In attendance were: . As facilitators: the evaluation team; the SOC Dr Apake and the whole SOCT; the zonal onchocerciasis coordinator Dr Ogbu-Pearce; local staffof the two NGDO partners, CBM and MITOSATH. . LGA representatives: LOCTs (kaders and teams); LG PHC co-ordinators; LG Supervisory Councillors for Health. Six LGAs attended on the first day, and six on the second (this was done so that the workshops would not be too large to give individual attention to each LGA). The mix of persons attending varied from LGA to LGA, but all were represented.

The full programme is given in Appendix 4, and more details of the proceedings in Appendix 2.Tlte workshop process closely followed that of the State level workshop held on 6n May, except that of course the focus was on the LGA level. LGA/ LOCT teams participated actively throughout, and prepared detailed plans (of varying quality) with the assistance of their facilitators. These plans are given in Appendix 5, exactly as they were produced.

Again, twelve 'LGA self-sustainability plans' now exist. Several need more work to be done on them though, to be of practical use, and all need to be put into operation. This is primarily the responsibility of the LOCTs and their leaders, but they will need the support and encouragement of the SOCT. Again, LGN LOCT teams need to look critically at the evaluation team's recommendations for their level, as they appear in this report. They may wish to incorporate some of these into the plans that they prepared at the workshop. It is suggested that SOCTs encourage the LGAs to improve on their plans in this way. 27

Appendix I State level workshop programme

Assessment of the self-sustainability of the Taraba CDTI Project

PLAI\IMNG WORKSHOP FOR STATE/ PROJECT LEVEL MAY 6,2002

AGENDA

S/II ACTIVITY TIME [.ACILITATOR 1. Openins Dravers 10.00 - 10.0s Pastor Skwaila 2. General introduction 10.05 - 10.r5 Dr. Anake 3. lntroductory remarks t0.15 - 10.20 PHC Director 4. Aooointment of scribe 10.20 - 10.2s 5. lntroduction to the workshoo Drocess 10.25 - 10.3s Prof Akosun 6. Evaluation obj ectives : 10.35 - 10.50 Prof. Prozesky What is self-sustainabiliW? 7. Methodolosv & limitations 10.50 - l,1.00 Mr Okoronkwo 8. Brief summary of findings: ' Community level 11.00 - I t.0s Dr Fayomi . Health facility/ district level 11.05 - I1.10 Mr Sankwai . LGA level 11.10-1t.15 Dr. Okeibunor (followed bv time for ooen discussion) II.I5 - 1,,.25 9. Summary of findings: . State/ project level 11.25 - 11.45 Dr. Nnoruka (followed bv time for ooen discussion) 11.45 - 12.00 10. BREAK 12.00 - 12.20 11. Where do we go now? - preparing broad recommendations for action at State/ project level (group work) . Group l: Planning, Finances 12.20 - i,3.20 ProfProzesky . Group 2: Training,Mectizarr . Group 3: Supervision, Leadership . Group 4: Manpower, Transport Each group appoints a scribe to report back 12. Report back from group work 13.24 - 14.00 Prof. Akogun (followed bv time for ooen discussion) 13. LUNCH 14.00 - 15.00 14. Planning for self-sustainability at State/ project level (group work) . Group l: What will our resources be for 2003? * Identifu dependable sources of firnding 15.00 * 16.00 Dr Okeibunor * Estimate likely amounts involved * Rank sources in order of 'dependability' . Group 2: What needs to be done during 2003? * Listing essential activities * Costing each activi8 (roughly) 28

15. Report back from group work 3.45 - 4.45 Dr Fayomi (followed bv time for ooen discussion) 16. The way forrvard: implementing self- sustainabitity in the Taraba CDTI project 4.45 - 5.30 Prof. Prozesky ' Practical steps to take the process forward (open discussion in the whole sroup) 17. General matters/ administrative information 5.45 - 6.00 Dr. Apake 18. Conclusions/ closing 6.00 - 6.15 Mr. Oeoshi

Facilitators for small groups in Session ll

Group l: Planning. Finances * Mr Okoronkwo * Dr Apake * Dr Ajai Group* 2: Training. Mectizan * Prof Akogun Mrs Olamiju , * Mr Sankwai Group 3: Supervision- Leadership " DrNnoruka * Princess Ogbu-Pearce * Dr Okeibunor Group 4: Manpower. Transport * Dr Fayomi * Mr Ogoshi * Prof Prozesky

Facilitators for small groups in Session 14

Group 1: What will our resources be for 2003? * Dr Fayomi * Mr Ogoshi * ProfProzesky * Mr Okoronkwo * Princess Ogbu-Pearce * Dr Ajai

Group 2: What needs to be done during 2003? * Prof Akogun * Mrs Olamiju * Mr Sankwai * Dr Nnoruka * Dr Apake * Dr Okeibunor 29

Appendix 2 The SOCT and LGA workshop processes

The SOCT worksho

The following is a record of &e process of this workshop:

1. Introductions and summary of findings of lower levels

. The Evaluation team leader introduced the elements of sustainability: effectiveness, efficiency, simplicity, integratiorl attitude and resources. . Reasons for evaluating the Taraba CDTI project was discussed. ' The general method was to attempt to get the participants to relax and to contribute to discussions without feeling shy or inhibited. . The methodology (low coverage, high coverage, peripheral health) used for the evaluation exercise was discussed and the limitations to the procedure were identified. . The State teagn was presented with a summory offindings at levels below the State (the community, health facility, and LG levels). This was just to acquaint them with the situation at these levels. . The meeting then discussed the findings together. There was enthusiastic discussion on the sunmary of findings at the levels below the State, with the evaluation leader facilitating discussions on each of the issues raised. The group arrived at the following conclusions: * Although these findings were discussed it was noted that they mainly fall within the level below the State. Creativity was mentioned as a thing that was lacking at that level. * For example, the devolution of documentation (records) between LG and health facility and the collection of drug from the State by LG would be included in the next plan.

2. State/ project level findings

. These were presented for discussion (see report for details). Coverage is high and well maintained, planning is thorough and detailed in line with APOC request. There is political commitment at level of the health centres, and routine supervision at the LGs. The concerns are: * No work-plan for sustainability at the Project level and MoH. * No funds released by the State for two years. * Numerous visits to LG and below but not targeted to particular issues. * Problems identified in the field were not addressed. * APOC funds solely support supervision and there are no other identified sources of support. * Training, mobilisation and sensitisation was done at inappropriate levels. * Management has no plans to remedy shortfall. * Well managed vehicle and equipment but no plans for maintaining and replacing them. * The size of the team is large and may need to be trimmed down to a small size. 30

. The following issues were raised in the discussion which followed: * The team size will need to be reduced. Staffwill be deployed to other areas such as blindness prevention, which is about to take offin the State. * Activities at the LG level ar€ a concern to the SOCTs and they had to do the work themselves rather than wait for the LOCT. The role of the LOCT in the progftrrnme is well acknowledged but the fact that the CDTI is mainly a local community progftrrnme was emphasised. Education was identified as a major factor. Community educatiott, sensitisation and mobilisatio,n suggested as the key factor.

3. Group work I: Making recommendations for sustainability on the basis of findings

. The SOCT was divided into four groups each with evaluation team members as facilitators. Each group was given the task of deliberating on particular findings (planning and finances, training and Mectizan, supervision and leadership, manpower and transport) and making recommendations on howto address them in a sustainable manner. Teams had the following ground rules: * SOCT member should be nominated by the goup as rappoteur, evaluator as facilitator' * Suggestions must come form the SOCT members while the facilitators guide the discussion towards addressing sustainability. This is best done by asking questions and seeking clarifications until a recorrmendation that addressed sustainability is made. * At the end of the deliberations each team presents the recommendations using the following format: recommendation; Action by; indicators for assessing outcome; start date/deadline. . Each group's recommendation was presented and discussed during the plenary that followed. The recommendations were very similar to those made in the draft report by the evaluators and its participatory nature and process of arriving at them made the SOCT to regard the outcome as their recommendations.

4. Group Work II: Planning self-sustainability at the State/ project level

. After lunctr, participants were divided into two groups each with a number of evaluators as facilitators. The teams were to develop a plan of action to address realistically the recommendations made in the first group session. These topics were: a. Planning for Resources for 2003 (identification of dependable resources, estimate likely amounts to be required for activities, rank sources in order of dependability) b. What needs to be done during 2003, the following distribution period (list essential activities, requirements and costs). The teams came up with very impressive plans, which were realistic and practicable within the system. . After presentation it was jointly agreed that the SOCT continue to work on the plan of action for 2003 the following day for presentation to MOH decision-makers as their own plan for addressing sustainability. r I member of the evaluation team worked with the SOCT to further develop the State draft plan of action which will be implemented during the following year. 3l

The LGA/ LOCT works

Attendance at Workshop l: Takum, Zing,Yono, Sardauna, , Kurmi LGAs/ LOCTs Attendance at Workshop 2: Ardo-Kola" Bali, Donga, , Ibi, Karim-t amido LGAs/ LOCTS.

The following is a record of the proceedings of these workshops:

1. Introduction and presentation of findings

. Introductions were made - including a welcome address by the Director of the Epidemiology unit. . The aim of the workshop was mentioned and the method of evaluation explained. The reasons for the workshop (to assist LGAs make their own plan for sustainability) were explained. . The findings at the community level, health district and LG levels were explained and discussed with LGA participants taking the lead in the discussions and suggestions, under the guidance of the evaluators. . [t was noted that few Directors of Finance and Supervisory Councillors were present - none at Workshop 2.

2. Analysing the situation and making plans

. Members of the State team and the NGOs took part in the facilitation. . The aspect of findings at the State level was skipped - members mainly discussed the LG level findings: * , Some participants had misgiving about the collection of drugs since Mectizan is expensive and treated like money it should be sent to LGs using the existing method. One important training need that the participants noted was compilation and record-keeping. One participant at Workshop 2 observed that the selection method did not reflect the entire state profile and wished that the evaluators take into consideration the endemicity of the areas such as Gashaka LG which was not selected for visitation. The participants were delighted about the arrangement and regarded advocacy and fund-raising as the most important factor. It was suggested that a trust account be opened and the signatories be the highest traditional leader in the area and the PHC Director. Realistic presentation of budgets was mentioned as an important factor. * There was enough time to discuss the findings and make recommendations on what to do. The recommendations were highly innovative and constructive. Thereafter the group broke into six LG groups. Every LG group had at least two facilitators: the SOCT responsible for the LG and another person (SOCT member or evaluator or NGDO partner). At the end of the group work, the rapporteur for each group presented the 2003 LG plan of action. The groups discussed the plan and the use to which the plan will be put. The general decision is that the plan of action will be useful, but will need moral and material support from LGA political leadership. \o oo (Jr H { o\ 5 UJ N) oz t9 tr- E EO (D \_< +i ? HrO,1 AF CT E oo 8> ,a t, A8 o X' (- ho 9,P E (D 5Fl 5< x(D t(, o? ts TJO 91 F a ! Uco a (Ds. 6'P. r-t ts.o Fl. - FtEsts Ft i< (D t CQ iao g U) rd 7L ts+r F) s ET Fl HiJ 0a A) F! o, tiO ts. () ir O) (D () v) o oq q' ='< D) s€ rr) N o 6E' { o) ol (! U) Cu, o- (, (D rE' E o oF' Ooa (D F.B ? F tr (D o o a Oo o ts+) 6s v) Flt E ra o) + ra'l ) s0 U) (D 0e D) o s) o t9 + EJ 5' E89 aetr o! dFl N) it Ft (,)tsI U) E) st S E' 9:] Oa' (D a' qt O '-lr-r' NO Ont QE tsl--5 lo' E [t (D- F} H Ba UH 3€ (Ds O@r+ bo tD =(D E'(D (DP- a(A D: +(D k8a ,a 6PE\.i a;8 +FD 5 l-.1. @ iD TE 6-B !JO (D { Y,, oqc: o EN Ft 5'o p 5'9 ,Q ! ,+ !'O o @ui E (D (! 8

Lr v) L< t z o ()o (D d *> o o E' S) .a* o) t+ :'+ E (D qit I 3 I t t.) n U NJ t'.J L{ t.J @ U z O O f3 (D o o o 9) O O o F! s t.J (D (! I NJ N) Y t\) N) rt N) t\) tJ ) oO O oN) ? o tJ o O o (D a N) tJ t'.J o N B r.l { o\ (,! E u.) t9 z o D9Fl te o@> E ao a -lt_t O!tr> p o rdt p) 5 if-o E*P (D El(Dd oo!fr+F I s6- E aFl. rdt g. EgI =Q - tr E'iJo a oq E 5'E (l Ft. oF o H. i+ E 6S t.E 3 (D ()50-0)a -o u) Ft o o a's iro-- r+ rd +)o o d' 0itr t_t f;"8 (A 0 !r OrJ O- Fl dPFl o) ()E Fl Ga FD F.1 da' 6F OOA:a' rf:3H B{o' 6Hkv O €!o' !, frR 58 E'()fio' d.P o i'ts d. o EIH() s: 3+ i.!I b 5 o)O-a C' 5E P:t-O &q s.d a e06 iL(D o. ?i o.o i45ts R6P!:i (2 (D frEE$ ur(D u 9r' a5 a'9 Ea+ o ,a tr. cnJ!f, o: 5'P E'3 s 8'E'8 rtrL* o' 3q d qH P=lo U)P* nc, ts 5o (D { EE 5E I-i Y of6 p-E t? o *o g.H El -(D E.g, E ts+r (D rt EJ? fli'tr, b5 o o =o r'D F D) BA 88. (D U U r5 g. Fh ao o8 C) !9 (D V) I E'- o = *l EL en F r.rl v)- caF gu!9C)!d > oo H e 85 oo oo zN H o oo ts E OO oo oo F c v F*EH (fij FlFl ..1 -i -l E EF E giH oct Fi v1-l v)-l a g OCtA-0' ou1-] -\' (, e. tr(! Fti{u 9y .$ (D -#"# @ E - - 'or =-^ o. o. a8 *z trr te o .? 5: |{ Ft g NJ UEL o (D 8' (! E Fl Ft "E (,o a a V) g F+ -@ Ie q> .) EN o=E> o2 E< go- g5 erd U 3H d5 65pHBEgE b$E 3o -l ()E' 5'H Er:j4g=ii-tr (Doa 6g () Eoq ti= sgEE ga-E @oa o o)5 k'r53 ? ts a 93. (D r-r A ii' 5' d t! aa o H'E) a t9 (D()H5' (lt< 'd Yu) E< g,E' -- +O 9o + s) B$ EFET orl tslH +) D) o'q o '-:n6' Oal (D5 =- i,J o HVB. ag o o oXi (D E ;i, O rr BE H ? E?E a (D A) o.5 C' 9R t? H. () E Eg e.6 t: !J '' "'' Ho)5 6- (D g U, iA O (D a !D rj D) o l*) A = Li tsi tJ t/ tJ \i> (D o) '/ t g (D E (r= s) tD SiI S:I rt a t.) t t9 Ot O o o U U o ? O o (D o(l) o (r) o o D) t, N (.) o

Y. Y, Y Y Y Y \r @ (,r L,I @ 6 O (rlO _tJ _N) F 3* s O @ @ O trte O "o\ O O o o o o O O o 35^ O E iq (D 8e:s (/r) (r) UJ cr\ (rt s lJ) t'.) O \o 6 *l o:/ trF go It?\ r-t tsp t o o) 6- to P El a+ EB 6 .rt o o. (D H) o U) a ? 7 o ? 7 z ? o o o o o o o o -l 7ooH5E rf{ rl{ +r t! *r Ff< n@ . -s, E! 2 2 r< o o o U U o o o -l "s v, U) U) ne c.-c) 4 O E'FU EB :--o= au) o> qrro rrl o1 bE: oE- (J 9o- o) BE+ di{Ir 86 ()H A)(D A) x'(D HE S.H E.'o o. E. o) H.B o= -=v) H9. u-Ea'o ct Y(DA) {: ElL= NS ab iak Htr i5 tD P(D tr. 5 o-='(D Ju) trj Xo:9 ()(Dss 5 H8. & 5 e o 'oE- A' D) E) oq otsi) .)i. ar 8S ='5 (D (D o E ra Oq i5o ) Fa Ft 0, o (D fd !f r,)5 5^.+, d o. (D= s) F) o (} h:(D r_t -r{ V) .A d' tri, Be o S) p SE F+, D) F) F{() Ft Ft U) o 5(D (D (D o. =8. O.d (D H o o)ia 8e (D A) il 5 U) (D o) o- ?) (D F o o- oa (i N)F N) rr N)i/ U U U t otJ w> -P ol (D (D (D (D (D OP (, I I s) s) 8p BFI S: I N) t\) U NJ N) t) NJ o I o o g o o o o o O () (D o o o O (]) (, o l..J N) N) N)

Y Y Y Y z Y Y Y Y, LA N) (,r N) ao N (,r (f) @ o P oo (,,r o oo o o\ P P o P F O o o o O O o O o o O O o o O O o o o o O o O

(]) 5 \o @ { @<^ fr N o tre? gHfi2 -l I <0' o5' 41 r,Ho)< -(.){ cA3 u))s)5 o AE @o (D (D g|. +u.6'E rb (Dx 0a 0q o- d6

O-l lE>E.H (D i(-' EEo ^. FB8' N B Fl!, 3g \lPH a E ul BE. ='s H aFx (4(Dt. U) BSsS 96 o o5(D5-59d ra9€ 8.3 s5(D rn4 80=ts B s rsE 6',r - la) )atlLh + u)=p qts SFHd9U) (D Fl(D EP o -a J E U)V) >aa H oo aoo HA E'OO H -'- ta Fi" u a-o V) ?l{ A J"'? 9"7 g o zo o O oU ,sE td ,SE N> EEi?D (9 -q) 'U Oqe ?HE 5EE{6X -lE i'o- ^ !1 FD ,a "o H) oad H) (DH u!1tr.]e(a g.e EE 3 i5E s. E5 -P)(-DE{ -A)ra3{ oa H. |J5 UH (D C0d (D5 (n ag. fg p t F5 (la +0a (D (D

N) qi N) L{ otr o otr H t+ 8F tJ BF O 3r O o oq UJ o

.\) Y Y (rr O Y "o P O O N O O c\ O (, .r

(rrUJ

Appendix 4 LGA level workshop programme

Assessment of the self-sustainability of the Taraba CDTI Project

PLAIINING WORKSHOP X'OR LGA LEVEL MAY 7-8.2002

AGENDA

SAI ACTIVITY TIME FACILITATOR 1. Openine Drayer 10.30 - 10.i5 SOCT member 2. Welcome 10.35 - 10.40 Dr. Apake 3. Introductions 10.40 - 10.45 Mr Sankwai 4. Introduction to the workshop: t0.4s - 10.s0 Prof Akogun Whv are we here. and what are we olannins to do? 5. Background about the evaluation: 10.55 - I1.05 Prof. Prozesky Whv it was done: what is 'self-sustainabilitv'? 6. Background about the evaluation: 11.0s - il.1s Mr Okoronkwo How it was carried out 7. Brief summary of findings: . lntroduction: LGA achievements 11.15-11.20 ProfProzesky . Community level 11.20 - 11.25 Dr Fayomi . Health facilityldistrict level I1.25 - 11.30 Mr Sanlaryai ' State/ project level 11.30-11.35 Dr. Nnoruka (followed bv time for ooen discussion) r r.35 * il.40 SOCT member 8. Summary of findings: . LGA level I1.40 - 11.50 Dr. Okeibunor (followed bv time for open discussion) I 1.50 - 12.1s SOCT member

9. BREAK t2.15 - r2.30

t0. Where do we go now? - preparing broad recommendations for action at LGA level Group work - mixing the different LGAs . Group l: Planning ' Group 2: Finances 12.30 - 13.30 Dr Nnoruka , Group 3: Training and Human resources SOCT member . Group 4: Mectizan . Group 5: Supervision and monitoring . Group 6: Leadership . Group 7: Transport Each sroup aopoints a scribe/ rapporteur 11. Report back from group work 13.30 - 14.00 Mr Sankwai (followed bv time for open discussion) SOCT member

t2. LUNCH 14.00 - 15.00 38

13. Planning for self-sustainability at LGA level Group work - members from each LGA work by themselves. Each group has thefollowing tasks: . What do we need to do, between now and the 15.00 - 16.00 Dr Okeibunor end of this year? SOCT member . What will our resources be for 2003, for CDTI? . What will our CDTI prosramme be for 2003? t4. Report back from group work 16.00 - 16.30 Dr Fayomi (followed by time for open discussion) SOCT member 15. The way forward: implementing self- sustainability in each LGA CDTI project 16.30 - 17.00 Prof. Akogun . Practical steps to take the process forward SOCT member (open discussion in the whole srouD) 16. General matters/ administrative information 17.00 - 17.10 Dr. Apake 17. Word of thanks and closing 17.t0 - 17.20 LGA member

Facilitators for small groups in Session l0

. Group l: Planning Group 5: Supervision and monitorins Dr Nnoruka, Mrs Olamiju Dr Okeibunor, Mr Ogoshi . Group 2: Finances Group 6: kadership Prof Akogun, SOCT member Princess Ogbu-Pearce, Prof Pro zesky . Group 3: Training and Human resources Group 7: Transport Mr Okoronkwo, SOCT member Dr Fayomi, SOCT member . Group 4: Mectizan Mr Sankwai, SOCT member

Facilitators for small groups in Session 13

. LGAI . LGA4 DrNnoruka Mrs Olamiju, SOCT member Mr Okoronkwo, SOCT member LGA2 LGA 4 Prof Akogun, Mr Sankwai, SOCT member Dr Okeibunor, Mr Ogoshi, SOCT member LGA 3 LGA 6 Princess Ogbu-Pearce, Prof Prozesky, Dr Fayomi, Prof Prozesky, SOCT member SOCT member 39

Details of tasks for group work in Session 13

. What do we need to do, between now and the end of this year?

From the group work earlier, it is clear that we need to perform some additional tasks this year, if we want CDTI to continue properly. This means we have to work out: * What are each of these tasks we have to undertake? * Who will have to perfiorm each of these tasks? * By when does each task have to be done? * How will we know that we have performed the task?

. What will our CDTI programme be for 2003?

From the group work earlier, it is clear that our CDTI progralrrme next year will be different from the one we have been carrying out in former years. This means we have to work out: * What are each of these tasks we have to undertake? * Who will have to perform each of these tasks? * By when does each task have to be done? * How will we know that we have performed the task?

. What will our resources be for 2003, for CDTI?

To carry out our work programme for 2003 need to have resources: staff, transport, money, stationery etc. * What exactly are the resources we will need? (work out how much of each) * Where can we get these resources? * What must we do, to get the resources we need? S 9 y, i :, !-, :- E !^, !., EF p tr ,r.. U o. /1 (). aro o o> E #,'I' (} rcl (DE t.,t 5A E tA o l-, o o ?E K o ioo :,' rt E ;I trI :tr< rt3 B V (D oE 3 (D 6p ia -t o * lrj F. r5' () (D o d a? N 6 e ;s;; I d t D) u)d I N) ri (Io O a? tD 89, i+)o oa!J (D@ ds) ag I I I at !a tt tt It PH) o +(D ='o t-t E< (D }4'ctPE 20> d.6' !) x'o xb >9? Q!aF> (D6F> (DtF> aD+ E o) Sqe |Je+ =rd 8i3 Eg 9iD Eg (DLa9 o +O a 89 o)!J ir- Aa. HA :+ ir- o0. H-3 D cr d ocl =(r) p, (,)!D U)o) (, p) H)q t-t o5 o (D o !f) p +O (D rt Ed F) () o o o TJO o o ;t=o (T o (D (D (t o ) {-. tr orf o 4ts. o (D E'ts lir U) (a U) v) E a)= o ++ :i5 d d o o = i-!. a Pf 5o r-t o 73 a o o5 tt (r) (DoHC) (Do o Eoq t: rc5 g) o 9..? U1 N O 9) !J U2 o) 7f o. H'E tt (D t-t (Do a a e (D ra r-t7 a (D (D p0o rt U) (D '11.1^ o a :]. Ir/ {@FU !^, 1., p 90 i :- (DF 6 (a FzH O.',6 rr..(t) ? Ft-l a o o 7 EPH A: D) o E o H Fl o sr5 R ru (, t-, x. EB t? P oso F E o V) (D @ O-d EE5';E o a o o o F Fl 5 6 EE"O H (D o -h; *; O B Eg* E! IJ o o 0a rt \J F+) s) 5' e Fl 8r t: (D ) tD (, o. -JE rd U) o v) p o d Fd :1 FCJ Etr (D q) (D t r-t 8-o v) q) o) o ? o: o H tJHN)(rr Y s Ft \o i-t 8xx()oE n O oB o o ,frfB o o+ FD (D(Di]a O i tr iJ U) o () l, o o iJ o (D V) E o I I I

r< rro o o3o9 t a II -l Fl il

r-{ t- ri ot- { oC) (D (D o o o rt U) B> (D B,, 6 D p*Lb) F. H( (D { v) (D lq (D "d>'i (D{ o (D :t t( (D H)o o 7 Ft E) t: (,(D

-t -l .l -l H H H H o o o o { a I tr t tr t oa rct rc oa 8r F r{ F rr A) a) o O o O ra dD), dD (D (D (D (} (!{ (D (D F) GD ol F) Fl H + d + o (D ) ) o tJ o. o. o. o (D (D (Do o .+ o fd o rdo v) o d 6 ,e D] A) o, D) (! H H o(D = = ,f (D) (D (D) (D 5 (D U) rt U) (a(! o tt tl @ 0 + FE a { Ot Lrr 5 !.., p :, a E z l, z t9 B ? 2? o o ? E"rt AEF1 (D o t-t-l o hJ ID rc, o TD o o- (t dtrl (T=t V) d (D (Di' I-.LJ (D o (! (t) (,

b.)

C)Orl ()FI O.() Fl Ft ()o! A() |-l oo;' Oa' -l -l OOa' 55- 6'9 o' o 6 PPC) i+(D 3b'o5 (D;:cE3' S"' ;J. i-r o- .dd Ft ;J g BEA HP E.B s) irD o. aP tr eE BE8 d B,o = gE A) Hs)i! E' mF)tr ='Etr.(D 5g s d F0 ia ='tr FISA) 3 o (D E(!u) 5' c tr.(D g'8.+ t-t 3e dga<8qE o ()E 6.+ 8€Ei+t,a< HeH (D () od El O- c+ -'-i- *Hco) o HE ()(D cFD o E Ero oFa E+ i, l_t i+ Oi o5 ua' E6 ET TE (D o a. o!) EE 03 (D (l 0q gF v) \JO H(D tl 3fi +J o- v1 'Ft o) a' I 3fi A) lv) (D!i H{ (D !J (Do' ri; ilo (D l+ t-t N) & EaFt E El(D o T] (DE o HH H;J + sa' ac> o -?i N) €o\H) i+, it s (D (D E =' + E(U - t- o ri rr OU o o o Jr Ft \fK9. ;i i+t)8.H .) U C) o x(D J> *.1 a *l (Dq++i() fr (J E! - o) Ft EU >\EF|-t o o OE=E !r'trL- { o.l UE { -i -() u-.) o "^ r, rr "r)t* l-l c) o o UAFl .l jl

U (A Lr L{ (D ()o (D t- ts85 o Fl ,6 (D o oa o E' ct o NJ N) EFH (D U) NJ H d (D t-! o o (D d NJ o o o E Fl N) (D b.J N) slS l, o n oO tJ r-r P (D (! N.) o NJ N) o N) E 5'{- <) (D p- N) E ++ E N) Bgq o 9Z p+='H11 v)

tsd $o? E(D do> 4. ,Z- eRz r{|o F bn o xge R9e 81 A) a' bxtr QJO () r-l F( EtsH (D5-l- d5 H (D-' ,f ?D(DdY. iJ Q6 ES >qe F axi a E 5@-t H t-td d !9 o o d F) EAo I o) t-t (D t.J tJ a o o E tJ o N) o lJ) UJ O o (j) UJ

r- az (Dd'-2, LFPta z otr O:E +C) dEl (D=:+H !'0 E '@O (Dd (DE -o r-t 3.4 Fl o.o o H () o o o te .F E.e rt .o t(? a T I r I '!g io g< 8 OL1 ob>.'o ltn io 5(D()<< 8g3u1 nu**i() c!)Y 9P ;< 9d 5 i5- (D B5 5 0.H -(D ,E€ Hqp H5. t4 iD tr.=='x a) (, i+ 8r 5-r H K.F' i. (D :+X ,ll.I !JH5. Htr E;=:EH. F.:- € ='a) I *€o H)O0a i So 6€ Ff) 5' !i: oa (D5 = (D< g5!:. C)H G |{ (A(/)n) a 8E< E' u)e (D HP i-t a(J't D(D a ,td ;g E E8 ; o =' rD <; Fhd9 E+. o d.aE u) C' gH8 !. :+ Er> \J+r|' @ HOa x'lJ 68 E€ U) C)>iD (D sl ;o 6 $ I si El" -s. a x'o\J 'J(, N) o. +{ o d;' UN o o

.J (D I O. Fl O. Fi O. Fl )u, '-l t-l o o do b\J E'' 6' o' @v -l i- (D $.p (}=,if(D *o So 55 :a d6 doi cr oi .Ft trE oP treD cD) F 7X PH aa =+ (Do (Do d(9 x.(D x.(D FJ oc + 9A i-i: 0e E9 x +i+ + al D) oo' !lo iE NC) H) Ft H,H +H t9 0ro A na IJ< ?s t9 U) b(D I'o (Do

I [ 2 a o o *i rJi A o o o o o to rn rn ln o Ji o F iJ1 f) E' rn rn trl a o a o v) v) u)

N) FI1 f^J r< L{ Li ()o tr d d o(D OE FO F) Fl Od o n (r) I*)B d tr L{ d N) !o o) z ()o t 7 (D N) =D) o A) r-t o N .{ 6 o o O a? aI I o (D N) UJ o o I t.) t\) (! o d N) tJ.) (f) p (D NJ tJ o ? o) o o r-t o O o o H o o ct O { tJ) !D UJ UJ (D NJ t.) o oE g f-t O N) N) (! iJ N) o oO tJ at I r N) a r+E Ft %F oo d o (D 5S Fl 5 trl a U) Eda s) d (D (D gE \./ o (DF> r+ U) FI :t> FU oH F aD i+ o) (DF a I I () o @(D d o- L. Ft (D (D o oa a- U) ftrlt o r-.i tc oEl v) :t'd Eg i_t B ir. a).' fd (D sI H)o o ()o) A,O F> t (D o ;e (D oe 63 p) (Dts (D^' r_t ES ()iJ !f.+ +rH v) r-i aC) o t (D E: F+) a o.8 tsg (D E(D F) B +(D (D oa E9 ) (D o tr|E z D9 l-*) ?ta E Hq (D OP=o. ts d g.s o d Ft O) s,E s) (D o o ;) +rE Ft pt: 3a Pe ) rt (D gE' Ia6 : , N Eo s) o H (n IclE d n o' ,q s) rt+ B 9.Hb x r-t d (D (D s.E Pa) p U) o 5li o P 5 .r) E'o r.t3 (t) "E A) (! ,a6 13. o d Fl ,e!J !) o) P (D o U) !r + Eq Ft o d +ts f) : s) iJ H 6a (! (D d U) V) ,c H. o o' tr8. (D v)4 Ft v) + (! A) (D +a (D o. q A) (A + i d !D + ao (D o -(,) I o' o. r-t |5u)58. FD rT (D (A Ju)OE

L,Is FU L{ N) t.l (, a g)E A)Q. UN2 (DF (Dc (D7 (DUA !9 (/) iF O.. N) z O E* (D< P FD (1i 8* g6 o E5 ,J(D5(D Hd t{! Et <(D a*. ct !f, dF z t9 t> re ,f t? o H z (D OO qo H'* cq o- o aa otst N) F+) N) Ft !J s) (!F !a N) o U) E i, (, tr) o o a d O Ft3 o o o t d o o N) t\) O o bJ t\) I 5 ts rt Ft s) (D{ d Ft a hJ (D (, (D a a E r t trFl it Fl (, (D 8g po- (D a' o-l t! 3in (Do .l o: ;-a ts5. -l PP o" oo B5 'd =dHL trto -ct ,H Fl iri O d3 q9 o 8.6' O r< t- r< (DE' P(D irO F(D o r-t o o -o og (DH Qca ol s) o F+) ar( { o o.iJ { Uz FH r-iA: 5 () z FttD (D oo o o CD (! o o () o H) tl p (D r+ (D sD N P r< t) 5 N s) (A iJ o !D 5 p o (D ,q F0 a ) ) Ei, o d o o o d -t o rl p) o F) t (! 0 U) o. o oO o D) U - (D ir-l (!t? AA

IT I a t- iJe> i\ o F< FU ITJ Y Y, Y Y eo o tJ NJ N) xtr 60 rl 88 O L,I (,l Ur H o. il !, tr!D tg !l ,o O O P o .,c g E€ o oO o o { d6 HL ) o O (Dg. o F.l3s (D 6g E.€ Fo 5EL tt 3s (n 5iJ o5 OI5 P :l ocl t) *p 43. { o v)+a€ sio H u) ,f (! E: E o) r-to rr U) iJ< v) o IQC) o H 'r)5(D a iJ FD o !D i) ) o+ p t-t oq l+ s0 U) s) J o -rr r< Fr, xg U oo o oo EE U oo o oo ,-(D''( o (A -l *l .J -J -l ,-l 'o+ (D f-t { OD iu o- o (D rJr B c) z z Y z F PUJ Lfr O TE O O O E ,q oEl', 4' (! ) o ri rr D o O 5 o\ raaHH l(A rr.4 {> z q6- (, E'> B E oo. o c'.-o -= 5'+ A) G. a te (t tr? oa^ E Xc)hl d (ax 5rrttrrlE tr 5#i o o Frps;-=.-dU) I 'u1 o g)o EB V) \H.LXI d.+ (DbE8 tr L2-tr=Jl,lY Y oo) () rle (D< H ir.H L ,q 6'g o.< (DSoi! s ts ,+ OQ r+ $. + k'a o $E [+ a9 o *(D o o o t.D o g.F'H o (D+ d Ft it{r. /^ H * U E O'7;.rJ t! eH"F[6' U qe (D o E pEl f $H d. a r< D $F 3 l-{r 9EAEts' Orr o 9o q,i H( !DN IQ ca agQ l* 0, (D !.- lir (D' o ,a H' + g u, ti o' r-t g (D e:. 68Ft (+ p (D (! *.0Q ra oo rt g x'5 o (< r-i 3E I I o iJ< i,. o Ox Il. o: X'( o r-O D0 CJ (D t: B. +E t C) (D Fri H 6. ft A) Ir EE o b,J -ag 9s s' -6 o 5< * rrJ gR ai=-^ o x @a + ? o \J hl 11 b:i-'x3E Fg o d Er+ IHF. f, t! o l{l +t -(D E eB X (D ttr v) @ -, = F) z (D 8H' FU ;E 8" tdo *(D u)56.(D B. ts H (D AA o A) P * oy"B o) H' g o) I o u oq iJ o (D d Ft H P N U) gr. t_ia IJ (D (D oq U U fra 9AA 94p.(A EU REU FU ro 50 (D(J3q oE' tso EO Hid HHoi=iaE' dFl ct Fl Eg8.,1 d" tsB o o i. (D l-1 ;.(a Fl as { 9=- 9u- oo iH 8E rt rl .(,6 8AE 8a4 aI o o o -u, 5 ? q Yr;,fr=5 C) o Uts Uts AEFi (l FlaE (l *< .=* o *l .l E8- c) 11 .) aD (l JrH rJr H 0) D I p i1 J2 o--=8- * 3; @ (D rr rr EsB EsB o. LpO (D I 3-(D Li-(D r. H() !9 d C' o o t? (D (D o o o t-t t-t FFE rFE C) a o U) v) -l -J ..1 o o o .) -.1 rJ *l ? ? z ? o (D l>t 3 EJ () 9) D) o) A) !) 0ao o t< Li Lr (t d t t tr d { @ (D H ) p n o @ (D (D t.J r'D t.J t.J t.J l..J tJ o o o O O o o o O o o <) tJ tJ N) NJ N) tJ

ca () l-l V) q9> V) Y o d E> d 9E r0 o\ o E rd :+d o (,t E 9Bli .o tiEB .o E U2 (,Q (D "o E E6 o o Fl Ft HEBo o t aE -t O BEa (D "H(D H tr'il 0 o a o' iJPB a (t ts F! Fi ts ro .I! rri *- E EfrT o) pC) Il o) (D o B o 9or H i,i a U) ij- 5 s) 9e H. U E td U (D o. U o o U TEF o ,i o. xff e .A 4 Ft U) Eo- p, A) E ia (D t ar-t d B:r1 €* fd o o C) tn H :, E E.T (!a U o It E"' do'tE o o ti -l (D !J 3 (D o' '*' . t & $,1 - (D ) tr' (D (D gt'5-.i'l s 5 F:':Ft-', { a E a ErJ (, tJ) s (rt (, t9 i'r , 5 N) z tr s N) z P El; B 3 i''," Ft Fr ,Fil *l go O-l ? [J ? A) 'u1 HH >:q (Dv z9 a stE +=-*&8 h O \J F) o o o 5H k (D (t:a 0a d d 9e EIF o \J5 (, o!J (D 935- EiL +8 t, (a(DXiE+i 65 lE f il fl o B. U) U) { 3.c 5' a oq F) F' aoq PoXE E: P E $i,, O -)El o=l o 8.4.q Fi E) Etli F+) qE @ 5 -o o o < (D E ig, Xo, o H) tst ox Et o U: tse o" ht?, (,8 + E o o 8.E SqI (D !I9.. o ;< Fn H) o 8g oq dai o It ill-' <8 ts o(1 o80 () t? () =-+ trr5 0 (l o Eir\ (DH (Dg.=(.) (D o o tH3 *E Ef.O T l{: itl I 9€ oa ()N ti i, it N) fo, (D H 5+(D Bs. s eE. e f E.tD n !L ii'r,iE -o U) C) qEy F+) tJO iJ O olJ i,I; rdt 8e (D r' U U) aD(D() !,E lEl o (D i(D ts+) E Fl U o) Sg o -U' E"A P o' ill a oo5 o t$ " a (D a'n9. F+) K:.,;, o :,_ii.. I { o sr':' i:l ()F ' rr r{ r< r. r{ r< :E r- r{ t,. rt - iD t-) o>. r.:,", o o o o o o o o l.l C) (-) o o o o o sai o 5-o *l .l -l -l -l j-l F -l 9-l -v, I ? -(2 ? oH '. o U aO o e(D o Ho o o +i 8E ts oil frl t-l{ C)*{ C' aD= frl rn rd rn tD gp Fi r- "o a =.(Di.i rt) q) E! v J,, Etr ? ? () a >9 ,I o o tc, o.,= o o { d (D s.5 o? { U t ) -O U ) o () ? s? o (, t) V) 4 a;' o FO PE E .{ (}er o o o) V) (D It o o d o =o F+) (f (D t (D t-t ?u r-t V) o hco a *H o (D= '{ a64

Lr NJ7 'TJ p ? A (D (D (D z o t A) o do !J o) 8F d d t) (D (J)d n H t (D (D o N) it u B d NJ N) I F'r-| $, 9 o o a? { Cf F! o o { O (D d O O E tJ (? (D N.) (D u) t Fa tJ tJ Fl N) N) O O o o o N) NJ o I o O (4) o NJ UJ lJ) O N) tJ

T I ()H I I p? ru ='o lin o o 3'? ai P) (DC .?Q o) Eo0r B'q a3. a)(a dEijo, o IQ+ a6 @ o a5 5E o9. cro) U{ (, V) o 3',d H)O UA sr>.r 80 (D UD ;) lJ It 6 Eg6 O co'U, i7, AP F B p) (, a o 9Pit gE g ar = lvt !) q-E o 6 .+ X' tsr so Ja= oo(D5 o (t o o' pa 6s () (D E r-! +5 6- Ss o 5El H o d Hs o S) (2 3. 8" R5' F! tE8B t D) t.. Ft ird (D a EE g; ) oa g; oE,. 9a o ,f 3 o E@O+) o AE (Dit ^.(D U) o P (to d d ra $. :i(D o o'H o5 Rfl r< U) ts r< -", I (n (D 5g =oa -?, (D (D t'J o o- o. o o o 5' o oa o 5 o UJ 6 O (D (,t s u) tJ a \o @ { o\ oz o E Et (? Fd aa? (D 6> -l d O o ()hD>:q (}F (D o o 5H k o E. e Nl CI' B oLl (D I F3 tJ* tt k+i !J d Oai = bJ (,oX( H. { ) Et5 !a g:BE' t oa o 5? P o E8 D) 96" t,e *aQ tsl p o U) au) al (D a iD

Y Y Y Y Y ZY +H L,I s lJr (r) H t) t- t$ r< t- \t O N) P O u)5 o xo YA o P o o O o PP EU o IdQ TEQ o o O o o o oo *l (DH (DH -.1 o o o o O oo a V) !0(,,) A)u) a o o c)o (!,ll o !'u trt A FU tsu trj +r H a _(, r{ r{ r{ r{ ots v a (A o>. o tr rdd o o o a o E(D (D HY d H 4 td ()iJ P 82, a a H.n Fto r-to o) tD 1Lx ) g a (D -_x o B C) O H H E. d o o o o p Ft (D E d () H I @ V) () o U) s) a 6 a (n o o H E ts rdo V) U (D z ()o t o@ o o (D g o (D EI u d i.J P (D o cr' d E O o (D N) (, t E O N) N <> o O u) (J)o (,)o o TI T! FU v o oi a) o !l :z Frt 3E =' O)A or-t ) U* t *FEE o iJ o> H) o t o 8[sr o U) o Eg6 o otst p) o .+9PEi X' tt { o p (D 5' a ) ts o+5 d o o' t (D PFtEt o- p 'o(D oa o OE) (D IA d i-. aD' + o) ( "t.Dl V) H DD o xo. rFt !0 E oa Ft@ H (T o?t d p.o E E () d Ta) tr' I ,a d o c o U' a'8 E; U) a E*. oa D) Fto (D o LJ (D gH d o o .-o P o 5'< o o+ ) o H) o j''rl| I U troF+) !J +O an D) N) a o o U s o (D Fr ';1.' t .i1,, +) H =o- o LO F' (/)0qEE o (r> v) o o 5 rn )J g F (+ 0q o F) (, t t_i o|1 9 p D) Ia (D q)

o r-{ t- C)()r{ ot' t- r< r{ z o - po o o t :Eo :TO o o o o Fl o o UrdQ iTi O o C) o o Ft B -J *J v, -.1 -t -l t <1 #' -l (! !J o o U) It

z .) F 1 .2, U or F!o o (D (D -' F.l 8P !9 E ;+ a{ (D (D !1 6 e5- iJ o oa !J oa i, 5(D I I H a.E o. g) G iJt 5(D U) r.l p cv, i

Y Y z >? >fr >? lrJ *l -r1 41 gl >:r 2, HIJ (DiDoc s 6.s (D5ets (Dtst=r 5.s \t\J P ltt=(D =(D Q-- =!5 {n (, Oo B€ E'il 3€ 5 o 5'H E'e € (D@E* (Doof;x H* 'i3 (DooHz ilt ilE ilE HN ug 6il u, atr, EE Lrl C) 9* Y, ilI a YO YO YO O ,tl { ll o\ O ll { Y, @ \o \o{ \o{ { L'I (,l E8 z8 \o o L'I UJO HO (,r o @ s O o os rr z t- r t- - t- t- - z O a O O o a o O oa Ft ot? L'I O r.g 0 p \o @ { o\ (,r s UJ tJ tr O o o H: tr t) (A a ? a rr 7 o o o or-t o o) o o o (D U o o s o ,q (ltrl () rc F ot (D U D) (D (D o U) () o I F ? N H d B A) o 6 A) d U) rt U) o $) o o T (D o o \J D) x o o. r+ g o (! o) (D o (D p. H H U) o) F+) B CJ o ,q U) (, o. F+) Fl v) I o (D o cr s) o o d L{ d (D (D U + s) o{ o (D s o z q) tst o U IJ o) ,f Np F !e (D Iq p) o Fl e o U) tl () o L oz @ t o { D) Fa Fi U o I o (D H d +) o o o p (D o (D tf (D o dFt g q 0 o Ft C o d o) ct' o N) N) o q (D o o o Ft r-t o o C) N) N) oz (r) tJ C) o o o o o 0 u) tJ U o(D tJ Oo NJ a - - tr t- t--r o ri r{ rr rr Ft o o o o o U o o o t9 IA E o C) o U o o o o + o H D) t9 o -l -l -l -l -l -l tf Ft F (D rl o (D I (D tr o.!0 (D o Ft o (D& r-t V)

Y Y Y Y, Y z z Y z z Y z N 5 N) ,5NJ (rt 6 u) @ o o\ o o\ IO o N o o o "o\O o O o o O o 5 o O o o O o o o o O Oo rr) O 2

il :, 1. ^

L,r 'lr rg a ti ,tr tJ) tJ Q p z o tli r, 6 { Or Ut s u) N) z o E '.1 o 3Et fr -J ,TJ -l lu) o 89 o lo l-Jr-t l(-) F oo Fl o tr ls o lo I (D o C)H' () lu) l€ l!) l9 E o- B lo (D l(D IB ,E ! (D B lo lt) IE, 100 o Fl p E! CJ IC) IE lFt o Ft ts + t? IE la o o ar) l@ pa o) a o o E I5 o l9 IE lo, o (D (D s) ra l@ f, lP to l!J o (D to D' I9 lol lH) k ? U) Fl { o te t;' I t-r, lE a o) Itr to Its (D ,f h lU) o. IO l= (D (} lt+) lo. A' o (D tr () IE lo u, (D ET o (D c,i s9 @ a o U) { (D 0a tr +J U) D' o E a s d o A) D) o N d I S) U o o bJ o o U i, o o t> e t o- p v) o o t-t-l AHt*l CDr> r-t u) >t p (D o d YD) o)o N +El }+) ) rtB p. ct o I o 6 d' E: @-. o (t o t.) Fl d aoE U) (D o 0c t.J u) c) f.t E o !D (! o I (D (, F{) o !J o (D rt o (, N I u, !D o C' rr (D (D ID Ftl s *) (D o a1 o O o d = o TD 0a ()o o d ol rrl a r< a- ()t o o E,- (Dl o o 5C) !Jl *l .l o tst+l ?", !9 cDt u1 t-1 rtFt @l I6 o o6oq o EH I r< r< r. rr ri F'U 5 o xg o o o o LJA o ti o () o o c)o t? ,io .l 'o -l -J rj -l q7 x" Fa (D F! o FO F) (D C) (Do. F r-t + (D o no (D (D 'd tr ij r-to o o. o. t? l< Lr TD F) 7 7 E te ort P r-> (D o) c) (DU 5 o Fa o) D) 5 () o F+) o tr Ft Ft d () rt C) (.) t tr (D o o ) E F) F) Fl o o ? o) q v) V) C' lii N) d o A) N) N (D O E o t\) O r-l (} ah 89 ts (])o o t? N) o o o N) o) t> O O (, (, o + t! tJ UJ O p o rt2 o ra UJ O tJ ) (r)o (! N)7 z oooz o OJ wd (D gd Fg z Y Y Y Y Y Y, Y, z p B BE (! (,r (.,I C' d Ft hJ (,ts tJ N) Lar (D (D Ut € o F.t \o o I P P r-t sE o O o O o o o O (ao t'J N)\ e O o o O o O O O o o O O o o o O o N) t\) P z z z EE a ,q(!

L,I NJ O \o 6 { o\ L,I 5 trl E'() r-l t*l A()AFI (DOF.I -l A. O) Fl *l A)9,o' +o o e o EEg' g€ g: (DBE 9Ad o E iH e E E.E E 5's lrQ", Ft H Fl !t(D tsEEg F) deLB=tt o gEE 8.8 ts F) Ei EEE Ei 1ts E b(Dtrr (D E oo 5--(Df aS B.(D o e9 g g.= (D B s) , =f.E H f F'f; F'HSB { a EF EF 5 .?D o< o2 ia(D aD'() g. :e (D .)hs IJ E. (D;i Bs. $3 As ='dE.o i{ Ft ni6 u.- xo, g(a *r+3 o. E: :r 0eo Xcr '6(D ds I * H.o tr) NB t00 F+) tr' C, (D ;- Ft () U) oq 'tsE? (D d €, ot< Il< o() t0 H Ft ftrl !JO oo (D g.E' c40 EI ,f rc, H.) o;-^ & U) r+, (} o) poS. d 5: I o r-t E i !J'N (D o.i.!) t o o 55 A oa n(D V)

'(J -! N) :/ ?\1 ?41 Li , N) t--1 oa H :.' |i> oF A) :i(D g'3 ()Pog OH FghY (}g. (, F: (*)ci o2 C);JFE ts8 s6 d PDD PO: 6 3ra o a? ) eE o t.r 5 d N)@ to z tsE oN) no u) o) u)v o t-)8? EFt UJ

z z Y z 7, z Y Y s { \t PO PO PO PO o O O O O o O o O (,)Ur O o (a ao o\ (,r 5 u) NJ ^lr i.) { z Fl 5 (, N) z '.i o o ltH oa t, pF a ()H o -l o) rn (t F-l bD(D rc o o) {o O- a- ? d E(D o" It Ft tJ'o o 56' o H 9# O o. g€g g+ bor I HH (T d !a F rcs) E.9 o () o 5'B O +o, (t= ()o E '9. ga + (D [j{ E*9(l) .+ u) ti u) s o - t+(D o) IoC) (D o o) r o 9s o o- () s.x *o o -rd tr F+) u) i-i, o B.B A (D Eo a X(D= ,\. o o o { o p FI Kra* o) F+) U o E o o o Fi IA ? +D toR l*) o v) v F+, U F CA U) E s$. o g, (D t (D =:- u) z (D o r-t I (D U) .A ,O SF t o o p) o E t? r-t g, - rt) |cl (>o (D V) s+E r{ t? g) o (D I E 'o o Fl N o 9' a E. (D if. $D B-- N to BE d tr d rro sD !D (D a l+ q E (D A) B HIs (D :to o H' Et o o o N) (a o ts (D o \) o 9D () rA (D UEB. (D-:a9 U o u, !0 t'.) o{ HD (^r) t_i o- IAU !) I (I d Ei ,f FD (D FE o E o,f EtD o as p t-t p a ;h o't rt F { bJ rr rr r- o-F @ t- - o oH 9 o o o o o rrr o HQ bJ o o o o rn rn o o (.1 OFU -.1 *l il F.l -J Ei -l rr r{ -FU o ND iS: o o OE O. *{ r{ v) u) !D ti !i'o o g) S) ) .) o C)o (! o. s) o. o o -l *J -l P. Eo. t? a. FU t_l 6 o (D o. o. O tr D) oE' EI F! ) (D tso t? rJi o r{ o rli CT & () pQ 5 lrj U o o o o o rt(D U c) .J o r_t EF U) U) A TD }J -J E rt o. A* b,J v) Fi(D 7 11 t, tsIl Lr Lr v:'$ ,d 7 o o (D s) P S) Fl FO C' (t (f P ()Ft H E E d g O) s) (! P !D !0 (f o !: r-i .2 q a Lr o z t o (D T 2 o iJ CJ t (D d E (D o (D (? qr' (D (D p!J d |.t d (D (D ts Fl o H 7 5 !9 (D 4F o (D u o g o Fc' aio o |dP ()o ()o o s) U t9 o :o d B r-i (D Ft Ft o o (D N N B (Do p o) 6 d (D (D U) b k { A o o. d s) o SD !) 6 H (D ,'f - o { g) o (D n !0 p 9; U' Ft O U) o o s) F) s rA C' (t clt (D o ttl o (D l, E ts o F U t- r, { D) d (D (D A) !D Fio iJ E o6' t () o (Da A E (D B o) o E. >p. a o () r-r { E AP o .) o (D t! (D :1 (D !D C' o U Fn Ft B (! E !t a. tr04 o (D (D o (D E 9+ oa o U .) o- (D DO { o U) IA o o U Fl 11 oi o o' {A 9) () U Ft d tf :' 0Q tal @ V) (D ) () o r-t (D E u) 9 o (n o o) oF.t o ) ar) o H -l D: (D FOp oa ? p) o- d!D Y (D o oE o (D e O e p- (rrs

Appendix 6 Detailed findings

1. State/ project level

No. Indicator Findings Position/ scale 1.1 Therapeutic I 82o/o 3 coverage r MITOSATH is still calculating therapeutic coverage with'elieible pop.' as denominator 2.1 CDTI plan . CDTI is reportedly planned for like all other disease 3 part ofoverall control progmrnmes at State level, but there was no plan written evidence except one line in a budget. . There is a detailed APOC style plan at project level - this is different from other progftlrnmes , Review meetings at the end of distribution - followed by planning. That plan is sent to the State for counterpart funding. . NOTE the MITOSATH initiative to add Vit A distribution to CDTI 2.2 Plans contains . The plan submitted to APOC is highly detailed, and 4 all elements of was seen. CDTI . There is a2002 project timeline of activities 2.3 Participatory . The plan reflects input from all partners, but not all J planning participate in actually compiling it. . The review meeting is a good forum though, and leads directly into the planning. . All partners clear on their respective roles.

2.4 Planning for . They are aware of the need for a plan but haven't 1 sustainabilitv actually made one. 3.1 Specific CDTI . Dr Apake is officially allocated and recognized, but 4 leadership without documentation. The documentation is really not needed in this case. . He has enough time for his CDTI work - so does the PHC Director. . MoH has seconded programme officers to both NGDOs (some of whom are too busy to cope, since they retain MoH responsibilities) 3.2 Evidence of ' The Permanent Secretary and PHC Director are 2 political commiffed, even the Commissioner, but all they can commitnent do is write memos for release of frrnds. These are not responded to. . There have been 3 allocations in 5 years. The last was in 2000 and was influenced by external factors. There has been nothing for 2 years. 4.t Routine data I It takes place in the govemment system, but APOC 3 collection funds and registers are used for collecting the data. mainstreamed I NGDOS are involved though- SOCTs appear to give it to them, then it goes to SOC. 57

4.2 Only , The use the approved NOTF format. Everything is 4 necessary data necessary and useful. collected 4.3 Routine . Each LGA is visited at least once by relevant staff 2 supervision by during distribution - but also for mobilisation, right person training, advocacy. . The visits by SOCTs are routine and numerous, and not targeted. ' NGDOs also visit LGAs and do spot checks (on Mectizan, SOCTs) - use checklist; also do advocacy at that level. 4.4 Efficient . SOCTs routinely supervise belowthe LGA level, and 2 supervision thereby some LOCTs are not firlly empowered. . APOC funds pay for supervision visits by SOCTs . SOC and PHC director supervision visits appear to be integrated. . There should be fewer SOCTs, therefore fewer visits. . Supervision visits have specific goals. 4.5 Routine . Usually they deal with problems identified, but at 2 process of times SOCTs do not- some problems are left to problem and NGDOs to solve. success . NGDO reports looking out for low coverages, and management dealing with those. Generally they seem to tackle observed problems actively. . We are not clear about their plans to deal with areas oflow coverage. . Successes are sometimes noted and verbal feedback given. Feedback on coverage data is routinely given. . The LOCTs pass on problems that are beyond them to SOCTs - but SOCTs are still doing things that LOCTs are capable of. 5.1 All aspects of . Mectizan is stored by the NGDOs. It is administered/ I Mectizan controlled by Ministry staff, and uses its own control supply system (which is better for sustainability). mainstreamed . NGDOs (both) are responsible for ordering, and APOC pays for the distribution up to LGA level. 5.2 Alternative . Both NGDOs depend on outside funding - they may 2 mechanisms cease to operate in due course. At present however dependable they are available to help. This is dependable. . APOC contributions are ending. . State contibution is not dependable. 5.3 Import . Not applicable clearance arransed 6.1 Only . Up to 2001 they trained all LOCTs routinely, but not J necessary in2002 - firnds arrived late and this made them training being realise that the haining wasn't needed. done . NGDOs did separate training on CSM. MITOSATH also reports doing targeted training on issues observed durine supervision. 58

6.2 Training done . LOCTs are trained by SOCTs and NGDOs - but 2 by appropriate SOCTs also participate in training CHEWs and staff CDDs. 6.3 Continued . SOC, PHC director, Permanent Secretary, 4 sensitisation/ Commissioner for Health, SOCTs are all involved mobilisation appropriately. . There is routine mobilisation of all 1500+ communities before every distribution. . NGDO is mobilising CBOs to help in practical ways; uses any available opportunity for advocacy, e.g. annual dinner 7.t Cost . The costs are fully detailed in the APOC style budget. J implications By the time it gets to the Ministry it is reduced to one are quantified figure. Recurrent and capital costs are separated in the in the LGA APOC budget. budget 7.2 Appropriate . The amounts budgeted are adequate but not 2 and adequate appropriate - they don't take the previous year's amounts activities into account, and budget is based on past budgeted routine. . The amount budgeted for SOCT daily allowances (for training and supervision especially) is inappropriate. ' Programmes without external funding get by with far less (but also achieve less) 7.3 Funds ' Relative contributions are clearly spelt out in the I increasingly APOC style budget. being supplied . The amount supplied by the State is not the major one by State currently, and the proportion is getting less. The State resources is not puling itd weieht 7.4 Deficit met by . State managers are not frrlly aware of the size of the 0 dependable shortfall. provision . There are no specific plans to make good the shortfall (although there are good intentions). . There is no written commitment of any kind. HoweverNGDO verbal commitrnent is there: to continue helping with transport especially. They will be there to bridge important gaps. 7.5 Funds ' Every criterion is met. 4 efficiently managed. 8.1 Sufficient . There is more than sufficient transport available. 2 transport for There has never been any report offailure to carry oul necessary activities (although there has been, at LGA level - visits to LGA twice). Howevertransport is dependent on APOC. for CDTI 8.2 Transport well . Trips are all authorised, but not always in writing. 2 managed . No logbooks in the State system. NGDOs use them. . The vehicles are being used to some extent below LGA level. . Only NGDOs service/ maintain vehicles. 59

8.3 Sufficient . They have the stationery they need. J other material , They are borrowing a computer from another resources programme, and go to the Ministy for photocopying. . NGDOs provide bicycles and motorbikes . Some APOC money is used to print material. 8.4 Dependable . Management may be aware but there are no really I replacement specific plans for replacement. plan . The lower order State managers are aware, and are happy to share resources between programmes, if these should become available. There are no written commitrnents. . NGDOs are going to be helping - not clear how muctr, but they won't just do nothing. But they will insist on specific requests and motivatons. 9.1 State team , The team is excellent and knowledgeable, but the J skilled and number is too large for current level of operations. knowledseable 9.2 Personnel . All staffat this level are stable (except the Permanent 4 stability at the Secretary, but he is not actively involved) State level . Replacements can be easily trained on the job 60

2. Health district tLc[level

Yorro Ardo Kola Takum

No. Indicator Findings Position /scale 1.1 Geographic . Ardo Kola has no record of endemic communities or 2+4+2 coverage total number of communities in the LGA :2.'l r ftl Takum there are 103 endemic communities in 13 health centres and all were covered . 11 communities were under treatrnent but the number of communities are not known in Yorro t.2 Therapeutic . Takum 7l.l% 2+3+3 coverage . ArdoKola is 8l.l % :2.7 . Yorro is78.2Yo 2.1 Written yearly . There is a plan in Takum 2+2+2 plan r fu Ardo Kolathere is a plan :2 . Yorro has a plan which is not documented 2.2 Plans contain . Takum has elements needed for CDTI 4+1+l elements of . ArdoKola does not have a plan -2 CDTI . Yorro has no written plan but it falls within the general PHC 2.3 Participatory . Ardo Kola plans are participatory 4+4+l planning r ftl Takum plans are participatory _J_a r fu Yorro the director draws up the plan 3.1 Allocated . Ardo Kola depends on the SOCT for everything 4+3+l leadership for r fu Takum the leadership initiates all key CDTI :2.7 CDTI activities . In Yorro the LOCT is fully responsible for CDTI 3.2 Evidence of r fu Ardo Kola the leadership is committed and firnds 4+4+2 political proposals brought to the LG _J.J commitment r ftl Takum the Vice Chairman and the Supervisory councillor know enough about CDTI and are committed . Supervisory Councillor for Health in Yorro is committed 4.1 Routine . There is no evidence or record of monitoring or l+4+4 supervision at situation supervision in Ardo Kola _J_a the LGA r fu Takum the LOCT visits twice every year to supervise . [n Yorro the LOC visits thrice 4.2 Routine data . LOCT collects and sends data to LOCT in Takum 4+l+4 collection and . No evidence of reports sent to higher level in Ardo :3 transmission Kola , Data are sent routinely within the PHC framework 6l

4.3 Routine . The LOCT manages distribution problems in Takum. 4+4+4 process of . The CHEWS are responsible for managing problems 4 problem and of the CDDs in Ardo Kola success r fu Yorro they manage problems during routine management suoervision and then they give verbal commendation. 5.1 Order of . Mectizan procured from the State and taken to LGA in 4+2+4 Mectizan Takum :3.3 every year and . The State sends an estimated quantity of drugs to Ardo in good time. Kola . Suffrcient amount of drug is received every year to Yorro 5.2 Storage of r ftl Takum it is stored at the LG main store along with 4+3+4 _a1 Mectizan other drugs -). I within r fu Ardo Kola Mectizan is stored in the central store government . At Yorro it is stored in a health cenhe at the sub level district level 5.3 Distribution to . The drugs are collected during training in Ardo Kola 4+4+4 the sub-district r fu Takum the health centres are delivered by the 4 LOCT . Distribution by LOC using goverrment vehicle 6.1 Only . Takum training is routine and not targeted 3+4+4 :3-7 necessary . ft1 Ardo Kola old CDDs are separated from new ones training being for training done . Yorro trainine is vearlv and new CDDs are given skills 6.2 Training done . LOCT trained CHEW and CFIEWs tained CDDs in 4+4+4 at appropriate Takum :4 level by . fu Ardo Kola there are 9 training centres for CDD appropriate training staff . Yorro: CDDs are trained at the subdistrict only 6.3 lntegration of This is not applicable inNigeria Instead it should be CDTI training asked if CDTI is an integral part of CFIEW training into in-service curriculum trainine. 6.4 Staffinvolved : ftl Takum the CHEWS and the CDDs take part in 4+4+4 in sensitisation and mobilisation in the communities 4 sensitisation/ . Ardo Kola CHEWS and LOCT take part in mobilisation mobilisation of decision . Yorro relevant decision makers enlightened makers 7.1 Cost . No written budget in Takum but proposals are 4+3+3 implications approved by policymakers in the LG :3.3 are quantified . fu Ardo Kola there is no microplan for CDTI in the LGA . Yorro there is no specific budget for CDTI activities budset but funds made available . No written budget in Takum but amount is appropriate 4+3+0 7.2 Appropriate :2-l and adequate and adequate amount . Supervision and maintenance done within the budgeted for government sYstem CDTI . Yorro there is no budget or doctrment on costs and activities adequacy 62

7.3 Funds to cover r ftl Takum the amount being supplied by LG increaseJ 4+4+0 costs with time =2.7 increasingly . Ardo Kola this is being covered being supplied . No budget for oncho specifically by LG resources 7.4 Deficit met by . No deficit budgeting in Takum 4+0+0 dependable . Ardo Kola not applicable =1.3 provision . Yorro there is no budget 7.5 CDTI in LGA ' Funds sufficient when released in Takum and shared to 4+4+0 sufficient meet the needs :2.7 managed. ' Ardo Kola funds are efficiently managed when released . Yorro there are no records 8.1 Sufficient . There are 5 well maintained PHC motor bikes in 4+4+4 transport for Takun 4 necessary ' LG used to provide transport in Ardo Kola visits to sub- . Yorro adequate transport is made districts for . NOTE: LGA reports that there have been 2 instances CDTI where distribution was held back due to transport 8.2 Tips and . LG pays for all the trips and all trips are integrated to 4+4+0 journeys for all other PHC activities in Takum :2.7 CDTI are . It is integrated into other activities in of the LG integrated to r fu Yorro there is no log book other activities 8.3 Management I In Takum there are routinely managed by the LG 4+4+4 of vehicle I ln Ardo Kola it is well managed by the user-ofhcer 4 I ln Yorro they are well managed 9.1 LG team . Takum team is well skilled and knowledgeable 4+2+4 skilled and _J.J ' Ardo Kola team is not skilled but have knowledgeable -aa knowledgeable about CDTI . Yorro team skilled and knowledgeable 9.2 Personnel . All staffare stable in Takun and when transfened they 4+4+4 stability at the are moved to endemic areas -4 LG level : fu Ardo Kola the staffare stable : fu Yorro the staflare very stable oEr . Sustainability of CDTI in Takum by LG is feasible .q r fu Ardo Kola the LG does not seem to be in the best position to sustain CDTI at the moment r fu Yorro CDTI may be sustained at the LG level 63

3. Sub-districUfirst line health facility level

Ardo Kola Tau Lankaviri Kanjong Dongawa Lufu

No. Indicator Findings Position /scale 1.1 Geographic . All eleven villages are treated in Tau but the 2+4+4 coverage denominator is not known :3.3 r fu Kanjong and Lankaviri 100% coverage . fu Lufu and Dosonsawa coverage is 100%. 1.2 Therapeutic . The number of villages are not known and the 0+2r-0 coverage number of people teated are not known. =0.7 r ft1 Kanjong &3.2%treated . There are no records in Lufu and in Dogongawa 2.1 Official plan of . There is no planning and the in charge has never 0+2+4 the centre attended any meeting -2 . No documentation of the plan in Kanjong and Lankavid . There are no documents in Dogongawa but there is some plan 2.2 Written year . No written planning 0+2+2 plan , No written plan but it is well understood :1.3 . No written plan but activities carried out in sequence and there is a plan 2.3 Content of the . Not applicable 0+2+4 plan . The content is well known -2 . Not applicable in Dogongawa and in Lufu 3.1 Full . Very little involvement in management there is no 1+3+2.5 responsibilrty of orientation, no opportunity to provide leadership :2.1 local leaders . Based on information from communities the plans are made . Initiative begins in the health facility and in Lufu the instructions come from the LG 3.2 Political . Personnel is willing to perform but does not know 0+0+2 commitment what is expected of him :0-7 ' No evidence of political commitrnent . Communities are happy and involved in Dogongawa and in Lufu there is no commitment 4.1 Routine and . No routine supervision 0+3.5+4 efficient . There is some supervision but it is not routine in :2.5 supervision of Kanjong in Lankaviri the villages on r ftl Takum Supervision and monitoring are regularly site done by CHEW 4.2 Collection and . Not at all 0+4+4 transmission of . Collection and reporting within govemment system :2.7 routine data in Lankaviri and Kajong within system . There is no documentation but collection and transmission done at this level 64

4.3 Routine . Not at all 0+4+4 management . There is routine monitoring in Kanjong and :2.'l process of l,ankaviri successes and . Routine processes of management of problem and challenges joint solution of problems in Takum 5.1 Sufficient . CDDs estimate of requirement is used to get supply 4+3.5+3 orders for . LOCT decides on quantity in Yorro :3.5 Mectizan . Tally sheets used to determine number of drugs required in Dogongawa but in Lufu they come for more when the allocation is fininshed 5.2 Mectizan . Not at all 0+4+4 regarded as free . The people knowthe drug prevents blindness and it :2.7 but essential is good for them drug , Mectizan is acknowledged as free and community affair in Takum 5.3 Storage and . No document regarding this 0+4+2 administration . Mectizan is stored in the health centre :2.0 . Stored in the health centre in Dogongawa but in Lufu there is no storage facility 5.4 Appropriate . The people get the drug 4+4+4 distribution to ' The village sends the CDD to collect the drug and is 4 villages effectively distributed to the villages . Distributes drugs to all villages in Dogongawa and in Lufu drugs are shared to all CDDs after trainine 6.1 Only necessary . In-charge does not take part in training 2+4+4 training is being . In Lankaviri the in charge is trained to enhance their _J.J done knowledge and in Kanjong they retrain every year r fu Lufu and Dogongaw4 CDDs are trained annually since some do forget and new CDDs come. 6.2 Training is done . LOCT and SOCT staffdo training 3+4+4 by appropriate . CDD is trained by the supervisor and the LOCT -). I staff members . The in-charge has what is required in the health centre for training 6.3 Materials for . One-on-onecorlmunitymobilisation 2+4+4 IEC available . There are materials for training in Kanjong and in _J.J_aa Lankaviri . There are adequate IEC materials including charts in Takum 6.4 Personnel . Not at all 0+4+4 continue to be : ftl Kanjong and Lankaviri the staff still go for :2.7 engaged in mobilisation and sensitisation sensitisation . Staffroutinely go to check ongoing work in Dogongawa and in Lufu 7.1 Adequate . Not at all 0+4+0 provision of the . Fuel and vehicle is provided by the LG in Lankaviri :0.8 cost of CDTI and Kanjong . There is no budget and not applicable 65

7.2 Available costs . Not at all 0+4+0 of CDTI at this . Funding and assistance comes from the LG to the :0-8 level ommunities . Not aoolicable 8.1 Transport for . No transport means but has a bicycle l+4+0 necessary visits . There is a means of travel. Transportation is adequate :1.'l in Yorro . There is no vehicle at this level commercials vehicles are often used 8.2 Integration of . Somewhat integrated into the processes l+4+4 _J processes ' There is integration since the personnel also do other -a things such as NID in Yorro . There is some intesration in both health district 9.1 Skill of the sub- ' More CDDs are required 2+4+3.5 district team . The staffis skilfirl and knowledgeable inn t ankaviri :3.2 and in Kanjong . There is some skill available in both health disticts 9.2 Stability of . They are very stable 4+4+3 personnel . There is stability of staffin Yorro :3.7 ' Staffremain in one station for a long time in both health districts 9.3 Satisfactory . Staffhave not been paid for three months 2+3+2 work conditions . Salaries are paid for two months out of four in Yorro :2.3 and there is enough working materials . Salaries have not been paid for nine months in Takum t{ !) . The first line Health system in Ardo Kola is not oP involved beyond being a collection centre and it is therefore not sustainable . The first line hedth system in Yorro is well involved and has clearly defined responsibilities. The program is sustainable at this level r fu Takum the first line health system is very much involved and has clearly defined responsibility. The Drosftrm is sustainable at this level 66

4. Community levet

No. Indicator Findings Position /Scale 1.1 Geographic r fu Napu, Kanjong, Shompa B, Lankaviri B in 4+3.5+4 coverage Yorro coverage is 100% :3.8 r ftl Alheri company the number of households are not known and the denominator is not calculable, Ardo Kola (86.30/o), Tau Galadima every segment was treated (L00%),In Lapo the number is not determinate . Tampo l00yo,Ikyor 100%, Agba l00yo,Fete2 rca% r.2 Therapeutic r fu Napu itis29.5o/a, Kanjong 88.6yo, Shompa 23+3.5+2.7 coverage 7 5.3Yo, Lankaviri E 88.5% :2.8 : fu Alheri C 81.7 Yo, Ardo Kola 91.5olo, Tau 86.lYo,Lapo 95.7Yo . Tampo 6l.2yo,Ikyor 81.73Yo, Agba9g.7yo, FeteII 80.9 % 2.t Census update r ft1Napu and Kanjong , Shompa B, Lankaviri 4+2.5+3.5 done at time of CDD updates census by moving house to house :3.3 distribution . In Alheri, Ardo Kola the register is updated but in Tau and Lapo no register was seen but he said he updates the register regularly, , Tampo and Ikyor census is well done in Agab census is done sometimes but in other times no! in Fete II census is updated 3.1 Leadership/ . In Napu, Kanjong, Shompa B, Lankaviri the CDD 4+3+4 community takes part in community mobilisation those who -)-I problem react report to the chief who motivates them to management take the drug r fu Alheri and Ardo Kola and Tau community contributes funds for feeding CDD and takes part in the arrangement. In Lapo there is no indication of leadership. . In Tampo,Ikyor, Agbq Fete tr leaders take responsibility and solve problems as they come, mobilisation, education absentees follow-up. 4.1 Maintenance of r fu Nup,l Kanjong, Shompa B village register is 3.5+2.5+4 village level kept accurately and updated but in Lankaviri _J.J-aa register update was not properly done and underage not changed. r fu Alheri, Ardo Kola, Tau the register is kept but not accurately entered but in [,apo register is poorly kept . In Tampo lkyor Agba and Fete lkegister is complete and filled bv CDD, 67

4.2 CDD report to . fu Nup,t Kanjong, Shompa B and l,akaviri the 4+2+4 sub-district report is submitted to the nearest health facility. :3.3 r fu Alheri report is sent to the health district, in Ardo Kola the report is not sent to the health centre, in Tau the report was not available but sent before, during and after dishibution, in Lapo there is no evidence of reporting . fu Tampo, Ikyor, Agba and FeteII there is an inventory for drug and the summary forms are submiued to the health facilitv 5.1 Receipt of r ft1Nup,l Kanjong, Shompa B, Lakanviri quantity 4+2+3.5 required requested received on time due to refusals :3.2 amount of . In Alheri, and Ardo Kola dugs that are given to drugs him by the SOCT, so the CDD does not determine the number of drugs required, Tau and Lapo the nomads are treated but there are no rational means of detennining the number required. r ftl Tampo,Ikyor, Agbq Fete II the drug Mectizan is given to everyone in the village, drug is given to everyone livins in the villase. 5.2 Accuracy and r ft1Napu and Shompa B it is based on the 3.5+1.8+3 rationality of population of people in the village but Kanjong :2.'l drug estimate and Lankaviri based quantity required on the amount requested in the previous year , In Alheri, Ardo Kola, Tau and Lapo whatever the CHEW gives is used and there is no rationale for entries ' The drug is given by the health stafl in Tampo and Ikyor the CDD collects 500 at a time and replenishes when he has finished, in Agba and Fete the number of elisibles is used to determine 5.3 Required r fu Nup.u Kanjong, Shompa B and Lankaviri it 4+4+4 amount was received at the time the community wanted 4 received on and called for it time . Alheri, Ardo Kola, Tau and Lapo the drugs arrive at the time they like and they are happy. . Tarrpo and Ikyor mectizan arrives when the distribution period is around. In Agba and Fete II the number requested is received at the time needed. 6.1 CDD and . In Napu, Kaqiong, Shompa B, [,ankaviri the 4+3+4 Community people are mobilised, sensitised with and without -J-I leaders carry on IEC materials any time the drug arrives. sensitisation . Alheri, Ardo Kola, Tau the CDD informs and and sensitises the villagers on their role using IEC mobilisation materials. There was no evidence of sensitisation and mobilisation of the community r ftl Tampo,Ikyor, Agba and Fete II take part in sensitization and mobilisation and advocacy 68

7.1 Villagers r ft1Napu, Kanjong, Shompa B and l,ankaviri we 4+3+4 appreciation know the drug is costly and that the finance involved :3.7 offinances is much and distributed free. involved in . They appreciate the problem in Alheri, Ardo Kola, CDTI Tau and contribute money to the CDD, village head feeds the workers and pay N5 per household for the CDD's incentive. In l,apo they abuse him and do not give me any support. r fu Tampo and Ikyorthe communities appreciates the finances involved, in Agba and Fete [I the villagers are aware of the cost of the drug and appreciate the finances involved 7.2 Community r fuNup,r, Kanjong, Shompa and Lankaviri the 4+2.5+4 arrangement community has no arrangement to compensate CDD :3.5 to meet but provide transporf provides goods and food such local costs as groundnuts and yams as incentives to compensate for CDD time and effort. r fu Alheri there is a sustainable system of supporting CDDs, Ardo Kola govemment is required to support CDD, in Tau there is an zurangement for funding local costs but in [,apo there is no evidence of community support of the CDD . In Tampo, community provides pencils and writing materials but the CDD provides these in lkyor and Agbq in Fete II there is a community contribution to motivatine the CDD (farmins) 8.1 Community r fuNapu, Kanjong, Shompa B and Lankaviri the 4+4+4 access of drugs are always collected in spite of the transport 4 transport to difficulties, there are no problems of access and collect collection mostt often the collection centre is near. Mectizan . The CDD goes to collect the drug from the health centre in Alheri, Arodo Kola Tau and Lapo r fu Tampo and Ikyor they promise to give money and to support his collection of the drug. In Agba and Fete there is no oroblem with communitv access 9.1 CDDs have r fu Napu, Kanjong, Shonpa B and l,ankaviri the CDD 4+4+4 received has been trained to treat and manage side effects 4 appropriate r ft1Alheri, Ardo Kola and Tau and Lapo receives training training every year, r fu Tampo, Ilryor, Agbq Fete II the CDD has been trained in the past six years some up to nine years and this shows- 9.2 System for r fuNapu, Kanjong, Sompa B and Lankaviri there is a 4+3.5+4 acquisition plan to replace absent CDDs and train new CDDs :3.8 of skills by . Alheri, Ardo Kola" Tau there is a system on ground new CDDs for the training CDDs using older ones. There is no system on ground for training in Lapo. . In Tampo, Ikyor, Agba and Fete II there is routine yearly training at the community level and to send another CDD for trainine. 69

9.3 Willingness . fu Napu, Kanjong, Shompa and Lankaviri the CDDs 4+4+4 of CDDs to are willing to continue to help their people. -4 continue . In Alheri, Ardo kola Tau and Lapo: 'We continue to with CDTI do the work even if there is no community support' , CDDs are willing to support the community and to continue to serve in Tamoo.Ikvor. Asab and Fete II 9.4 Appreciatio . In Napq Kanjong, Shompa B and Lankaviri there is a 4+3.5+4 n ofannual lot of refusals but the people like it since the wonns :3.8 t treatment by are removed. There is a general appreciation of the community importance of annual fieatment of the itching and the worns. . In Alheri and Ardo Kola" Tau the villages appreciate the benefits of the drug for skin and sight. There is some interest in the drug in Lapo . Communities appreciate the improvement in the skin, worn expulsion and value the treatment in Tampo, Ikyor. Aeba and Fete II 9.5 Community r fu Napu, Kanjong, Shompa B and Lankaviri the 4+3+4 acceptance villagers want the CDTI to continue and accept their :3.7 ofneed for role in the distribution for the next 15 years long- term r ft1 Alheri, Ardo Kola" Tau the community accepts the treatment need for long term treatment. The community does not feel the impact of the problem and does not have much interest. . The community members accept the treatment for a lone time in all the communities for a long time i Self-sus- . In Yorro the community meets their responsibilities o rrt tainability at and are capable of sustaining CDTI () community r fu Ardo Kola there is no sustainability but could be ()o level turned around if there is sensitisation and mobilisation as well as training and education of the communities and CDDs r fu Takum the performance is very good and the Drocess is sustainable I