Annual Report 2018

Quality Education Economic Empower- ment S • CIVIL S HIP OC S IE R T E Y N T IN R A S P T R

C A I

DIGNITY G

– empowered I A C

communities & P

A Good

individuals

N T

N Health

Peaceful T

I S

H C

co- S L

I • V I

existence C

Environmental Sustainability

Annual Report 2018

Contents Contents ...... 2 1. Introduction ...... 3 2. Aggregated Result Scores ...... 4 3. Thematic Reports ...... 8 3.1 A Strong Civil Society ...... 10 3.2 Good Health ...... 19 3.3 Peaceful Coexistence ...... 23 3.4 Environmental Stewardship ...... 28 3.5 Quality Education ...... 31 3.6 Economic Empowerment ...... 36 3.7 Cost-Effectiveness ...... 40 3.8 Deviations in Projects Ending 2018 ...... 44 4. Progress Report on Ongoing Projects ...... 46 5. Earmarked Funding ...... 51 6. Management of Cross-Cutting Risks ...... 56 7. External Project Evaluations ...... 61 8. Report on selected outcome indicators...... 64 9. Secretariat ...... 78 10. Conclusions ...... 87

1. Introduction Digni is pleased to present the annual report for 2018. In 2018, Digni has given support to projects in 37 countries through 19 member organizations. A total of NOK 161 034 637 has been spent towards the project portfolio. In every given year, a number of projects in the Digni portfolio will reach their conclusion while the rest of the portfolio is ongoing. For this reason, we distinguish between projects that were concluded in 2018 (23) and projects that were ongoing as of 2018 (78 projects). The main results, thematic analyses and cost-effectiveness assessment provided for the reporting year is based on concluded projects only (chapters 2 and 3). A full summary and assessment of each projects ended in 2018 is included in Annex A to this report. A progress report on ongoing projects in 2018 is provided in chapter 4, which includes a summary of notable deviations and follow-up. Special reports on projects receiving earmarked funding from Norad is provided in chapter 5. An analysis of risks related to Norad’s cross-cutting issues of women’s rights and gender equality, climate/environment, human rights, including the rights of people with disabilities, and anti-corruption is provided in chapter 6. The cross-cutting concerns are also covered in the thematic reports in chapter 3 (on environment, gender equality, and human rights) and in the secretariat report in chapter 9 (on financial management and anti-corruption efforts). An analysis of external evaluations carried out in 2018 is included in chapter 7, while a full list of external evaluations carried out in the period is attached to the report as Annex B. In chapter 8, a special report on selected outcome indicators from Digni’s Global Results Framework is provided. A report on the Digni secretariat is included as chapter 9, which includes analyses on risk management, financial management and anti-corruption work in addition to brief reports on member activities included in the secretariat budget.

Finally, in chapter 10, conclusions and follow-up measures are summarized. The full accounts are submitted as a separate report. In addition, we have included overviews of expenditure vs. budget in relevant chapters. The full accounts are summarized as follows:

Total Budget Total Accounts Grant from Norad 20181 2018 Deviation Main project portfolio 167 897 580 154 106 295 -13 269 076 Digni secretariat + member activities 18 102 420 15 871 940 -2 230 480 Rights of Minorities of Faith and Belief Funding Scheme 4 217 627 2 777 912 -1 207 053 Regional Grant 4 397 700 4 150 430 -247 270 Total 194 615 327 176 906 577 -16 953 879

1 Refers to the combined budgets of QZA-12/0763 Addendum 11 (Jan-Apr 2018) and QZA-18/0159 (May-Dec 2018)

2. Aggregated Result Scores Below we have provided the combined results scores based on in-depth readings and assessments of all projects concluded in 2018.

Each project report on one or more thematic areas in Digni’s Global Results Framework (GRF) for 2018-202, which covers six thematic areas. In each project, a score is provided for each applicable thematic area. The scoring is made on an “empowerment scale” ranging from 1 to 5, where 1 equals output level and 5 equals impact level. The scoring is based on Digni’s Empowerment Assessment Tool (EAT), in which characteristics have been assigned to the different levels describing developments in terms of resources mobilized, agency gained, and achievements made. Below we have provided definitions or characteristics of each level in the assessment scale:

LEVEL 1 (Output): Resources: H ave increased, been provided by project to individuals and/or community and/or other target groups Agency: No demonstration of target groups having changed their behavior or using resources to act. Results: There are no documented changes in target groups situation.

LEVEL 2 (Output):

Resources: have increased by project to individuals and/or community, some local resource mobilization. Agency: Target groups tell that they have gained “power within”, increased their self-esteem, and/or have changed perspectives. Still little change in behavior and signs of agency. Results: There are few documented changes in the target groups’ situation.

LEVEL 3 (Outcome):

Resources: have increased by project to individuals and/or community and/or other target groups. There might be some local contribution of resources to the project. Agency: Target groups show that they have gained not only individual power, but also some collective agency, the “power with”. There are some documented actions. Results: There are documented changes in target groups’ situation.

LEVEL 4 (Outcome): Resources: have increased, been provided by project to individuals and/or community, and/or local resources are contributed. Agency: Target groups show that they have gained not only individual power, but also collective agency, the “power to” act. There are documented community/target group action. Results: There are documented changes in the situation for direct and immediate indirect target groups. There are indications of results at “structural level” for instance stakeholders such as local government and/or others power

elites are providing some resources or changed their behavior/practice to some degree.

LEVEL 5 (Impact):

Resources: have increased, been provided by project, and/or local resources are contributed, and/or provided by stakeholders. Agency: Target groups show that they have gained collective agency, the “power to” act, but also some “power over”. There are documented community/target group action. Results: There are substantial documented changes that most often goes beyond improvement of the situation for the direct target groups. The changes are often perceived to be sustainable and results are often at a “structural level”. There might be multiplication effects and adoption of project methodology by others. Examples may be change in norms and harmful traditions, policies and laws; Stakeholders such as local government and/or others power elites are providing increased resources or changed their behavior and institutional practice.

Aggregate results 2018 The results from the assessment of projects ending in 2018 is presented in Table 1 below. The scores in the tables have been weighted according to expenditure (accounts) on each theme in each project, based on the DAC sector codes chosen.

Table 1: Achievement scores based on 2018 final reports, adjusted for expenditure – 22 projects

Achievement of Digni goals 2018 Contribution towards the # of Level of results Score realization of entries Output Outcome Impact Goal 1 – Civil Society 22 3,59 Goal 2 – Good Health 12 3,39 Goal 3 – Peaceful Coexistence 7 4,21 Goal 4 – Environm. Stewardship 4 3,04 Goal 5 – Quality Education 13 3,74 Goal 6 – Economic Empowerm. 8 3,11

AVERAGE ALL THEMES 3,60

The table shows that results in 2018 were on average recorded at a high outcome level (3,6). This is a clear improvement on the results from the previous agreement period (3,2)2. It should be noted however that the present sample comprises results from 22 projects, compared to 59 projects in the period report for 2013-2017, hence the risk of random deviations is present. This

2 The results in the period report for 2013-2017 were based on thematic assessments of 59 projects ending in 2016 and 2017. It should also be noted that in the previous agreement period, Digni’s results framework contained nine thematic areas. The average score of 3,2 is therefore the average thematic score of nine thematic areas. The overall thematic score and theme-wise scores from the previous period constitute the baseline values against which Digni will compare results in the new agreement period.

5 notwithstanding, Digni observe that the quality of reporting from the projects has improved, which may partially account for the positive results. Comparing average thematic scores in 2018 with results from the previous period (see Table 2, below), we observe that results were better in all thematic areas except health, in which the average result in 2018 is considerably lower than in the previous period. This may be because the large share of projects reporting results related to health in 2018 were integrated projects, in which health constituted one of several focus areas, as opposed to projects focusing primarily or solely on health. It is sometimes the case that the average scores are lower in multisector projects, compared to projects with a narrower focus. On the other hand, integrated projects often address a more complex set of development challenges. We discuss this further in the conclusion, in chapter 10. Within the thematic area of peaceful coexistence, the results are considerably stronger in 2018 compared with the previous period. This is largely explained by the fact that results for 2013- 2017 are based solely on two projects working with peace and reconciliation. With Digni’s new GRF, the thematic sector has been expanded to include outcome areas related to gender-based violence, safe environments for children, and the rights of ethnic, indigenous and religious minorities. Hence results from previous periods are not automatically comparable. The projects ending in 2018 have also recorded particularly strong results. Please refer to the thematic discussion in chapter 3.3 for more details.

Table 2: Results 2018 compared to results 2013-2017 (adjusted for expenditure)

Share of accounts Result 2013-2017 Result 2018 2018 (baseline) A Strong Civil Society3 30 % 3,59 3,33 Good health 20 % 3,39 4,33 Peaceful Coexistence 12 % 4,21 2,00 Environmental Stewardship 4 % 3,04 2,33 Quality Education 25 % 3,74 3,33 Economic Empowerment 8 % 3,11 2,66 AVERAGE 100 % 3,60 3,33

Breaking results down according to total budgets (Norad share) per project also yields interesting results. The average score (weighted) per project with total budgets of less than NOK 6 million (Norad share) was 3,20, whereas the average score of projects with total budgets above this threshold was 3,86. While no conclusions can be drawn on this basis, the difference is worth noting. Are larger projects more effective? What are the decisive success factors? Digni will need to monitor this parameter carefully in the years to come. Here we refer to discussions on cost-effectiveness, in chapter 3.7 and the conclusions in chapter 10.

Scores not adjusted for expenditure Table 3, below, shows the results when not weighted for expenditure. It is worth observing that the average scores in all but one thematic area are somewhat lower when results are not

3 The average score for 2013-2017 for civil society as a thematic area is calculated on the basis of three separate thematic areas in the previous period: Strengthening Civil Society, Women Empowerment and Gender Equality, and Human Rights.

weighted. This is largely due to the strong results achieved in two large projects supported through Misjonsalliansen (MA) in Bolivia (QZA-18/0159-171-176 MA-Local Development Plan Rural-Urban Zones, El Alto) and Cambodia (QZA-18/0159-190-195 MA-Community Transformation in Rural Cambodia). The average score per project when not weighted is 3,40 as opposed to 3,60 when weighted.

Table 3: Achievement scores based on 2018 final reports, not adjusted for expenditure – 22 projects

Achievement of Digni goals 2018 Contribution towards the # of Level of results Score realization of entries Output Outcome Impact Goal 1 – Civil Society 22 3,45 Goal 2 – Good Health 12 3,58 Goal 3 – Peaceful Coexistence 7 4,00 Goal 4 – Environm. Stewardship 4 3,00 Goal 5 – Quality Education 13 3,46 Goal 6 – Economic Empowerm. 8 2,88

AVERAGE ALL THEMES 3,40

General notes on Digni’s assessments Digni has chosen a conservative approach to assessing the level of results. For projects that have not been able to present solid evidence of change, the results have generally been downward adjusted. This was however a more common feature in the reports for 2016 and 2017, with the implication that results in this period were likely under-reported. We are pleased to note that the quality of reporting from projects have improved, although some issues remain – ref. chapter 3.8. There is also a balancing act involved in assessing results. A low score in a demanding context may be a good result. Projects that have operated for a short time may not obtain high scores. Results towards the impact end of the scale involves some uncertainty about the level of attribution as opposed to the output end of the scale, which is firmly within the control area of the projects. The long-term effects and wider implications are also uncertain. Analysis and example of results related to each thematic area is presented in the following chapter, following the structure of Digni’s Global Results Framework.

3. Thematic Reports The results and analyses provided in the thematic reports are based on the assessment of 22 projects that ended in 2018. One additional project ending in 2018 was not included in the analysis due to evaluation and reporting not concluded (ref. FV5419). The ending projects accounted for 23 of 99 active projects in Digni’s project portfolio as of 2018. In-depth summaries of results, scores, remaining challenges and added value of Digni and member organizations related to each project are included in Annex A to this report. The 22 projects that ended in 2018 have received more than NOK 144 million in funding from Norad via Digni over the respective project periods. In 2018 alone, the 22 projects received NOK 37,279,798. On average, the project periods lasted 4,5 years. An overview of the accounts for 2018 only is provided in Table 4 below. The projects were implemented in 19 different countries, of which 11 (58 %) were located in Africa, 7 (37 %) in Asia and 1 (5 %) in South America. This is quite representative of the total portfolio, in which Africa accounts for 54 % of the projects, Asia 38 % and South America 8 %. While the 22 projects ending in 2018 constitute the main basis for the thematic analyses provided below, comparisons are also made with findings in the period report for 2013-2017. Digni introduced the present system of assessing and scoring results according to the Empowerment Assessment Tool (EAT) in projects ended in the report for 2016 and 2017. Altogether, 59 projects ending in 2016 and 2017 were summarized and analyzed according to EAT in the previous agreement period (2013-2017). For the present agreement period (2018-2022), a new results framework has been introduced. The thematic areas have been reduced from 9 to 6, and the aggregated EAT scores represent results recorded against impact indicators 1-6 in Digni’s Global Results Framework (GRF), for each thematic area in the Digni portfolio (Average thematic score, according to Digni's empowerment assessment tool (EAT), adjusted for expenditure). The present sample includes projects supported through 12 of Digni’s 18 active members at the time of the report. No projects supported by Areopagos (AR), Blå Kors (BKN), De Frie Evangeliske Forsamlinger (DFEF), HimalPartner (HP), Stefanusalliansen (SAI) or Wycliffe (WYC) ended in 2018. However, project results from 5 of these organizations have been included in the reports for 2016 and 2017. Stefanusalliansen is the only organization not covered in any of those reports.

Table 4: Accounts 2018 for projects ending in 2018 only

Projects ending in 2018 Budget Accounts Deviation BS-HIV material and training to churches in Ethiopia 1 350 465 1 322 342 -28 123 BS-Trauma healing and reconciliation in Burundi 1 011 150 1 000 582 -10 568 DELF- Conflict Transformation in the Palestinian Areas 2 600 100 2 599 410 -690 DNB-Education lower Bas-Uele 754 029 801 859 47 830 FA-HIV/AIDS, Community Health and Empowerment4 2 651 027 - -2 651 027 FA-Youth Focused Development Program 1 120 027 1 009 648 -110 379 MA-Community Transformation in Rural Cambodia 4 182 437 4 432 096 249 659 MA-Local Develop. Plan Rural-Urban Zones, El Alto 2 673 545 3 894 312 1 220 767 MA-Equitable and sustainable WASH services in Bong County 2 508 069 2 976 306 468 237 MKN-Mental Health Training Center, Herat (MHTC) 989 579 1 070 172 80 593 MM-Mother Child Survival Tr., Mutambara 724 368 789 370 65 002 NLM-Raytu Comm. Dev. Project (RCDP) 969 720 888 385 -81 335 NLM-Strengthening Children's Rights Project (SCR)2 1 778 830 1 738 943 -39 887 NLM-Hope for All 2 454 554 2 273 368 -181 186 NLM Community Mobilization Pre-Project 1 596 181 1 351 667 -244 514 NLM-Pilot Project for Natural Resource Management 651 642 647 921 -3 721 NMS-Malagasy Integrated Rural Development Program 3 380 986 3 268 985 -112 001 NOR-Socio-Economic Empowerment with Peace and Reconciliation Project 2 255 023 2 161 262 -93 761 NOR-Organisation Development Project – DPAB 625 950 648 801 22 851 NOR-Identity Based Comm. Dev. and Educ, (iBCDE) 963 000 812 570 -150 430 NPM-IEAL Secondary School Project 1 733 400 1 505 772 -227 628 NPM-Inuka Kanisa 1 569 690 1 560 719 -8 971 UIO-Education and Basic Life Skills in Arsi 858 075 913 444 55 369 Total 39 401 847 37 667 934 -1 733 913

4 Deviation due to FV5419. Please refer to the financial report.

3.1 A Strong Civil Society Overall goal: Society is characterized by a high degree of civil society engagement for change

Average thematic score, according to Digni's empowerment assessment tool (EAT), Indicator 1 adjusted for expenditure Baseline 47 3,43 Based on an assessment/analysis of 47 projects ending 2016-20175 Results 2018 22 3,59 Based on an assessment/analysis of projects ending 2018

Target 2020 43 3,50 Based on an assessment/analysis of projects ending 2018-20196

Presented graphically on a scale, the 2018 results for thematic area 1, Civil Society, are:

Impact score # of Level of results (3,60) entries Output Outcome Impact Gal 1 – Civil Society 22

Basis All projects ending in 2018, from 12 different member organizations, reported results on civil society as a thematic area (mandatory), of which 13 were in Africa, 8 in Asia and 1 in South America. The accumulated accounts (Norad-share) amounted to nearly NOK 43 million, or 30 % of the total accounts of the projects in the sample. In terms of project focus, the projects covered areas such as organization and training of community- based organizations and groups, local resource mobilization and assets-based development initiatives, gender mainstreaming and women empowerment, and human rights and rights-based initiatives for local rights- holders to engage with relevant duty bearers. In addition, an organizational development project was implemented. The projects record results related to SDG# 1 on No Poverty, SDG #16 on Peace, Justice and Strong Institutions, SDG 17 on Partnership for the Goals and SDG #5 on Gender Equality, in addition to others.

DISTRIBUTION OF RESULTS # of projects achieving score level 1 (output) 0 # of projects achieving score level 2 (output > outcome) 1 # of projects achieving score level 3 (outcome) 12 # of projects achieving score level 4 (outcome > impact) 7 # of projects achieving score level 5 (impact) 2 Total # of entries 22

5 The results framework for 2013-2017 included nine thematic areas. The results from thematic areas 7 (Gender Equality), 8 (Human Rights) and 9 (Civil Society) have been combined to establish the baseline for thematic are 1 (Civil Society) in Digni’s Global Results Framework for 2018-2022. 6 The number of projects in sample and average score will be accumulated as of 2018 and throughout the present reporting period.

Selected Results There is a high degree of organization in the target groups (Outcome 1.1): Most projects ended in 2018 have elements of establishing and organizing community-based committees and training of these in management and in specific technical thematic areas within health, education, environment, economic empowerment, etc. For example, in DR Congo (QZA-18/0159-47-48 DNB-Education lower Bas-Uele), all 59 targeted schools have established student committees in addition to parents’ school committees. The presidents of these committees are represented in the school management committees. In Mozambique (QZA-18/0159-372-373 NPM-IEAL Secondary School Project), 545 students in 15 schools and in 8 church have been organized in 23 students’ clubs. The clubs are largely run by the students themselves with the assistance of social workers. In India (QZA-18/0159-483-487 NOR-Socio-Economic Empowerment with Peace and Reconciliation Project), several community-based organizations have been formed during the project period, including 87 village development committees, 36 youth clubs, 425 self-help groups, 5 Gaonburah federations, 18 peace mediator forums (PMFs) and 3 sub- divisional PMFs, one project central committee and 30 village organizations. The members of these organizations have undergone training in leadership, advocacy and conflict management. In Indonesia (QZA-18/0159-298-301 NLM Community Participatory Action for Transformation), there was only one inactive women fishery group registered in the Agriculture/Fishery and Marine Department before the project started. At the end of the project period, there were 6 active registered farmer and fishery groups with a total of 80 members. Each group has an elected chairwoman, a secretary and a treasurer. They have also defined responsibilities for group leaders and members that are written in statute and bylaws. In addition, they practice meeting attendance list, provide basic financial report and record savings. The groups have weekly meetings where they develop their savings activities, cultivate their demonstration plot and make food processed products. In 2018, the groups had 3-4 meetings a year with agriculture subdistrict officer/Fishery and Marine Department officer.

Local communities are able to identify and solve their challenges together (Outcome 1.2): Examples from the following projects demonstrate the potential of community mobilization for change: In Ethiopia (QZA-18/0159-9-10 BS-Good Samaritan HIV program), a project run by the Ethiopian Bible Society has played a role as an ecumenical bridge between the three major churches in the country (the Orthodox, the Pentecostal and the Catholic churches) to resolve common challenges related to HIV/AIDS and gender. The cooperation was effective, and the churches have learned that they can work in areas of common interest while maintaining their differences. In DR Congo (QZA-18/0159-47-48 DNB-Education lower Bas-Uele project in Congo) a project implemented by the Baptist Union worked with improvement of school infrastructure. During general assemblies, 12 organized and trained parents’ committees initiated and organized repair and construction of 12 schools. Furthermore, in 10 out of 13 secondary schools, parents have collected means and students have carried out income generating activities to finance renewal of materials and textbooks. Students at the technical schools have been selling products like chairs, tables and cloths. Parts of the generated income go to the schools.

In Mali (QZA-18/0159-309-312 NLM-Pilot Project for Natural Resource Management), the project activities have resulted in a social cohesion and cooperation between the three villages Diarrala, Koulaka and Sébécourani. Previously, there was a climate of mistrust and suspicion

11 between the villages and the landowner due to a lack of control of customary property rights. At the onset, one of the village leaders made it clear that they would never cooperate with the other village. Through sensitization by the project and the support of customary and political leaders, the landowner and villages agreed to cooperate which was unimaginable before. As a result, the people of the Diarrala clan, the hamlet of Koulaka and the village of Sébécourani have contributed a total of 3290 individual working days to the work related to backfilling, planting and fencing. A third of the contribution was from women. The NLM-Strengthening Children's Rights Project in Mongolia (QZA-18/0159-314-315) addresses children’s’ rights to ensure they are respected and protected in the school dormitories of Khovd and Bayan Ulgii provinces. The stakeholders have worked together to provide equipped furniture and facilities for the dormitories by own means, from local fund and from parents of the children in the dormitories, resulting in an improved life condition at the dormitories .School principals, dormitory teachers and staff express having gained much knowledge and changed attitudes through trainings, participatory exercises on dormitory assessments, observatory visits to model dormitories and monitoring and evaluation visits accompanied with methodological guidance from the project. While waiting for external support prior to the project start, the stakeholders now have realised that they themselves can create a safe, healthy and friendly environment and make significant changes in dormitories. In Madagascar (QZA-18/0159-423-429 NMS-Malagasy Integrated Rural Development Program), grassroots mobilization through assets-based approaches is carried out on a large scale. More than 1600 local development committees are set up through the structures of the Malagasy Lutheran Church. The main conclusion of an external evaluation of the project (2017) concerning the impact of the project is the evidence of an increased capacity of the targeted groups, enabling them to acquire new knowledge, to enhance theoretical and practical skills, to promote their own interests, to build their local society, all resulting in noticeable empowerment to construct the foundation of their own development and of their communities. The contribution of the project has mainly been to provide capacity building to local committees and associations.

Communities provide equal opportunities for women and men (Outcome 1.3): According to statistics from the Protestant Convention School Coordination Department (PCSCD) in DR Congo DR, the number of female teachers in the project area of the DNB-Education lower Bas-Uele (QZA-18/0159-47-48)) has increased by 27% from 167 in 2013 to 212 in 2017. In the same period, the number of female principals has increased from 8 in 2013 to 12 in 2017. In Cambodia (QZA-18/0159-190-195 MA-Community Transformation in Rural Cambodia), a total of 605 women leaders and 875 male leaders in the target communities have learned about leadership and financial management by the end of the project period. They are leaders of savings groups, CBOs, schools supported committees and producer groups. Of the 91 CBOs, 22 were chaired by women and 6 by disabled persons. In Ethiopia (QZA-18/0159-284-287 NLM- Raytu Comm. Dev. Project (RCDP)), women were not part of development activities 15 years ago. After the project intervention, they are participating in activities and community meetings equally with men. The communities’ perceptions about gender roles are changing as evidenced through the achievements related to increased enrolment of girls in school and reduction in early marriage and female genital mutilation (FGM) rates. Furthermore, 7 community participants, of whom 4 men and 3 women, have been assigned in administrative positions in government structures at kebele level. These community

12 participants learned how to read and write through the project and were consequently recruited to government positions. Still in Ethiopia (QZA-18/0159-530-531 UIO-Education and Basic Life Skills in Arsi), cultural customs towards children and especially girls have changed greatly in the target area. Children have been considered as unimportant and it was against the religion to educate girls. Through trainings of and discussions with parents, use of extracurricular activities, home visits and cooperating with governmental bodies, the project has contributed to change the low regard the community had towards girls and the female enrolment rate in the schools. While school enrolment was 2 % prior to the project intervention (the project was first initiated in 2007), it is now 52 %.

Rights-holders are holding duty-bearers accountable (Outcome 1.4): In Mongolia (QZA-18/0159- 314-315 NLM-Strengthening Children's Rights Project (SCR)2), nearly 40,000 children are living in 512 dormitory schools throughout the country. In the target area more than 6500 children are living in 46 dormitories. At the beginning of the project period, the education authorities had no plans or documents related to child development and protection. During the period of intervention, the project has been developing several policies and tools for dormitories. These have been adopted by the government. The Ministry of Education has also approved a National child protection policy and guidelines on prevention from child abuse in education setting, which is partially attributed to the work of the project. A National plan on child development and protection has also been approved by the Ministries of Labour and Social Welfare, Education and Health. In addition, a national midterm Action plan for 2018-2020 has been developed, including a monitoring system that enable the Education Department to follow up the project- initiated activities related to the dormitory’s physical and psychological environment. The Dormitory Assessment Tool developed by the project has been nationalized and includes leisure time activities and clubs, child development room, updated library, trainings on child rights and communication, organizing parent’s involvement activities and experience sharing activities locally. The results of the project’s intervention will apply to all dormitories in Mongolia also after the project period. In Afghanistan (QZA-18/0159-121-122 MKN-Mental Health Training Center, Herat), a project implemented by the International Assistance Mission has successfully lobbied the Afghan government to develop a community-orientated national mental health strategy. As a result of this strategy, more resources are allocated to mental health care in Afghanistan. In 2012, only 0.01 % of the national healthcare budget was allocated to mental health. By 2018 it has increased to 2 %. The project has also contributed to the development of the National Treatment Protocols for mental health disorders used by all primary care providers across the country and has successfully advocated to enforce the collection of mental health data into the National Health Management Information System in Afghanistan. The project has been very influential with regard to training of health personnel, being the first organization to establish highly specialized psychiatry services in Herat province; and raising the awareness of the general public, having, among other achievements, advocated the government to include 10 lessons on emotional resilience and mental health information in the national health package for public schools. In Cambodia (QZA-18/0159-190-195 MA-Community Transformation in Rural Cambodia), the project approach of engaging local authorities in project activities from the start and throughout the project period have increased cooperation, relationship and the authorities’ commitment to

13 work alongside with communities and CBOs. 98 % of community members surveyed7 during the final evaluation stated that their relationship with local government have improved by the project. The project final evaluation stated that “Structural benefits in how local authorities understood the needs of communities and communicated with them were achieved, indicating that local authorities are fulfilling their roles and responsibilities.… ensuring the needs of communities are met in the future”8.

In Bhutan (QZA-18/0159-479-480 NOR-Organization Development Project – DPAB), DPAB is working closely with the government. One of the significant changes achieved through the project is a higher level of advocacy and awareness raising on the rights and needs of People with Disabilities that led to the formulation of the National Disability Policy in Bhutan. It is anticipated that the National Disability Policy will soon be tabled for approval. In addition, DPAB has managed to use focal persons hired by the government to volunteer and advocate the interests of disabled people in the districts.

Partners have strong capacity (Outcome 1.5): One project ending in 2018 has been a specialized organizational development project, aiming at strengthening the institutional capacity of the Free Pentecostal Fellowship in Kenya - FPFK (QZA-18/0159-363-364 NPM-Inuka Kanisa). This has resulted in a new constitution being adopted, which has led to more space for women, youth and professionals in the leadership. The strategic plans have been revised to become more concrete, and a social ministry coordination office has been set up, which has improved the coordination of and learning between various projects supported by Digni and other donors. A standard system for performance monitoring has been implemented within the church. FPFK have around 226,000 members in Kenya.

Analysis The 22 projects ended in 2018 achieved an average score of 3,59 in the thematic area of civil society, indicating that the overall result achievement of the projects on this theme was closer to an impact than an outcome level. Out of the 22 projects, 12 achieved an average score of 3 (outcome) and 7 achieved results between outcome and impact levels. No project received the lowest score level 1 (output), but one achieved score level 2. Two projects achieved the highest score level 5 (impact). Surprisingly, there is no obvious correlation between results achieved and how many project periods the projects have implemented. It is true that the only project that have ended its 1st phase had achieved the result score level 2, which is understandable given the short time of activity implementation. In return, one should expect that at least a few projects at the end of their 3rd phase would achieve results at an impact level. This is not the case with this sample of projects as the two projects which achieved the highest score had been in their 2nd phase and none of the projects having ended their 3rd phase achieved results at the highest level. It is difficult to see a clear pattern of the reason for this observation, so this needs further analysis.

7 Final Evaluation for World Renew Community Transformation in Rural Cambodia Project, Final Report, July 2018, by Enduring Consultancy. 189 surveys were carried out in the project communities of the four provinces. Sampling was random convenience sampling carried out among all households in project villages based on their availability. 8 page 44 and page 2. 14

Twenty-one out of the 22 projects report on Outcome 1.1. which concerns the degree of organization of target groups. The established groups vary in size and function and in focus thematic areas; trauma healing groups, self-help groups, community-based organizations (CBOs), community-based associations (CBA), community-based committees (COC) women associations, youth associations, youth groups, girls’ clubs, student committees, parents’ school committees, saving groups, associations for patients, clinical psychologists and psychiatrists, community development committees, water point committees, water and sanitation health committees (WASH), natural resource management committees and peace mediator forums. The various entities represent a response to several SDGs, including but not limited to access to basic services (1.4, 3.8), building resilience (1.5, 2.4, 13.1), productivity and food security (2.3), the promotion of literacy (4.6), women leadership and decision making (5.5) management of water resources (6.b), income generation (8.3, 8.5, 9.3), social, economic, and political inclusion of all (10.2, 10.3), the promotion of security and rule of law (16.1, 16.3), and transparency (16.5, 16.6, 16.7). There is a growing tendency of formal registration of groups and associations as legal entities at the authorities among the target groups. This is beneficial related to advocacy work towards the government bodies and practical management issues like opening a bank account. In some cases, registration also makes the various groups eligible to receive support from government schemes. All the established groups have been trained in management issues relevant for their purpose, size, structure and local context in addition to their specific areas of concern within health, WASH, education, peaceful coexistence, environment or income generating activities. Although we can see a slight increase in the quality of the project reports, it is still a challenge to report on the result of the training activities at outcome and impact level. While numbers of people trained trainings undertaken are often specific, there is an uncertainty of the effect of these trainings on the community as many evidences are anecdotal. However, examples show that specific trainings on result-based management at Digni’s network meeting and consistent follow up by Digni’s member organizations as well as experience and competence sharing between projects have increased the understanding of how reporting results. It seems that for some projects, good results have been achieved during many years, but they have been underreported. For example, after consecutive trainings, the Baptist Union in DR Congo (QZA-18/0159-47-48 DNB-Education lower Bas-Uele project in Congo) were able to present and document results at a high level, whereas in the past the reporting was typically at output levels. In the 22 projects, a total number of 31,573 persons (of which approximately 16,800 or 53 % were women) were organized in 3962 groups, of which 1128 or 28 % were led by a woman. 835 or 21 % of the groups were based on already existing groups that were revitalized or given new mandates (to avoid duplication of civil society structures). Most of the projects report on Outcome 1.2, which concerns the ability to identify and solve challenges together in the community. There is a higher level of, and more differentiated, cooperation and partnerships between different entities in the society now than was observed in previous years (SDG 17.16, 17.17). This includes churches from different denominations, communities, the authorities, schools, hospitals, national NGOs, international NGOs and multinational organisations like UNICEF and UNESCO. The use of social media and TV broadcasting is also emerging, although on a small scale so far. On average, the 22 projects in the sample mobilized 466 volunteers contributing nearly 30,000 hours of labor in 2018. The total numbers were 10,256 volunteers who contributed 653,485

15 hours of voluntary work (indicator 1.2.2 in Digni’s Global Results Framework). The figures are testimony to the strong ability of Digni-funded projects to mobilize local resources, highlighting the catalytic potential of assets-based approaches to mobilize resources for development cooperation (SDG 1.a, 17.1, 17.3). The projects were also asked to Table 5: Indicator 1.2.1 - results provide self-assessments with # and % of reporting projects in the final year of project period regard to their ability to solve documenting outcome results on how communities and/or local challenges using own community-based organizations are solving local challenges using resources, and to provide EAT own resources scores for their efforts in this Proportion # of projects Average Proportion EAT score 4- regard. The results are captured reporting score >Outcome in indicator 1.2.1 in Digni’s 5 Global Results Framework Result 2018 22 3,64 95,5 % 59,1 % (Table 5). The self-assessments indicate that on average the projects achieved results ah high outcome-levels, at 3,64. This is consistent with Digni’s own assessments, in which the average score for the civil society thematic area (taking into account all outcome areas) is 3,59. In fact, a 13 (59.1 %) of the projects reported scores at 4 or better, and 21 (95.5 %) reported scores at outcome level or better. The narrative reports mainly focus on local contribution of funds, material, voluntary labour and monitoring. Some also point out that new practices learned through the project have been adopted and spread. It is fair to conclude that there is a strong local ownership in these Digni-funded projects, and that assets-based approaches are commonly used. Concerning providing equal opportunities for women and men (Outcome 1.3), the positive trend that has emerged gradually the last years continues. In general, the projects seem to be increasingly more gender sensitive. However, deep rooted cultural and traditional gender stereotypes and norms are challenging. The projects were asked to provide self-assessments on project results related to local communities lifting social restrictions facing women and girls, and to provide EAT scores for their efforts in this regard (SDG 5.1). The results are captured in indicator 1.3.1 in Digni’s Global Results Framework (Table 6). The self-assessments indicate that on average the projects achieved results at medium-high Table 6: Indicator 1.3.1 - results outcome-levels, at 3,36. This is # and % of reporting projects in the final year of project period consistent with Digni’s documenting outcome results on how local communities have assessments. It is noticeable that been able to lift social restrictions facing women and girls the scores are lower than the Proportion # of projects Average Proportion corresponding scores for local EAT score 4- reporting score > Outcome resource mobilization discussed 5 above. Achieving gender equality Result 2018 21 3,36 100 % 42,1 % involves changing deeply rooted structures and cultural norms, which is more difficult to achieve than to organize and mobilize resources from the communities. Change comes slowly and is a long-term endeavour. Some trends are detectable from the narrative reports. For example, literacy and skills development is frequently singled out as empowering factors (SDG 4.6). Most projects report that the main change taking place is that women more frequently participate in decision-making processes in the households. More women are elected in decision-making positions than before, both internally in an organisation, in the community and a few are elected into public office, recruited into public service institutions or positions at local authorities. Gaining an income, opening a bank account, etc., also changes the status and economic empowerment of women and girls.

Leadership training and experience through self-help groups and similar entities are also important factors contributing to changing roles for women and perceptions about women and girls (SDG 5.5). For further discussions on women empowerment, please refer to chapter 6 (on risks related to the cross-cutting issue of gender equality) and chapter 8 (on results related to Outcome 1.3: Communities provide equal opportunities for women and men).

Rights-holders are also increasingly holding duty-bearers accountable (Outcome 1.4). The projects in the sample has particularly addressed sustainable development goals regarding access to basic services (1.4), in addition to health services (3.4, 3.8), education (4.1-4.5), peace and security (5.2, 16.2). A common feature of the projects is that groups and associations have been advocating matters of common interest towards local and national authorities. Some have obtained free medication and treatments from the government and public hospital and received government funds to create jobs for HIV positive persons (QZA-18/0159-9-10 BS-Good Samaritan HIV program in Ethiopia). Others have successfully advocated for and influenced national educational policies (especially QZA-18/0159-31-33 DELF-Conflict Transformation in the Palestinian Areas, but also QZA-18/0159-121-122 MKN-Mental Health Training Center, Herat and QZA-18/0159-314-315 NLM-Strengthening Children’s Rights Project, Mongolia). It may seem like local authorities are involved in project initiation and implementation at earlier stages than before. This leads to increased cooperation, relationship and strengthen their commitment to work with communities and community-based organizations. Early involvement has led to government bodies taking more responsibility for issues related especially to health and education, which is crucial for the sustainability of the work after the end of the projects. Instead of creating and developing a parallel structure, churches and other partners cooperate more interdependently with the government. An interesting case worth mentioning is the achievement of a project in Mongolia (QZA- 18/0159-314-315 NLM-Strengthening Children’s Rights Project, Mongolia). Despite a common perception that organizations should work together in partnership to achieve greater impact for development, this project showed that a small partner organization had a great impact at national level for the wellbeing of dormitory children in Mongolia. With commitment and dedication, the partner organization managed to influence the government to develop and approve a national policy, action plans, assessment and monitory systems for all dormitories in the country. This is an example of a successful project despite its small size and limited network in the beginning of the project phase. The projects were also asked Table 7: Indicator 1.4.3 - results to provide self-assessments # and % of reporting projects in the final year of project period on project results related to documenting outcome results related to how local communities are local communities lifting able to advocate their interests in public decision-making bodies social restrictions facing Proportion # of projects Average Proportion women and girls, and to EAT score 4- reporting score >Outcome provide EAT scores for their 5 efforts in this regard. The Result 2018 19 3,16 78,9 % 36,8 % results are captured in indicator 1.4.3 in Digni’s Global Results Framework (Table 7). The self-assessments indicate that on average the projects achieved results at outcome level - 3,16. This is somewhat lower than Digni’s assessments of general results in all civil society outcome areas. In our opinion, the score

17 belies the fact that 3 of the projects have achieved policy changes at a national level, in Palestinian areas (QZA-18/0159-31-33 DELF-Conflict Transformation in the Palestinian Areas – inclusion of valuing differences pedagogy in curriculum and plans, funding of social counsellors), Afghanistan (QZA-18/0159-121-122 MKN-Mental Health Training Center, Herat – changes in mental health strategy and increased allocation of national health budget to mental health), Mongolia (QZA-18/0159-314-315 NLM-Strengthening Children’s Rights Project, Mongolia – changes in national policies and directions regarding the wellbeing of dormitory children), and potentially also Bhutan (QZA-18/0159-479-480 NOR-Organisation Development Project – the formulation of a national disability policy, which is not yet officially adopted). A general trend reported is the use of community-based organizations and committees as liaisons, and other initiatives that ensure participatory dialogue, between rights-holders and duty-bearers. Some also note that the concept of advocacy is not well enough understood, yet in practice advocacy takes place as an integrated approach in a majority of the projects. One of the 22 projects ended in 2018 was a clear-cut organizational development project (QZA- 18/0159-363-364 NPM-Inuka Kanisa) aiming at strengthening a church’s organisational capacity and competence to make greater development impact in the society (SDG 16.6, 16.7, 17.7). Strengthening the governance system, clarifying the roles and the balance of power between the board, the executive body and the regional structure of the church, working the strategic plan, developing and renewing policy documents, establishing financial control mechanisms and establishing systems for performance monitoring were among the main components of the project. The main activities were workshops and development of documents. Creating ownership and consensus on important issues appeared to be a challenge and processes took longer than expected. Assessing and measuring results (behavioural and cultural change) from organization development projects has proven a challenge. At the same time, strengthening organisational capacity is important for a large and relevant civil society actor. Assessing the cost-effectiveness of the project and other projects of its kind is an issue that Digni wants to explore further.

3.2 Good Health Overall goal: Target groups are able to influence conditions regarding own health and wellbeing

Average thematic score, according to Digni's empowerment assessment tool (EAT), Indicator 2 adjusted for expenditure Baseline 24 3,80 Based on an assessment/analysis of 24 projects ending 2016-2017 Results 2018 12 3,40 Based on an assessment/analysis of projects ending 2018

Target 2020 N/A 3,90 Based on an assessment/analysis of projects ending 2018-20199

Presented graphically on a scale, the 2018 results for thematic area 2, Good Health, are:

Impact score # of Level of results (3,39) entries Output Outcome Impact Goal 2 – Good Health 12

Basis 12 projects ending in 2018, from 8 different member organizations, reported results on good health as a thematic area, of which 7 were located in Africa, 4 in Asia and 1 in South America. The accumulated accounts (Norad-share) amounted to approximately NOK 28,4 million, or 20 % of the total accounts of the projects in the sample. In terms of project focus, the project covered areas such as, basic drinking water and basic sanitation (4 projects), HIV/Aids (3 projects), Health personnel development (3 projects), Basic health care (2 projects), and Health education (2 projects). The projects primarily addressed SDG #3 on Good Health and Well- Being and SDG # 6 on Clean Water and Sanitation.

DISTRIBUTION OF RESULTS # of projects achieving score level 1 (output) 0 # of projects achieving score level 2 (output > outcome) 0 # of projects achieving score level 3 (outcome) 7 # of projects achieving score level 4 (outcome > impact) 3 # of projects achieving score level 5 (impact) 2 Total # of entries 12

Selected Results Rights-holders have access to health services (Outcome 2.1): In Afghanistan (QZA-18/0159-121- 122 MKN-Mental Health Training Center, Herat), the local partner International Assistance Mission (IAM), has been one of the key partners of the Ministry of Public Health (MoPH), and played a significant role in the development and implementation of National Mental Health

9 The number of projects in sample and average score will be accumulated as of 2018 and throughout the present reporting period.

Strategies for Afghanistan. This has impacted the whole of the country through the provision of counsellors within the government system (i.e. placement of 750 psychosocial counsellors in community health facilities and inclusion of one counsellor in each of the hospitals across the country) and sustainable improvements to central government practise in mental health such as curriculum development (e.g. health and social work curriculum, life skills curriculum and national mental health messages developed by IAM which are now practiced by MoPH across the country). It has impacted the West through provision of psychiatrists and counsellors in Western provinces and changed attitudes and behaviours surrounding mental health (e.g. the number of psychiatrists increased from 10 in 2012 to 32 in 2018). The project has reached more than half a million people, aiming to change their understanding of mental health issues. During these 7 years, the number of people accessing affordable government mental health services in the West region increased by 231 % (In 2012 total 145,061 patients seen while in 2017 total 335,367 people seen in one year). This result is documented through the Government of Afghanistan (GoA) Health Management Information System (HMIS). This increase is partly due to increased capacity of primary care doctors and counsellors trained by MHTC-H, which will continue after the handover of the project.

On a smaller scale, a project in India (QZA-18/0159-483-487 NOR-Socio-Economic Empowerment with Peace and Reconciliation Project) reports that 100 % of childbirths (356) were attained by trained health workers in 2018 compared with baseline value 2014 of 62 % (241 out of 388) in the project operational area. 1670 children between the age of 0-6 were immunized against preventable diseases, which is assumed to reduce child mortality.

Target groups demonstrate knowledge about conditions affecting the health of households (Outcome 2.2): 4 of the projects have focused access to clean drinking water and basic sanitation for improving the health situation. In Cambodia (QZA-18/0159-190-195 MA-Community Transformation in Rural Cambodia) a reduction in disease and sickness is reported as a result of use of latrines and clean water in 69 % of the target communities (91 communities with 24,905 direct beneficiaries and 89,114 in-direct beneficiaries were targeted). The use of latrines was adopted by a large number of villagers. 85 % to 90 % of households have applied sanitation and hygiene practices by using latrines, washing hands and drinking safe water. Communities achieved decreased sickness and diarrhea in their entire villages, saving money on medical care, having better health for income generation.

Some projects also report improved school attendance by girls when the amount of time spent to collect water has been reduced due to increased access to water facilities as reported in the next example. In Liberia (QZA-18/0159-222-223 MA-Equitable and sustainable WASH services in Bong County), the construction of 31 new waterpoints and rehabilitation of 7 waterpoints reached the total of 11,411 persons with clean, safe and accessible water. In addition, 7 sanitation and 10 hand wash facilities were constructed in schools. As a result, the project increased access to water facilities from 25 % to 98 % in the targeted population. Household survey interviews displayed that only 2.9 % of households reported incidences of illnesses (illness occurred within 2 months prior to survey) compared to the baseline figures of 39 % of the households.

In Ethiopia (QZA-18/0159-284-287 NLM-Raytu Community Development Project), a culture for boiling drinking water and digging latrines has developed. The prevalence of water-borne diseases has been reduced from 8 % to 2 % annually of the target population (ca. 7300 people) during the project phase. 2500 community members have received awareness training on water, sanitation and hygiene.

In Madagascar (QZA-18/0159-423-429 NMS-Malagasy Integrated Rural Development Program), 20,696 households have implemented the use of a toilet as consequence of the WASH program. Cases of diarrhea and lung disease (cough) have decreased because kitchens have been separated from the bedrooms and poultry are no longer kept in the house where people live. According to the local primary health care centers in one of the implementation areas, the cases of diarrhea reported decreased with between 10 % and 21 % (on average 14%) in each of the 7 centers in the area from 2016 to 2017, which may partially be attributed to the work of the project

Target groups combat stigma related to health (Outcome 2.3): In Ethiopia (QZA-18/0159-9-10 BS-Good Samaritan HIV program) HIV/Aids workshops have been organized as an approach to increase the knowledge and understanding about HIV and Aids in target communities. Pre- and post-workshop surveys shows that out of total 10,358 participants, 59 % (6067) answered correctly on basic questions regarding HIV and AIDS in the pre-workshop survey. Post- workshop survey shows that 94 % (9787) of the participants could give correct answers. Results from random sample studies of 1200 workshop participants in the period 2016-2018 indicate that workshop sensitization also have led to behavioral change in the target group. Out of the 1200 individuals in the sample study, 1025 did conduct an HIV test at the local VCT center after workshop training. A similar sample study confirmed that out of 1145 individuals targeted, 938 initiated open conversations about sexual issues in their family. Records also show a reduction of stigma and discriminations in intervention areas, and the situation of HIV positives in the community improved compared to previous years. According to pre- and post-workshop surveys in the period 2016-2018, correct knowledge about stigma and discrimination among participants increased from 27 % (1444 out of 5339) to 93 % (4945 out of 5339) in the period. The external evaluation (2018) confirms attitudinal change towards people living with HIV in target communities and records an increase in the number of people who make their HIV status public. In Afghanistan (QZA-18/0159-121-122 MKN-Mental Health Training Center, Herat) reduced levels of stigma toward mental health disorders are reported, as recent data from the patients shows that 92 % of patients themselves decided to approach mental health services (compared to only 31 % in 2012). As the result of the work with media and journalists, the assessments show that 82 % of people found the media programs useful to their life. As the result of the sensitization activities with media staff, 6 local TV-stations in Herat continue to broadcast TV programs on mental health and the trained psychiatrists/counsellors are contributing to these programs. These TV companies will continue to make programs after the end of the project. In Zimbabwe (QZA-18/0159-158-162 MM Mother and Child Survival Tr. Mutambara), the project evaluation (2018) states that through campaigns carried out by the programme there has been a significant reduction in stigma and discrimination of HIV/Aids-affected people. The home-based care volunteers pointed out that stigma and discrimination were very high before and people were reluctant to get tested or seek medication early because of fear of discrimination. After trainings, many people have been convinced that one can live longer with HIV if they follow instructions and take their medication.

Analysis An analysis of the 12 projects ending in 2018 shows that all projects report on the Outcome 2.2 (Target groups demonstrate knowledge about conditions affecting the health and households), corresponding with SDGs 3.1-3.4 and 6.1-6.2. A total of 8 projects report on Outcome 2.1 (Rights-holders have access to health services), corresponding with SDGs 3.3, 3.4, 3.7 and 3.8. In

21 addition, 3 projects report on Outcome 2.3 (Target groups combat stigma related to health), corresponding with SDGs 3.3 and 3.4. In 4 projects health is the main component, with 70-90% of the budget allocated to this. In 4 projects, the health component accounts for between 25 to 30% of the budget allocation, and in the remaining 4 projects the health component constitutes 10 to 15% of the projects’ allocation. For projects in which health constitutes the main component (more than 50 % of the budget allocation), the average score is 4,00, which would seem to indicate that projects that are more solely focused on health achieve better results within this thematic sector than projects in which health is one of several project components. This is consistent with the results in 2016 and 2017. It is also worth mentioning that the two projects with the highest scores, have finished their second project periods, (a total of 10-12 years support). This echoes the experience in Digni that it takes time to build up the necessary trust and collaborative relationships in order to achieve good results in areas that involve changing attitudes and establishing new practices. The integrated model is the most preferred model for many of the partners, which combines elements of different topics such as education, gender equality and human rights, depending on the needs in the community. The more curative forms of health work are largely handed over to the countries' authorities. The main approach of the projects is a focus on the target groups' right to receive the necessary health services in line with the country's health policy (SDG 3.8), and to increase the target group's knowledge and understanding of good health and disease prevention (SDG 6.1-6.2, 6.b). These are interventions which require a more cross-sectoral approach and, arguably, the desired change is more difficult to achieve than in projects with a narrower focus on specific health topics/curative health. As shown in the introduction of the chapter the effort is mostly concentrated on basic services such as drinking water and basic sanitation (SDG 6.1, 6.2, 6.b), basic health care (3.3, 3.4 and 3.8) and health education. Even though the effort is small in terms of budget and percentage distribution, the results are nevertheless at least on outcome level for the target groups. The idea to “leave no one behind” is emphasized in many of the partners' identity and vision. This also appears in an increasing understanding of mental health and the needs and rights of the disabled to be integrated into their communities. Only 2 of the projects work specifically towards reduction of stigma related to HIV/Aids. This is a very small proportion compared with the distribution some years back. An explanation for this is that the authorities, sometimes in cooperation with global funds, have increasingly taken over the medical aspects of this area. Although there are now few projects addressing stigma related to HIV/Aids in Digni’s project portfolio, many of the local church partners have continued to address the issue in their work and messages without depending on external funds for this. We also see that some of the member organizations, together with their partners, have the necessary capacity to make a more targeted effort also in relation to capacity building of health personnel and structures in the public health system. This seem to give good results at impact level when there is a mutual agreement between project/partner and health authorities. An example from this year is the mentioned project in Afghanistan (QZA-18/0159-121-122 MKN- Mental Health Training Center, Herat).

3.3 Peaceful Coexistence Overall goal: Target groups are coexisting in a safe and peaceful environment

Average thematic score, according to Digni's empowerment assessment tool (EAT), Indicator 3 adjusted for expenditure Baseline 2 2,00 Based on an assessment/analysis of 2 projects ending 2016-2017 Results 2018 7 4,21 Based on an assessment/analysis of projects ending 2018

Target 2020 N/A 2,50 Based on an assessment/analysis of projects ending 2018-201910

Presented graphically on a scale, the 2018 results for thematic area 3, Peaceful Coexistence, are:

Impact score # of Level of results (4,21) entries Output Outcome Impact Goal 3 – Peaceful Coexistence 7

Basis 7 projects ending in 2018, from 6 different member organizations, reported results on peaceful coexistence as a thematic area, of which 3 were located in Africa, 3 in Asia and 1 in the Middle East. The accumulated accounts (Norad-share) amounted to approximately NOK 17,2 million, or 12 % of the total accounts of the projects in the sample. In terms of project focus, the project covered areas such as Civilian peace building, conflict prevention and resolution (3 projects), Ending violence against women and girls (2 projects), Human rights (1 project) and Harmful traditional practices (1 project). The projects primarily address SDG #16 on Peace, Justice and Strong Institutions, SDG # 5 on Gender Equality, and SDG #1 on No Poverty.

DISTRIBUTION OF RESULTS # of projects achieving score level 1 (output) 0 # of projects achieving score level 2 (output > outcome) 0 # of projects achieving score level 3 (outcome) 2 # of projects achieving score level 4 (outcome > impact) 3 # of projects achieving score level 5 (impact) 2 Total # of entries 7

Selected Results Target groups are able to promote non-violent coexistence (Outcome 3.1): In the Palestinian areas QZA-18/0159-31-33 DELF- Conflict Transformation in the Palestinian Areas (CTPA) has worked towards increasing tolerance and reducing the occurrence of violence in public schools. The ‘valuing differences’ method is at the heart of the training

10 The number of projects in sample and average score will be accumulated as of 2018 and throughout the present reporting period.

23 and is described as “a process of engaging with and transforming the relationships, interests, discourses and, if necessary, the very constitution of society that supports the continuation of violent conflict”. The Ministry of Education (MOE) has demanded training for all the school counsellors in the country – due to the training´s relevance of providing tools and means to deal with violence in society and in the classroom. The project evaluation observed that children were solving problems more easily, taking the time to know each other more to have better relationships with others who are different, especially those with special needs; searching for win-win solution; reflecting on learnings in the discomfort zone. There are good reasons to believe CTPA’s program has been an influential factor in this development. According to the MOE, the proportion of students exposed to physical violence has been reduced from 61.8 to 54.9 % and verbal violence from 68.6 to 60 % (the latest available data is from 2017). This is attributed to the presence of more qualified counsellors within the schools to deal with the cases of violence in a more professional way. In India (QZA-18/0159-483-487 NOR-Socio-Economic Empowerment with Peace and Reconciliation Project), have organized and empowered people of different ethnic groups in self- help groups, community-based organizations, networks and federations. 100 % of communities are represented in 5 Federations. They meet to discuss issues of peace and conflict and also discuss issues such as alcoholism, robbery, early marriage, relationship building between communities, etc. 85 % of communities are assessed by project to have the capacity to understand and solve local conflicts with their own capacity. No major violent incidents were reported during the project period within the operational target communities. This is an indicator that the many organisations, dialog forums, competence building, and livelihood related project activities have increased the communities’ resilience and ability to handle conflicts peacefully. In Burundi, the QZA-18/0159-7-8 BS-Trauma Healing and Reconciliation Project reports that in collaboration with the American Bible Society, trauma healing information has been made available through broadcasted radio programs in 12 out of 18 provinces in Burundi with an estimated population of 6 million people. The final evaluation argues that project efforts have contributed to increase targeted churches’ knowledge and recognition of trauma as a psychological state that needs to be addressed by cognitive, emotional and relational strategies. An increasing number of people are now able to openly share their experiences of trauma, practice reconciliation and express their emotional wounds, contrary to normative cultural practices. Increased acceptance and accommodation of healing processes implies that cultural norms and practices are being challenged and are changing among target groups.

Local partners and communities combat gender-based violence (GBV) in target areas (Outcome 3.2): In Cambodia (QZA-18/0159-190-195 MA-Community Transformation in Rural Cambodia), communities received awareness training on gender-based violence and alcohol abuse. The evaluation focus group discussions show that 81 % of communities report a decrease in gender- based violence and 44 % report changes in male and female responsibilities. These are structural changes in attitudes and behavior resulting from project activities. In Tanzania (QZA-180159-74-77 FA-Youth Focused Development Program), 87 of 111 young men active in youth groups reported positive attitudes towards girls’ rights in relationship and marriage matters, compared to only 20 % of men in the original baseline survey. 3 of 4 targeted communities have developed bylaws to safeguard the rights of girls on issues of sex, relationships and marriages. Community sensitizations and conversation meetings were used to raise awareness and build community confidence to report cases. According to the project report, the reduction of stigma and taboo related to discussing issues of sexual and reproductive

24 health rights is significant. By involving local stakeholders and government, a positive attitude has been developed in the communities towards discussing and sharing knowledge about sexual and reproductive health rights, where this was previously considered a taboo. In Ethiopia (QZA-18/0159-284-287 NLM- Raytu Comm. Dev. Project), incidents of early marriages have been reduced from 100 % to 70 % during the project phase. (According to official statistics). This achievement is partially attributed to the awareness raising of the project, through capacity building trainings at grassroots level by locally based project facilitators. The total population of the target communities are reported at about 7300 people. According to official woreda statistics, the prevalence of FGM has been reduced from 100 % to 60 % in the target communities through the project phase. The achievement is partially attributed to the capacity building and awareness raising of the project at grassroots level.

Children grow up in a safe and caring environment (Outcome 3.3): In Mongolia (QZA-18/0159- 314-315 NLM-Strengthening Children's Rights Project), 4884 (74 %) out of 6573 dormitory children in Khovd and Bayan Ulgii demonstrate knowledge of the emergency plans, child protection regulations, and know whom to contact if they need help or assistance (baseline: 26 % Khovd and 0 % in Bayan Ulgii). 86 % of the dormitory children can mention three basic safety skills regarding protection from sexual abuse, compared to 0 % before the project-start. This indicates that the dormitory children have gained knowledge regarding safety and protection and know how to report cases of any kind of abuse from adult to child and child to child. Now, all 46 dormitories have school doctors (baseline: 0) and they do health checks quarterly among all the 6573 dormitory children, provide guidance on child protection, and approve the menus. Parents attitude have also changed, visiting the children 4-6 times per year as opposed to 1-2 times annually before the project. This is particularly important for the youngest children. In sum, the situation for children in the targeted dormitories have significantly improved and their rights to protection, to play, to be heard, and to health are respected and protected to a much higher degree than before.

Local partners and communities combat human rights violations against ethnic/indigenous or religious minorities (Outcome 3.4): In India (QZA-18/0159-483-487 NOR-Socio-Economic Empowerment with Peace and Reconciliation Project), the target group encompasses diverse ethnic minorities and indigenous minorities. The high degree of mortgaged land in project target areas is a result of exploitation and oppressive power structures at play. The project reports that 85 % (1367 acres out of target 1600) acres of land under mortgage has been released by the group or by themselves which led to increased cultivation of land and thereby increasing their income. This result shows high degree of empowerment of target groups resulting in lasting effect of improvement of their livelihood.

Analysis There is a large difference between the baseline and the result of this thematic area as we see in the introduction of this chapter. This is because the thematic area previously up to 2017 only covered more “classical” and specific peace- and reconciliation projects. In the new Digni global results framework (GRF) the scope of the thematic area has been extended to also include domestic and gender-based violence (SDGs 5.2-5.3, 16.1), safe upbringing for children (SDG 16.1), and minorities/ indigenous peoples rights (SDGs 1.4, 2.3, 3.8, 4.5-4.6, 5a, 10.2, 11.4, 16.7, among others). The widening definition of the thematic area increases the probability of a higher score. It is more difficult for a project to influence and obtain long lasting structural changes at

25 outcome and impact level when there is violent conflict not only between individuals or communities, but also at a regional or national level.

The 7 projects have a fairly good distribution among the GRF outcome indicators. Only 2 of the projects have peaceful coexistence as the main component, with 80-90% of the budget allocated to this. In 3 projects, this thematic area accounts for between 25 to 40% of the budget allocation, and in the remaining 2 projects peaceful coexistence constitutes around 10 % of the projects’ budget allocation. In one project where peace and reconciliation accounts for 40 % of the budget, peace is still the main focus of the project. However, their approach to obtaining peaceful coexistence in a context where part of the conflict is due to scarcity of resources and immigration, is by incorporating other supporting activities. Such activities include socio- economic empowerment, improvement of the local resource base, improvement in health and education and access to government welfare schemes and building strong civil society organisations. The integrated, multiple themes approach employed by the project is one of the reasons why people are motivated to cooperate and coexist peacefully due to everyone benefiting and improving their living conditions. It is also worth mentioning that the two projects with the lowest score (3), have only finished their first project period, whereas the projects scoring 4 and 5, all have undergone second phases. Two projects have even carried out a third project phase. Based on Digni’s experience this is not a coincidence. Building trust, changing attitudes, increasing cooperation among people, building networks and sustainable community organizations to create peaceful coexistence – that is maintained by target population – takes time. Reflecting on the high scoring of this years’ projects i.e. 4,21 out of 5, it is interesting to note that the projects with high scoring have had solid results frameworks and evaluation reports that have been able to document and verify the results obtained. However, in one of the projects with lower score (3), the project has not succeeded in producing results that can be verified at impact level. Although the evaluation of the project points to indications of results at a high level, they are only substantiated by anecdotal evidence or reporting of results at output level. Even though measuring and assessing results related to peace and reconciliation is challenging, there is a need to develop improved result frameworks, establish baselines and have a solid monitoring system to capture and monitor results.

3 projects specifically report results related to gender-based-violence (GBV), corresponding with SDG 5.2 and 5.3. However, there are many more projects that in their final project reports or project evaluations show that they have worked on changing attitudes regarding the issue and report that the communities, self-help groups, community leaders, and government officials have addressed the issue and handled/solved cases. There is an increasing awareness among local partner organisations on GBV and it is increasingly being included in capacity building initiatives in projects. Since most GBV activities are below 10 % of the project budgets, the results are not reported under the theme of “Peaceful coexistence” but may show up under the other themes such as “strengthening civil society, quality education, etc”.

UN Security Council Resolution 1325 In accordance with the cooperation agreement (Specific Conditions 3.4), Digni herewith provide a statement on how the intentions in UN Security Council Resolution 1325 have been addressed in the reporting year. The resolution 1325 focuses in particular on increased participation and representation of women in peace and reconciliation processes, the specific protection needs of

26 women and girls in conflict, and gender mainstreaming in programming, implementation and reporting. Of the peace and reconciliation projects ending 2018, the three reported under Outcome 3.1 above, i.e. in the State of Assam in India (QZA-18/0159-483-487 NOR-Socio-Economic Empowerment with Peace and Reconciliation Project), Palestinian areas (QZA-18/0159-31-33 DELF- Conflict Transformation in the Palestinian Areas) and Burundi (QZA-18/0159-7-8 BS- Trauma Healing and Reconciliation Project), fall under the category of initiatives with specific relevance towards UN Resolution 1325. In India, the peace project reports that out of the 412 people in leadership positions in the various organisations and networks established 187 (45%) are women. Women have received training in peace building and conflict resolution and take an active role in their organisations and networks at community level. In this project the increased gender sensitivity has resulted that issues such as gender-based violence (GBV) have started to be included – mostly related to domestic violence. However, Digni notes that women’s participation is lower at higher levels of mediation and networking, in particular in faith-based forums, exemplified by the in Inter- denominational Consultation on Peace that was conducted in 2018. It was attended by 55 (4 women and 51 men) leaders from Northern Evangelical Lutheran Church, Catholic, Revival and Baptist Churches of lower Assam. In Burundi, the Trauma Healing and Reconciliation Program have activities that have specifically focused on addressing gender-based violence such as rape and domestic violence. In total 1490 individuals have been sensitized in GBV. The project has managed to strengthen new and existing relationships between churches and organisations/associations, involve government structures (police and army). However, the evaluation for this program point to that there is a need to develop more specific strategies to increase gender sensitivity in program implementation, which will be addressed in the next project period. The Conflict Transformation Project (CTPA) in the Palestinian Areas challenge traditional stereotypes related to gender. In every project activity, the importance of including both genders are emphasised. The project has made sure that the target group (i.e. school counsellors) are receiving training with men and women together. During the workshops, the CTPA team (itself mixed gender) makes sure that every individual finds their voice. Male and female counsellors tend to have different experiences within their schools as usually a male counsellor is assigned to a boys’ school and a female counsellor to a girls’ school. The Palestinian public education system has no co-educational schools. Differences exist from area to area, as some parts of the Palestinian areas are more socially and religiously conservative than others. For example, during the time of evaluation it was noted that in Tubas and Jenin men and women councillors in the focus group discussion divided themselves in the women on one side and the men on the other whereas the female and male counsellors from Jericho and Jerusalem naturally mixed. The evaluation concluded that the CTPA project is sufficiently aware of gender issues and practices equality in the organizing and carrying out of activities. Digni assess that the project should improve its reporting and more consistently provide gender disaggregated results.

3.4 Environmental Stewardship Overall goal: Target groups exercise responsible stewardship of the environment

Average thematic score, according to Digni's empowerment assessment tool (EAT), Indicator 1 adjusted for expenditure Baseline 8 2,95 Based on an assessment/analysis of 8 projects ending 2016-2017 Results 2018 4 3,04 Based on an assessment/analysis of projects ending 2018

Target 2020 N/A 3,20 Based on an assessment/analysis of projects ending 2018-201911

Presented graphically on a scale, the 2018 results for thematic area 4, Environmental Stewardship, are:

Impact score # of Level of results (3,04) entries Output Outcome Impact Goal 1 – Environm. Stewardship 4

Basis 4 projects ending in 2018, from 4 different member organizations, reported results on environmental stewardship as a thematic area, of which 2 were located in Africa and 2 in Asia. The accumulated accounts (Norad-share) amounted to approximately NOK 5,4 million, or 4 % of the total accounts of the projects in the sample. In terms of project focus, the project covered areas such as agricultural development (3 projects), forestry development (1 project), livestock (1 project), environmental education (1 project), mineral/mining policy 55 (1 project). The projects primarily address SDG #1 on No Poverty, SDG #2 on Zero Hunger, SDG #7 on Affordable and Clean Energy, and SDG #13 on Climate Action.

DISTRIBUTION OF RESULTS # of projects achieving score level 1 (output) 0 # of projects achieving score level 2 (output > outcome) 2 # of projects achieving score level 3 (outcome) 0 # of projects achieving score level 4 (outcome > impact) 2 # of projects achieving score level 5 (impact) 0 Total # of entries 4

11 The number of projects in sample and average score will be accumulated as of 2018 and throughout the present reporting period.

Selected Results Target groups are resilient to negative livelihood conditions (Outcome 4.1): In Cambodia (QZA- 18/0159-190-195 MA-Community Transformation in Rural Cambodia) project efforts has improved resilience towards climate change in 79 out of 81 target communities by developing emergency preparedness plans in cooperation with local authorities. As a result, drought mitigation efforts, such as pond excavations for storage of surface water has been initiated by target communities. At the end of the project period a total of 302 ponds have been excavated. In Mali (QZA-18/0159-309-312 NLM-Pilot Project for Natural Resource Management), pilot demonstration of natural resource management has resulted in initiated measures at 3 target villages to reduce the negative environmental impacts of mining activities in the project area. By the end of 2018 restoration of six-acres land area, including backfilling of 4600 mine holes and planting of 6000 trees has been carried out. In addition, target communities have reported a significant reduction in loss of household animals. Previously, up to 100 animals were trapped/lost in goldmines annually, whereas in 2018 there were only 3 reported cases.

All projects have provided systematic training and sensitization of farmers on environmental care, i.e. a project in Madagascar (QZA-18/0159-423-429 NMS-Malagasy Integrated Rural Development Program-MIRD) have managed to sensitize 14,695 farmers (8371 male and 6324 female) in various methods to protect the environment.

Local partners and communities implement environmentally friendly measures (Outcome 4.2): In India (QZA-18/0159-483-487 NOR-Socio-Economic Empowerment with Peace and Reconciliation Project) 89 % (76 out of 85 target) communities have been engaged in environmental protection and regeneration activities. This result can be attributed to the 16 environmental education training sessions provided to community members on environmentally friendly farming practices and methods such as the use and development of organic manures and use of bio pesticides and bio fungicides. Unused lands within the communities have been utilized for tree plantation and agro-farming. Social forestry promotion and orchard development activity has been carried out, promoting greener environment and income avenue for the targeted communities. In Mali (QZA-18/0159-309-312 NLM-Pilot Project for Natural Resource Management), demonstration of project activities has led to a multiplication effects, where individuals observing the project process have themselves initiated backfilling of a total of 10 hectares of their own land and started cultivating it. Local clans have been actively involved in the project process, and three other clans in the area have requested a similar model on their land. National television has repeatedly reported from the backfilled sites and the Minister of Environment has visited the project area. Targeted villages have also agreed to establish natural resource management structures for the project area and introduced a new taxation system for gold diggers with fixed prices for each hole dug. Collected tax will finance the backfilling of holes and monitoring structures of the area. In Cambodia (QZA-18/0159-190-195 MA-Community Transformation in Rural Cambodia) training of 3060 farmers (2112 women) on environmentally friendly approaches to agriculture has represented a significant change in the applied methods of farming and animal rearing. However, some challenges with animal diseases remain.

In Madagascar (QZA-18/0159-423-429 NMS-Malagasy Integrated Rural Development Program- MIRD), despite several obstacles in the form of droughts and bush fires, 38 % (3795) out of 9864 farmers (5260 male and 4604 female) trained in tree planting, have carried out tree

29 planting. In addition, volunteers have received training to become tree-nurserymen and women and initiated collaboration with local farmers and school pupils to take care of the nurseries. This kind of collaboration did not exist previously. However, many of the volunteers stopped working due to the farmers’ lack of consideration for the reforestation task, and the fact that the work invested does not yield any immediate results. There is also a challenge to control bushfire practice and slash-and-burn farming because of its cheap cost.

Analysis The sample of projects reporting specifically on environment as a thematic area is limited (4 reporting projects), and barely enough to provide an analysis of achievements and challenges related to the thematic area. The reporting projects varies in size, location and approach. Climate change is not the main focus of partners and local communities’ environmental interventions. However, it can be shown that many project activities are undertaken with the objective of poverty alleviation relevant to the context of climate change. Of the reporting projects in 2018 there is a common feature in aiming to empower marginalized communities to implement environmentally friendly agricultural practices and sustainable management of natural resources (SDGs 2.4, 6.3, 7.2, 13.1, 13.3, 15.2-15.3, among others). It should be noted that a substantial portion of projects in Digni’s project portfolio address environment and include this thematic area in an integral manner as a cross-cutting issue in project analysis and activities. The average result score of projects reporting on environment in 2018 is 3.04, or outcome level. This is the same level as in 2017 (5 reporting projects), where average results were recorded to 3.1. As in previous years, documented results are somewhat output-oriented, where indicators such as number of trained individuals are frequently used in reporting results. However, 2 of 4 projects in sample have demonstrated or tracked changes on higher outcome level. This is shown in the project in Mali (QZA-18/0159-309-312 NLM-Pilot Project for Natural Resource Management), where project efforts have created a multiplication effect, inspiring similar initiatives by neighboring communities. The project has also managed to positively engage the national government with repeated visits by the Minister of Environment to project site. The notable results in this project represents good value for money by demonstrating high level results in a rather short time span (2017-2018), with limited inputs (total project accounts in the period amounts NOK 1,4 million) targeting more than 1000 direct beneficiaries. Interestingly, out of the 4 projects in the sample, this is the only project where environment is the main component (representing 75% of the allocated budget). Although not enough to generalize, this example indicates that in project with low/moderate input, there could be a connection between thematically focused project strategies and higher level of result achievement, in comparison to integrated projects where environment is one of several thematic areas in focus. The project in Madagascar (QZA-18/0159-423-429 NMS-Malagasy Integrated Rural Development Program-MIRD) reports on observed challenges related to the approach aiming to achieve behavioral change. Although positive change is taking place in terms of voluntary efforts and wide range tree planting, resistance by a substantial portion of targeted local farmers to abandon traditional farming practices such as slash and burn farming, are significant. As described in the report, this mainly relates to the short-term profitable benefits of this practice and the lack of immediate results by introducing alternative environmentally friendly methods. This may indicate the need to rethink or diversify the project strategy and focus more on the creation of win-win situations linked to the objective of poverty alleviation.

3.5 Quality Education Overall goal: Learners in target areas acquire relevant education of high quality

Average thematic score, according to Digni's empowerment assessment tool (EAT), Indicator 5 adjusted for expenditure Baseline 23 3,22 Based on an assessment/analysis of 23 projects ending 2016-2017 Results 2018 13 3,76 Based on an assessment/analysis of projects ending 2018

Target 2020 N/A 3,35 Based on an assessment/analysis of projects ending 2018-201912

Presented graphically on a scale, the 2018 results for thematic area 5, Quality Education, are:

Impact score # of Level of results (3,74) entries Output Outcome Impact Goal 5 – Quality Education 13

Basis 13 projects ending in 2018, from 8 different member organizations, reported results on environmental stewardship as a thematic area, of which 6 were located in Africa, 6 in Asia and 1 in South America. The accumulated accounts (Norad-share) amounted to approximately NOK 37,2 million, or 26 % of the total accounts of the projects in the sample. In terms of project focus, the project covered areas such as education policy and administrational management (1 project), education facilities and training (3 projects), early childhood education (1 project), primary education (3 projects), secondary education (1 project), basic life skills for youths and adults (4 projects), and various forms of vocational training (4 projects). The projects primarily address SDG #4 on Quality Education.

DISTRIBUTION OF RESULTS # of projects achieving score level 1 (output) 0 # of projects achieving score level 2 (output > outcome) 1 # of projects achieving score level 3 (outcome) 8 # of projects achieving score level 4 (outcome > impact) 1 # of projects achieving score level 5 (impact) 3 Total # of entries 13

Selected Results Target institutions provide quality and inclusive education to learners (Outcome 5.1): In the Palestinian areas (QZA-18/0159-31-33 DELF-Conflict Transformation in the Palestinian Areas), a project run by the Palestinian Bible Society has worked systematically with educational

12 The number of projects in sample and average score will be accumulated as of 2018 and throughout the agreement period.

31 authorities to improve education policies by incorporating a methodology for valuing differences and reduce conflict levels and violence in schools, a strategy which is implemented through the training (responsibility of the project) and employment (responsibility of the government) of social counsellors in all schools. A total of 1221 counsellors are now employed in Palestinian schools, and training has been carried out in 9 of 17 governates. According to government statistics, the proportion of pupils exposed to physical and verbal violence have been reduced from 61.8 to 54.9 % and 68.6 to 60 % respectively. The objective to change or improve national education policies in this area has largely been achieved, contributing to the realization of SDG 4.7. In Mozambique (QZA-18/0159-372-373 NPM-IEAL Secondary Schools Project) has focused on the introduction and training of activistas (school nurses/social workers) in public secondary schools, which has led to a reduction in annual drop outs from 270 in 2013 to only 38 in 2018 (over approximately 14,000 students enrolled). The activistas provide training and information to girls, and act as liaison between the schools and the parents/communities. The project contributes to the realization of SDGs 4.1, 4.5 and 5.2. Several projects have worked to increase enrolment of girls in schools through various strategies (corresponding to SDG 4.1, 4.5). For example, in Eastern Ethiopia (QZA-18/0159-530- 531 UIO-Education and Basic Life Skills in Arsi), in a project run by the Harvest Church of God over two projects, the proportion of girls enrolled were as low as 2 % in some areas prior to intervention. Presently, girls make up 52 % (approximately 2500) of all students enrolled in the target areas. The change has been achieved through community sensitization in close cooperation with local authorities and religious leaders, but also through improvement of water and sanitation facilities in schools and communities, which has improved safety and reduced the work burden on girls who no longer have to walk more than 2 hours per day to fetch water. Training of teachers and school administration is a common strategy to improve quality of education (corresponding to SDGs 4.1, 4.7, 4.c). For example, in North-Eastern DR Congo (QZA- 18/0159-47-48 DNB-Education Lower Bas-Uele), a project supported through the Baptist Convention have achieved higher pass rates (from 40 % or 454 of 1135 students in 2013 to 63 % or 930 of 1475 students in 2018, which is explained by the introduction of new pedagogical training in 59 schools. One project in Cambodia (QZA-18/0159-497-498 NOR-Identity Based Community Development and Education) has focused specifically on indigenous minority communities, working with educational authorities to provide multi-lingual education (MLE), as a response to SDG 4.5. It is reported that government is gradually taking over responsibility for providing MLE and pledging funding, however the results are not quantified. The project has made use of outcome mapping for monitoring.

Communities support the right to education for all (Outcome 5.2): In most projects addressing the quality of and enrolment in early childhood education, primary school or secondary school, community sensitization is an integral part of the strategies, of which the UIO-Education and Basic Life Skills in Arsi project mentioned above is a good example. In another integrated community development project in Eastern Ethiopia (QZA-18/0159 NLM-Raytu Community Development Project), literacy education for adults (2417 people have received literacy training through 20 education centers, using Freirian pedagogy) has paved the way for increased enrolment in schools, as parents have gained knowledge and value education more than before SDG 4.6). As a consequence, school enrolment in three target schools increased from 1180 to

3800 during the project phase. Previously, children below 10 years of age generally did not attend school. In Bolivia (QZA-18/0159-171-176 MA-Local Development Plan Rural-Urban Zones, El Alto) and Cambodia (QZA-18/0159-190-195 MA-Community Transformation in Rural Cambodia), projects supported through Misjonsalliansen (MA) have addressed the inclusion of children with disabilities through community sensitization on national legislation and stigma, home visits and contact with caretakers and relatives in addition to training of teachers and technical adaptations in schools. In Cambodia, 56 % (105 of 187) of the disabled children in target villages are now attending schools, and 90 % of the disabled students have been able to pass onto the next grade. In addition, in both these projects, a high degree of resource mobilization was evident in the form of voluntary labor and materials to build school facilities and to provide salaries for teachers. Both projects are examples of responses to SDGs 4.5 and 4.a. Adult literacy (SDG 4.6) is a key component in many projects, especially integrated community development projects. The NLM-Raytu Community Development Project has been mentioned above. In Madagascar (QZA-18-0159-423-429 NMS-Malagasy Integrated Rural Development Program), 316 alphabetization associations have been established and 2104 women and 1615 men have become literate. In Côte d’Ivoire (QZA-18/0159-277-280 NLM Hope for All), 104 literacy centers have been set up and 1789 women and 1126 men have become literate (80 % of students). Literacy training is an important empowerment strategy to promote health-seeking behavior, address gender inequality, boost economic development (financial literacy) and to organize and mobilize civil society for change. Five projects have provided self-assessments through reporting on the Digni GRF indicator 5.2.2 (# and % of reporting projects in the final year of project period documenting outcome results on how communities' attitude towards inclusive education has changed positively), averaging a score of 4,00. Only one project has reported against indicator 5.2.3 (# and % of reporting projects in the final year of project period documenting outcome results on how communities hold local authorities accountable for providing education for all). We refer to Table 8. Reporting against the indicators are voluntary, which increases the risk of under-reporting. For the results recorded on both indicators, however, Digni finds that the self-assessments are largely in line with Digni’s assessment of the results in the project.

Table 8: Indicator 5.2.2 and 5.2.3 – results 5.2.3 # and % of reporting projects in the final 5.2.2 # and % of reporting projects in the final year of project period documenting outcome year of project period documenting outcome results on how communities hold local results on how communities' attitude towards authorities accountable for providing inclusive education has changed positively education for all # of # of Average Proportion Average Proportion projects projects score >Outcome score >Outcome reporting reporting Result 2018 5 4 100 % Result 2018 1 4 100 %

Learners trained in vocational skills are employed or self-employed (Outcome 5.3): While several projects have registered DAC sector codes indicating a focus on vocational training, no projects have actually reported specific results against outcome 5.3. This is likely due to the fact that several projects have carried out educational activities related to thematic area 6 – economic empowerment, such as QZA-18/0159 MA-Local Development Plan Rural-Urban Zones in Bolivia (training in micro-enterprises), QZA-18/0159-298-301 NLM-Community Participatory Action

33 for Transformation in Indonesia (training in productive agriculture), and QZA-18/0159-483- 487 NOR-Socio-Economic Empowerment with Peace and Reconciliation Project in India (entrepreneurship training for youth). Also, a number of projects have carried out activities related to thematic area 4 – environmental stewardship. For example, in Madagascar (QZA-18- 0159-423-429 NMS-Malagasy Integrated Rural Development Program), sensitization on environmental stewardship and technical training on tree planting has been carried out. In Cambodia (QZA-18/0159-190-195 MA-Community Transformation in Rural Cambodia), training in environmentally friendly agricultural methods have been carried out. We refer to the respective thematic reports for further analysis of these results that fall within the category of life skills development (SDG 4.4).

Analysis The average impact score of education projects is 3,74 which is at a high outcome level. This is higher than the average results recorded for projects ending in 2016 and 2017, which stood at 3,22. The strong results in 2018 are driven by impact-level results in three projects, which together account for 36 % of the total expenditure. Only one project has recorded results below outcome level. Whereas the lack of systematic data collection and/or baseline data was cited as the main reason why the combined results in 2016 and 2017 were not higher than 3,22, the opposite is true for 2018. The quality of project reports has improved. For example, a partner in a remote region of DR Congo that has struggled to report beyond output level in the past, has reported quantitative and qualitative results bordering on impact levels for 2018. This is due to the intensive follow- up of the Norwegian member organization (Baptistsamfunnet – DNB). Also, project staff from this area were able, for the first time, to attend the Digni regional network meeting in Cameroon in November 2018, in which results-based management was a key topic. Of the 13 projects in the sample, the education component on average constituted 41 % of the total project costs, based on the DAC sector coding of the projects. For projects in which the education component constituted less than 40 % of the project component (typically integrated community development projects), average scores were 3,28, whereas projects in which education accounted for 50 % or more, the average scores were 3,67 (scores not adjusted for expenditure), suggesting that projects that are more purely education-orientated achieve better results within this thematic area than integrated projects. Integrated projects would also more frequently focus on vocational training as the education component. More importantly, as was also noted in the period report for 2013-2017, projects that systematically engage with duty-bearers and rights-holders as a key strategy, tend to achieve better results and sustainability than projects that are not as clearly focused on a rights-based approach. The projects in the Palestinian areas (QZA-18/0159-31-33 DELF-Conflict Transformation in the Palestinian Areas), Bolivia (QZA-18/0159-171-176 MA-Local Development Plan Rural-Urban Zones, El Alto) and Cambodia (QZA-18/0159-190-195 MA- Community Transformation in Rural Cambodia) build their success on the degree to which national or local authorities have been made to assume responsibility for providing, funding or changing educational services to the public. In DR Congo (QZA-18/0159-47-48 DNB-Education Lower Bas-Uele), where rights-holders (parents’ committees) have developed a culture of mobilizing to demand services from authorities, for example the construction of toilet facilities (which were duly built) and effectuation of payment of examination fees and student cards to provincial divisions (the payments were duly made).

Conversely, in Côte d’Ivoire (QZA-18/0159-277-280 NLM Hope for All) the speed schools organized by the project will not continue, regardless of how effective the methodology has been, as the model unfortunately has created dependency and expectations both among users and educational authorities. In Mozambique (QZA-18/0159-372-373 NPM-IEAL Secondary Schools Project), the activista-model represents a promising model for reducing the number of girls dropping out of secondary school due to domestic violence, early pregnancies and abject poverty. However, there has not yet been a strong enough push to make the government assume responsibility for the institutionalization of the model in the schooling sector, on which the sustainability of the model hinges (given the ongoing state crisis in Mozambique this is no doubt an uphill task). Consequently, advocacy will be a primary focus of this project as it enters a second project period.

3.6 Economic Empowerment Overall goal: Women and men in target areas are economically empowered

Average thematic score, according to Digni's empowerment assessment tool (EAT), Indicator 6 adjusted for expenditure Baseline 22 3,02 Based on an assessment/analysis of 22 projects ending 2016-2017 Results 2018 8 3,12 Based on an assessment/analysis of projects ending 2018

Target 2020 N/A 3,20 Based on an assessment/analysis of projects ending 2018-201913

Presented graphically on a scale, the 2018 results for thematic area 6, Economic Empowerment, are:

Impact score # of Level of results (3,11) entries Output Outcome Impact Goal 6 – Economic Empowerm. 8

Basis 8 projects ending in 2018, from 5 different member organizations, reported results on environmental stewardship as a thematic area, of which 4 were located in Africa, 3 in Asia and 1 in South America. The accumulated accounts (Norad-share) amounted to approximately NOK 12,1 million, or 8 % of the total accounts of the projects in the sample. In terms of project focus, the project covered areas such as informal/semi- formal financial intermediaries (loan and savings and income generating activities schemes) (3 projects), small and medium size enterprises (2 projects), agricultural development, food crop production and livestock (4 projects), and life skills education (1 project). The projects primarily address SDG #1 on No Poverty, SDG #2 on Zero Hunger, and SDG #8 on Decent Work and Economic Growth.

DISTRIBUTION OF RESULTS # of projects achieving score level 1 (output) 0 # of projects achieving score level 2 (output > outcome) 3 # of projects achieving score level 3 (outcome) 3 # of projects achieving score level 4 (outcome > impact) 2 # of projects achieving score level 5 (impact) 0 Total # of entries 8

13 The number of projects in sample and average score will be accumulated as of 2018 and throughout the present reporting period.

Selected Results Women and men in target areas have improved their livelihood (Outcome 6.1): In all sample projects, economic empowerment is one of several project components in integrated projects. Loan and savings schemes: A dominant feature in this regard are loan and savings schemes, which are frequently linked to the development of income-generating activities (SDG 8.3). For example, in Cambodia (QZA-18/0159-190-195 MA-Community Transformation in Rural Cambodia), 3299 group members have been organized and saved a total of USD 190.530 thus far, which is above expectation. 61 % of the members have accessed loans from their groups. More than 80 % of the 1150 households surveyed by the project demonstrated improvement of their overall incomes from various sources, including small businesses and agricultural production. In India (QZA-18/0159-483-487 NOR-Socio-Economic Empowerment with Peace and Reconciliation Project), 78 % or 4358 households are part of self-help groups (SHG) and 73 % of these (3168) have accessed credit from the groups and are engaged in income-generating activities. 51 % of the SHGs have been able to access the revolving fund from Assam State Rural Livelihood Mission for various income-generating activities. In addition, 58 % (705 of 1215) educated unemployed youth targeted by the project have become engaged in income-generating activities supported through SHGs, village development committees and youth clubs. Agricultural production as a source of income generation: Improving agricultural techniques and development of cash crop production is a common feature in several projects (SDG 2.3-2.4). Often these initiatives are closely linked with resilience towards environmental degradation and climate change. In a large-scale community development project run by the Malagasy Lutheran Church, 28,599 farmers have adopted improved techniques for rice cropping and other products. In the farming season some farmers harvested more than double the normal results by utilizing new knowledge. Unfortunately, several of these crops were destroyed by drought and cyclones that hit the island in 2018. In addition, 14,322 farmers (52 % women) have started income-generating activities, and 51 market chains have been established for the farmers to sell their products (SDG 8.3). Also, 7 village granaries have been built, enabling farmers to protect and store crops. In Bolivia (QZA-18-0159-171-176 MA-Local Development Plan Rural-Urban Zones, El Alto), 74 dairy farmers on average increased their milk production by more than 50 %, boosting the annual income of their families by 5-25 %. A project mobilizing communities for change in Indonesia (QZA-18/0159-298-301 NLM-Community Participatory Action for Transformation), have empowered farmers to increase their average income by 26 % by providing training. A learning center has been set up to continue training, in which representatives from various groups organized meet and share experience and insight. In Mali (QZA-18/0159-309-312 NLM-Pilot Project for Natural Resource Management), back-filling of abandoned gold mines has enabled the introduction of agroforestry practices to grow cash crops, which is not commonly practiced in the area. While the results at this stage are limited, there are already signs of multiplication effects, as neighboring communities are adopting the practices. Small enterprise development: In Bolivia (QZA-18-0159-171-176 MA-Local Development Plan Rural-Urban Zones, El Alto), 174 women were trained in micro-enterprises (fabrics, clothing, pastry) and 87 of these proceeded to establish ventures that represent permanent work, enabling approximately 1/5 of the women to increase family income by more than 50 % (SDG 8.3). Welfare schemes: In India (QZA-18/0159-483-487 NOR-Socio-Economic Empowerment with Peace and Reconciliation Project), a project has assisted eligible mothers in project communities to access government health schemes. 98 % (349) gained government support, compared to 78

% at the start of the project period (SDG 1.3).

Rights-holders are accessing financial services (Outcome 6.2): This outcome area largely applies to two large scale microcredit schemes in projects supported by Misjonsalliansen (MA): QZA- 18/0159-212-213 MA-Microfinance in Liberia QZA-18/0159-227-232 and MA-Climate Change Resilience and Inclusion in Vietnam. However, none of these projects are included in the present sample of projects ending in 2018.

Analysis There are eight projects in the sample presenting results related to economic empowerment. All of these projects are integrated projects, in which economic empowerment is one of several project components. On average, accounts allocations related to economic empowerment made up 19 % of the expenditure in the 8 projects. From this it is clear that economic empowerment is seldom the main focus of the projects reporting, which is reflected in the results. Economic Empowerment is one of the lowest scoring thematic area in Digni’s portfolio together with Environmental Stewardship, based on this year’s sample, with an average score of 3,12, adjusted for expenditure (the average when no adjustment for expenditure is made is even lower, at 2,88). This is a similar picture to what was presented in the period report for 2013-2017: Results were hovering around the outcome-mark in a project sample dominated by integrated projects. In three projects, Digni have assessed the results to be below outcome level (score 2). In Ethiopia (QZA-18/0159-284-287 NLM-Raytu Community Development Project), it is claimed that the livelihoods of cooperative members have improved, and some anecdotal evidence is provided in this regard, but the changes are not quantified or otherwise systematically documented. In Tanzania, (QZA-18/0159-74-77 FA-Youth Focused Development Program), a large share of the youth involved in loan and savings groups dropped out due to a project management dispute. The project also had to battle a dependency culture among the target groups, who were expecting hand-outs and seed money that the project would not provide. The project will not be continued. In Mali (QZA-18/0159-309-312 NLM-Pilot Project for Natural Resource Management), a pilot venture to backfill gold mines and develop agroforestry is showing promising results, however the project intervention is in the early stages and hence the results related to economic empowerment are not yet documented at a higher level. Having a reliable income/livelihood is essential for all people. The lack of a reliable income is a challenge in most contexts where Digni-funded projects operate, and the demands from beneficiaries and target groups to include project components on income-generating activities is becoming increasingly common, whether the main project focus is strengthening of civil society, organizational development, the promotion of good health, peace and security, and education or a combination of these. For example, in the above-mentioned project in Tanzania, the primary objective of the Salvation Army in Tanzania was to address sexual and reproductive health rights of young girls. In reality, the project ended up focusing as much on income-generating activities through the organization of youth groups as this was considered a priority among the target groups – with mixed results. Commonly, the income-generating activities involve various forms of small-scale initiatives in the informal sector or agricultural sector. But the potential is often limited. Market adaptation and the purchasing power of the local communities are common challenges, and the multiplication effects are often limited. The scope of the products and services are often

38 restricted to the local communities. Yet, as is clear from the results above, small enterprises and income-generating activities are yielding noticeable effects in the lives of beneficiaries, as the additional income is providing households with more opportunities and security. These are often small but important steps, and a foundation for further development. Traditionally, loan and savings schemes are heavily geared towards women, who account for around 90 % of all savings group members14. But an emerging trend in Digni’s portfolio is to focus more on youth. Given the demographic profiles especially of countries in Sub-Saharan Africa and the widespread challenge on youth unemployment, we anticipate this trend to continue and gain momentum in the years ahead.

14 Based on results reported against indicator 6.1.10 in Digni’s Global Results Framework in 2018.

3.7 Cost-Effectiveness Digni’s guidelines regarding Value for Money outline the challenges involved with assessing cost-effectiveness (the degree to which projects have been able to maximize the impact of money spent to empower poor and marginalized people to live a life in dignity) in the Digni portfolio. Projects are implemented in very different contexts, with different cost levels, are organized differently, and address development challenges that vary considerably in terms of complexity. In addition, the total years of implementation come into play. A seemingly low score may therefore be a good score, depending on the issue the project addresses, the vulnerability of the context, and the time spent addressing the issue. And conversely, a high score may not be as impressive if the results are “low hanging fruits” and have been achieved in a favorable context. For this reason, Digni do not wish to score and compare projects, but rather provide a qualitative assessment and address tendencies for learning and improving future performance. The present observations below are based on the 22 projects ended in 2018. Reflection on these may provide information to develop theories or hypothesis of cost-effectiveness in the portfolio. We discuss this challenge more in depth in the conclusions Studying data from projects ending in 2018, the following may be observed:

• The projects with the largest budgets tended to achieve the best results On average, 10 projects that spent more than NOK 6 million (Norad share) achieved average EAT scores of 3,86 whereas 12 projects with expenditure below NOK 6 million (Norad share) achieved average EAT scores of 3,20. A similar pattern is detectable in the sample of projects ended in 2016 and 2017 (included in the final report for the previous agreement period 2013-2017): 16 projects with budgets above NOK 6 million (Norad share) achieved average EAT scores of 3,55, compared to 43 projects with smaller budgets, which achieved average EAT scores of 3,05.

Projects with larger budgets had been implemented on average for 8,8 years, often through several project phases, as compared to an average of 7 years for the projects with smaller budgets. When two projects, which have run for extensive periods are kept out of the equation, the average drops to 5,4 years (close to one five-year project cycle). This may be an indication that the length of implementation may also be connected to budget size. One hypothesis is that projects are often launched on a modest budget, which is gradually scaled up through the project phases if results are good or discontinued if the results are too weak. The issue is further discussed in the conclusions in chapter 10.

• There seems to be no obvious correlation between results achieved and the level of expenditure per direct and indirect beneficiaries in the project. Please refer to Table 9, below. On average the projects ended in 2018 reached ca. 17,500 direct beneficiaries and ca. 63,000 indirect beneficiaries at annual average costs of NOK 593 and 134 respectively. There are no previous records against which to assess these figures. Moreover, there is no apparent correlation between total expenditure and average reach and costs per direct and indirect beneficiary. Digni believe this is because the projects address widely different issues in different contexts. A whole range of other variables need to be taken into account before a meaningful analysis can be made on the level of expenditure per direct beneficiary. Moreover, the methods of calculating the number of direct/indirect beneficiaries may vary somewhat depending on the context

and approach of the project, making it difficult to compare data.

• There seems to be no simple correlation between results achieved and the voluntary contribution to the project. Please refer to Table 10, below. Digni-funded projects tend to display considerable voluntary contributions from volunteers and other community members. The present sample is no exception. On average, the projects in the sample mobilized 466 volunteers contributing nearly 30,000 hours of labor (based on data reported for the year 2018 only). While it is difficult to assess the value of the voluntary contributions, it is likely considerable and underlines the catalytic potential in assets-based community interventions. There is however no apparent correlation between the level of voluntary engagement and the level of results. In fact, one of the projects achieving the highest scores had no voluntary contribution at all (QZA-18/0159-121-122 MKN-Mental Health Training Center, Herat), while the project with the highest number of voluntary hours ranked closed to the bottom (QZA-18/0159-423-429 NMS-Malagasy Integrated Rural Development Program). And vice versa. We discuss this issue more in-depth in the conclusion (chapter 10). For project-wise data, we refer to the tables below.

Table 9: Cost-effectiveness parameters: budget size – scope costs – average scores

Total project DB - Direct IB - Indirect Cost per Cost per Thematic Project Years cost15 beneficiaries beneficiaries DB/year IB/year scores

MA-Local Develop. Plan Rural- 31 455 984 5 7 582 15 261 830 412 4,75 Urban Zones, El Alto MA-Community Transformation 22 563 433 5 24 905 89 114 181 51 4,75 in Rural Cambodia NMS-Malagasy Integrated Rural 17 917 523 5 65 669 302 046 55 12 2,86 Development Program (phase II) MKN-Mental Health Training 16 010 684 7 100 682 302 046 23 8 4,70 Center, Herat (MHTC) NLM-Hope for All 13 343 288 6 51 000 71 000 44 31 3,00 NLM-Strengthening Children's 11 803 968 5 1 856 9 747 1 272 242 4,60 Rights Project (SCR)2, Mongolia NOR-Socio-Economic Empowerment with Peace and 9 807 964 5 26 145 29 160 75 67 3,65 Reconciliation NOR-Identity Based Comm. Dev. 9 744 494 3 10 979 9 349 296 347 3,00 and Educ, (iBCDE) DELF- Conflict Transformation in 7 259 859 3 788 38 095 3 071 64 4,30 the Palestinian Areas (CTPA) NPM-IEAL Secondary Schools 7 231 916 5 13 856 20 000 104 72 3,00 Project MA-Equitable and sustainable 7 164 914 3 22 816 59 321 105 40 3,00 WASH services in Bong County UIO-Education and Basic Life 6 604 479 6 4 769 23 845 231 46 3,30 Skills in Arsi, Ethiopia NPM-Inuka Kanisa 6 498 531 3 930 226 000 2 329 10 3,00 BS - Trauma healing and 5 380 914 6 4 572 7 563 196 119 3,00 reconciliation in Burundi NLM-Raytu Comm. Dev. Project 5 180 008 5 1 800 3 000 576 345 3,05 (RCDP) FA-Youth Focused Development 4 222 563 5 4 459 17 836 189 47 2,50 Program NLM Community Mobilization 4 022 746 3 1 620 4 050 828 331 3,00 Pre-Project DNB-Education lower Bas-Uele 3 449 601 5 851 30 354 811 23 3,30 BS-Good Samaritan HIV Program 3 385 035 3 33 430 100 290 34 11 3,80 in Ethiopia NOR-Organization Development 2 879 853 5 547 1 094 1 053 526 2,80 Project – DPAB MM-Mother Child Survival Tr., 2 681 446 5 10 220 17 886 52 30 4,00 Mutambara NLM-Pilot Project for Natural 1 474 952 2 1 073 6 985 687 106 3,70 Resource Management AVERAGES 9 094 734 4,55 17 752 62 911 593 134 3,60 TOTALS 200 084 154 390 549 1 384 042

15 Total costs when all donors and contributions are considered, i.e. not limited to Norad share of accounts (on average the Norad share constituted 71 % of all income sources for the projects in the project sample).

Table 10: Cost-effectiveness parameters – scores – voluntary contribution

Thematic Hours Total project Cost per Cost per Project Volunteers scores contributed cost DB/year IB/year

MA-Local Develop. Plan Rural-Urban 4,75 -16 - 31 455 984 830 412 Zones, El Alto MA-Community Transformation in 4,75 791 178 390 22 563 433 181 51 Rural Cambodia MKN-Mental Health Training Center, 4,70 - - 16 010 684 23 8 Herat (MHTC) NLM-Strengthening Children's Rights 4,60 455 45 760 11 803 968 1 272 242 Project (SCR)2, Mongolia DELF- Conflict Transformation in the 4,30 171 47 395 7 259 859 3 071 64 Palestinian Areas (CTPA) MM-Mother Child Survival Tr., 4,00 126 40 984 2 681 446 52 30 Mutambara BS-Good Samaritan HIV Program in 3,80 400 20 640 3 385 035 34 11 Ethiopia NLM-Pilot Project for Natural 3,70 2 590 10 858 1 474 952 687 106 Resource Management NOR-Socio-Economic Empowerment 3,65 11 300 9 807 964 75 67 with Peace and Reconciliation UIO-Education and Basic Life Skills in 3,30 63 2 597 6 604 479 231 46 Arsi, Ethiopia DNB-Education lower Bas-Uele 3,30 192 1 250 3 449 601 811 23 NLM-Raytu Comm. Dev. Project 3,05 10 1 000 5 180 008 576 345 (RCDP) BS - Trauma healing and 3,00 209 627 5 380 914 196 119 reconciliation in Burundi NLM-Hope for All 3,00 607 6 070 13 343 288 44 31 NOR-Identity Based Comm. Dev. and 3,00 781 93 720 9 744 494 296 347 Educ, (iBCDE) NPM-IEAL Secondary Schools Project 3,00 30 15 828 7 231 916 104 72 MA-Equitable and sustainable WASH 3,00 1 384 575 7 164 914 105 40 services in Bong County NPM-Inuka Kanisa 3,00 77 1 232 6 498 531 2 329 10 NLM Community Mobilization Pre- 3,00 77 2 239 4 022 746 828 331 Project NMS-Malagasy Integrated Rural 2,86 2 268 181 940 17 917 523 55 12 Development Program (phase II) NOR-Organization Development 2,80 10 480 2 879 853 1 053 526 Project – DPAB FA-Youth Focused Development 2,50 4 1 600 4 222 563 189 47 Program AVERAGES 3,60 466 29 704 9 094 734 593 134 TOTALS 10 256 653 485

16 No data has been reported, but the voluntary contribution in the project is known to be significant.

3.8 Deviations in Projects Ending 2018 Results are not always reached as intended. In the following, we have provided accounts of some the most notable deviations in the projects ending in 2018.

Poor documentation of results For projects that fail to produce good documentation of data, either through their own project reports or external evaluation reports, the scores will be set lower. No projects have received the lowest score in 2018, which may partially be attributed to improved reporting. However, some challenges are still evident. In Burundi (QZA-18/0159-7-8 BS-Trauma Healing and Reconciliation in Burundi), it has proven difficult to document results on a higher level, as the achievements presented are substantiated with insufficient or anecdotal evidence. In the next project phase there is a need to design a more robust monitoring system with proper baseline values, indicators and targets. In Kenya (QZA-18/0159-363-364 NPM-Inuka Kanisa), it has proved difficult to measure cultural/behavioral change related to an organizational development project as no baseline or methods for measuring this was included in the project plans. In Madagascar (QZA-18/0159-423-429 Malagasy Integrated Rural Development Program), it has proved difficult to aggregate qualitative data on social change from a large- scale, assets-based community development project, which needs to be addressed in the new project phase from 2019. One project in Cambodia (QZA-18/0159-497-498 NOR-Identity Based Community Development and Education) has made use of outcome mapping as a method for documenting results. It has been a challenge to align this method with Digni’s Global Results Framework. According to the evaluation of the project, the concept was difficult to understand for the local project management and stakeholders and required significant input in terms of resources.

Poor sustainability/institutionalization Achieving sustainability is a major challenge in all development efforts. In Digni’s portfolio, this is largely mitigated by employing rights-based and assets-based approaches, to minimize transfer of resources and thereby creating dependency. The success of these approaches depends on the context and governments. In Mozambique (QZA-18/0159-372-373 NPM-IEAL Secondary Schools Project), a promising model for reducing drop-out of girls was developed. But it has proved difficult to persuade educational authorities to provide funding for the model, which hinges on the key role of activistas or school nurses. By providing training and salaries, the project tended to take away some of the responsibility that should reside with school principals and authorities. Advocacy for institutionalization will be key to the second project phase. In Côte d’Ivoire (QZA-18/0159-277-280 NLM-Hope for All), education was provided through speed schools, and some learning materials were distributed. However, this has created dependency both among users and authorities. The government is not prepared to assume responsibility for the speed schools. The project will not be continued. Interestingly, the project was only implemented for one project cycle (ref. discussion in chapter 3.7). In Zimbabwe (QZA- 18/0159-158-162 MM-Mother and Child Survival Tr. Mutambara), local funding of the services has not been achieved, due to the political and economic crisis in the country. The future funding of the WASH services will be secured by the International United Methodist Church.

Project management In one project in Tanzania (QZA-18/0159-74-77 FA-Youth Focused Development Program) has suffered from internal disputes between the project team and the partner’s headquarters. This resulted in the total number of youths organized by the project fell between 2017 and 2018. Although the situation was addressed, and mitigating efforts were put in place, a number of volunteers and beneficiaries opted out of the project. The external evaluation also revealed that some misconceptions existed with regard to the expectations of the target groups to the project. The project was only implemented for one project phase, demonstrating that there may be higher risks involved with the first project phase. The project will not continue.

External factors In some projects, external factors have impacted negatively on the results/implementation: In Ethiopia (QZA-18/0159-9-10 BS-Good Samaritan HIV Program), the fragile peace situation in the country has been a challenge in the past period, with project implementation restricted in some areas due to unrest. Additional measures and risk analyses should be conducted to explore alternative ways of implementing the project in zones with heightened tensions. In Zimbabwe QZA-18/0159-158-162 MM-Mother and Child Survival Tr. Mutambara), the ongoing political and economic crisis has affected the project’s sustainability (as noted above), and damages to the infrastructure (notably roads) means that areas are inaccessible at times. In Liberia (QZA-18/0159-222-223 MA-Equitable and Sustainable WASH Services in Bong County), the lack of budget allocations for WASH activities by different government departments made it difficult for the partner to engage in joint monitoring of the interventions implemented at the community levels. Constant advocacy and engagements of policy stakeholders have not yielded tangible results as government continued with the usual limited budget situation. The high level of reliance on the NGOs by the Government of Liberia and delays in the implementation of the National Water, Sanitation and Hygiene Commission Act of 2012 were found to have limited the government’s ability to carry out effective monitoring of WASH activities in the country. In Ethiopia (QZA-18/0159-284-287 NLM-Raytu Community Development Project), the project faced constant challenges related to drought (especially in 2016), border conflicts and displacements as a consequence. The partner organization has been able to mitigate these challenges by providing emergency relief, however the expectations of the local population to continue to receive emergency relief in future incidents may be difficult to meet. In Madagascar (QZA-18/0159-423-429 NMS-Malagasy Integrated Rural Development Program, project achievements have been hampered by unpredictable climate and security situations. Extreme poverty is also a constraint, especially as the project relies heavily on voluntary contributions. In Cambodia (QZA-18/0159-497-498 NOR-Identity Based Community Development and Education), there is clear difference in the level of results achieved in the two main project areas (provinces). The main reason is that 6 tribal languages are spoken in Ratanakiri as opposed to only one in Mondulkiri. This means that there is a statistically higher chance of success in Mondulkiri as opposed to Ratanakiri, because the teachers in Mondulkiri can use their mother tongue whereas in Ratanakiri they may not be able to do so. The project reports that it has proved difficult to recruit highly qualified staff in Ratanakiri due to the language situation. The area is also poorer and more inaccessible in rainy seasons.

4. Progress Report on Ongoing Projects In 2018, Digni’s portfolio consisted of 99 (10117) projects. Of these, 23 projects were concluded in 2018. The results from 22 of these projects form the basis for the thematic analyses in chapter 318. The remaining 76 projects were ongoing as of 2018. Results from ongoing projects are not included and STATUS analyzed in this report, as they are still in progress. Instead, Digni has devised a system for assessing progress in ongoing projects based on assessments carried out by Norwegian member organization on behalf of their partners and projects. Using Digni’s Status Reporting Tool, each member organization has been asked to complete a row for each running project and select applicable status from a predefined menu (progress above expectation, progress as expected, progress below expectation, little or no progress). "Progress" is assessed according to two parameters: 1) The project's ability to carry out activities according to the plan and within the budget and 2) The project's ability to reach result targets.19 Progress above expectation According to the assessments made by members, 9 Progress as expected projects (11,8 %) are progressing above expectation. Progress below expectation 55 projects (72,4 %) are progressing as expected, while 11 projects (14,5 %) are progressing below Little or no progress expectation. One project (1,3 %) has recorded little or no progress. In sum, 84,2 % of the ongoing portfolio is considered to progress as expected or better. The corresponding figure for the ongoing portfolio in 2017 was 84,5 %, indicating a similar situation. However, a larger proportion of the projects report progress above expectation (11 in 2018 as opposed to 4 in 2017) The projects progressing above expectations were supported through 8 different Norwegian member organizations. No particular pattern is detectable with regard to which organizations and/or region the projects belong to, also when compared to data from 2017. Of the four projects reported to progress above expectations in 2017, two have ended in 2018 and two

17 One project that was originally budgeted for in 2018 was postponed to 2019 (QZA-18/0159-296-297 NLM-Jigjiga School Capacity Improvement Project). In addition, a project in Senegal (QZA-18/0159-141 KMM-Ker Yaakaar - Community Development in Senegal) was discontinued. 18 One project completed in 2018 has not been included in the summary and analysis, due to FV5419 19 The different status brackets were defined as follows: "Progress beyond expectation": The project has carried out all planned activities or more. Results are better than anticipated, exceeding set targets. "Progress as expected": The project has carried out activities more or less according to plan. Results targets have generally been met. "Progress below expectation": The project has carried out fewer activities than indicated in the plan. Results have fallen short of set targets. "Little or no progress": The project has carried out few or no activities. Few or no results have been reported.

46 report progress as expected in 2018. So far, no projects have reported progress above expectation in successive years. Among projects progressing above expectation, the majority cite results exceeding set targets as the reason, either by reaching more beneficiaries or achieving better results from activities than anticipated. One project in China (QZA-18/0159-275-276 NLM Yunnan Left Behind Children Development Project) report that different local government actors have adopted project models and activities and are now fully funding these, demonstrating the catalytic potential of the interventions. The 11 projects progressing below expectation were supported through 7 Norwegian member organization. The reasons for projects running behind schedule could broadly be attributed to:

a) Political situations (five projects). For example, political insecurity has hampered project activities in some areas in Ethiopia (QZA-18/0159-418-422 MS-Green Livelihood Program in Western Ethiopia (Green LIP), while elections have affected projects in Cambodia (QZA-18/0159-202-207 MA-Somleng (Voice) Prey Lang) and Madagascar (QZA-18/0159-430-433 NMS-MLC Empowerment program). b) Conflicts (two projects). In Cameroon, conflicts between farmers and herders is a cause of concern which may require the project to revise strategies (QZA-18/0159-410-411 NMS-Environment Project of ELCC), while a stand-off between the local implementing partner and the government in Lesotho has caused delays and a temporary standstill in activities (QZA-18/0159-22-23 BKN-Prevention of harmful use of alcohol through alcohol policy and outpatient treatment). The situation is closely monitored by Blue Cross Norway and Digni. c) Cash flow and administrative capacity (four projects). For example, in Congo-Brazzaville, miscommunication on cash flow caused a significant delay in project activities (QZA- 18/0159-127-130 MKN-Indigenous Peoples’ Rights and Culture in The Republic of Congo). In Pakistan, a project could not be launched as planned, as due diligence procedures identified several weaknesses related to the capacity of the local partner (QZA-18/0159-535-537 NMS-Legal Aid Assistance and Settlement Project). d) Natural disaster: Also, in Indonesia, a project has suffered setbacks and have needed to change the focus as the project area was hit by a series of damaging earthquakes (QZA- 18/0159-302-303 NLM-Joint Action to Address Malnutrition). e) Challenging context: A microfinance project in Liberia experienced growth stagnation and high portfolio at risk (PAR) scores along with unfavorable development of core key performance indicators and poor staff performance. The situation was compounded by a case of financial mismanagement (QZA-18/0159-212-213 MA-Microfinance in Liberia).

Evidence of successful mitigation When analyzing the material there seems to be evidence that mitigation of risks in projects running below expectation has been carried out effectively – they have been detected and successfully been followed up. No particular pattern is detectable with regard to which organizations the projects were supported through or location, also when compared to data from 2017. Of nine projects running behind schedule in 2017, six are back on track in 2018. The remaining three projects all ended in 2018, with mixed results – two achieved fairly high scores (QZA-18/0159-47-48 DNB-Education lower Bas-Uele and QZA-18/0159-158-162 MM-Mother Child Survival Tr., Mutambara), and one achieved low scores (QZA-18/0159-74-77 FA-Youth

Focused Development Program). Successful mitigation strategies include better time management and cash flow management. Some have also adjusted targets.

Underspending in 2018 The vast majority of the projects are running more or less as expected. However, underspending has been a challenge in the entire portfolio in 2018, as further explained in the financial report (Regnskapsrapport 2018). This is largely caused by Digni entering a new cooperation agreement with Norad, which was not finalized until 22 May 2018, which meant that Digni were not able to sign agreements with the member organizations before June 2018. The first disbursement on the new agreement were made in June. Prior to this, ongoing projects had received 80 % of their budgets for the period January-April 2018 (QZA-12/0763 Addendum 11). One project that was originally budgeted for in 2018 was postponed to 2019 (QZA-18/0159- 296-297 NLM-Jigjiga School Capacity Improvement Project). In addition, a project in Senegal (QZA-18/0159-141 KMM-Ker Yaakaar - Community Development in Senegal) was discontinued following circumstances related to VS1751. For further details of all deviations related to under-spending, we refer to the financial report. Tables 11 and 12 showing expenditure vs. budget for all ongoing projects in 2018 are provided below (including projects receiving earmarked funding).

Table 11: Accounts 2018 running projects in Digni main portfolio

Running Projects in Main Portfolio Budget Accounts Deviation AR-Habilitation Center for Intellectually Disabled 1 191 585 1 203 757 12 172 BKN-Prevention of harmful use of alcohol through alcohol policy and outpatient tr. 1 177 000 900 661 -276 339 BKN-Youth Alcohol Prevention 1 177 000 1 283 166 106 166 BS-HIV Service – capacity building for the Good Samaritan Program 1 011 728 934 206 -77 522 DFEF-Fighting gender-based violence (GBV) and reducing teenage pregnancy 2 142 675 2 103 224 -39 451 DNB-Integrated program 1 130 562 1 068 903 -61 659 DNB CBCN -BUN: Strengthening of organizational competence and skills 631 728 604 341 -27 387 FA-Capacity Building for Stronger Communities 2 183 685 1 585 821 -597 864 FA-Integrated Community Livelihood Development 479 574 367 898 -111 676 FA-Kinshasa Fight against Poverty and Prostitution/Youth at risk 1 021 053 991 148 -29 905 FA-Environmental Protection, Food Security and Economic Development 1 337 818 1 208 858 -128 960 FA-Capacity Building for Community Engagement and Development Across Africa 859 627 677 130 -182 497 HP - Peace and Conflict Transformation 1 136 518 1 117 654 -18 864 HP-Improving Access to Mental Health Services in Nepal 1 450 848 1 377 765 -73 083 HP-Mainstreaming Mental Health in Nepal through Self Advocacy 544 159 522 700 -21 459 HP-An Integrated program on Early Childhood Development and Education 674 100 563 360 -110 740 HP Empowering Parenthood in Nepal 286 122 313 510 27 388 KMM- Ker Yaakaar - Community Development in Senegal 1 968 372 213 547 -1 968 372 MA-Community Development Project, Guayaquil 7 740 337 7 208 074 -532 263 NMA-Microfinance in Liberia 3 100 079 2 526 417 -573 662 MA Comprehensive development program Yaco and Luribay 4 388 605 5 193 024 804 419 MA-Community Integrated Development – Needs Based Education (CIDNEP) 5 487 367 4 783 503 -703 864 MA-Integrated Ebola Recover Project 2 837 415 2 624 944 -212 471

MA-Somleng Program (Voice) 1 298 916 1 253 514 -45 402 MA-Somleng Prey Lang 574 847 672 148 97 301 MA-Climate Change Resilience and Inclusion in Vietnam 7 003 974 6 753 362 -250 612 MA-Transformation, restoration and community Empowerment (Trace) 2 337 608 1 978 378 -359 230 MA-Empower Farmer Communities Claiming Their Rights and Basic Need 467 537 508 100 40 564 MKN-Gender based violence in church and society in the Republic of Congo 1 342 851 1 377 616 34 765 MKN-Indigenous peoples’ rights and culture in The Republic of Congo 1 372 275 1 371 598 -677 MKN–Community transformation for peace. Colombia 960 515 953 596 -6 919 MM-Community Development Programme 2 759 688 2 591 440 -168 248 MM-Chabadza, Community development programme 2 541 415 - -2 541 415 MM-Community Empowerment for Livelihood and Development (CELAD) 2 447 697 2 682 611 234 914 NLM-Filtu Food Security Project (FFSP) 949 279 910 138 -39 141 NLM-Reducing Maternal Mortality (RMM) 3 627 879 3 113 243 -514 636 NLM-Tana North Water and Sanitation Project 3 300 028 2 983 966 -316 062 NLM-Family Development and Strengthening Project 1 682 169 1 568 360 -113 809 NLM-Bena Tsemai – Pastoral Community Development Project (BT-PCDP) 541 443 476 510 -64 933 NLM Yunnan Left Behind Children’s Development Project 2 763 452 2 622 456 -140 996 NLM : «Meda Wolabu Community Capacity Enhancement Pilot Project» MWCMPP 458 511 358 832 -99 679 NLM-Joint Action to Address Malnutrition 2 267 063 1 967 489 -299 574 NLM-Strengthening Children’s Development 1 193 136 868 765 -324 371 NLM-Jigjiga School Capacity Improvement Project 582 759 - -582 759 NMS-Reinforcement of Capacity of Leaders 1 358 439 1 404 487 46 048 NMS-Western Ethiopia Women empowerment program 1 626 032 1 548 504 -77 528 NMS MLC Empowerment program 1 140 283 938 386 -201 897 NMS-Green Livelihood Program in Western Ethiopia (Green LIP) 4 131 484 3 801 385 -330 099 NMS ENVIRONMENT PROJECT of ELCC 904 522 632 171 -272 351 NMS Innovation Project – Use Your Talents 1 300 050 1 316 422 16 372 NMS-Tamar Campaign Project 481 500 437 577 -43 923 NMS-Living for a better story 1 479 314 700 052 -779 262 NOR-Mohulpahari Christian Hospital 818 561 747 364 -71 197 NOR-Community Health in Okhaldhunga 2 388 248 2 621 609 233 361 NOR-Integrated Community Development Progr. (ICDP) 1 018 256 1 026 204 7 948 NOR-Integr. Progr. for Community Capasity Building 2 249 290 2 631 518 382 228 NOR-Development Support Program for Stone Quarry Affected Communities 2 733 134 2 787 446 54 312 NOR-FAST – Family and School Transformation 1 059 300 999 177 -60 123 NOR-Combating Traditional Practices that are Harmful to Women and Girls 1 152 715 1 436 511 283 796 NOR-Doing development differently- Cluster-approach for social change 481 307 269 967 -211 340 NPM Improvement of Education and Health Services 2 900 059 2 814 355 -85 704 NPM CELPA – ACAD Organizational Development for Social Service 1 691 494 1 172 174 -519 320 NPM-Secondary School Project (SEP) 3 493 764 3 437 133 -56 631 NPM-Peace and Rights Program 2 172 528 2 157 912 -14 616 NPM-CAMPS-PREV: Mental health care to populations affected by war in DRC 1 975 113 1 972 560 -2 553 NPM-Widows 481 500 477 590 -3 910 NPM-Proyecto de Desarrollo para el Bachillerato Técnico Humanístico (PD-BTH) 1 058 337 1 016 554 -41 783 NPM-Desarrollo Organizacional de FES 373 644 262 258 -111 386 SAI - Grassroots Human Rights Education Program 1 435 703 1 424 427 -11 276 UiO-Female Teacher Education Program, Afghanistan 982 260 1 007 418 25 158

WYC-Parkari Community Dev. Program 1 797 472 1 633 146 -164 326 WYC-Kachhi Community Dev. Program 577 800 576 002 -1 798 WYC-Mother Tongue Based Multilingual Education (MTB MLE) in the Segen Zone 802 629 802 319 -310 Total 128 495 733 116 438 361 -12 057 372

Table 12: Accounts 2018 ongoing project receiving earmarked funding

Rights of Minorities of Faith and Belief Budget Accounts Deviation DELF-Jerusalem Unites Us (JUU) 1 240 652 1 240 652 -51 612 SAI-Supporting Myanmar peace through promotion of religious freedom 876 975 - -876 975 NMS-Sat-7 Current affairs 1 600 000 1 588 872 -11 128 NMS-Legal Aid Assistance and Settlement Project 500 000 - -500 000 Total 4 217 627 2 777 912 -1 439 715

Regional Grant Budget Accounts Deviation NMS-Miara-Mianatra Project, MLC Inclusive Education Project 2 568 000 2 433 725 -134 275 NMS-FGM component in the Integrated Program, Mopti region 1 829 700 1 716 705 -112 995 Total 4 397 700 4 150 430 -247 270

5. Earmarked Funding In 2018, Digni received earmarked funding for two projects over the regional grant, and four projects over the funding scheme for strengthening rights of minorities of faith and belief. However, two projects that were budgeted for on the faith and belief grant were not implemented in 2018 and no disbursements were made – see table below.

Rights of Minorities of Faith and Belief Funding Scheme

Table 13: Accounts projects receiving funding scheme for strengthening the rights of minorities of faith and belief

Accounts Rights of Minorities of Faith and Belief Budget 2018 Deviation % Comment 2018 QZA-18/0159-548-551 DELF- 1 240 652 1 189 040 -51 612 -4 % Jerusalem Unites Us (JUU) QZA-18/0159-541-542 SAI-Supporting Deviation due to Myanmar peace through promotion of 876 975 - -876 975 -100 % VS1845 religious freedom QZA-18/0159-538 NMS-Sat-7 Current 1 600 000 1 588 872 -11 128 -1 % affairs QZA-18/0159-535-537 NMS-Legal Aid Project initiation 500 000 - -500 000 -100 % Assistance and Settlement Project postponed Amount transferred TOTAL 4 217 627 2 777 912 -1 439 715 -34 % to 2019

The Palestinian Areas – QZA-18/0159--548-551 DELF-Jerusalem Unites Us (JUU) (2018-2021) This project, focusing on peaceful coexistence between Christians and Muslims in East Jerusalem, is run by the Palestinian Bible Society, with Norad/Digni support through Den Evanglisk Lutherske Frikirken (DELF) in Norway. JUU works with certain target schools in East Jerusalem, and with Muslim and Christian Civil Society groups. This is the first year of the second project phase (2018-2021). In this second phase the project has been included in the funding scheme to strengthen rights of minorities of faith and belief (from 2018), whereas previously it was a part of Digni’s main portfolio. Highlights from 2018 include the JUU magazine, which has been published in 6000 copies on a quarterly basis. The magazine is an important tool in the project, addressing sensitive issues related to internal community conflict and featuring famous writers and commentators on Christian Muslim dialogues. A partnership with Yabous Radio, broadcasting from Jerusalem, has been established and 4 shows were produced this year, highlighting social and political problems that face the Jerusalemites. A colouring book about coexistence in Jerusalem has been published in10,000 copies in cooperation with Nakhleh Shiber Institute (NSI). 8000 copies were distributed so far. The book had a lot of positive feedback from the community and till now they’re still asking for extra copies. It was a successful intervention helping school teachers and social workers explain about the religious sites in Jerusalem and how Muslims and Christians live together in the city and share the heritage. The first set of workshops on children rights started with the 5th Grade in Frere school, 102 students targeted; this workshop consisted of 6 meetings, 3 meetings took place in the first semester and 3 will be done in the second semester. This has created a space for these students

51 to express their fears and discuss the ways that will make them overcome their fears and feel safe. It was a good start for deeper discussions with the teachers and the headmaster, who for the first time expressed a real need to carry out these trainings for all the classrooms. Other workshops and programs have been organised with topics as reinforcing the Jerusalemite Identity and getting to know the minority communities in the city (African, Indian, Armenian, Coptic, Afghan and others) and the historical and holy places inside the Old City. Two iftar events during Ramadan have been organised; where Christian and Muslims gathered to have the Iftar meal and the events were accompanied with different activities and fun and fellowship. The feedback was good, especially that a Christian institute organized the Iftar meals, as they said. These events are a great start to consolidate the concept of coexistence in Jerusalem. A Christmas dinner that gathered the most influential Christian and Muslim figures in the Jerusalemite society was also organised. Around 100 people came together in this first- time event, and 10 of the most prominent influencers in the city were honoured, both Muslims and Christians. Media attention was present and a number of Radio stations in addition to the main newspaper Alquds covered the event. There are several good examples of change of attitude at personal levels as a consequence of the activities mentioned. A challenge for the project is to multiply these changes to contribute to a more peaceful coexistence in Jerusalem, with the focus on Muslim and Christian groups.

Egypt/MENA – QZA-18/0159-538 NMS-Current Affairs Project (2018-2022) The Current Affairs Project is a new project under Sat 7 Media Services Limited and receives Norad/Digni support through Det Norske Misjonsselskap (NMS) in Norway. The project draws on the experiences from the Bridges project that ended in 2016 with an extension year in 2017. By undertaking various activities to focus on minority issues, diversity, participation and civic education, the project aims at strengthening the rights of religious minorities in the MENA region through TV productions and interaction with audiences. The project started in mid-2018 after Norad issued a request if the project could start one year earlier than first intended. Since the process for an entirely new concept was premature, NMS and SAT-7 applied for a two-step process, where the focus in 2018 was on testing, surveying and production of different program concepts, in order to develop a new program concept for engaging young Arab-speaking viewers in 2019. NMS has partnered with SAT-7 for many years and supported several projects. In accordance with Digni requirements, NMS completed a Due Diligence assessment of SAT-7 May 29th-30th 2018. This resulted in late disbursal of funds. Support has gone towards the production of three program series: On the Go (13 episodes), Women and War (12 episodes) and Not Forbidden (32 episodes), the content of which is in line with the objective of the minority grant. They all engaged thousands through social media. On the Go and Women and War reached 217,700 users on Facebook and YouTube, and had 2600 content posts, like comments and likes. There are no official viewer’s statistics for the three programs alone, but the two Arabic channels in SAT-7 have 21 million viewers according to latest independent statistics. This indicates that they have millions of non-Christian viewers, which coincides well with findings from the Online Survey conducted as part of the project in 2018. Out of 4000 respondents, 81 % were non-Christians. Still, 56 % reported that they are willing to watch current affairs programs on Christian TV. The many findings were compiled into a 200-page report and was also triangulated with secondary sources through a more thorough context analysis as part of the activities in 2018.

Following the above-mentioned activities, important conclusions could be made, and SAT-7 proceeded with the call for proposals and adapting the theory of change for the new project period, called “Think-Feel-Do”. SAT-7 received 7 proposals for the sitcom series (Feel), 3 proposals for the magazine program (Think) and 2 proposals for Public Service Announcements (Do). Moreover, 40 people received two-days training from Media Alliance International on subjects like television production and social media. A Service Agreement was signed with an external consultant to provide more trainings on relevant topics like media for development, FoRB, gender equality, shrinking civic society and conflict sensitive journalism in the years to come. The project was able to complete most of the activities according to their activity plan. However, the online survey and evaluating process took more time, and the time for evaluating the proposals was also underestimated. Consequently, the pre-production could not be initiated in in 2018. Some trainings were also postponed.

Pakistan – QZA-18/0159-5355-537 NMS-Legal Aid Assistance and Settlement Project The project was first challenged to start up already in 2018 even though this was not the initial plan. A comprehensive project application was developed, and the goal was to provide legal aid and shelter support to victims of both blasphemy accusations as well as gender-based violence such as forced conversion and marriage. CLAAS – Center for Legal Aid Assistance is the largest organization in Pakistan in terms of caseload management capacity for victims of blasphemy cases. However, NMS and Digni concluded that no Norad funding could be transferred in 2018 since the due diligence assessment showed some critical deficiencies that needed to be addressed, which is an ongoing process. The intention is to launch the project in 2019 on the condition that CLAAS is re-assessed and the deficiencies have been mitigated in satisfactory manner.

Regional Grant

Table 14: Accounts projects receiving funding from the regional grant Budget Accounts Regional Grant Deviation % Comments 2018 2018 QZA-18/0159-556-558 NMS-Miara- Mianatra Project, MLC Inclusive 2 568 000 2 433 725 -134 275 -5 % Education Project QZA-18/0159-559-561 NMS-FGM component in the Integrated Program, 1 829 700 1 716 705 -112 995 -6 % Mopti region TOTAL 4 397 700 4 150 430 -247 270 -6 % To be repaid Norad

Mali – QZA-18/0159-559-561 NMS-FGM component in the Integrated Program (2017-2021)

A project supported by Det Norske Misjonsselskap (NMS) received funding from the regional grant in 2018. The project aims to stop the practice of female genital mutilation (FGM) in clusters of villages through a holistic approach. The second project phase started in 2017 (the project has been implemented since 2009). Prevalence of FGM-practice in the intervention areas have through the years been reduced from 90 % to 62 %. This is documented, however without sustained presence and follow-up these results may be reversed. Evaluation of the effectiveness

53 of abandonment villages over the years has unfortunately been postponed due to the security situation.

During 2018 three more villages have signed «Conventions d ’abandon» – agreements to stop FGM. This means that until now, a total of 27 villages and towns, one of them anonymously, has signed the agreement. The impact resides mainly in an awareness and change of mentality among women, men and young people who for some years opted to maintain the practice of FGM because it is a societal value. 2018 was the second year of phase II. The project had together with the population and the authorities, elaborated and signed development plans in 60 villages/towns with a population of 39,069. However, the security situation imposed the suspension of activities in two communes. Of the 60 villages included in the initial 2018 plan, only 23 villages were monitored in early 2018. Due to a rapid joint response to this situation, two new municipalities were eventually included in the program. These changes have been done in close dialogue with the national coordination office (CNAPN) and the regional office (CRAPV). PDRM also works in close cooperation with National Office to end gender-based violence in elaboration and implementation of “Programme Nationale de Lutte contre la pratique de l’exision” (PNLE) – the Malian national holistic strategy to end gender-based violence in Mali 2019-2030. PDRM-staff have been very involved and a significant contributor in elaborating these plans. The project has adopted a strategy to reduce conflicts with the establishment of committees, setting up rules of procedure based on consensus, the development of transparent business plans with responsibilities known to all, regular meetings assessing and monitoring activities, community dialogue allowing everyone to give his/her point of view etc., the respect of humanitarian principles by the field workers (neutrality, impartiality, humanism and operational independence). NMS/Digni consider it as important and crucial to continue PDRM activities in the Mopti region as long as possible. Democracy training through the committees, fighting for girls’ rights, and improving the living conditions are all initiatives to strengthen their resilience in times of unrest and difficulties. The PDRM also coordinate development activities at village and communal level between different NGO’s and the population.

Madagascar – QZA-18/0159-556-558 NMS-Miara Mianatra Project (2018-2020)

The NMS-supported Miara-Mianatra project is set for a three-year period and aims at the inclusion of children with disabilities (CwDs) into ordinary schools in four target areas in Madagascar. The project focuses on children with low and average level of impairment and has four focus areas and outcomes; (1.) Advocacy and awareness raising on inclusion; (2.) Providing in-service and pre-service training to the teachers receiving CwDs; (3.) Social inclusion, dealing with providing early intervention and social activities; and (4.) Educational inclusion to make it possible for CwDs to benefit from education with adapted infrastructure and equipment. The project received its first transfer quite late but was still able to carry out most of the activities. The project followed a strict step-by-step process in order to achieve the set objectives: starting from paying courtesy visits to the relevant local, regional and national church and government leaders – 206 leaders participated in a workshop in which they got to know more about inclusive education and rights of children and people with disabilities. Besides, 773 community agents at all levels were provided training to identify CwDs mostly

54 living in remote areas in the 4 target areas of the project. Official public launching followed afterwards, in active cooperation with relevant ministries involved in inclusive education. Thanks to the work of the community agents, data collection of out-of-school CwDs and medical screening was done. All in all, 2044 out-of-school CwDs were identified and 1368 medically screened, which is above the target for 2018. After medical screening, 384 CwDs matching the required level of impairment could be enrolled to the target mainstream schools. 328 in-service teachers from 111 primary ordinary schools were trained in basic inclusive education modules in 3 of 4 target areas. Since it has been difficult for local authorities to establish exact addresses for many of the out-of-school CwDs identified, some of the teachers trained have come from schools were there will be no children included. By the end of the year, only 257 out of 384 CwDs screened are enrolled in schools with trained teachers. The plan was 146, which makes it a great result after all. But the challenge is carefully followed up by the project in 2019, to avoid the same problem in the years to come. There was a huge participation of community agents which was not expected. Even though more people were willing to participate on voluntary basis, their transport costs and minimum allowances needed to be paid when they went on field for identifying CwDs and for collecting data. Moreover, since there were more identified CwDs than expected, transport costs for bringing them to have medical screening have required revisions to the budget. A baseline survey could not be carried out yet last year, since the work in collaboration with the Malagasy National Institute for Statistics was delayed.

6. Management of Cross-Cutting Risks In accordance with the cooperation agreement (General Conditions, 2.2 d) with Norad, Digni hereby present an overview of relevant risks identified related to the cross-cutting issues of a) Corruption and financial irregularities, b) Environment and climate, c) Gender equality, and d) Human-rights. The report focuses on risks observed that may have negative consequences for said themes and mitigation efforts.

Corruption and financial irregularities RISK MITIGATION In some cases, poor monitoring of • Continue competence building for members project results makes it difficult to and partners on results-based management, document and trace costs to particularly regional network meetings and activities, resulting in a heightened workshops, for example in connection with risk of irregularities. project visits. • Apply stricter requirements to results frameworks, budgets, and risk analyses in applications and annual reports. Apply better documentation of application and reporting dialogues/processes. • Use external evaluations strategically to document or reconstruct results where gaps are identified. Some partners have weak control • Develop risk profiles of members and partners systems and/or operate in areas and apply follow-up measures when necessary. characterized by an informal • Make use of arenas of learning (regional economy with widespread use of meetings, project visits, etc.) to address the petty cash and low standards of issue. Prioritize visits to partners/projects documentation (vouchers, invoices, with known capacity and competence receipts, etc.). challenges. • Conduct systematic competence building for member organizations. Emphasize members’ responsibility to ensure that partners and projects adhere to satisfactory standards. • Continue to organize and strengthen systematic control measures through due diligence processes, organizational reviews and spot checks. Some partners and members have • Develop risk profiles of members and partners. limited capacity to undertake • Stimulate cooperation between extensive control measures. members/partners with limited capacity, for example pooling of personnel/systems. Strict rules regarding the use of • Raise awareness among member organizations project funds limit the partners’ cash about cash flow issues and the need to plan flow management and flexibility to well ahead to avoid stand-stills. respond to needs and adjustments. Some projects/partners do not • Carry out competence building and raise identify relevant risks in project awareness, making use of established arenas applications and reports and may for learning and sharing of experiences. struggle to understand the purpose

56 of risks analyses. Low awareness on • Create safe spaces to discuss issues that are internal risks. This may also be often associated with taboo. Make use of related to a fear of presenting grassroots anticorruption training material weaknesses and the strict developed by Wycliffe. application of the zero-tolerance • Discuss with Norad how to navigate the issue policy. of sensitive contexts, in which displaying risks and weaknesses may constitute a considerable risk for partners or staff members. Projects are generally implemented • Invite political dialogue on the negative in high-risk contexts, and grants consequences of the zero-tolerance policy and recipients carry all risks in this voice the concerns of members and partners. regard. The risk profile is not reasonable and may deter organizations from entering into development cooperation, especially in the most vulnerable areas and with relevant partners. Whistle-blowing mechanisms are • Engage in discussions with members and exploited to retaliate or sabotage the partners about possible whistle-blowing work of partners/projects by people mechanisms. with ill-intentions. Partners may be reluctant to make whistle-blowing options known.

Environment and climate RISK MITIGATION Project results are affected • Conduct competence building and raise negatively by the impact of awareness about resilience and disaster risk environmental degradation and reduction strategies. Consider a new climate change, especially related to competence building project among agriculture. Crops are unpredictable, members/partners in this regard. Develop a and rights-holders are deprived of good evidence base for alternative methods. their livelihoods. • Apply stricter requirements to the submission of environment analyses and screening in project applications. There is a lack of awareness and • Invite discussions on the role of Digni knowledge on environmental issues members and partners in addressing among members and partners, as environmental and climate change in reflected in low number of projects upcoming strategy processes. actively addressing environmental • Continue to address theological aspects of challenges. Relatively few projects environmental stewardship. provide substantial reports on risks related to environment and climate change. Project activities may affect the • In projects were natural resources are environment negatively, for example involved, an environmental analysis should through agricultural activities or always be conducted. construction. Extensive travel • Avoid unnecessary travel. Consider the carbon increases the carbon footprint of the footprint of travels when deciding on locations portfolio. for regional network meetings.

Gender Equality RISK MITIGATION Cultural and traditional norms limit • Partner organizations have experienced and the degree to which women and competent project staff who have good and girls are valued, impeding girl’s trustful relationship with target groups and participation, inclusion, that are able to use evidence-based strategies representation and decision making. to address and change negative cultural gender norms and practices. • Projects need to include objectives and activities for the empowerment of women and girls, such as: building their self-esteem, thematic competence building, organizational skills, leadership training, rights-based advocacy, etc. • Projects need to include approaches and strategies to address stakeholders/powerholders (men, local leaders, religious leaders and others) to be able to negotiate space and increased women and girl’s empowerment. • Gender mainstreaming of projects, objectives and results frameworks, and requiring the use of gender disaggregated data is important for creating increased awareness and monitoring of women’s and girl’s participation, inclusion, representation and decision making. Women and girls lack access to basic • Projects apply gender mainstreaming and services such as education, health target women and girls specifically such as care (maternal and child health securing emphasis on girl’s education, care), government welfare schemes, maternal and child health care, welfare and water and sanitation, especially schemes and focus on provision of water and in rural contexts. sanitation. Women lack economic • Projects target women specifically with empowerment and are economically microfinance schemes, savings and loans in dependent on household decision self-help groups, training in income generating makers such as husband/father in activities, opening bank accounts, trainings on law and others. agriculture to increase productivity and income, etc. • Increasing women’s power and agency through their organization and women’s formal and informal networks and organizations is essential for their control over the use and decision-making power over newly acquired income and increased resources. Women and girl’s lack protection • Projects need to include strategies, objectives and experience gender-based and activities to address gender-based violence violence i.e. sexual harassment, in target group. abuse, rape in the public sphere • Projects need to build in accountability and/or within the household. mechanisms for reporting and handling of cases of GBV that can last after the completion of the project.

In several cooperating churches, • Organizational development projects directed gender inequality has historically at churches should always have a strong been legitimized on a theological gender focus. basis, with restrictions on the roles women can assume and which decision-making bodies women can be part of. Development cooperation partners • Awareness raising, competence building of may lack compliance with Digni, members and their partners regarding agreements regarding sexual compliance with this issue will be intensified at harassment and abuse and Regional Network meetings, and project visits. mechanism for reporting and • In 2019, Digni will undertake a Capacity following up cases. Building Project which has the working title “Addressing Power and Sexual Abuse” for cooperating partners in the Digni project portfolio. The project is in its planning phase and proposed activities/ideas encompass are the following: learning and sharing of experience; development of leadership training module; development, implementation and compliance of Code of Conducts; Systems for reporting and handling of complaints; establishing resource groups in the various countries/regions; development of a grassroots training module. Piloting some of these activities in two partners in order to gain experience will be carried out. The approach applied with be highly participatory and adapted to various cultural and organisational context for increased impact.

Human Rights RISK MITIGATION The employment of human rights is • Partners and project plans abstain from using restricted by government in many human rights language or referring to Human countries. Partners are therefore Rights conventions, but focus on “neutral increasingly reluctant to include themes/words” such as water, education, explicit objectives and result health, peace, income generation, environment frameworks on human rights, as in and gender, etc. many cases governments demand • Partners use non-conflictive approaches in the insight into or approve project cooperation with authorities, trying to plans/reports. Human Rights focus negotiate change and space for target groups and language may put partners at by creating win/win situations for target unnecessary risks. groups vs authorities. • Partners have thorough contextual knowledge of the political situation are able to negotiate space for meaningful implementation of project.

Rights-based approaches in project • Project application, project design and implementation are poorly strategies need to reflect a deep understanding understood by partners and/or are of root causes of the problem, power not used. The result is that projects structures to be addressed, stakeholder lack necessary cooperation with analysis, and how the project will empower (local) authorities and work too rights-holders (target group) to hold duty- much in isolation obtaining poorer bearers to account - given the limitations of the results. The authorities are hence “space” in the specific context. not challenged to meet their • Cooperation/engagement/challenging/addres obligations regarding provision of sing/ carrying out advocacy with or towards basic services, protection of citizens authorities should always be explored and and other fundamental human included in project plans, according to rights. limitations given by context.

The language of human rights may • Partner adapts language to the local context also be unfamiliar or is associated and appropriate stakeholders- i.e. use religious with a Western agenda. This is texts for change and or “cultural appropriate particularly so in regard to more words” with local communities/leaders/ “controversial rights” such as i.e. authorities rather than human rights language. Sexual and reproductive rights, • Members and Partners need to have good Freedom of Religion and Belief, relational skills, ability to engage in dialog with Collective rights for Indigenous deep contextual understanding, and apply a do peoples and minorities, and others. no harm methodology. • Partner use strategies to empower rights holders (economic, cultural, social, etc) to negotiate and have a dialog with duty-bearers to increase their space and obtain positive change. • Project application, project design and strategies need to reflect a deep understanding of root causes of the problem, power structures to be addressed, stakeholder analysis.

Collecting human rights-related • Partners need to apply a do no harm approach data, for example disaggregation by in their project, and always consider the views disabilities or ethnic/indigenous or of the target groups in their project design, religious minorities may be sensitive approach and collection of data. Project risk and cause tensions between project analyses should include considerations of this and target groups. aspect whenever this may be relevant.

7. External Project Evaluations 27 external evaluations were conducted in 2018 as detailed in Annex B – External Evaluations. Some evaluations were carried out in 2017, but the final reports were not ready until 2018. These are included in the list of evaluations since they are part of the reporting for 2018. Some evaluations have been postponed for different reasons, as explained in the table in Annex B. These will be part of the reporting for 2019. According to Digni’s criteria for support, all projects need to carry out at least one external evaluation during the project period. Digni is actively involved in the process of preparing the terms of reference for external evaluations and provide advice with regard to possible evaluators and the focus and methodology of the evaluation. Evaluations are frequently used to verify results obtained in the projects and to measure the effectiveness of the project design and its implementation. Digni also makes sure that evaluation reports are submitted to Norad’s database, as stipulated in the agreement. There are no significant changes from last year's report on quality and learning at general level. In order not to repeat the same, we have chosen two aspects that are new or different from last year.

Organizational development projects A final evaluation was conducted for an organizational development project in Kenya (QZA- 18/0159-363-364 NPM-Inuka Kanisa), which aimed at building a stronger church through involvement, capacity building and cooperation. Combining the learning from this evaluation with similar evaluations in previous years, it becomes increasingly clear that it is difficult to measure the effects of organisational development projects beyond output level. This is especially the case for projects addressing change of organizational culture and thereby behavioural change. It becomes even more challenging if baseline data in the beginning of the project period is unclear. Consequently, it is also difficult to make a proper cost-efficiency analysis of these kind of projects. Digni should find better ways of establishing baselines and measuring results from a general organizational development project. Digni could also assess what kind of organizational capacity building initiatives are most effective and result in tangible changes.

Reflection on the use of Digni’s Empowerment Assessment Tool in project evaluations 2018 In order to aggregate and report results from a diverse project portfolio, Digni has developed the Empowerment Assessment Tool (EAT) as a common approach to measuring change in all Digni- funded projects. The purpose of EAT is to assess the degree to which target groups are empowered to live a life in dignity. The tool is used to assess both the degree of empowerment- i.e. from output to impact - and the level of change – i.e. individual, community or society levels -, according to a set scale from 1-5. At the end of a project period, will set EAT scores for the project mainly based on a) the submitted final project report and b) external project evaluation. 2018 was the first year that the external project evaluations carried out EAT assessments, and hence it is a good opportunity to sum up some of Digni’s observations so far:

To what degree was EAT carried out in project evaluations in 2018? Project evaluations serve multiple purposes. The objectives of a project evaluation are diverse and encompass several dimensions such as assessing relevance, cost-effectiveness, results, sustainability, learning, added value of partner, etc. Assessment of changes in empowerment at project level will hence be one important dimension of evaluations and not the only one. EAT has been carried out in evaluations for almost all the projects which ended in 2018. Digni’s overall impression is that project evaluation teams were able to use EAT satisfactorily.

• There are a few exceptions. In Ethiopia 3 of the 4 evaluations did not include EAT. The Ethiopian government has set requirements with regard to how evaluations should be carried out, making use of their own Terms of References, which focus on outputs, the degree to which activity plans have been carried out and budget questions. Evaluation teams are appointed by line ministries in addition to the Bureau of Finance and Development. External evaluators are usually not approved and inputs from member organizations and back donors to the ToR have usually been ignored. However, all signals indicate that this will be possible for the evaluations for 2019. • Two project evaluations did not include EAT assessments (forgotten, as this is a new routine). In these two cases, Digni has requested that the evaluators provide the EAT assessments afterwards. To what degree did evaluators use the EAT tool as intended?

• Digni’s overall impression is that project evaluation teams were able to use EAT satisfactorily. In most evaluation reports, the EAT assessment form were filled out by the evaluator team and were included at the end of the report. Most evaluations also included the evaluation team’s justification for the EAT assessment score. To some degree it is correct to say that EAT became an addendum to the project evaluation report and represented the view/perception of the evaluation team. Digni regard this practice to be within the range of options of how to carry out the EAT assessment. • In one project evaluation, EAT was used in a highly participatory manner with the project target group, and the EAT assessment score presented in the evaluation were the score that the target group gave themselves after reflecting on their results using the criteria of the Digni EAT scale (1-5). This shows that EAT can be adapted to different evaluation methodology. EAT can be used as a main instrument/approach at the time of evaluation or it can be quick exercise carried out by evaluation team at the end summarizing and concluding based on the information gathered in the evaluation process. • It was challenging for the evaluation team to use EAT in the evaluation of the organizational development project (QZA-18/0159-363-364 NPM-Inuka Kanisa) in Kenya. EAT seems to be more easily understood and used by evaluators when it comes to more “standard” Digni projects within the areas of health, education, peace, environment, and economic empowerment. Even though EAT methodology can be used for assessing organizational development projects, Digni’s learning is that it would probably be useful to give additional information to evaluators of how to adapt the EAT assessments to this kind of project.

Did Digni’s Empowerment Assessment score differ from EAT scores given by evaluators?

• Generally speaking, the EAT assessments presented in the evaluations to a large degree corresponded to the final EAT scores given by Digni.

• There were however some examples were evaluators were stricter and others more generous than Digni in using the EAT scale 1-5. Even though Digni has specified the criteria for scoring, the way the evaluators understand and interprets the criteria and assess the projects will vary. This is something that Digni have taken into account, and therefore Digni does not only base its final EAT score of the project, on the EAT scoring in the evaluations. Digni will make its own EAT assessment and calibrate the information given from different sources such as Digni’s understanding of the project based on follow up of the project over the project cycle, feedback from Norwegian member organizations on the empowerment assessments of the project, the project final report, project visits, as well as the EAT assessment provided in the evaluation report. These various sources of information contribute to triangulation of information regarding project results and makes the EAT assessments provided in Annex A, more robust and reliable. • One important aspect to keep in mind is the fact that Digni’s Global Results Framework (GRF) and the projects’ results frameworks do not correspond 100 %. And evaluators base their EAT assessment using the project’s own results framework. Digni on the other hand, when assessing and aggregating results “translate” the project result assessments into the Digni GRF framework. An example: A project EAT assessment in an evaluation report may have categorized a thematic area “Livelihood”. Livelihood is not a thematic results category in the Digni GRF framework. Project results within the theme of livelihood, in the Digni GRF, correspond to both Economic Empowerment and Environmental Sustainability. Digni will therefore review the different sources of information and distill the results in the area of livelihood and place them in the appropriate GRF category. However, most thematic project EAT assessment categories correspond to the Digni GRF categories. Digni’s point of view is that it is better that Digni does the “translation”/interpretation between the project results framework and GRF, rather than requesting evaluators to do it. Digni believes that there will be less room for error and misinterpretations when evaluators base their EAT assessments on the project results frameworks, rather than Digni’s GRF. The empowerment assessment done at time of evaluation should be adopted and applied to “fit” the specific project and not vice versa. Digni’s reflections so far is that the Empowerment Assessment Tool seems to be sufficiently flexible, can be used in evaluations with different methodologies and approaches and is quite adaptable to different contexts and projects, with the exception of organizational development projects, where more instruction and guiding is needed to evaluators for proper use. Another important learning for Digni is the need for further information and training on EAT for Norwegian member organizations and for partners. The Digni Regional network meetings are suitable forums for such capacity building seminars, as well as follow up visits to partners, and dialog forums with member organizations.

8. Report on selected outcome indicators In accordance with the agreement with Norad (Specific Conditions, 12 a), Digni will provide results on minimum one outcome indicator per outcome are in the Global Results Framework (GRF) in the report for 2018. A full report on all indicators will be provided for the years 2020 and 2022 respectively. The Digni portfolio consists of projects that start and end in different years. The data aggregated in the GRF are therefore a combination of final results and preliminary results depending on which stage the reporting projects are in. Overall targets for 2020 and 2022 are consequently also based on estimations, as the exact future composition of the portfolio is unknown. We refer to Annex C for further details about the methodology used by Digni to aggregate results and estimate targets, as well as the Indicator Manual (Annex D) which provides instructions for data recording.

2014 2015 2016 2017 2018 2019 2020 2021 2022

Table 15: Illustration - Results data from 2018 are sourced from projects with different life cycles

When analyzing the results below, Digni has focused on the degree to which results from individual projects in the samples show a progress in line with the projects’ own baseline and targets, in addition to assessing the results in the larger context of the portfolio. The report is organized thematically in accordance with the GRF.

Please note that results related to indicators 1.2.1, 1.3.1, 1.4.3, 3.1.2, 3.1.3, 4.2.1, 5.2.2, 5.2.3 and 6.1.5 are presented and analyzed in the respective thematic reports.

A Strong Civil Society Outcome goal 1.1: There is a high degree of organization in the target groups

# of persons organized over # of direct beneficiaries and # of in-direct Indicator 1.1.1 beneficiaries # of projects Total Proportion Direct Degree of Indirect reporting organized women beneficiaries organization beneficiaries Baseline 93 179,884 71 % 1,375,577 13 % 7,072,934 Result 2018 98 204,963 70 % 1,543,194 13 % 8,527,980 Target 2020 100 266,845 71 % 1,854,083 14 % 8,271,735

The purpose of indicator 1.1.1 is to track the degree of organization and the scope of Digni- funded projects. The results show that around 13 % of direct beneficiaries have become organized through the projects, which is unchanged compared to baseline. The actual number of people organized has increased, but so has the number of projects reporting in the sample. The proportion of women among rights-holders organized remain at 70 %. However, it should be noted that a number of corrections have been made in connection with the results report for 2018. As many as 21 projects have downward adjusted the number of direct beneficiaries compared to baseline, 16 have decreased the number of indirect beneficiaries, while 8 projects have downward adjusted the number of people organized compared to baseline. Several projects report that the baseline data they provided in the first place was incorrect or wrongly calculated. In this regard, the data from 2018 effectively serve as a new baseline. This applies to several indicators in the GRF, particularly the mandatory civil society indicators. While the corrections make it difficult to meaningfully analyze results in 2018, it does show that the methodology and accuracy of data collection in the projects are improving. In general, members and partners have taken huge strides improving the data collection and monitoring the last years. The accuracy of the data reported will only improve in the years ahead. The inaccuracies of the initial baseline values may also be ascribed to the fact that partners were given short time to adapt and collect data against Digni’s new GRF.

Outcome 1.2: Local communities are able to identify and solve their challenges together

# of volunteers mobilized to serve the local community and estimated # of Indicator 1.2.2 man-hours # of projects Proportion female Estimated # working # of volunteers reporting volunteers hrs Baseline 93 23,443 47 % 2,825,396 Result 2018 98 33,322 46 % 3,138,800 Target 2020 100 40,332 49 % 5,291,206

The purpose of indicator 1.2.2 is to measure voluntary contributions to project activities, as a way to track local communities' ability to mobilize its own resources in order to solve local challenges, thus resisting aid dependency and demonstrating agency to take action. The results from 2018 appear to validate the baseline figures, which indicated an extremely high degree of local contribution and buy-in to the projects. On average, Digni-funded projects boast 340

65 volunteers each, contributing more than 32,000 working hours/year/project. However, one project alone reported a contribution of nearly 1,5 million working hours in 2018 (QZA- 18/0159-459-462 WYC-Parkari Community Dev. Program). When this project is kept out of the equation, the averages drop to 284 volunteers and 17,598 working hours per project – but this is still significant. Breaking data down per member organization gives interesting results. Both in sheer numbers and averages per project, Wycliffe dominates the results – due to the above-mentioned project. Other organizations with project reporting substantial voluntary contributions are Det Norske Misjonsselskapet (NMS) with 36,878 hrs/project, and Metodistkirkens Misjonsforbund (MM) with 35,410 hrs/project. This is coherent with the development strategies these organizations have chosen, in which community mobilization through the Use Your Talents-approach (NMS) and Partnership in Development (MM) is the dominant working mode (and indeed a goal in itself). Both NMS and MM are predominantly operating in Africa, working with/through large partner churches. For further analysis, we refer to chapter 3.7 on cost-effectiveness in projects ended in 2018, in addition to the discussion in chapter 10 (Conclusion).

Outcome 1.3: Communities provide equal opportunities for women and men An analysis of the results for projects ending in 2018 related to indicator 1.3.1 is included in the thematic report on civil society in chapter 3.1. The general positive trend of increased gender sensitivity in projects and communities is displayed in reporting of ongoing projects as well. However, change is slow, and discriminatory gender practices, norms and values are challenging. The projects are applying positive discrimination of women and girls by for instance targeting them in project activities and having specific objectives directed to addressing women’s and girls’ concerns. This is reflected by the fact that the majority of the project beneficiaries continues to be female (mostly women), exemplified by 70% of people organized by the project are female (assumption- most direct beneficiaries in projects are organized). However, when it comes to measuring gender equality in terms of obtaining leadership positions and decision-making in groups (self- help groups, community-based organizations, federations, networks, etc.) the proportion of male leaders are higher than female leaders. Here it is necessary to lend an eye to GRF indicator 1.1.2, which shows that in 2018, 44% of the groups organized by the Indicator 1.1.2 # of groups/networks organized and retention rate project in have # of projects Percent of groups with # of groups women in leadership reporting female leadership positions. Given that Baseline 93 17,707 13 % 70% of the people organized by the Result 2018 99 22,282 44 % project are women, Target 2020 99 20,609 14 % but only 44% of the organizations have women leadership display that there is a considerable empowerment “gap” demonstrating women’s disfavor at decision-making levels. Changing social norms and traditional gender roles takes time. This is also reflected in the analysis in chapter 3.1 where the self-assessments of projects ending in 2018 regarding how local communities have been able to lift social restrictions facing women and girls, on average obtained an EAT score of 3,36 (indicator 1.3.1). This score shows that sustainable and structural change in gender roles is still a challenge for most projects. This points to the fact that affirmative strategies for women in

66 projects seem to be necessary and justified. There is a need to continue the encouragement in projects for women’s further empowerment to higher levels of influence and decision-making. Digni would also like to comment on the very low baseline (and target) value for indicator 1.1.2 which shows that only 13% leadership positions were held by women. Digni believes that the difference between the baseline value of 13% and 2018 values of 44% of women in leadership is attributed mostly to that the baseline values were based on poor estimates, and that the projects have improved their collection of gender disaggregated data by 2018. It is also interesting to reflect on gender equality at project management level. The indicator 1.5.3, # and % of women project staff, is useful for tracking the degree of gender equality of project staff in Digni funded projects. By “staff” is meant anyone salaried by the project fulltime or part time (minimum position 50%). In 2018, based on information collected from 99 projects the total number of project staff were 1341 (100%) people of whom 525 (39%) were women. This reflects a considerable proportion of female staff at project level. But compared with the fact that that the majority of people organized in projects are women (70%), there is a need to continue to encourage increasing the level of female staff at project level. It is also important to state that these are aggregated numbers. Based on information from partner/project visits and participants at Digni regional network meetings there seems to be local variations in the degree of women project staff. In partner organizations and in particular the top leadership and finance managers are mostly men.

Outcome 1.4: Rights-holders are holding duty-bearers accountable Under outcome 1.4 we have chosen to highlight an indicator which is not mandatory. 16 projects have reported results, indicating that an additional 14,843 people have gained access to public services in 2018 alone. The bulk of the results are attributed to a project in India (QZA- 18/0159-488-492 NOR-Development Support Program for Stone Quarry Affected # of persons accessing public Indicator 1.4.2 services as consequence of advocacy Communities), where security scheme efforts coverage, access to specialized health # of projects # accessing Proportion services, and access to schooling services reporting services women generally account for most of the results. Baseline 17 12,861 68 % An analysis of the results related to indicator Result 2018 17 27,704 58 % 1.4.2 is included in the thematic report on civil society. Target 2020 17 19,230 73 %

Outcome 1.5: Local partners have strong capacity Digni’s main indicator for tracking the capacity of cooperating partners, is the Partner Capacity Assessment Index. An update on the index will be provided in 2021, in the report for 2020.

Another indicator used to assess the general Indicator % of running projects progressing partner capacity in the portfolio, is the degree to 1.5.2 according to plan or better # of Proportion which ongoing projects are progressing # of projects projects on of projects in sample according to plan (indicator 1.5.2). For a track on track comprehensive analysis of results related to Baseline 58 49 84 % indicator 1.5.2, please see chapter 4. Result 2018 77 66 84 %

Target 2020 N/A N/A 86 %

Outcome 1.6: Partners mobilize faith-based assets for social justice

The purpose of this indicator # and % of partners documenting results with is to gauge the degree to Indicator 1.6.1 regard to how they are able to draw on faith- which partners in the Digni based resources to combat social injustice # of portfolio are able to draw on Average Proportion Proportion partners in faith-based resources in order score >Outcome EAT score 4-5 sample to achieve change, using the 20 EAT methodology to assess Result 2018 31 3,16 78,9 % 36,8 % results. 31 partners have reported results against the indicator, of which the majority are partners in Africa (61 %), in addition to partners in Asia (29 %) and South America (10 %). This is consistent with the fact that partners in Africa tend to be churches or church-related organizations, whereas in Asia, a greater variety of partners are found. In much of Africa, Christianity is also the majority religion and churches represent mass movements. In Asia, churches are smaller, often consisting of minorities, and as such they assume different roles in society. This is reflected in the narrative explanations provided. For example, for a number of African partner churches, the churches are considered important contributors to the national poverty reduction strategies, Moreover, in Africa, the partners tend to emphasize the roles as both an arena for change (where the church members and their leaders are direct targets of a development message – notably on gender equality, gender-based violence and transparency) and agents of change in society, with the presence, legitimacy and mobilization capacity to achieve change. The role of church leaders, as gate-keepers and gate-openers is frequently mentioned too, pointing to the catalytical potential of faith leaders to address and change cultural norms. Other factors which are frequently mentioned include: infrastructure (venues), network (providing linkages between actors/duty bearers and grassroots/rights-holders), scripture (using religious texts to convey social justice messages), and mobilization (a high degree of voluntary contribution). The strong position of churches in Africa are reflected in the average EAT scores, which is at 3,7. In comparison, in Asia, a message of inclusion for all and personal faith motivation of staff is emphasized more, and the average score is 2,7. In general, however, few Norwegian member organizations are able to report concrete evidence of results which may be ascribed to the added value of faith-based resources. This is probably related to the indirect effect of faith-based resources, the added value of which is difficult to measure.

20 The indicator is based on reporting only, hence no baseline and targets are provided

Good Health Outcome 2.1: Rights-holders have access to health services

Indicator 2.1.2 tracks the impact scope # of persons directly/indirectly from new and running health services Indicator 2.1.2 benefitting from new and running health established through/supported by Digni services projects. Reporting against the indicator # of projects # direct # of indirect is voluntary, which gives a risk of under- reporting beneficiaries beneficiaries reporting. The results are accumulated Baseline 22 598,512 2,296,143 from baseline values. Result 2018 22 698,831 2,337,148 The results show that projects recording Target 2020 25 528,397 2,149,763 results against the indicator have generally been able to achieve results as anticipated or better. 12 of 22 projects recorded better results than anticipated (project targets 2018), whereas 6 achieved less than anticipated. Counting the number of direct beneficiaries, no projects deviated more than -19 % below target, whereas 6 projects exceeded targets by 182-667 %. Two of the cases are explained by an increase of the projects’ scope (QZA-18/0159-182-189 MA-Community Development Project, Guayaquil (Ecuador) and QZA-18/0159-277-280 NLM-Hope for All (Côte d’Ivoire)), whereas a change of data collection method entailed a correction of baseline data in Sierra Leone (QZA- 18/0159-150-153 MM-Community Empowerment for Livelihood and Development). It should be noted that one project in Ethiopia (QZA-18/0159-288-289 NLM-Reducing Maternal Mortality) accounts for nearly 60 % of the results (based on share of direct beneficiaries). No deviation was recorded for this project.

Outcome 2.2: Target groups demonstrate knowledge about conditions affecting the health of households Indicator 2.2.1 is a key performance indicator for # of targeted households WASH-projects. Per instructions, only households in Indicator 2.2.1 practicing WASH which it can be documented that WASH-principles now principles # of projects are being practiced where it was previously are # households reporting counted. Reporting against the indicator is voluntary, which gives a risk of under-reporting. The results are Baseline 19 45,295 accumulated from baseline values. Result 2018 19 58,927 Of the 19 projects included in the sample, 8 have Target 2020 19 44,968 performed better or significantly better than target, 6 are more or less on target, while 4 projects are behind the target for 2018. Two projects have deviated by more than 30 % below target, however, the scope of these projects is limited and so the effects on the total result is insignificant. In general, few significant deviations are recorded. Misjonsalliansen (MA) accounts for 7 of 19 projects included in the sample and 55 % of the total result. Meanwhile, Det Norske Misjonsselskap (NMS) only have one project in the sample (QZA- 18/0159-423-429 NMS-Malagasy Integrated Rural Development Program), but this project in Madagascar alone accounts for 35 % of the total result.

Outcome 2.3: Target groups combat stigma related to health

The purpose of indicator 2.3.3 is to track the extent of # of patients referred to patients being referred. A high number of referrals is diagnostics, treatment, Indicator 2.3.3 considered indication of reduced stigma. The results counselling from the local are accumulated from baseline values. community # of projects # patients However, reporting against the indicator is voluntary, reporting which gives a risk of under-reporting, especially as Baseline 6 1,836 monitoring data related to the indicator may be a challenge. Only 6 projects are included in the sample of Result 2018 6 2,541 which one project in Pakistan (QZA-18/0159-459-462 Target 2020 6 3,399 WYC-Parkari Community Dev. Program) accounts for 71 % of the results. Moreover, in the context of this project, the referrals appear to be an indication of increased awareness about health services available to the communities as such rather than a stigma-related issue. In the future, Digni may need to adjust the instructions and/or encourage more members to report data against the indicator – or drop the indicator completely.

Peaceful Coexistence Outcome 3.1: Target groups are able to promote non-violent coexistence

The purpose of the indicator is to track # of persons actively promoting peaceful Indicator 3.1.1 the extent to which projects are able to coexistence # of projects Proportion mobilize resource persons as agents of # of persons peace, which again is an indication of reporting women whether peacebuilding is taking root in Baseline 11 8,265 (3,000) 37 % target communities. Reporting against Result 2018 11 7,414 58 % the indicator is voluntary, which gives a risk of under-reporting. Target 2020 10 14,443 43 % The results are accumulated from baseline values. Yet the results for 2018 actually show a reduction from baseline values. This is due to faulty baseline values in one project in Kenya (QZA-18/0159-365-367 NPM-Peace and Rights Programme); the baseline should have been in the hundreds rather than 5,600. As a general policy, Digni will not make adjustments in the baseline values although in this case the consequences are significant. The actual baseline values are likely closer to 3,000 rather than 8,265. When the Kenya-project is kept out of the equation, the average increase compared to baseline values is 165 %, and set targets are on average exceeded by 46 %. The changing proportion of women compared to baseline is explained with reference to one project in Burundi (QZA-18/0159-7-8 BS - Trauma Healing and Reconciliation in Burundi) in which considerably more women were mobilized in 2018. No further explanation is provided by the project in this regard.

Outcome 3.2: Local partners and communities combat gender-based violence The purpose of the indicator is to gauge the degree to # of GBV cases reported Indicator 2.3.3 which GBV is uncovered and followed up in the target and handled # of projects areas. Reporting against the indicator is voluntary, # patients which gives a risk of under-reporting. reporting Baseline 11 1,123 On average the projects in the sample have exceeded targets for 2018 by 32 %, which is an indication that Result 2018 11 3,056 the targets are based on conservative estimations. A Target 2020 11 3,000 common explanation is that the number of survivors coming forward is unpredictable. The most significant result reported is from DR Congo (QZA- 18/0159-359-362 NPM CAMPS Mental health care to populations affected by war in DRC), in which a total of 1143 rape victim cases were handled by professional psycho-social counsellors (925 new cases in 2018), compared to a target of 450. This project adheres the intentions provided in the UN security council resolution 1325.

Outcome 3.3: Children grow up in a safe and caring environment The purpose of the indicator is to gauge the degree to which the safety and protection of children are improved in target institutions. Reporting against the indicator is voluntary, which gives a risk of under-reporting.

On average the projects in the sample have exceeded targets for 2018 by 5 %. However, it is worth noting that one project working with the situation for children in boarding schools in Mongolia (QZA-18/0159-314-315 NLM-Strengthening Children's Rights Project (SCR)2) accounts for the bulk of the results (6573) – but no new children were targeted in 2018. The # of children positively affected project was concluded in 2018 and a full account by measures to improve safety Indicator 2.3.3 of the results is provided in Annex A. The second and protection of children in largest contributor in the sample is a project in target institutions Burundi (QZA-18/0159-7-8 BS-Trauma Healing # of projects # patients and Reconciliation in Burundi), which has been reporting working with SOS children’s villages as part of Baseline 5 7,922 the program intervention on trauma healing. This project was also concluded in 2018 and Result 2018 5 9,246 summarized in Annex A. Target 2020 5 2,109

Outcome 3.4: Local partners and communities combat human rights violations against ethnic, indigenous or religious minorities

The degree to which indigenous, ethnic or religious # of persons gaining minorities secure ownership of land is considered a Indicator 3.4.3 ownership of land key indicator of their human rights situation. # of projects Reporting against the indicator is voluntary, which # persons gives a risk of under-reporting. Only three projects reporting report against the indicator, in Pakistan (QZA- Baseline 3 2,756 18/0159-459-462 WYC-Parkari Community Dev. Result 2018 3 2,996 Program), Bangladesh (QZA-18/0159-474-478 NOR- Integr. Progr. for Community Capasity Building), and Target 2020 3 3,111 Kenya (QZA-18/0159-368-371 NPM-Widows). On average the projects in the sample have exceeded set targets for 2018 by 4 %. The Parkari project in Pakistan accounts for the bulk of the results, which reports that an accumulated 2690 persons have gained ownership of their own land during the project period. The newly started Widows-project in Kenya accounts for the smallest portion of the results, with 16 persons reported. These are widows who have been empowered to reject widow inheritance and have assumed ownership of their own houses and properties contrary to the traditional customs.

Environmental Stewardship Outcome 4.1: Target groups are resilient to negative livelihood conditions

The purpose of the indicator is to track # of farmers adopting climate smart Indicator 4.1.1 the extent to which climate smart agricultural methods # of projects Proportion agricultural methods are adopted, as a # of persons token of resilience. Reporting against reporting women the indicator is voluntary, which gives Baseline 13 15,700 N/A a risk of under-reporting. Result 2018 13 22,604 (52 %) On average the projects in the sample Target 2020 14 23,008 65 % have exceeded set targets for 2018 by 15 %. No projects have achieved results below target. The proportion of women is difficult to estimate, as gender disaggregation has only been provided for 43 % of the total number of persons. This should be improved. The reporting projects are evenly distributed between African and Asian countries and all the contexts can be classified as vulnerable to climate change/environmental degradation. For example, three projects are operating in Ethiopia, where draught, migration and termite infestation are causing problems, while Asian countries like Bangladesh and Vietnam are exposed to flash floods and salination. With one exception, all projects in the sample are supported by the largest member organizations in the Digni portfolio, i.e. Misjonsalliansen (MA), Det Norske Misjonsselskap (NMS), Norsk Luthersk Misjonssamband (NLM) and Normisjon (NOR).

Outcome 4.2: Local partners and communities implement environmentally friendly measures The purpose of the indicator is to track the extent to # of persons benefitting which people are benefitting from sustainable (new Indicator 4.2.2 from sustainable energy and improved) energy sources. "Sustainable energy sources sources" refers to energy that is theoretically # of projects # of persons inexhaustible and includes energy sources such as reporting solar energy, geothermal energy, wind power, Baseline 6 20,251 hydropower, biomass etc. Reporting on the indicator is voluntary, which gives a risk of underreporting. Result 2018 6 30,275 On average, the six projects in the sample have Target 2020 6 17,949 exceeded set targets for 2018 by 28 %. Although the instructions state that only results related to renewable energy sources should be reported, we observe that some projects have also reported on the installment of energy saving cooking stoves (for example QZA-18/0159-78-82 FA-Environmental Protection, Food Security and Economic Development in Uganda). Digni may need to specify or change the instructions to also included energy sources that are not only based on renewable energy as such, as especially as the introduction of energy saving cooking stoves take place in several projects that are presently not reporting against the indicator. Again, gender disaggregation is not provided in the majority of the projects. As these measures tend to benefit entire households, it is sometimes argued that gender disaggregation is difficult to carry out.

Quality Education Outcome 5.1: Target institutions provide quality and inclusive education to learners

# of drop-out students over total # students The purpose of the indicator is to Indicator 5.1.3 track drop-out rates in target enrolled educational institutions. # of projects # of drop-out #students reporting drop-outs rate enrolled Reporting on the indicator is voluntary, but the sample is still Baseline 19 1,510 2,6 % 57,782 fairly comprehensive (19 Result 2018 19 775 1,2 % 66,333 projects). Target 2020 19 925 1,6 % 66,487 On average the projects in the sample have exceeded results target for 2018 by 34 %. Analyzing disaggregation provided by the projects also yields interesting results. While a majority of the students dropping out in the past were girls, the results for 2018 shows that equally many boys as girls were dropping out in 2018. This reflects the fact that most projects working with out-of-school students focused their efforts on girls who have dropped out or at risk of dropping out, hence a reduction in the proportion of girls are to be expected.

Outcome 5.2: Communities support the right to education for all An analysis of the results related to indicator 5.2.2 and 5.2.3 is included in the thematic report on education.

Outcome 5.3: Learners trained in vocational skills are employed or self-employed

# and % of learners employed or self-employed within one year Indicator 5.3.1 of completing vocational training # trained # of projects #employed/ Proportion previous Success rate reporting self-emp. women emp. year Baseline 4 (3) 354 162 46 % 85 % Result 2018 4 (3) 465 328 71 % 80 % Target 2020 4 304 201 66 % 61 %

The indicator tracks the degree to which vocational training leads to the desired outcome for target learners. Reporting on the indicator is voluntary, which increases the risk of under- reporting. Digni observe that few projects choose to report results on the indicator, even though vocational education is provided in several projects. Of the 4 projects in the sample, one has yet to register any data (QZA-18/0159-351-352 NPM- Technical and Vocational Education and Training Project). Analyzing data from the remaining 3 projects, we observe that the projects on average have exceeded targets for 2018 by 56 %. The sample is too small however to draw any meaningful conclusions regarding the effectiveness of vocational training in Digni-funded projects.

Economic Empowerment Outcome 6.1: Women and men in target areas have improved their livelihood

This indicator tracks the degree to Indicator 6.1.2 # of women and men gaining an income which target groups diversify or make # of projects Proportion # of persons use of alternative/new income sources reporting women to boost the household purchasing Baseline 16 27,055 44 % power and thereby reduce risks. By Result 2018 16 77,355 74 % “gaining an income” we mean any new source of income gained during the Target 2020 16 77,923 69 % reporting year. Reporting on the indicator is voluntary, which increases the risk of under-reporting. On average the 16 projects in the sample exceeded targets for 2018 by 17 %. Three projects account for the large share of the results (QZA-18/0159-281-283 NLM-Filtu Food Security Project in Ethiopia – 20,000 persons; QZA-18/0159-227-232 MA-Climate Change Resilience and Inclusion in Vietnam – 40,000 persons; QZA-18/0159-423-429 NMS-Malagasy Integrated Rural Development Program in Madagascar – 14,322 persons). Of these, the project in Madagascar exceeded its target for 2018 by 84 % (the target was 7789 persons). This positive deviation is because a number of volunteers receiving training in 2017 starting income-generating activities (within sustainable and productive agriculture) in 2018. It is also worth noting that the proportion of women has increased to 74 % (ca. 52,000) compared to baseline. The deviation is largely due to the project in Vietnam, which initiated a new project period as of 2018 with baseline values reported at zero. All beneficiaries of the project are women. Disaggregation has been provided for 15 of 16 projects, or 99 % of the results, which is also an improvement.

Outcome 6.2: Rights-holders are accessing financial services The indicator tracks the quality of microfinance Portfolio at risk (PAR30) loan schemes, which are presently provided in two Indicator 6.2.2 projects supported by Misjonsalliansen (MA): QZA- # of projects PAR30 18/0159-212-213 MA-Microfinance in Liberia QZA- reporting 18/0159-227-232 and MA-Climate Change Baseline 2 11,7 % / 0,01 % Resilience and Inclusion in Vietnam. Result 2018 2 5,5 % / 0,01 % The outlooks of the two microbanks are very Target 2020 2 5,5 % / 0,01 % different. The microfinance project in Liberia has experienced growth stagnation and high portfolio at risk (PAR) scores along with unfavorable development of core key performance indicators and poor staff performance, as Liberia has proven a challenging environment to operate in. Nevertheless, the PAR30 has improved from 11,7 % to 5,5 %. Continued focus on training of staff, business development and solemnity in budgeting and spending are highlighted as mitigating efforts. In Vietnam, the microfinance services are one component of a large country program, which also includes components focusing on inclusive education and climate change resilience. The quality of the portfolio remains strong. The microbank in Liberia currently serves 4225 clients of which 2957 or 70 % are women, whereas the microbank in Vietnam serves 53,318 clients, of which 52,676 or 98,8 % are women.

Conclusions and Learning Points This is the first report presenting results on outcome and output indicators in Digni’s Global Results Framework (GRF) for the period 2018-2022. The process of collecting and analyzing results data has provided improved insight on the GRF as a monitoring tool. Here we summarize some of the most important conclusions and learning points:

• Accuracy of (baseline) data: The GRF was introduced to members and partners during 2017. Previously, projects had not reported quantitative data against a global results framework – only their own, project-wise LFAs/results framework. The onboarding process required sustained follow-up from the Digni secretariat and the members, and a steep learning curve at all levels. Despite working with short deadlines, most projects were able to report baseline values and set targets for 2018 onwards. Reviewing results data against baseline data and set targets for 2018, Digni observe that several corrections have taken place, with members reporting that baseline values/targets were wrong, usually because the methodology or definitions used when gathering initial data were faulty. Consequently, the accuracy of progress data is, in some cases, difficult to assess. The results data for 2018 represent more accurate data than the baseline values; evidently much learning has taken place among partners and members in this regard. The accuracy will only improve with time. Digni do not want to change baseline values retrospectively as this would require considerable resources. Rather, the data from 2018 will constitute a new baseline, as of 2018, against which further progress in the projects will be tracked in coming reports. While it does have some consequences for the calculation of the official, aggregated targets in 2020 and 2022, Digni would rather explain the deviations in the reports than reassessing the baseline report. • Mandatory vs. voluntary reporting: Digni have made reporting on a number of civil society indicators compulsory for all projects. In addition, all projects with education components are also required to report on a set of mandatory education indicators. Reporting against other thematic indicators are largely voluntary – but all projects need to report on at least one indicator associated with each thematic component in the project. As has been noted in the reports above, this increases the chance of under- reporting, as projects may choose not to report results on indicators even if they are relevant. In some cases, the number of projects in the sample is too small to provide any meaningful insight about the scope and effectiveness of the projects to address the relevant outcome goals. Beyond assessing the scope and the degree to which projects reach their own targets, voluntary reporting has limited value. We are however reluctant to introduce more compulsory reporting, as it has been clearly communicated from partners and members that the present reporting regime is stretching their capacity. Limiting the number of indicators in the GRF may be necessary. The challenge is to provide enough indicators to capture the breadth of the portfolio. While the process of reporting GRF data has resulted in much learning, the present regime represents limited value compared to the resources spent. • Deviations should be explained: The GRF set-up in Digni’s management tool (Petrus) features comment boxes that members may use to explain deviations from baseline/target, and to provide description about what kind of data has been reported and which methodologies have been used. The majority of the members make good use of this option, but frequently explanations are not provided. In the future, Digni will instruct all members to make better use of the comments option, as the information provided here is valuable when analyzing the data.

• Gender disaggregation has improved: Digni have consistently challenged members and partners to provide gender disaggregation whenever applicable. We are pleased to note that this area has improved significantly. In most cases, disaggregated data are available. This improves the accuracy of data and it also leads to a sharpened gender awareness in the projects. Digni will continue to further strengthen this aspect. • Flexibility is an asset – and a challenge: The strength of Digni’s GRF is that data can be broken down by projects, countries, regions, etc., allowing Digni to assess the data in detail. As projects vary in size and are at different stages in the project life cycles, this is important. In several instances, the results and/or deviations in one single project may impact on the total results. The problem with having a number of disaggregation options, however, is that the analysis process becomes very time-consuming. Deciding which indicators to analyze in detail is a challenge, especially given the number of indicators. • Self-assessments provided in Petrus are valuable sources of information: Through the Empowerment Assessment Tool (EAT) methodology, Digni have developed a method of converting qualitative data into numeric scores. The same methodology has now been tested out for a number of “qualitative” indicators in the GRF. Here members are asked to provide a narrative description of the results projects have achieved related to certain indicators, and to provide self-assessment with regard to the results-level (this only applies to the final year of a project period). This has proven a valuable source against which Digni can triangulate results when summarizing projects ended (Annex A). Although there are some deviations, self-assessments were generally found to be in line with Digni’s own assessments.

9. Secretariat The main responsibility of the Digni secretariat is to manage the framework agreement with Norad on behalf of the members and to secure good management of the programs and projects in the portfolio. Digni exercises control with and provides advice to projects in the portfolio and provides competence building for its member organizations and their implementing partners in the South. In addition, Digni facilitates meeting places and networks for the purpose of information exchange and learning.

Main activities in 2018 In addition to the regular portfolio management, the main efforts of the secretariat in 2018 included:

• The follow-up and amendments required by Norad in order to finalize Digni’s application process. This included, among others, adjustments on the global results framework and budgets. All of Norads requirements were met before the deadline set. • While adjusting the Global Results Framework, Digni also developed a new tool; the Partner Capacity Assessment Index, which enables us to report on Outcome 1.5 in the global results framework. • Quite a lot of effort was put in the implementation and consolidation of the different portfolio management tools and policies that were developed as part of the application to Norad in October 2017. These include the Theory of Change, the Empowerment Assessment Tool, the Application Assessment Tool, and Due Diligence tools, and the Partner Capacity Assessment Index. • After signing the five-year agreement with Norad, the secretariat developed and signed a new agreement with each of its member organizations and also developed a check list for the necessary content to be included in their agreement with their partner organizations. • All baseline data for the portfolio was sent in by the 15th May. This information was aggregated and included in the Global Results Framework and in the baseline report that was submitted to Norad together with the final report for the period 2013-2017. • The project management tool, Petrus, was further developed and adapted to suit Dignis needs and the new Global Results Framework. • Certification of Digni under the new ISO standard 9001:2015 was obtained. • Project visits and organizational assessments with partners in Sierra Leone, DR Congo, Nepal, Ethiopia and Senegal were carried out. • Three network meetings with members and partners were carried out: o For South-East Asia in Thailand, April 2018 o For South Asia in Nepal, November 2018 o For Francophone Africa, Cameroon, November 2018 • An HR Policy (“Policy for personalarbeid i Digni”) was developed. (Digni’s HR strategy document). • Follow-up of fraud cases and anti-corruption work (see chapter below). • In November, the secretariat migrated its IT system to a cloud-based solution. This was also the starting point of a digitalization project that will run for several years. • Digni developed “The abilities”, a guide for conducting organizational assessments.

Accounts A total of NOK 15,871,940 was spent towards the secretariat and member activities, which represents a deviation of NOK 2,230,480 (under-spending). The main deviations were caused by extended sick leaves (staff costs, communication costs), in addition to fewer member activities implemented than budgeted for (competence building programs). Please refer to the financial report for further details regarding the accounts for 2018.

Digni secretariat and member activities Budget 2018 Accounts 2018 Deviation Staff costs 8 729 503 7 823 248 -906 255 Operational costs 3 451 602 3 270 072 -181 530 Communication costs 522 058 206 260 -315 798 Digni programs/activities 1 197 068 1 253 846 56 778 Member activitites 4 202 190 3 318 514 -883 676 Total 18 102 420 15 871 940 -2 230 480

Human resources Digni’s Human Resource policy is gender neutral and there is equal opportunity and treatment for both genders. By the end of 2018, there were 11 employees in the Digni secretariat, 4 men and 7 women. Digni had a staff of 9,86 man-years in 2018. The staffing situation was somewhat challenging, given some long-term sick leaves (7,63 %) and a heavy workload in the process of finalizing the new agreement with Norad. By September 2018, the new secretary general, Mr. Hjalmar Bø, and a newly recruited finance manager were onboard. This increased considerably the work capacity of the secretariat.

Risk management The projects that are part of the Digni portfolio, are mostly located in high-risk contexts. Many external risks are far beyond Digni’s control. However, we need to make sure that we identify and monitor these risks and put in solid mitigation measures. Other risks, such as those related to the projects, partners, members and the secretariat are within Digni’s reach to manage. A formal risk management system for the Digni secretariat was therefore developed and established as part of the 2017 application process. It consists of a Policy, a guideline and a risk matrix. In 2018, Digni reviewed the risk matrix as established in the guidelines; twice in the board meetings and twice in the staff meetings. Our experience is that the new policy and guidelines have led to a more systematic approach to and increased awareness of risk management in Digni, both in the staff and in the Digni board. As this is the first full-fledged risk management system in Digni, we will, based on our user experience, make revisions of the system in due course. The risk analyses carried out as part of the project applications were also reviewed by Digni staff and followed up through evaluation, project visits etc. throughout the year.

At the beginning of 2018, Digni had not yet signed a new five-year agreement with Norad and the level of funding was not set. Being in a transition period, a considerable amount of the 42 identified risks, were therefore rated as high or medium high risks (9 high and 20 medium). The risk assessments made during 2019 have adjusted many of these risks to low or medium. The latest risk analysis shows that Digni have 16 low, 22 medium and 6 high risks. Some risks were removed, as they were no longer relevant, while others were added, such as risks related to IT- security and GDPR. As is visible in the risk matrix attached to the report as Annex E, Dignis highest risks are related to potentially weak organizational structures in member and partner organizations. High expectations from Norad and little risk sharing, even in the most difficult contexts, is still a challenge when it comes to reaching the most marginalized. Poor financial management, corruption, and sexual harassment are among the risks we need to monitor and mitigate. These risks have led to an increased focus on the strengthening of organizations as a whole and financial management/anticorruption work in particular in both members, partners and projects. This effort will continue in the years to come.

Financial management in the Digni chain 18 members receiving funds from Digni in 2018 have reported on how they have been working to strengthen financial management of partners and projects throughout the year. This issue was high on the agenda for all organisations in the Digni chain. During 2018, the main focuses have been on strengthening internal routines and controls using Dignis’ financial checklists and the Due Diligence processes. Most members report on improvements and higher awareness concerning internal routines and adherence to agreements. The anti-corruption course developed by Wycliffe is frequently conducted, especially for new projects/partners, since long- standing partners are already familiar with the course. Project visits: All member organisations have been on project visits during 2018. They use these visits actively to monitor partners and projects, where conversation on financial matters consistently seems to be on the agenda. Digni member organizations actively use the tools developed by Digni, especially the financial check lists. Monitoring from Norway: Through emails and skype meetings, the process of assessing and revising budgets and financial reports from projects is used by many member organisations to give advice and feedbacks to projects, and to build their competence. Internal routines and control: Digni observe a tendency of increased awareness of the importance of good internal routines and control among members. Many organizations report increased focus on budget analyses, procurement procedures and follow up of audit reports and management letters from local auditors. Financial reviews: Using Digni’s financial check lists, 6 member organisations (BS, FA, NOR, NLM, WYC) have undertaken 15 financial reviews of at least one partner/project each either by using own finance manager or by an external consultant. In general, a good understanding and implementation of financial routines among partners and projects was reported. Suggestions for improvement are listed in a prioritized order and planned to be followed up in 2019. Two members report having conducted organizational assessment in addition to financial reviews to see the bigger picture. Both members and partners emphasize closer collaboration between project managers, accountants and staff members working with specific thematic areas.

Due Diligence: 2018 was the year of Due Diligence within the Digni chain. During 2017 and 2018, 77 Due Diligences have been conducted by the Digni members, of which 64 were carried out in 2018. Normally, a Due Diligence should be carried out in the beginning of a partnership cooperation. But many cooperation agreements between member organisations and partners were established several years before it became common to work in this way. To have an overall overview of the partners’ capacities, Digni required a Due Diligence for all partner organisations in the chain. Most member organisations have expressed that they found the process useful. For example, Misjonskirken (MKN) writes in their report: “The Due Diligence-document helped us to ask relevant questions for the financial management. We involved a large group of the staff members to be part of the learning process. We used the opportunity to train and build competence, to show the importance of good financial management, and to share the politics on zero-corruption once again”. Normisjon (NOR), who had conducted 6 Due Diligences during the year also reported that “The work with the Due Diligence processes has been fruitful to identify strengths and weaknesses in the financial management of partners in different context and has led to increased financial knowledge and awareness both at the Normisjon Headquarter and with our partners”. In one case, the process led to a postponement of project implementation because the member organization found that the financial management system was weak. In another case, the process led to a report of suspicion of financial irregularities to Norad, a case which is still under investigation as per June 2019. Digni has received useful feedbacks from the member organisations, including suggestions for improvements of the tool for Due Diligence that will be followed up during Autumn 2019. Training on financial management, accounting and anti-corruption: 4 member organizations report that they have conducted trainings for project finance staff in 8 projects by using their own finance officer from Norway. In two cases, the training team included local internal audit bodies and external audit agencies. The themes varied from financial management in general to specific professional accounting training and use of accounting software. Concerning anti- corruption, it seems that the topic remains on all partner and project’s agenda. Member organizations introduce Digni’s anti-corruption course to new partners at an early stage of a cooperation. An example is the new partnership cooperation between SIL Ethipia and Wycliffe (WYC). Their cooperation started in 2017, and SIL Ethiopia held anti-corruption training for their staff in September 2018. During 2018, Det Norske Misjonsselskap (NMS) established an anti-corruption group within the organization and among partners. The group works on routines and guidelines, prevention of fraud and follow up of suspicion of fraud. Moreover, Norsk Luthersk Misjonssamband (NLM) applied for and received funding from Digni to conduct a course on anti-corruption for all the projects and partner synods in Ethiopia, in addition to a project in Kenya. Through local courses, this initiative has resulted in a multiplication of the knowledge gained in four projects.

Special report on anti-corruption efforts and financial irregularities Four fraud cases were concluded in 2018:

1. Kristen Idrettskontakt (KRIK) for projects implemented in East Africa The case was registered in September 2016. Forensic audits were carried out in Kenya; Uganda and Tanzania. Staff were found to have embezzled funds, costs lacked proper documentation. Low awareness among staff of project targets and double reporting with

other donors. NOK 2,546,365 were claimed from KRIK and repaid to Norad. The projects were discontinued. 2. HimalPartner (HP) for project implemented in China The case was registered in February 2016. A forensic audit was undertaken. Unauthorized loans from project funds were made. NOK 222,461 were claimed from HP and repaid to Norad. The project was discontinued. 3. Misjonsalliansen (MA) for project implemented in Ecuador The case was registered in March 2017. A forensic audit was carried out. A staff member in Ecuador was found to have embezzled funds. NOK 18,385 were claimed from MA and repaid to Norad. 4. Kristen Muslimmisjon (KMM) for project implemented in Senegal The case was registered in August 2017. An organizational and financial review was carried out. Pre-payments were made for mechanical equipment that was not delivered. NOK 464,065 were claimed from KMM and repaid to Norad. The funding from Digni was later discontinued due to internal challenges in the partner organization. 2018 saw the conclusions of cases that were largely investigated in 2017. Fraud cases registered in Norad that were not finalized by the end of 2018 will be reported on when the cases have been concluded. Some of the fraud cases closed in 2018 took a long time to investigate, for different reasons. Staff turnover and sick leaves was a particular challenge in the Digni secretariat, where capacity was stretched for extended periods of time. In one case (KRIK-East Africa), the sheer complexity and scope of the case, with a number of donors involved and different forensic audits in three countries, translated into a lengthy follow-up period. Tendering processes and quality assurance of forensic audit reports required sustained input from the Norwegian donors, coordinated by Digni. The cases varied in regard to findings, as detailed above. However, all the cases displayed varying degrees of weaknesses with regard to the control environments of local partners and the Norwegian member organization the partners were supported through and Digni’s secretariat. Also, a lack of awareness of the contractual obligations was detected. Measures have been put in place to address critical capacity gaps at all levels and to raise awareness about the terms of the agreements. For example, in Digni, a Finance Manager was hired in September 2018 to strengthen the financial management in the secretariat. A review of the organizational capacity of members and due diligence processes of partners were commissioned in December 2018. A plan to carry out organizational reviews of all members during the agreement period was developed, and reviews were carried out for 3 members in 2018. Regional network meetings and member meetings have been used to build competence. Digni also assumed leadership of the civil society anti-corruption forum (formerly hosted by Bistandstorget). A detailed overview of learning points from fraud cases and a plan of action was developed in Spring 2018 (focusing particularly on KRIK-East Africa). We are pleased to note that most of the proposed mitigation efforts in the plan of action have been implemented by 31st December 2018. Please refer to Annex F for a full overview of learning points, follow-up measures and status. Digni will continue to prioritize capacity and systems development related to financial management and anti-corruption measures in the secretariat and in relation to members and the implementing partners. This report has also been published on Digni’s website.

Special report on member activities

Regional network meetings Digni has for several years arranged regional network meetings, bringing together local partners and members working in the same region for joint competence building and sharing of experiences. These meetings are highly appreciated by all parties. Based on previous feedbacks and evaluation, Digni sought particularly to address expressed needs related to compliance to donor requirements, particularly financial management and accountability, in the regional network meetings in 2018.

East-Asia: The fourth Regional Network Meeting for East-Asia was held in Bangkok, Thailand in April 2018. There were 49 participants present, including two staff from Digni, 8 Norwegian member organizations and their respective partners from 10 countries in the region. The main thematic focus was organizational sustainability and local ownership, civil society and community empowerment and accountability, including anti-corruption and financial management. The meeting lasted for three full working days. The sessions on accountability, anticorruption and financial management were beyond doubt the most valued sessions among participants. Feedback points to the importance of presenting these topics based on real experiences and the opportunity to discuss points along the way. Key takeaways from these sessions were the need to train staff on corruption and the consequences of fraud, proper documentation, follow-up of auditor’s management letter, periodically review of internal control systems and segregation of duties.

South Asia: The fourth Digni Regional Network Meeting for the South Asia Region was held in Kathmandu, Nepal, November 2018. 60 Participants, including a representative from Norad, 3 Digni staff, 9 Norwegian member organizational and local partners from 5 countries in the region took part in the meeting. The program covered a wide range of themes. Presentations and sharing of experiences took place over the course of three intensive full days and the main areas that were covered during the meeting were: sustainability and local ownership, role and space for civil society, anti-corruption training/financial accountability. As for the network meeting for East-Asia, the sessions on accountability, anticorruption and financial management was very well received by the participants. The review and presentation of practical case stories and group exercises raised particular interest. I.e. the shared experience from one partner receiving a spot-check visit from the Norad Fraud Unit, where the processes was laid out and explained in detail. This generated important questions and discussions regarding methodology, requested level of documentation, areas of examination and follow-up measures. In addition, sessions on shrinking space for civil society in the form of increased conditions on foreign funding as well as progressive restrictions on religious freedom were stressed as a central concern for several local partners. This was information was welcomed by the representative from Norad, who also expressed the importance of gaining insights on situational challenges in order to improve directives and decisions for support.

French-speaking Africa: The third regional network meeting for French speaking countries in Africa was held in Cameroon in November 2018. Facilitated by Digni, 43 participants from six

83 countries in Africa (Burundi, the Democratic Republic of Congo, the Republic of Congo, Mali, Madagascar and Cameroon) and participants from Digni member organizations in Norway were gathered for 5 days. The themes elaborated were the trends in development cooperation, the content and implications of the new agreement between Norad and Digni, anti-corruption, Digni’s Global Results Framework, monitoring and evaluation mechanisms and security. All participants highly appreciated the possibility for networking, experience sharing and competence building. Although all the themes were relevant, three sessions stand out as particularly relevant for continued follow-up:

1. A step-by-step workshop on results framework, indicators and results measuring. This has resulted in a significant improvement of the quality of the results report for 2018 from projects that participated at this network meeting. 2. Discussions concerning the translation and the understanding of different development expressions in relation to French-English cultural contexts did create space for clarification and consensus on common critical words and expressions. 3. The session on security turned out to be more significant than expected. All partners shared challenges related conflict situations and political instabilities in project areas. There was consensus on the need for more training and awareness on this topic. This will be prioritized for future network meetings.

Competence building programs Digni has supported three competence building projects in 2018.

Value-Based Leadership: In collaboration with VID Specialized University in Oslo, Misjonsalliansen (MA) has carried out a three-year competency development project within value-based leadership in Bolivia for the period of 2016-2018. The purpose of the initiative was to develop a systematic leadership development program for leaders and staff within faith-based organizations. The final product will consist of eight modules of teaching booklets and a curriculum for each module. It is intended to be relevant for faith-based organizations and churches in other continents than Latin America as well.

In 2016, the first teaching module was finalized and a proposal for the curriculum of the entire leadership program was developed. Formal agreements between MA and two local partner organizations in Bolivia, Diaconia and Intellectual Capital, were signed. The program has during the period been under continuous development and adjustment, and now has the following overall structure:

Topic I: Introduction to leadership and values Topic II: Faith and Diaconia as a platform for leadership Topic III: Value-conscious management in organizations Topic IV: Theory of organization Topic V: Personnel management and conflict management Topic VI: Change management Topic VII: Financial management and management Topic VIII: Organizational culture

Diaconía has in collaboration with Intellectual Capital/Microfin and VID put together the curriculum literature of approx. (2,500 pages) for the entire program. The part of the curriculum that has not been available in Spanish has been translated into Spanish.

20 students participated in the program. Of these, 18 came from senior management and the middle management group in Diaconía. Two of the participants were from the Mission Alliance in Bolivia. All students submitted a written exam of 4,000 words.

The program will undergo an external evaluation in 2019.

Cooperation with Private Sector: HimalPartner (HP) initiated a three-year competence building project on Private Sector Development as a response to the Norwegian government white paper knowledge of the mechanisms of profitable, socially responsible and environmentally sustainable Private Sector Development in developing countries.

The overall goal of the competence building project has been to increase the knowledge about the mechanisms for profitable, socially and environmentally sustainable business development in developing countries. HP wanted to contribute to this by providing an overview of the topic and contributing to increased interaction between relevant actors.

In 2017, the project developed a resource booklet in cooperation with the Norwegian consulting firm TINKR and the Mission Alliance. TINKR assisted in developing the models in the resource booklet. Through meetings, seminars, and data collection, the project has worked on looking at the role of mission organizations and other non-governmental organizations in actively contributing to a sustainable business sector in developing countries. The booklet has been translated into English in 2018 eventually formed the basis for monthly morning meetings in what was called Digni’s Business Forum; based on the topics in the resource booklet

HP reports to have increased their own expertise and have developed models for reflection and built networks between Digni's member organizations. There has also been contact with Norad and other parts of the Norwegian authorities as well as with ForUM for development and environment. This has given a broader understanding of what role the mission organizations have and should have in the future.

Through the UN's Sustainability Goals and Parliamentary Report 24, 2016-2017 (Joint Responsibility for the Common Future), there is now a great demand for getting the business community as a player in the development arena. The OECD guidelines for responsible business are important tools to ensure that this initiative takes place through a responsible business sector. In this perspective, the civil society is important. Mission organizations represent networks, contextual knowledge and experience in business development with high levels of corporate social responsibility. It will be interesting to see how the insight gained through this competence building project can be used in the future.

The program will undergo an external evaluation in 2019.

Early Childhood Education (ECE): Pinsemisjonen (NPM) received support for a one-year program as continuation of a previous project in the regular portfolio. The goal of the initiative was to contribute with competence building in pre-school teacher education in a network of 9 partner institutions in southern Africa, in collaboration with NPM and Queen Mauds Minne University College (QMUC) for Kindergarten Teacher Education in Norway.

The program had three specific goals:

• Sustainable and amicable exit of the previous supported project NPM-Competence Building Network; CBN - Early Childhood in the region of South and East Africa.

• Member institutions have developed professionally within the fields of inclusive education and parental participation. • NPM, QMUC and member institutions have a plan for continued professional development of early childhood education in the region.

The program was implemented during 2018, according to the activity plan and budget agreed in application. The main activity was a conference held in Eswatini, featuring delegates from the cooperating institutions for early childhood education. The conference focused on challenges regarding early childhood education in the respective countries and institutions, and how a methodology of action research may help moving from an academic and abstract discourse to tackling on the ground challenges and actual change of practices in the institutions involved.

A second phase of competence building has been granted, focusing on development of action research in the institutions in the South, which will be jointly coordinated by a researcher affiliated with St. Mary’s College in Tanzania and NPM/QMUC in Norway, involving the same institutions across Southern Africa.

10. Conclusions By way of conclusion, Digni would like to examine some of the main findings from the report in the light of Digni’s strategic plan for the agreement period and Digni’s theory of change, focusing particularly on questions related to the cost-effectiveness of Digni-supported projects.

Realization of strategic goals 22 projects ending in 2018 formed the basis of the results summarized in the present report. Together the projects targeted approximately 390,000 direct beneficiaries and 1.4 million indirect beneficiaries. Results were found to be on average at 3.60 when assessed in accordance with Digni’s empowerment assessment tool (EAT), which represent stronger results than the average in projects reported in 2016 and 2017 (3.20). The results put Digni ahead of targets, which are set at 3.25 by 2020 and 3.40 at the end of the agreement period. The improvement of results compared to the results in the period report for 2013-2017 may be down to random yearly deviations. At the same time, Digni has observed improvements in the quality of reports from the projects. The projects in the present sample were generally able to document changes at outcome levels or better for target groups, which is likely an important reason why results appear improved in the present report. This again is testimony to the effectiveness of the arenas of learning in Digni, as competence building on results-based management has taken place on a number of occasions for both members and partners. It is compulsory for all projects to report on the strengthening of civil society. Creating a strong civil society engagement for change in strategic partnership is a key element of the Digni’s theory of change. In the strategic plan it is presented as a supporting goal to the main goal of achieving dignity for all. It constitutes the cross-cutting approach to the main objective of Digni, to see empowered communities and individuals living in dignity, as underlined in the illustration. In the 22 projects constituting the sample for this year’s report, the goal of strengthening civil society is largely achieved at a satisfactory level – but has it led to the empowerment of communities and individuals to live in dignity? In order to make an assessment of the impact related to the main goal in Digni, we need to consider the thematic EAT scores of all themes, which represent different facets of empowerment. High EAT scores correspond to obtained structural change and sustainability. The strongest results were achieved in the thematic areas related to peaceful coexistence (4.21), quality education (3.74), and strengthening civil society (3.59), indicating that the projects in the sample had significantly empowered target groups, in terms of their power to improve the safety of target groups (notably women and children, by addressing gender-based violence and conditions for

87 children), power to access quality and inclusive education, and the power to organize, mobilize resources and engage with duty-bearers to claim rights (civil society engagement for change). The lowest scores were achieved within environmental stewardship (3.04) and economic empowerment (3.11), highlighting the need to focus more on resilience towards environmental change and economic empowerment. The scores related to good health was also considerably lower than in previous years, which is attributed to health not being a main focus in a large share of the projects ending in 2018.

Effectiveness of Digni’s strategic partnership model Generally speaking, we find that the results included in the annual report for 2018 represent very good value for money. The overall results scores are high, and in a number of projects a real impact has been achieved, involving substantial documented change that go well beyond the improvement of situations of direct target groups, as has been the case in for example Afghanistan (QZA-18/0159-121-122 MKN-Mental Health Training Center, Herat), Mongolia (QZA-18/0159-314-315 NLM-Strengthening Children's Rights Project (SCR)2) and others, in which national policy changes and increased funding represent real changes, or in contexts such as rural Cambodia (QZA-18/0159-190-195 MA-Community Transformation in Rural Cambodia) or Ethiopia (QZA-18/0159-284-287 NLM- Raytu Comm. Dev. Project), where a reduction in cases of gender-based violence represent changes in local norms and culture. Put together, the results from 2018 represent a comprehensive response to the Sustainable Development Goals in a number of different countries. In addition, few significant deviations have been noted as projects appear, by and large, to be implemented according to plan. This notwithstanding, what are critical areas for Digni to challenge and monitor in order to ensure continued strong value for money? Here a number of factors should be considered. Below we highlight some factors that are important to consider when monitoring Digni’s theory of change. The list is by no means exhaustive.

The effectiveness of integrated approaches: On average, the 22 projects in the sample reported on more than three thematic areas in each project, which underlines the prevalence of multisector or integrated approaches to development in Digni’s portfolio. This is a natural consequence of the community-based/assets-based approaches that are highlighted in Digni’s theory of change, in which a multi-faceted approach to community development is developed in accordance with local needs and resources (bottom-up approach). The problem with a holistic, integrated approach, however, is that results may be weaker in some thematic areas. Often these are supporting focus areas to the main goals of the project. The results related to good health has already been noted, but the trend is observed also with regard to economic empowerment. While the results related to supporting focus areas may appear weak, they are often important preconditions for achieving results within the main focus area. For example, this is the case in Assam, India (QZA-18/0159-483-487 NOR-Socio-Economic Empowerment with Peace and Reconciliation Project), where bringing people together for other project activities has served as a precondition for peace mediation in the first place. In some cases, unintended, strong results are also achieved within thematic areas that are not the main focus of the project. For example, in Ethiopia (QZA-18/0159-284-287 NLM-Raytu Comm. Dev. Project), a project focusing primarily on WASH and literacy development contributed to significant reductions in early marriages and female genital mutilation in the target community -

88 especially related to the literacy work. In both cases, an integrated approach has been necessary to achieve change. Analyzing overall results there are no observable pattern regarding results achievements and the number of thematic areas a project is reporting on.

The effectiveness of a strong voluntary contribution: Projects in the Digni portfolio boasts high levels of voluntarism and community mobilization. While this demonstrates the catalytic potential of assets-based approaches, which is central to Digni’s theory of change, some challenges are also evident. In the majority of projects, mobilizing volunteers and resources are necessary to obtain local ownership and long-term sustainability. However, volunteers and local contributions are not sufficient alone as a determining factor for obtaining results. Relying too heavily on voluntary contributions may leave a project more vulnerable for turnovers and poor monitoring, as volunteers do not have the same obligations and level of training as regular staff members. Some interventions require a high level of professionalism, which may not be ensured in a project relying too highly on locally available human resources. There is a need to balance competence requirements with the locally available assets, to ensure proper monitoring, compliance with development standards, and ensure quality in programming. As discussed in chapter 3.7, no apparent correlation between level of voluntarism and level of results were detectable, which indicates that a range of other factors come into play. Moreover, it is also interesting to compare the effectiveness of rights-based approaches to that of assets-based approaches. Some of the strongest results recorded in this report can be attributed to a successful employment of rights-based strategies. However, this also depends on other factors, not least the ability of local governments to provide funding and/or make policy changes. In vulnerable states this is particularly challenging.

The effectiveness of large projects vs. small projects: A pattern is observed in the present report and the period report for 2013-2017 that results appear to be relative to budget sizes. Large budgets may appear to achieve better results than projects with smaller budgets. But are the results better because the budgets are larger or vice versa? Larger scale budgets are considered to increase the efficiency of implementation (smaller proportions used on administrative tasks), but in our experience, a gradual shift often take place. One hypothesis is that initial project phases may be approved on a smaller budget, after which the implementation is either scaled up or phased out depending on how the initial period has played out, as we also observe that results are related to the length of implementation. On average, the projects in the results sample with the largest annual budgets had been implemented for longer periods of time.

Cost-effectiveness vs. leaving no one behind: From a risk management perspective, the high level of results reported for 2018 can be viewed from two different angles: a) Risks have been successfully mitigated, which has created conditions to achieve good results, or b) Projects have played it safe and deterred from taking risks. In the context of development assistance, striking a balance between mitigating risks and avoiding risks altogether is an art. As partners in development cooperation, committed to realizing the Sustainable Development Goals, we are driven by the agenda to leave no one behind. This involves seeking out high-risk contexts. But operating in vulnerable contexts also tend to be expensive, involves potential security challenges for staff, and involve a heightened

89 risk of financial mismanagement, as corruption is rife and partner organizations in hard to reach areas may lack the capacity required to comply with grant scheme rules. For this reason, cost- effectiveness analyses should also take into account whether projects are reaching out to the most vulnerable and marginalized. This is an issue that need to be explored in the future. Implementing partners in the Digni portfolio tend to be genuine grassroots organizations, rather than highly specialized/professional organizations. As such they are often better positioned to serve vulnerable communities but may struggle with capacity weaknesses. While we do not wish to offer up any conclusions regarding the results from 2018, the degree to which Digni-funded projects are leaving no one behind and implications for results and risk management need to be kept in mind.

Learning and adjusting for increased change A central feature of Digni’s theory of change, is the degree to which arenas for learning are utilized for learning and competence building, in order to make adjustments to increase change. As illustrated below, the learning feeds into the various assumptions undergirding the strategic civil society partnership in Digni’s theory of change. While the high levels of results achieved in 2018 is a testimony to the effectiveness of Digni’s strategic partnership model for change, important areas of improvement have been identified through the various arenas for learning.

Here we summarize some of the main learning outcomes that provide direction for the work of Digni, the members, and their partners in the years to come. Ways of thinking: The Empowerment Assessment Tool (EAT) has represented a systematic approach to verify the local organizations’ and communities’ ability to empower individuals and communities for change. It also seems to be an effective tool for analyzing and aggregating results. The methodology is used by Digni and has also been included in external evaluations. In some cases, the tool is also adopted as a methodology in project log-frames. Training on the methodology has taken place through Digni seminars and regional network meetings. Some challenges have been observed with regard to making the material more user-friendly. Digni as an enabler of change: Digni’s capacity (competence, resources and networks) is verified in evaluations and follow-up by Norad, self-assessment and documentation of results, as well as feedback from members and partners. Entering a new and larger cooperation agreement with Norad has entailed revisions and upgrades to management systems and a sharpened focus on control aspects of the portfolio management and a more systematic approach to monitoring results and risks. There is a constant need to improve the quality of systems and follow-up which is an ongoing effort. A challenge in this regard is to balance the need for thematic competence development with the need to strengthen administrational management and compliance aspects. The secretariat has prioritized competence building and follow-up of members and partners, especially through Digni seminars, regional network meetings, project/partner visits, organizational reviews and through assessments of project reports and applications. Member organizations as enablers of change: The member organization represent the key link between the funding source in Norway and the local change agents, having developed a wide network of long-term partnerships and deep contextual knowledge. Through self-assessments and organizational reviews undertaken/commissioned by Digni, assumptions about the members’ capacity and transparency is tested. A challenge identified is that capacity is unevenly distributed among Digni’s members, which is mitigated by regulating grant sizes and geographic distribution of portfolios, close follow-up by Digni, and emerging pooling initiatives among smaller organizations. There is a need to monitor capacity and competence development closely throughout the Digni-chain. Particular emphasis is placed on the member organizations’ responsibilities with regard to quality assurance of financial management towards partners and projects, which is an area with room for improvement. Partners as local change agents: Major emphasis was placed on carrying out Due Diligence reviews of partners in 2017-2018 to test the assumption that local partner organizations operate with the necessary quality assurance systems, financial management and levels of transparency. The process is described in more detail in chapter 9. While partners in general were found to have the necessary capacity, there are also weaknesses and deficiencies that need to be addressed. Two areas may be highlighted, namely a) monitoring of project results and b) financial management. These are areas that have been put firmly on the agenda in several learning arenas in 2018, especially the regional network meetings (as noted, an improvement is already noted with regard to monitoring and reporting standards). Sustained efforts are undertaken to improve these areas, for example through the introduction of monitoring and reporting templates and training, organizational reviews, and partner/project visits. Digni also observe that more learning between local partners are taking place. Again, the regional network meetings play an important role in this regard. Communities as local change agents: Project reports, external evaluations, and project visits constitute the main source of information to verify the underlying assumption that organization

91 and empowerment of community members and bodies will lead to changes that are vital for a life in dignity. Given the widespread geographic distribution and diversity of communities reached by Digni-funded projects, some variance with regard to the effectiveness of the strategic civil society partnership for change models is to be expected. More analysis is needed in this respect. The high level of results achieved in 2018, however, is an indication that Digni’s theory of change regarding community development and mobilization, and that the added value of the different partners in the Digni-chain, appears verified.