Covenant of Mayors Capacity Building Model for Ukraine

EXTERNAL EVALUATION REPORT OF THE PROJECT "COVENANT OF MAYORS CAPACITY BUILDING MODEL FOR UKRAINE AND GEORGIA – MODEL SOLUTION FOR EASTERN PARTNERSHIP AND CENTRAL ASIAN COUNTRIES" IMPLEMENTED BY THE ASSOCIATION "ENERGY EFFICIENT CITIES OF UKRAINE"

THE PROJECT WAS FUNDED BY THE EUROPEAN UNION IN THE FRAMEWORK OF THE EUROPEAN COMMISSION PROGRAMME "COVENANT OF MAYORS EAST: SUPPORTING THE PARTICIPATION OF EASTERN PARTNERSHIP AND CENTRAL ASIAN CITIES IN THE COVENANT OF MAYORS", AS WELL AS BY THE ASSOCIATION "ENERGY EFFICIENT CITIES OF UKRAINE" AND OTHER PROJECT PARTNERS. EXTERNAL EVALUATION REPORT OF THE PROJECT "COVENANT OF MAYORS CAPACITY BUILDING MODEL FOR UKRAINE AND GEORGIA – MODEL SOLUTION FOR EASTERN PARTNERSHIP AND CENTRAL ASIAN COUNTRIES" IMPLEMENTED BY THE ASSOCIATION "ENERGY EFFICIENT CITIES OF UKRAINE"

Independent Evaluator Iryna Skorbun

2015 The report was developed in the framework of the project "Covenant of Mayors Capacity Building Model for Ukraine and Georgia – Model Solu- tion for Eastern Partnership and Central Asian Countries", implemented by the Association "Energy Eﬃcient Cities of Ukraine". The document contains the evaluation of the project implementation process and recommendations regarding possible improvements for this process in the future. The report is addressed to the supervisory authorities of the European Union, the Executive Management of the Association "Energy Eﬃcient Cities of Ukraine", project’s stakeholders and all other interested parties.

This document was prepared thanks to the financial support of the European Union. Its content is the sole responsibility of the author and does not reflect the official opinion of the European Union.

2 CONTENTS

1. GENERAL INFORMATION ON THE PROJECT 2. INTRODUCTION 3. EVALUATION METHODOLOGY AND ORGANIZATION 4. MAJOR CONCLUSIONS 5. LOGICAL FRAMEWORK AND INDICATORS OF PROJECT IMPLEMENTATION 6. SUSTAINABILITY OF RESULTS 7. PROJECT IMPLEMENTATION FEATURES IN PARTNER CITIES 8. ACTIVITY OF CONSULTANTS 9. PROBLEMS AND WEAKNESSES 10. REVIEW OF EECU MONITORING AND EVALUATION PROCEDURES 11. COMMUNICATION AND PUBLIC ACTIVITY 12. REVIEW OF INTERNATIONAL TECHNICAL ASSISTANCE 13. RECOMMENDATIONS

List of abbreviations References

Annexes Annex 1. Scheme of the theory of changes Annex 2. Logical framework template Annex 3. Pictures taken during monitoring visits Annex 4. Semi-structured interview questionnaire Annex 5. Draft of manual on monitoring and evaluation

3 1 «COVENANT OF MAYORS CAPACITY BUILDING MODEL FOR UKRAINE AND GEORGIA» GENERAL INFORMATION ON THE PROJECT

The «Covenant of Mayors Capacity Building Model for Ukraine and Georgia» Project was implemented in the framework of the European Commission programme «The Covenant of Mayors East: Supporting the Participation of Eastern Partnership and Central Asian Cities in the Covenant of Mayors» in 2011-2015. The project was implemented in partnership of public non-profit organizations and local authorities. The project partners of the Association «Energy Efficient Cities of Ukraine» (EECU) were the Development Agency «Sinergija Ltd» (Slovenia), the «Energy Efficiency Centre – Georgia» (Tbilisi) on the part of Georgia, self-government cities of Rustavi and Gori, in Ukraine project partners were the executive committee of Kamianets-Podilskyi City Council (Khmelnytskyi region), the executive committee of Novovolynsk City Council (Volyn region), the executive committee of Berdiansk City Council (Zaporizhia region), the executive committee of Alchevsk City Council (Do- netsk region). The project activities took place in the cities participating in the project as well as in Lviv, Kyiv, Vinnytsia, Dolyna (Ivano-Frankivsk region) and Tbilisi.

THE PROJECT GOAL To support the efforts of local governments in Ukraine and Georgia (sub- sequently in other countries of the Eastern Partnership and Central Asia as well) in strengthening their energy security, reducing greenhouse gas emission, reducing dependence on fossil fuels, increasing the share of alternative energy sources, savings costs, and improving quality of residents life.

THE PROJECT MAIN TASKS ▶▶ To provide necessary information and technical support for city councils in Ukraine and Georgia for their active participation in the Covenant of Mayors. ▶▶ To strengthen the capacity of Ukrainian and Georgian project cities of addressing their Covenant commitments through the development and implementation of local sustainable energy policy and local Sustainable Energy Action Plans (SEAPs).

4 PROJECT TARGET AUDIENCE AND BENEFICIARIES

▶▶ Elective officials (city mayors and deputy corps) and local government personnel. ▶▶ Community of the project cities. ▶▶ Employees of the newly established Covenant of Mayors Supporting Structures in Georgia and Covenant of Mayors Energy Agency in Ukraine. ▶▶ Selected Ukrainian and Georgian urban energy experts.

PROJECT ACTIVITIES FORESAW

1. Development of guidelines on political and organizational preparation for participation in the Covenant of Mayors for city councils. 2. Selection of appropriate methodologies and software tools and their adaptation to Ukrainian and Georgian conditions. 3. Competitive selection of Ukrainian and Georgian project pilot cities. 4. Organization and conduction of practical interactive training course based on the guidelines and adapted tools. 5. Development, support and promotion of the Covenant Supporting Structure in Georgia. 6. Development, support and promotion of the Covenant of Mayors Ener- gy Agency in Ukraine. 7. Support for the project cities in the developing energy management system for their public buildings. 8. Support for the project cities in the development of the СО2 emission registry. 9. Support for the project cities in the developing 3-year SEAP. 10. Development and implementation of awareness raising campaigns and participation programmes focused on gaining public support for local energy policies and SEAPs. 11. Implementation of energy efficiency and renewable energy measures for public buildings in the pilot cities. 12. Technical and expert support for the project cities to fulfil the Covenant obligations. 13. Shifting the SEAP of one of the project cities into a practical investment plan.

5 THE COVENANT OF MAYORS This is a leading initiative, launched by the European Union in 2008. It covers local and regional authorities, which undertake voluntary commitments to boost energy saving and increase the use of renewable energy sources on their territories. Following these commitments the Covenant signatories pledge to cut CO2 emissions by at least 20% by 2020, thus contributing to the developing environmentally oriented economy and improving quality of life. After the European Union climate and energy package was adopted in 2008, the European Commission launched the Covenant of Mayors to endorse and support the efforts deployed by local authorities in the development and implementation of sustainable energy policies, as up to 80% of energy consumption and CO2 emissions are associated with cities activity. To support municipalities that show their political will to sign the Covenant, but are lack of the necessary political and administrative potential, as well as of financial and technical resources to fulfil the requirements, some state authorities and networks that are able to support the signatories in achieving their ambitious goals are offered a special status in the framework of the Covenant. The networks or associations of local authorities, which gain a status of the Covenant Supporting Structures, commit to maximize the impact of the initiative through promotional activities, cooperation with their members and providing platforms for best practice exchanges. The Covenant Signatories, Coordinators and Supporting Structures are provided with promotional, technical and administrative assistance from the Covenant of Mayors Office (CoMO) in Brussels and the Covenant of Mayors Branch Offices in Lviv and Tbilisi (CoMO-EAST). The Joint Research Centre of the European Commission in cooperation with the Covenant of Mayors Offic- es assists signatories in scientific and technical issues associated mainly with baseline emission inventory and Sustainable Energy Action Plans. The signing ceremony of the new Covenant of Mayors on Climate and Energy was held at the European Parliament in Brussels on October 15, 2015. New Covenant of Mayors grew from the European initiative into an international one and aims to achieve 40% reduction in greenhouse gas emissions by 2030, to integrate and strengthen the efforts of cities in three main areas: pollution reduction, adaptation to climate change, improvement of energy efficiency and use of renewable energy.

6 2 INTRODUCTION

This report is prepared on request by the Association “Energy Efficient Cities of Ukraine” (EECU) in accordance to short-term contract on external evaluation of activity results of «Covenant of Mayors Capacity Building Model for Ukraine and Georgia» project, implemented in the framework of the Euro- pean Commission Programme “The Covenant of Mayors East: Supporting the Participation of Eastern Partnership and Central Asian Cities in the Covenant of Mayors”.

The project started in late 2011, lasted for 45 months and finished on Septem- ber 30, 2015. During this period a significant progress was made in the implementation of energy efficient technologies, however handling the problems of energy saving and energy efficiency by the local government and community remains important for both Ukraine and Georgia as well as for other Eastern Partnership countries, and needs further development and support. The report contains evaluation, conclusions, and recommendations. It aims to inform interested parties about the project achievements and outline the steps for further development and improvement of EECU activities.

The evaluation aimed to find out how effectively and efficiently the project tasks had been performed, determine if the project had achieved the desired impact on the local policy for energy saving and energy efficiency.

THE FOLLOWING KEY QUESTIONS OF EVALUATION WERE RAISED IN COOPER- ATION WITH EECU TEAM: 1 Were the measures for the project goals achievement chosen correctly? 2. Were those measures implemented efficiently and fully? 3. Are the achieved results stable? 4. What were the differences between the project implementation processes in Georgia and Ukraine, and the project implementation processes in the project cities in Ukraine? 5. How was the communication between employees, cities, and countries participating in the project provided?

As the project is multi-component and large-scale, its implementation experience became a factor of EECU professional and organizational capacity improvement. Monitoring and evaluation system is one of the key components

7 of organizational development, that is why focus of evaluation covers not only the project programme activities, but as well monitoring and evaluation procedures, which are represented in the organization both on the level of formalized policies, and on the level of routine practices. The review of monitoring and evaluation system, currently used by EECU, was conducted in order to develop detailed recommendations and provide assistance for its improvement. The project implementation included active public and leading role of EECU of its energy efficiency advocacy implementation activity on the international, national and local levels. Therefore the following aspects were taken into account during the evaluation: relationships with partners, recognition and support from government institutions, EECU public image, in particular, EECU media and Internet representation, following the rules of visual representation, labelling and branding of the European Commission and EECU during the project implementation.

3 EVALUATION METHODOLOGY AND ORGANIZATION

Final evaluation was conducted by an external consultant on monitoring and evaluation during the project last implementation months from July 9 to Oc- tober 30, 2015. The evaluation was carried out according to the European Commission recommendations on result oriented monitoring and evalua- tion1 that requires the analysis of activity compliance to declared goals, efficiency of selected approaches, economic feasibility, influence and stability of the project achieved results.

SEVERAL METHODS OF DATA COLLECTION AND ANALYSIS WERE USED TO EVALUATE THE PROJECT ACTIVITIES, IN PARTICULAR: ▶▶ document analysis; ▶▶ semi-structured interviews with the project participants, co-contractors and beneficiaries; ▶▶ observation during demonstration site visits.

THE MEETING WITH THE FOLLOWING EECU TEAM REPRESENTATIVES WAS HELD:

1 Results Oriented Monitoring Handbook March 2015 (Version 2.0). Instructions and guidance for ROM reviews and support to end-of-project results reporting for projects and programmes financed by the European Union within the framework of its external assistance.

8 Andriy Kyrchiv, EECU Executive Director Agnieszka Schirru-Nowicka, the Project Head Vitaliy Volkov, the Project Deputy Head Oleh Harasevych, EECU Project and Programme Head Vitaliy Lesiuk, EECU Financial Consultant

THE FOLLOWING DOCUMENTS WERE PROVIDED UNDER CONSIDERATION: 1. Project application form. 2. Reports on the project implementation in 2012, 2013, 2014. 3. Project logical framework. 4. Project monitoring plan. 5. Project presentation materials. 6. Information on project official partners. 7. Sample documents adopted by the local authorities with support of the project. 8. Expert and consultative conclusion about EECU organizational policies and procedures improvement and implementation. 9. Informational materials issued in the framework of the project.

Data on EECU activity in open information sources – the Association and Project official web-sites and newsletters – were analyzed. Current strategies of leading agencies for international development and international organizations, which work in Ukraine and support energy efficiency initiatives, were reviewed.

We also reviewed certain aspects of inter-project cooperation used by EECU and other international aid programmes on energy saving and energy efficiency, in particular, the USAID Municipal Energy Reform Project in Ukraine, the EC Covenant of Mayors Demonstrational Projects of Eastern Partnership Programme, the DESPRO Project, initiatives of the Nordic Environment Fi- nance Corporation (NEFCO).

In the course of evaluation all project cities were visited (except Alchevsk, which is on the territories outside the control of the Ukrainian authorities). Meetings with the project executives were held and all the facilities, equipped by the financial support of the project, were visited. The meetings were held with experts, directly involved into the project, as well as with their partners and beneficiaries.

9 THE SCHEDULE OF PROJECT CITIES VISITS WAS AS FOLLOWING:

UKRAINE

Lviv July 9, 2015

Novovolynsk (Volyn region) July 27, 2015

Kamianets-Podilskyi (Khmelnytskyi region) August 19, 2015

Berdiansk (Zaporizhia region) September 14, 2015

Alchevsk (Donetsk region) not visited

GEORGIA

Tbilisi October 21, 2015

Rustavi October 22, 2015

Gori October 23, 2015

10 Working meetings and interviews in the framework of the project evaluation were held with the participation of the Project consultants and executives:

Vasyl Myhas, Head of the Economic Policy and Investment Department in Novovolynsk City Council (Volyn region); Yuriy Liahutko, Energy Saving Expert, Advisor for Kamianets-Podilskyi City Mayor (Khmelnytskyi region); Nataliya Kryvoruchko, Head of the Investment Activity and Energy Effi- ciency Department in Berdiansk City Council (Zaporizhia region); Tamaz Vashakidze, the Covenant of Mayors Consultant, Georgia; Tengiz Ivanidze, the Covenant of Mayors Consultant, Georgia; Ivan Cholokashvili, the Covenant of Mayors Consultant, Georgia; Davit Tsyskaridze, the Covenant of Mayors Consultant, Georgia; Nataliya Dzhamburiya, the Covenant of Mayors Consultant, Georgia; Georgiy Abulashvili, Project Coordinator in Georgia, Energy Efficiency Centre in Georgia, Tbilisi; Elena Gvilava, Communication Expert, Energy Efficiency Centre in Geor- gia, Tbilisi; Givi Khuroshvili, Gori municipality representative, Georgia; Zurab Tabagua, Deputy Director of Architectural Infrastructure and Housing Department, Rustavi, Georgia; Iryna Barulina, the Covenant of Mayors Consultant, Kherson, Ukraine; Oleksiy Verba, the Covenant of Mayors Consultant, Poltava, Ukraine; Yuliya Zabelina, the Covenant of Mayors Consultant, Zaporizhia, Ukraine; Oleksandra Naumova, the Covenant of Mayors Consultant, Kherson, Ukraine; Olesia Lotysh, the Covenant of Mayors Consultant, Lviv, Ukraine.

In December 2015 evaluation results were presented to EECU team for dis- cussion and comments.

11 4 MAJOR CONCLUSIONS

1 The project implementation had a significant impact on local energy policy in the project partner cities. Project activity and technical assistance helped local authorities in selected cities in Georgia and Ukraine to join the Covenant of Mayors, develop an action plan and start per- forming their responsibilities. That is confirmed with the considerable raise of the Covenant signatories in Georgia and Ukraine in 2014-2015, and increase in the amount of developed and adopted Sustainable En- ergy Action Plans.

2 Timeliness of the project topic intensified during the implementation period. In 2014-2015 energy efficiency and energy saving issue became not only an economic factor, but also one of the key political factors of national security in Ukraine.

3 Review of annual reports, review of documents, developed by executive committees of city councils, interviews with the project main partners and beneficiaries, as well as visits to facilities equipped by means of the project financial support, allows to draw a conclusion that absolute majority of the assigned tasks was completed.

4 According to official reports and results of expert interviews during the project implementation energy efficiency situation was improved in the pilot cities, approaching many indexes of the project intended results. However, it is not possible to confirm the project contribution into the Covenant of Mayors overall goal on a level of long-term effects indicators measuring (reduction of greenhouse gas emission and dependence on fossil fuels, increase of the share of alternative energy sources) due to a short term that has passed after programme implementation in the project pilot cities.

5 All partners and participants of the project had positive experience and highly appreciated opportunity of the cooperation: the project implementation was directly curated by city deputy mayors with full support of city executives.

6 The interventions in the framework of the project met the needs of target groups and beneficiaries. Local authority representatives ad- mitted and appreciated advantages of joining the Covenant of Mayors

12 for each city. The most useful results are supposed to be the development of strategic action plans, city energy management systems, raising of officials qualifications in the field of energy saving and energy efficiency.

7 On the partners’ opinion, participation in the Covenant of Mayors pro- vides the city with reputational advantages, which can be used for attracting new projects, partners and investments into this branch. Three project cities (Berdiansk, Novovolynsk, and Rustavi) had managed to attract additional funds into the field of the energy saving and alternative energy sources development before the project was completed. The funds level exceeded those that were granted in the framework of EECU project.

8 Due to the priority of energy saving and energy efficiency topics, all obligations of partners on their own contribution were provided with funding from local budgets.

9 In several pilot cities the share of their own contribution into the equipment of facilities even exceeded the originally planned that allowed to improve the facilities in more holistic way. That was achieved through local authority support, sponsorship, and favourable terms of service for local suppliers.

10 The example of the project partner cities showed that even small investments into energy efficiency can bring reasonable results on municipal level in reducing energy consumption, improving municipal services quality, and improving comfort level for consumers.

11 In the framework of the project the emphasis was made on the thor- ough documentation of experiences and best practices, and dissemination of information among new members and signatories of the Covenant of Mayors. Information materials issued in the framework of the project contain step by step instructions for local authorities representatives, based on evidence and real experience, written in plain and meaningful language, containing samples of regulations that significantly facilitates the work and encourages such partnerships “new- comers”. Furthermore, materials are designed and printed in high quality, issued in Ukrainian, Russian, Georgian and English languages, what also adds comfort in use.

13 12 The project information events, the most noticeable of which were Sustainable Energy Days, became traditional, recognizable, and care- fully designed information events on local level during the years of implementation. Such information campaigns not only inform about the project activity, but also confirm that energy efficiency and energy saving became major component of local policy. Interviewed experts confirmed that Sustainable Energy Days will be held after the project completion as well.

13 EECU uses modern information tools: the association web-site http:// enefcities.org.ua/ and project specially designed web-site http://eecu-comogrant.org.ua/ contain comprehensive information on energy efficiency principles, policy and practices, are up to date and filled up with new publications. EECU information newsletter is regularly sent to the association participants, partners, journalists. The Covenant of Mayors topic is regularly covered in the newsletter, though its issue is not financed in the framework of the project.

14 Networking opportunities among the project participants from different cities, sharing experiences, comparing their achievements with the situation in other cities, and between Ukraine and Georgia, were noted as additional benefits by the majority of the project participants.

15 Huge volume of EECU responsibilities in the framework of the project can be considered as a challenge for the organization, however it was adequate for its organizational capacity. Also, the project managed to establish an effective system of coordination involving partners and interested parties, government institutions and projects of other international programmes.

16 The project activity was complementary to other running projects and programmes, managed by other donors.

17 Social and political situation in Ukraine and Georgia was one of the factors that affected the project implementation progress. During the project implementation dramatic changes took place in the political context, which influenced on the project timeline of scheduled tasks. In 2014 mass protests, change of power, and Russian occupation of the Autonomous Republic of Crimea and territories of Donetsk and Lu- hansk regions took place in Ukraine.

In Georgia, local election and significant changes in the local authority personnel were a risk factor for the project. It somehow slowed the process, but did not result in failure of the project commitments undertaken by the municipalities. These critical changes in circumstances were taken into account during the revision of the project working plan.

5 PROJECT IMPLEMENTATION LOGICAL FRAMEWORK AND INDICATORS

During the evaluation not only the project logical framework, but also all directions of its activities were reviewed. However, correct logic of intervention is one of the key factors of efficiency, so special attention was devoted to analysis of this document. The project logical framework was an integral part of the project application, and apparently was developed according to the documentation requirements of the EC 2011. During current evaluation the analysis of logical framework was conducted according to the new requirements, which are contained in a standard package of documentation templates for preparation the EC new projects and programmes starting from January 1, 2015. This new template of logical framework contains clearer requirements how to identify indicators and their basic and target values. Provided recommendations are based on the requirements and standards of new templates of the European Commission documentation. However, the requirements for result-oriented planning, project implementation and monitoring are today almost universal in most international agencies, such as organizations of the UN system, the World Bank, USAID, etc. The project logical framework was analysed by means of the “Theory of Change” methodology to develop recommendations on EECU project cycle improvement. This methodology, recommended by the World Bank Inde- pendence Evaluation Group (WB IEG), helps to verify whether introduced in the project/programme activity logic could lead to achievement of the intended result. The basis of the evaluation was the understanding of the logical framework as a document describing the logic of changes which might take place due to the implementation of planned activities. Based on its text a structure of cause and effect relationships between the project activities and intended results was developed as follows: → Contributions → Processes → Products → Consequences → Effects. This logical structure was supplemented with assumption list – affirmative state- ments, providing their implementation the logical consequences stand in force. Thus the theory of changes was formed (see Annex 1).

15 BASED ON THE EVALUATION RESULTS SUCH POSITIVE ASPECTS CAN BE NOTED:

▶▶ Review of the project documentation, in particular the Logical framework and regular reports, confirmed that logic of achievement of the project intended results was reasonable and based on socioeconomic and socio- political realities in Ukraine and Georgia in 2011.

▶▶ The Logical framework was used as a tool for the project activity planning and adjustment. Every year it was updated in accordance to the context of the country.

▶▶ Most of the project activities met stated purposes. Providing their full implementation they should lead to the planned results. In general, the undertaken activities answered the consequences of their implementation defined in the project Logical framework.

▶▶ Project time schedule, provided under the consideration, clearly defined not only time parameters, but also the role and actions of each partner, stated purposes and responsible coordinators.

Analysis of indicators of different levels (influence, result, process), proposed by the project Logical framework, showed some weaknesses. ACCORDING TO EVALUATION RESULTS THE FOLLOWING ASPECTS REQUIRE TO BE IMPROVED:

▶▶ Fuzziness in identification of indicators of different levels can be noticed. Monitoring is focused on indicators of the project implementation processes, not on indicators of result and impact. For example, according to the project logical framework, strengthening of municipality technical competence is measured by number of qualified (trained in the framework of the project) specialists and consultants, what can be one of the confirmations. In order to monitor the effectiveness of the project training activity, it is desirable to have indicators which confirm or do not confirm further activity of trained specialists (for example, whether they continue to work in this sphere, or initiate similar decisions, whether they have demand on their services, whether they provide relevant consultations, etc.). ▶▶ Interventions in the framework of the project in selected cities are mul- ticomponent and aim not only to develop regulatory document, improve the infrastructure and exploit it properly, but also to mobilize efforts and active participation of the citizens, support open and proactive position

16 of local authority representatives in energy efficiency. So the final result should be change in people behaviour and their consumer and behaviour habits regarding energy sources use; the project activities have to support such changes in behaviour. Indicators for monitoring and evaluation of communicational component should be developed in the same way. In order to measure results one should monitor not only “what happened?” (indicator of process), but as well “what was changed?” (indicator of impact) in behaviour of the project target groups. The project documents, provided under consideration, do not contain any information on changes in awareness and public behavior in pilot cities. Implementation of informational and educational component of public activity was mostly monitored by means of indicators of processes (number of events, printed materials, etc.)

▶▶ Not all indicators, which are mentioned in the project Logical framework, have clear base and target (planned to achieve) values. That makes it more complicated to measure the project achieved results and goals. These data are not specified in the Project monitoring and evaluation plan as well. However, it should be noted, that the data envisaged by the Logical framework is available and presented in the project reporting documentation.

▶▶ The project reporting materials contain affirmation about equal gender parity among representatives of target groups and beneficiaries, though concrete data and real ratio according to the implementation results is not mentioned.

It is recommended to use a new template of Logical framework in projects supported by the European Commission since 2015 that will help to remove shortcomings during next projects planning and implementation and the organization activity. The new template sample is provided in Annex 2. It is worth to mention that despite some shortcomings in indicators formulation, annual summary reports contain a lot of detailed information and additional data, which amply illustrate the implementation process and achievements of the project and its partners.

PERFORMANCE OF PROJECT MAJOR OBJECTIVES Review of annual reports, review of documentation, developed by executive committees of city councils, interviews with the project main partners and beneficiaries, as well as visiting facilities, equipped with the financial support of the project, suggest that the absolute majority of the settled tasks and planned events were implemented.

17 MAIN OBJECTIVES AND EXPECTED RESULTS STATUS

Objective 1. To facilitate effective participation of municipalities in Ukraine and Georgia and in the Covenant of Mayors initiative through provision of supportive materials and institutionalized technical expertise

1.1 Developed materials on political and organizational prepa- completed ration for participation in the Covenant of Mayors for city councils. 1.2 Trained consultants on municipal energy management and completed energy managers in the pilot cities 1.3 Developed and strengthened Covenant of Mayors Support- completed ing Structure in Georgia. 1.4 Developed and strengthened Covenant of Mayors Energy completed Agency in Ukraine.

Objective 2. To increase capacity of the pilot cities in Ukraine and Georgia in order to -ad dress their Covenant commitments through development and implementation of local sustainable energy policy and SEAPs.

2.1 Energy management system for public buildings established completed in the project cities. 2.2 Increased general awareness on climate change in the pilot completed cities. 2.3 Executed cities commitments on participation in the Cove- nant of Mayors (adaptation of relevant municipal structures, completed SEAP development and adoption, document submission to the EC).

2.4 SEAP of one of the project cities developed into practical in- completed vestment plan. 2.5 Energy efficiency and renewable energy sources measures completed implemented in public buildings of the pilot cities.

Analysis of the intervention logic confirms that the chosen mechanisms for project implementation contributed to the achievement of the expected results. Foreseen resources met the needs of the project, and the local partners provided contributions (both financial and human resources) needed for -ef fective execution of tasks. Overall, these contributions were made in time. Delay occurred in 2014 and was caused by objective socio-political changes in the project countries.

18 Due to military conflict and occupation of Donetsk region in Ukraine EECU could not continue the project activities in the city of Alchevsk. After consultation with the donor, it was decided to bring the project to the city of Ber- diansk. Despite all the difficulties, all the commitments of the partners were met, although with some deviations from the schedule.

In Georgia planned activities in 2014 were also implemented with some difficulties due to the local elections and changes of the key persons who made decisions at the city level. These factors were beyond the control of the project management, so the risks were immediately reported to the donor, and critical changes in circumstances were taken into account during the review of intervention logic and planning of future activities. It took extra efforts to establish new contacts and inform new officials about the benefits of joining the Covenant of Mayors and the continuation of the project implementation.

Most of the project partners and beneficiaries expressed their positive -ex perience and appreciated the opportunity of cooperation with EECU. Direct curators of the project implementation in partner cities were city deputy mayors or sometimes city mayors. The project had a significant impact on local energy policy in the project cities. Also an example of arrangement of the demonstrational facilities of social infrastructure showed that even small investments in energy saving at the municipal level could bring tangible results in energy use reduction and consumer comfort improvement. It also confirms that the approaches proposed to local municipalities on the part of the project are economically viable and justified and deserve further dissemination and application.

19 6 SUSTAINABILITY OF RESULTS

The sustainability of the project results is guaranteed with integration and consolidation of best practices in the framework of the EECU project thanks to relevant normative documents of local authorities, which guarantee their further use after the project completion. In particular all pilot municipalities developed and adopted strategic documents: sustainable energy action plans (SEAPs), energy monitoring system was implemented in budgetary institutions, and the position of energy manager was established. Participation in the Covenant of Mayors is an external factor to promote and stim- ulate the municipalities to fulfil the assumed obligations. All obligations ofthe partners for their own contribution were secured with funding from local budgets, which indicates confidence and faith in the validity of the project activity. In the framework of the project the Covenant of Mayors Supporting Structure was developed in Georgia at the Center for Energy Efficiency and the Cove- nant of Mayors Energy Agency was established in Ukraine. The objectives of these structures are to disseminate information on the Covenant, to provide expertise and technical support to potential and current cities-signatories to the Covenant of Mayors, to assist in sustainable energy plans development and to plan concrete events to implement these strategies. Mechanisms of innovations implementation in the pilot cities proved their effectiveness and can be recommended for implementation in other cities. To ensure the sustainability of the results, the innovations tested at the level of individual cities, should gain organizational and methodological support for national distribution. It is important to note, that the executors also kept records of expenses, savings and payback period of energy saving and energy efficiency. Using these examples, other cities can choose the most cost-effective measures, and operate more justified and economically convincing arguments to get the support from local authorities, representatives of the deputy corps and community. EECU team also assist in keeping records of activities and implementing best practices among other municipalities, which are interested in energy efficiency rising in their cities. Thus the project influenced outside the borders of the project cities. Information dissemination among professional community, local government specialists, and media lightening made so called «spon- taneous» dissemination of the practices offered by EECU.

This is confirmed by the increase of requests for support to EECU from representatives of other cities, increasing number of EECU participants, EECU recognition as one of the leading energy saving and energy efficiency pro-

20 fessional organizations by national partners, as evidenced by EECU expert participation in numerous national and international forums, conferences, and expert groups.

The dynamics of joining the Covenant of Mayors by Georgian and Ukrainian cities indicates the annual increase in the number of signatories. The project activities and technical support helped local authorities in selected cities of Georgia and Ukraine to join the Covenant of Mayors, to develop an action plan and begin perform their responsibilities. This is confirmed by a significant increase of the Covenant signatories on the part of Ukraine and Georgia in 2014-2015, and the increase of number of Sustainable Energy Action Plans developed and adopted by the cities.

number of new year cities- signatories in Ukraine signatories

2010 1 Korosten

2011 7 Chernihiv, Ivano-Frankivsk, Konotop, Kryvyi Rih, Novohrad-Volyn- skyi, Slavuta, Vinnytsia

2012 12 Cherkasy, Kamianka-Buska, Kramatorsk, Myrhorod, Novovolynsk, Novoyavorivsk, Rivne, Sambir, Ternopil, Yevpatoriya, Zhovkva, Zhytomyr

2013 8 Berdiansk, Dubno, Hlyniany, Korop, Mariupol, Mena, Ukrayinka, Velyki Mosty

2014 27 Berdychiv, Bilozarska, Biliayivka, Bilytske, Chernivtsi, Chervo- nohrad, Chuhuyiv, Dobropillia, Dubliany, Hola Prystan, Kolomyya, Komsomolsk, Kupiansk, Kuznetsovsk, Lozova, Melitopol, Morshyn, Novopokrovka, Novyi Rozdil, Omelnyk, Pavlohrad, Pershotravensk, Pyriatyn, Rohatyn, Shchors, Trostianets, Zbarazh

2015 30 Balakleya (Kharkiv region), Bobrynets, Bohodukhiv, Dashava, Dniprodzerzhynsk, Druzhkivka, Hlevakha, Hnivan, Horodok, Kalyniv- ka, Kaniv, Karlivka, Khmelnytskyi, Odesa, Khmilnyk, Kostiantynivka, Krasnoarmiysk, Kremenchuk, Muzykivka, Nikopol, Nosivka, Poltava, Sloviansk, Sumy, Svatove, Truskavets, Tulchyn, Varva, Velyka Oleksandrivka, Zdolbuniv

This increase might have taken place due to several factors, indeed the information on the Covenant was disseminated through many channels, but most cities that have joined the Covenant in 2014-2015, used the information and advice from EECU the Covenant of Mayors supporting structures in Ukraine and the Energy Efficiency Center in Georgia.

21 number of new year cities- signatories in Ukraine signatories

2010 1 Tbilisi

2011 3 Batumi, Kutaisi, Rustavi

2012 1 Gori

2013 1 Zugdidi

2014 2 Telavi (city council), Akhaltsikhe

2015 5 Bolnisi, Kazbegi, Mtskheta, Telavi, Tianeti

Based on the project experience and achievements, the participants managed to attract additional resources in the area of energy conservation and alternative energy sources development in their cities, which proves sustainability of the results and future prospects of improvement in energy efficiency. Here are a few examples.

1) A kindergarten in Berdiansk was equipped with solar collectors funded by the project. Next application, developed by the executive committee of Berdiansk City Council, was supported by the NEFKO financial corporation and involves installation of solar collectors in all kindergartens in the city. 2) The experience gained during the project by the team of executive committee of Novovolynsk allowed preparing the application and receiving additional funding in the framework of the European Commission programme «Covenant of Mayors – Demonstration projects for Eastern Partnership» to implement «The first step towards using of renewable energy sources in Novovolynsk» project. The amount of investments equals 1 million 300 thousand euros for the implementation of energy saving measures in the city. 3) In the framework of the European Commission «Covenant of May- ors – Demonstration projects for Eastern Partnership» the request of the city of Rustavi (Georgia) was supported to implement the project «Re-equipment of three kindergartens to achieve energy efficiency and emission reduction» to the value of 809,000 EUR.

22 4) Due to the Covenant of Mayors consultant trainings the project impact spread to cities that were not the project partners. With the support of consultants several SEAPs were developed for other cities: Hola Prys- tan, Kherson region, Sumy, Dnipropetrovsk. In Georgia the Covenant of Mayors Supporting Structure contributed to the cities of Telavi and Akhaltsikhe joining the Covenant of Mayors in 2014; SEAPs for these cities were developed and adopted with a help of the Structure consultants. Five more Georgian cities joined the Covenant of Mayors in 2015 and are now working upon strategic action plans development.

The project achievements and impact on some extent is a cumulative result of the efforts of the project activity as well as events taking place in the framework of other international technical assistance programmes, including large-scale USAID «Local energy development» project. Several consultants, trained in the framework of the Association «Energy Efficient Cities of Ukraine» (EECU) «Capacity Building Model for Ukraine and Georgia for their participation in the Covenant of Mayors» project, also mentioned that they continued cooperation with the project, namely dealing with issues of SEAPs development and implementation in other cities-signatories of the Covenant of Mayors, for example the city of Sumy. Some measures to implement SEAP in the city of Hola Prystan will also be carried out with the support of the Eu- ropean Commission «Covenant of Mayors – Demonstration projects for the Eastern Partnership» Programme. In Georgia expansion of the Covenant of Mayors initiative and activity of the supporting structure continue to work in the framework of the cooperation with British Petrol and the Nordic Environ- ment Finance Corporation (NEFKO).

For further implementation of the developed strategies there is a need of government political and financial support. Now, this is the greatest risk to the sustainability of the project developments. However, the teams in the project cities gained additional skills in resource mobilization as a result of participation in the project, and existence of strategic plans helps cities to use the available limited resources to achieve the target with proven efficiency.

The involvement of the local private sector to execute the project tasks is also a factor of the project results stability. Local private companies were involved as contractors to perform design, construction, installation work and further engineering and technical support. Thus, the project interventions can be replicated and implemented at other sites of the city.

23 Review of the project structure and logic of intervention leads to the conclusion that the structure of the project applies adequate level of human and institutional capacity, avoiding unnecessary parallel mechanisms.

The project goals, objectives and activities essentially aim at achieving environmental sustainability.

EECU declared commitment to gender equality and equal access to participation in the project activities for both women and men. The list of the project experts, partners and implementers whom the interviews and meetings were conducted with, confirms that this principle was committed to.

7 PROJECT IMPLEMENTATION FEATURES IN PARTNER CITIES

In the course of evaluation all project cities were visited (except Alchevsk, which is on the territories outside the control of the Ukrainian authorities). Meetings with the project executives, experts, directly involved into the project, as well as with their partners and beneficiaries, were held. All the facilities, equipped by the financial support of the project, were visited.

UKRAINE Kamianets-Podilskyi The city of Kamianets-Podilskyi is one of the recognized leaders in implementing strategic and innovative approaches in the energy sector, one of the EECU founders and one of the first signatories of the Covenant of Mayors. Since 1999, significant changes in the management of the energy sector have been made in the city, heating networks were reconstructed, and production and installation of power, heat and water meters were established. The «Ef- ficiency improvement of energy use in city budgetary institution buildings» Programme was approved in 2008, according to which the energy management system was introduced in the public sector;

«EnergoPlan» software was developed and introduced for energy consumption audit, daily energy monitoring was established. Such consistent policy and activity system proved its effectiveness, and at the start of the «Covenant of Mayors Capacity Building Model for Ukraine and Georgia» project the city already had enough developments to be a successful role model to follow,

24 so its experience was laid in the basis of the project training materials and publications. The project Coordinator in Kamianets-Podilskyi provided expert advice and was a coach for consultants of the Covenant of Mayors. Given the previous achievements, this city-partner had more ambitious objectives: to convert SEAP into practical investment plan, provide consulting support for other four project cities in strategic documents development in order to perform obligations in the framework of the Covenant of Mayors, including SEAP development and energy management system implementation.

According to the results of monitoring visit and interviews with the city team it can be summarized that the project tasks were fully implemented. Par- ticipants in particular noted the consistent education and explanatory work with the city community. Among the main obstacles there were most often mentioned personnel changes in the city authority, which sometimes led to different visions of energy policy priorities, and related to this inconsisten- cy and slowness in decision-making. On the project participants’ opinion, a transfer of functions of several actions on energy policy performance from the executive committee of the city council to an independent energy service company could be one of the possible solutions of these problems.

Similar to other project cities, a demonstration site was equipped inKa- mianets-Podilskyi – autonomous boiler was established and heating and water supply systems were completely reconstructed in kindergarten. During the site visit there was a meeting with the project coordinator, the director of the contractor organization «Teplotekhnichni vyroby «Mayster» Ltd., the head of the kindergarten. The project participants and beneficiaries noted:

▶▶ Autonomous solid fuel boiler was equipped with the project funds, windows and water supply systems were reconstructed with the support of the city, communications were laid from the boiler to the kindergarten building and included in balance by means of supplier. The city contribution increased as compared to initially planned.

▶▶ The reconstruction will significantly increase the level of children comfort in the pre-school institution, establish the optimal temperature conditions, taking into account weather conditions and other impact factors, and reduce heating costs, including expenditure on human resources for the boiler service. New equipment will not require permanent atten- dance of boiler firemen, so that time can be used for other tasks, such as support for general improvement and landscaping.

25 ▶▶ This site was selected, first of all, due to obsolescent, inefficient and inse- cure old equipment. ▶▶ The pre-school personnel and parent community reacted to this improvement very positively and with great gratitude. However, the financial contributions were not collected from parents, because children mainly from poor or single-parent families are brought up here. ▶▶ Since this facility was refurbished at the end of the project (September 2015) and the heating season of 2015-2016 is not over yet, it is not possible to determine in full and compare the reduction in heating costs between years. However, intermediate calculations show savings. Pellets made by local businesses from secondary raw materials (waste timber production) are used in the newly built boiler. Results of the first heating season has confirmed the ease of operation, increased comfort and better conditions for inmates and staff to stay in the facility.

Novovolynsk The city of Novovolynsk was chosen for the project participation in 2012 and in four years of active cooperation it fully performed its obligations in the framework of the project. The project implementation had sufficient support from the mayor and his deputy. Despite the personnel changes in the executive committee of the city council and change of an energy manager, the city was able to develop and adopt the necessary documents, such as the city energy policy, and SEAP, to develop and implement a system to monitor the consumption of all types of energy in buildings financed from the city budget. However, not all city government agencies are engaged in daily monitoring; according to the energy manager, now, about 50% of budgetary institutions do this. To fulfil their obligations in the framework of the project Novovolynsk team received significant consulting support from EECU team for the development of the city strategic documents, including SEAP.

Support provided in the framework of the project, was a significant impulse for further development and mobilization of the resources. The experience gained by the team of executive committee of Novovolynsk during the project allowed preparing the application and receiving additional funding in the framework of the European Commission programme «Covenant of Mayors – Demonstration projects for Eastern Partnership» to implement «The first step towards using of renewable energy sources in Novovolynsk» project. The amount of investments equals 1 million 300 thousand euros for the implementation of energy saving measures in the city.

26 With the support of the project a demonstration object in Novovolynsk, the secondary school, was equipped with individual heating unit, and entrance lobby windows were replaced. This facility was chosen taking into account that part of the energy efficiency measures (replacement of most of the windows) had already been implemented at the expense of parents’ community and sponsorship. After the installation of relevant equipment one heating season passed, but due to the lack of energy use baseline, failure of temperature heat schedules and possible impact of other operational factors, such as weather conditions, it was not possible to calculate the exact level of savings and consumption reduction for the first year of operation. After consultation with the contracting organization in order to increase savings, it was decided to install additional modern radiator valves. Before the next heating season started they had been installed. The school representatives indicated increasing comfort in school in the winter period. It should be noted that the school has a large area, and when it was constructed in eighties it was designed more than for 1,000 students, but now it has no more than 500. Therefore the premises require significant investments for modernization, heating costs also amount to a large part of the city budget, but the city authorities have no right to make a decision on a more rational use of space (e.g. an association of several schools or alternative use of a part of school premises). Thus the city remains a victim of inherited social infrastructure that was built «for growth» with the expectation of an increase in the city population. This example also shows that issues of efficient use of available resources require comprehensive cross-sector solutions and are not limited to the city energy policy.

Berdiansk Berdiansk was the last city that joined the project in 2014, as the participation of Alchevsk had been minimized due to the military conflict in Donetsk region. However, it did not prevent from performance of all scheduled tasks as in other pilot cities. Berdiansk is one of the leaders in introducing innovative practices in local government and has a dynamic and change-oriented executive team. At the time of joining the project the city SEAP had been already developed. In the framework of the project the awareness-raising activities on implementation of the sustainable energy action plan were carried out among centers of public initiatives, street committees, and representatives of condominiums. In 2015 a series of information events and actions were held in the framework of Urban Energy Efficiency Month.

For the installation of a demonstration facility one of the oldest kindergartens was chosen in the city (kindergarten «Romashka» #25 was built in 1963).

27 The kindergarten was equipped with solar collectors due to climatic conditions; since Berdiansk is a southern city the use of solar energy is feasible and economically justified. Kitchen equipment (obsolete electric ovens) was replaced and uninterruptible power supply unit was installed by means of the city budget. Savings from the imposed measures in one institution was at least 30,000 UAH a year. Positive social effects of the reconstruction are increasing of institution comfort, reduction of morbidity among kindergarten children.

The city fulfilled in full its obligations on co-financing of a pilot object. Imple- mentation of the «Energy saving and energy efficiency programme in the city of Berdiansk in 2013-2017» is going on. In the framework of this programme the most energy intensive preschool educational institutions in the city will be reconstructed.

Similar to Novovolynsk, the city participation in the project gave an additional push for further successful mobilization of resources in this area. Next application prepared by employees of the executive committee of Berdiansk City Council was supported by the NEFKO Finance Corporation, which involves the installation of solar panels on all kindergartens in the city.

GEORGIA Reform of energy sector in Georgia, similar to Ukraine, is a priority of national policy. Georgia has years of experience of participation in European projects and is one of the regional leaders in supporting and promotion of the Covenant of Mayors. In parallel to the project activities in Georgia in the framework of the Eastern Partnership systematic work on development of a system for collecting quality and reliable energy statistics data was carried out. In late 2014 the Ministry of Energy of Georgia and the National Sta- tistics Service of Georgia officially presented the results of energy balance, prepared according to the international standards, in cooperation with the Ministry of Energy and GEOSTAT.

The Energy Efficiency Centre of Georgia (Tbilisi), the non-government organization, handled the project overall coordination and implementation in Georgia; in August 2014 it was awarded the status of the Covenant of Mayors Supporting Structure. The organization has years of experience, in particular it was involved into SEAP and energy management system development in Tbilisi. The example of energy policy development in Tbilisi was included into the collection of training examples from Ukraine and Georgia «What the city

28 should do to become a successful participant of the Covenant of Mayors», which was published in the framework of the project implementation. The municipality of Tbilisi took active participation in holding of Stable Energy Days. The example of Tbilisi motivated other cities and municipalities to join the Covenant of Mayors.

Rustavi Georgian self-governing city of Rustavi joined the Covenant of Mayors in 2011, so at the beginning of the project the development of SEAP had already been started.

One demonstration facility was equipped in the framework of the project. As a result of the kindergarten reconstruction (replacement of windows, doors, heat insulation and installation of solar collectors) the sanitation conditions in the preschool were improved. As well thanks to these measures the attention of the preschool personnel and parent community was attracted to energy efficiency and energy conservation issues, although initially parents and the kindergarten management disbelieved in the success of this initiative.

The project implementation in Rustavi resulted in launching of a new project of the European Commission – SUDeP.

Gori The city of Gori joined the Covenant of Mayors during the project implementation in 2012. In Gori the project activities were implemented in full, the partnership financial obligations of the municipality were met. After installation of an demonstration facility – a kindergarten, according to the opinion of participants and beneficiaries of the project the following things can be noted: the improvement of working conditions of the kindergarten personnel, improved comfort and related hygienic conditions for pupils of the kindergarten, and increase of parents’ confidence on the quality of services, provided by the municipal institution.

General impressions of Georgian partners on participation in the project are rather positive. The participants consider the received skills and competence of project management and experts training to be the most important achievement of the project. Meanwhile Georgian participants noted that their skills were not always sufficient to develop SEAP of good quality. The problem of experts training remains relevant. The changes of decision mak- ers in local government after the elections were mentioned as a main ob-

29 stacle to the project implementation in the cities of Georgia. New people slowly entered the project, thus its support was greatly weakened, leading to disruption of the project. However, the team managed to establish new relationships and continue to promote and meet obligations in the framework of the Covenant of Mayors.

Direct communication with the cities allowed establishing closer professional contacts, strengthening understanding of working principles of donor structures. Georgian colleagues noted that relationships with Ukrainian partners were very good; the information from the project head office (EECU) was received in time and in full. Especially positive feedback was given to printed educational materials for their availability in the presentation of the material, practical advice and detailed instructions on the implementation of energy efficiency activities.

After the project was completed work on energy efficiency implementation in Georgia has been continuing. In December 2015, at the conference «Lo- cal government – best practices 2015» in Tbilisi energy efficient projects on street lighting in Rustavi and heat system modernization of historic building in Telavi were recognized as the best. The both projects were implemented with the participation of the Covenant of Mayors Supporting Structure «En- ergy Efficiency Center in Georgia». Taking into account high interest in joining the Covenant of Mayors by municipalities and increase of the signatories in Georgia, in 2015 the Ministry of Foreign Affairs of Denmark and the NEFCO Corporation signed an agreement on establishment of a trust fund, which would provide financial support in energy efficiency demonstration project implementation in Georgia. The new fund will have in its disposal about 1.6 million euros. Also a relevant agreement on cooperation between the Government of Georgia and the NEFCO Corporation was signed.

30 OVERALL CONCLUSIONS BASED ON THE RESULTS OF THE PROJECT IMPLE- MENTATION IN THE PARTNER CITIES

1 The city commitments and planned activities in the framework of the project are implemented in full.

2 Main factors contributing to the project success are political support of the city leaders and deputy corps understanding of the key principles of sustainable energy development.

3 In most cases the project contributed to mobilization of additional resources.

4 The participants highly appreciated the opportunities, provided by participation in the network international project, in particular expansion of communication circle, opportunities to estimate advanced experience of other cities and use best practices, and take into the consideration unsuccessful experience and mistakes of others.

5 The participants highly appreciated professional level of EECU team in providing technical support, holding educational and training programmes, organizing advocacy and communicative activities of the project.

6 The representatives of the project cities take a favourable view of project management level on a part of EECU; in particular they mention positive experience of communication, curatorial support, and timely provision of information on all aspects of the project implementation on the part of EECU head office.

7 Selection of the demonstrational facilities. Local partners noted several factors taken into account when selecting facilities for reconstruction and improvement in the framework of the project: ▶▶ Economic: the propose interventions had to have a short payback period, and proven effectiveness of financial expenses. ▶▶ Technologic: the proposed technologies had to contribute to rational energy supply and energy consumption, namely to supply energy in accordance to real needs and provide opportunities to load management. Spe- cial attention was paid to energy supply security issues – the possibility

31 to ensure stable energy supply, minimize breakages, and generate energy from different sources. ▶▶ Environmental: proposed technologies and re-equipment had to help to reduce pollutant emissions into the air, use local fuels, and promote sustainable environmental development. ▶▶ Social: repair and renovation of objects of social infrastructure aimed to increase comfort, safety for users, and compliance with health standards.

8 ACTIVITY OF CONSULTANTS

In the framework of the project a training programme for the Covenant of Mayors consultants was held. Later they will provide services for municipalities in preparations to join the Covenant, development of SEAP, and planning of activity for implementation. In the framework of the project ten consultants were trained in Georgia and Ukraine. During the project evaluation meetings and interviews were held with all consultants in order to evaluate a level of their engagement into consultative activity within the Covenant Sup- porting Structures or other initiatives related to energy efficiency. Most of the interviewed (9 of 10) confirmed that they continue to work productively in the field of energy saving and energy efficiency, providing services in the framework of cooperation with the Covenant Supporting Structures, as well as in cooperation with energy service companies. The consultants named the following types of works and services, which are provided by them after participation in the project trainings:

▶▶ municipal energy planning; ▶▶ SEAP development; ▶▶ energy audit in central heating systems, residential and public buildings; ▶▶ business planning and investment programmes development; trainings for representatives of municipalities and stakeholders; information on implementation of energy efficient and energy saving activities; ▶▶ services on improvement of energy management system in city adminis- tration according to international ISO 50001 standard; ▶▶ organization of public meeting with producers of energy efficient and energy saving equipment; ▶▶ municipal environmental management; ▶▶ consulting for the city government on how to join the Covenant of May- ors; ▶▶ usage of the gain knowledge during teaching activity.

32 Most of the consultants took part in all training events organized in the framework of the project. The participants evaluated EECU training programme as complex, innovative and practical; they also marked high professional level of the trainers. The consultants underlined the following topics as the most interesting and useful for them: ▶▶ preparation of emission inventory; methodology of SEAP development; energy management; ▶▶ financial appraisal of the project, activities, and preparation grounds for a bank; ▶▶ energy audit.

Based on the results of the interviews with the consultants it could be concluded that knowledge gained in the framework of the project is being used, experience is being expanded to other cities, consulting is being held in close collaboration with other projects of international technical assistance. The consultants, who work in energy service companies, noted that they also transfer the knowledge gained at the trainings to coworkers through so called «trainings on working place».

The consultants communicate with each other on informal level, and share information. An idea to develop a network of consultants and promote their abilities of providing services were expressed repeatedly, however it has not been yet implemented. On the consultants’ opinion, EECU could coordinate such cooperation, and provide organizational support for engaging consultants into providing services for clients, first of all, for municipalities.

After the trainings the consultants execute orders of SEAP development for Dnipropetrovsk, Kryvyi Rih, Sumy, Hola Prystan, partly for Ternopil and Kyiv. With the assistance of the consultants the process of preparation for signing the Covenant of Mayors was started not only by cities, but small towns as well. For example, small towns Velyka Oleksandrivka, Novoraysk, Hryhorivka of Chaplynskyi district in Kherson region expressed their interest to join the Covenant.

Among the most common problems and obstacles which slow down the implementation of energy saving and energy efficient activities the following were mentioned most often:

▶▶ The pace of adoption of documents, developed with the participation of consultants, was different in each city. For example, SEAP in Dnipropetro-

33 vsk was approved quickly, because the city government had the political will and support, but this city can hardly be compared with others – it is leading on many fronts. On the other hand, after the change of whole deputy corps in Sumy, consideration of SEAP was suspended because new deputies had weak understanding of the importance of these activities. Not all deputies are aware of the Covenant of Mayors; they do not understand the benefits of the city participation in the initiative.

▶▶ Representatives of local authorities do not have enough knowledge about energy efficiency, energy conservation; this is due to high turnover in local authorities and officials and weak awareness of these issues. When a city mayor approves implementation and promotion of energy efficient activity, then the main work is usually carried out by several enthusiasts, and really seldom cities form a team of experts on energy efficiency.

▶▶ Lack of public support – sometimes members of the public do not support or require any changes, and often they are even on opposite side for innovation.

▶▶ Implementation of energy efficiency activity in rural areas is very limited due to the lack of finances. The infrastructure is in poor condition because maintenance of water supply system, roads, and communications are set as priority in most towns and villages. However reduction of the heating cost is now a priority for all customers.

▶▶ Consulting assistance by the Covenant of Mayors Supporting Structures is very useful; however the issue of funding for energy efficiency activity is a key one, especially in rural areas. Representatives of local authorities do not have enough knowledge about the possibility of attracting additional funding through international programmes as well as through specific practices on resource mobilization (government programmes, grant programmes, preferential loans, etc.).

▶▶ The involvement of consultants into providing services to other participants of EECU was not carried out systematically. Conventionally, the consultants were assigned to the cities, but in fact – work on finding customers was performed independently by the consultants; the project partners from Georgian side proposed to make it in an orderly way. The plans of the Georgian colleagues were to establish an association of consultants that will make this expert resource more sustainable, facilitate further improvement of qualifications and skills development of the consultants.

34 Proposed topics for future trainings ▶▶ Public transport (electric and cycling transport, biofuel usage, optimiza- tion of public transport system). ▶▶ Practice of implementation of SEAP «soft» measures in the citiesof Ukraine. ▶▶ Experience of energy efficient measures implementation in condominiums in Ukraine. ▶▶ Experience of energy efficient measures implementation in housing sector. ▶▶ Experience of energy efficient measures implementation in municipal sector. ▶▶ Possibilities of financing from the State Fund for Regional Development. ▶▶ Mobilization of resources and search for financing (incl. for implementation of the activity in rural areas).

9 PROBLEMS AND WEAKNESSES

Interviews with the project participants showed a number of problems which prevented the achievement of results, in particular:

1. Approaches that are used for limitation of power consumption by var- ious budgetary institutions. Limits set for public institutions that can be changed depending on actual energy consumption sometimes play a negative role – consumers of services are not interested in saving, as funding for the next period can be reduced. To be able to take advan- tage of the savings and redirect it to other needs of the city, ingenious solutions have to be found that may conflict with applicable legal requirements.

2. Motivation and interest of consumers, employers, and government -of ficials are an essential requirement for the development of efficient energy management system. Monitoring of energy consumption falls on the shoulders of state employees, executive bodies, which human resources are typically very limited. Therefore, people who carry out energy monitoring on a daily routine basis, should understand the consequences and benefits of such work (improvement of comfort in institution, use of savings for other pressing problems of institution). If this is not the case, then in the eyes of executives, this process seems

35 like «measurement for measurement» that inevitably leads to loss of interest and motivation.

3. Lack of human resources for the implementation of coherent policy and frequent changes of personnel in local government.

4. It is not always possible to prove direct economic effect from interventions implemented on pilot facilities in the short term (i.e. within the project time frame) due to lack of properly established energy consumption baseline in institution. Such problem arose during installation of individual heat point (IHP) in Novovolynsk school. One heating season has passed after the relevant equipment installation, however due to the lack of energy consumption baseline, failure of temperature heat schedules and the possible impact of other operational factors such as weather conditions, there was impossible to calculate real energy saving level and consumption reduction. At the same time the consumers confirmed considerable comfort enhancement in the educational institution during winter period.

5. During the equipment of the pilot facilities in Kamianets-Podilskyi (construction of autonomous boiler and reconstruction of heating system in the kindergarten) the executers faced a delay of developing and ap- proving the project and authorization documents that slowed down the setting into operation.

6. In the framework of the EECU project the consultants were trained who could continue providing consultative support for municipalities to meet the Covenant of Mayors commitments even beyond the termi- nation of the donor support.

However, the possibilities of these professionals are not always used, what threatens with the loss of valuable human resources and experience. More often such fears were expressed by Georgian consultants. Currently, on local and regional level the biggest demand is for consultants who are directly related to energy service companies and work in energy saving and energy efficiency branch. The experts trained in the framework of the project provide consultations to commercial organizations and municipalities. The latter the most often happens through donor funding or within the framework of other international assistance projects.

36 10 REVIEW OF PROCEDURES FOR PROJECTS AND EECU MONITORING AND EVALUATION General provisions on monitoring and evaluation of the project are included in several separate documents – the Project Logical Framework and Project Monitoring and Evaluation Plan. These documents are the framework and do not contain detailed instructions on monitoring procedures. Evaluation showed that overall during the project the information for monitoring was gathered regularly and is sufficient for report to the donor. However, many components of monitoring and evaluation are not documented properly, do not contain detailed instructions for the performers, do not involve elements of data quality control, and data collection and analysis system is not clearly structured. It can be concluded that EECU activity monitoring procedures are formalized, maintained by the daily practice and vary depending on the specific project. However, monitoring and evaluation system is not formalized in a written form at the level of the organization specific policy and is not generalized in the operating manual on these issues. The absence of such documents can be a risk factor for the sustainability of the organization, for example, in the case of EECU personnel changes. The second aspect: carrying out of the monitoring only for individual projects does not allow EECU management seeing a complete picture of the organization activity.

Given the huge number of projects and considerable amount of work performed by EECU, it needs a developed system for monitoring and evaluation, which determines procedure for monitoring and evaluation of the organization activity in general and its separate projects. Requirements and procedures for collecting, storing, analysing, frequency, accuracy and complete- ness of the data should be regulated; there is a need to develop applications with standardized application samples, questionnaires for different stages of work and different target groups.

Previous version of the Operational Manual on Monitoring and Evaluation for EECU is provided in the annex and is the basis for further improvement and practical testing in EECU.

Particular attention should be paid to evaluation indicators development- cor respondingly to the goal of each project in order to monitor progress and in- corporate these data in decision making. It is necessary to have a plan for monitoring and evaluation of the organization activity with a list of indicators for each year, their detailed description, baseline and target values, sources and tools for data collection, budget and persons responsible for implementation.

37 One of the modern alternative approaches for project results monitoring, which is carried out at the community level and needs support and approval of the community, is public audit. Public audit is relatively a new approach that goes beyond the framework of traditional financial audit and involves public representatives (citizens, representatives of local authority and local most active members, civil society organizations) to discuss the report on the project implementation results, to confirm the principles of integrity during its implementation, to demonstrate benefits for all participants (such as cost savings, increased comfort, environmental security, etc.). The use of this evaluation tool is particularly appropriate in circumstances where the share of funds for its implementation is raised by community (tenants of house, parents of children who attend kindergarten or school); this openness promotes building of trust and a sense of ownership and responsibility for renovated facility.

11 COMMUNICATION AND PUBLIC ACTIVITY

The communication component was one of the key and the brightest components of the project. Each year, over several days a number of measures in the partner municipalities took place to attract the attention of residents and city leaders to energy saving issues. Mostly the activities were aimed at youth and student audience.

Key feature of Sustainable Energy Days was a combination of elements of sci- ence and education and demonstration of practical ways how to use energy and natural resources rationally in daily life. These events were widely covered by local mass media and electronic media. These measures also contributed to public dissemination of information on the participation and support provided by the European Commission for the project implementation. All the project participants and partners were informed and instructed on how to comply with the requirements for labelling and branding of the project activity. The requirements are posted in the relevant EU document «Guide to Communication» under the link http://ec.europa.eu/europeaid/ work/visibility/index_en.htm

Demonstration facilities on updated social infrastructure were marked with information with logos, project titles and text about support provided by the EC in the framework of the project. EECU quarterly newsletters, though they

38 were not funded in the framework of the project, regularly covered the project activity and progress of the Covenant of Mayors activity implementation in Ukraine.

Detailed methodology on how to hold Sustainable Energy Days is described in a separate collection «The EU Tips on organizing Energy Days», prepared by EECU in 2015. Public actions «Sustainable Energy Days» could be considered the project «best practices» that can be useful for experiences ex- change and use outside the context of the theme of the project, for example in public health educational and prevention programmes.

12 REVIEW OF INTERNATIONAL TECHNICAL ASSISTANCE

As energy saving and energy efficiency are priority objectives for the -Gov ernment of Ukraine, this theme is also reflected in the strategies of most international development agencies and international organizations- work ing in Ukraine. This trend is recognized as a priority by the Swiss Agency for Development and Cooperation (SDC), the Agency for International Develop- ment (USAID), the German Society for International Cooperation (GIZ), the Swedish International Development Cooperation Agency (Sida),

the Neighbourhood Programme 2013-2017 funded by Danish Internation- al Development Agency (DANIDA), the Canadian International Development Agency (CIDA), the Delegation of the European Union and the Council of Eu- rope, the United Nations Development Programme (UNDP). Many donors also considered this issue integrated with the issues of decentralization, improvement of local government mechanisms, support for newly established united territorial communities and in the context of inter-municipal cooperation.

Some programmes operate on national level and cover all regions of Ukraine, while others have «cluster» geographical structure. Some of them are fully dedicated to local government issues, while energy efficiency is cross-cutting theme.

The following themes of projects and programmes can be defined: Infra- structural – aimed at reconstruction or development of infrastructure facil-

39 ities and foresee design and construction activities, purchase of equipment, machinery, etc., in particular, in regions affected by armed conflict. Most of them are related to implementation of new models of management and quality increase of energy efficiency and public services and utilities. The projects aimed at competence development and strengthen of professional capacity among representatives of local authorities, non-governmental organizations, local community leaders, and have strong education component. Consultative projects on technical and expert supportfor creating development strategies and plans, territorial community statutes, mechanisms of cit- izen participation in these processes. Possessing significant experience and professional potential EECU can consider possibilities to broaden its activity and look for additional funding in the light of donors current priorities.

13 RECOMMENDATIONS

1 EECU team should use logical framework approach as a generally ac- cepted and modern tool for new projects development and management processes. This approach is used as a tool for planning and management in projects and programmes implemented by the European Commission, the UN, the World Bank, the US Agency for International Development, the Swiss Agency for Development and Cooperation and other international institutions that provide technical assistance and funding for energy efficiency and energy saving activity and policy support.

2 To develop indicator system, which will help to monitor EECU activity results, not just separate projects. Indicators of different levels should be developed (processes, results and long-term effect), as well as supporting documents – indicator passport with specifying data sources, frequency of collection, persons responsible for the collection, storage and quality data control. Such documents will strengthen organizational capacity and sustainability of the organization, and greatly facilitate the process of preparing and submitting projects to raise funds for the implementation of EECU statutory activity.

3 In order to improve these processes in addition to the logical framework EECU can use the theory of change tool, which allows graphically depicting the logic, relationships and consistency of intervention, iden-

40 tifying gaps and timely considering the new needs arising due to the context changes. This tool also allows considering how external factors can affect or hinder the achievement of planned objectives.

4 To develop detailed operational guidelines on monitoring and evaluation with consolidated information on requirements, procedures and tools for monitoring and evaluation in order to improve EECU monitoring and evaluation system. Efficient monitoring and evaluation system is a key requirement for transparency and accountability of the organization activity.

5 To develop indicators and methods for evaluation of behaviour changes of target group representatives by virtue of informational and educational activity.

6 To support strengthening of organizational development of the association members and partner organizations, in particular through the development of planning, monitoring and reporting skills in accordance with the donors requirements on implementation of projects focused on the result.

7 To review and agree data collection tools according to certain indicators, including those that allow monitoring of compliance with the principles of gender equality.

8 To perform periodical analysis of informational needs of the association members and offer relevant consultative and training services in order to strengthen EECU leadership position.

9 To consider possibility of transferring training courses developed by EECU into an online format in order to expand access to knowledge for more participants. Given the rapid changes in the country, training materials in certain aspects lose their relevance. Training materials can be timely updated by means of open educational on-line platforms.

10 Due to a large number of EECU partner organizations the opportunities of open electronic public services for needs assessment, information gathering, and questionnaires testing and conducting should be used in order to optimise time and human resources. For example, in order to evaluate how the training participants use gain knowledge 3, 6 or 12

41 months after participating in training or coordinate joint programme of the event, the online platform with a set of templates for rapid surveys can be used.

11 To consider possibility of using public audit model of demonstration projects (facilities) implemented with the participation of EECU in- or der to increase community confidence and involvement of citizens into the implementation of energy efficiency projects.

12 To study opportunities and provide support for publication of information on EECU activity on the web-sites of partner organizations, and integrated resources of other donors. To encourage the project participants to present their achievements on contests of best practices of local government in Ukraine and Georgia.

13 To develop and publish short informational and consultative materials for newly elected deputies with basic information and infographic, which demonstrate advantages and economic feasibility of energy efficiency and energy saving activity.

14 The Covenant of Mayors signatories should develop a short description of SEAP main measures in English in order to disseminate the information among potential investors and publish in document base on the Covenant of Mayors web-site.

15 To analyse and share the information on new possibilities of mobilization and fundraising related to financial innovations in the context of decentralization with EECU participants.

16 To continue to monitor stability and long-term effect of the project through monitoring of progress of sustainable energy action plan implementation, developed by cities with participation of the Covenant of Mayors Supporting Structures.

42 LIST OF ABBREVIATIONS

EECU Association «Energy Efficient Cities of Ukraine» USAID U.S. Agency for International Development EC European Commission EU European Union UN United Nations SEAP Sustainable Energy Action Plan IHP Individual heating point CoM the Covenant of Mayors CIDA Canadian International Development Agency GIZ Deutsche Gesellschaft fuer Internationale Zusammenarbeit DANIDA Danish Development Cooperation ED Light-emitting diode NEFCO Nordic Environment Finance Corporation SDC Swiss Development Cooperation SIDA Swedish International Development Cooperation Agency SUDeP Sustainable Urban Demonstration Projects UNDP United Nation Development Program USAID United States Agency for International Development WB IEG World Bank Independent Evaluation Group

43 LIST OF REFERENCES

Newsletters of the Association «Energy Efficient Cities of Ukraine», 2013, 2014, 2015.

Newsletters of «Covenant of Mayors Capacity Building Model for Ukraine and Geor- gia» Project, 2012-2013. http://eecu-comogrant.org.ua/about/downloads/informatsijnyj-visnyk- proektu/

State Target Economic Programme on Energy Efficiency and the Development of Energy Production from Renewable Energy Sources and Alternative fuels for 2010- 2015.

Decision of the Cabinet of Ministers of Ukraine of November 1, 2015, #929 «On the extension of the implementation of the State Target Economic Energy Efficiency Pro- gramme and Development of Energy Production from Renewable Energy Sources and Alternative Fuels for 2010-2015».

Sustainable Energy Action Plan for the city of Novovolynsk by 2020.

Sustainable Energy Action Plan for the city of Berdiansk by 2020.

Decision of Berdiansk City Council of Zaporizhia region #1 of July 12, 2013 «On joining «The Covenant of Mayors» European Initiative.

Decision of Berdiansk City Council of Zaporizhia region #21 of April 17, 2014 «On approval of the Programme «Berdiansk Sustainable Energy Action Plan by 2020» in the framework of the European Commission Project «The Covenant of Mayors – East» implementation».

Decision of Kamianets-Podilskyi City Council of Khmelnytskyi region of December 8, 2008 «On joining «The Covenant of Mayors» European Initiative.

44 Decision of Novovolynsk City Council #36/4 of April 29, 2014 «On approval of the Programme «Novovolynsk Sustainable Energy Action Plan by 2020».

Decision of Novovolynsk City Council of Volyn region #20/19 of November 8, 2012 «On joining «The Covenant of Mayors» European Initiative.

What the city should do to become successful participant of the Covenant of Mayors. Guidelines for local government authorities – Lviv, «IDEA Studio», 2013 – 95p.

What you should know while ordering energy audit. Guidelines for local government authorities – Lviv, «IDEA Studio», 2015 – 20p.

What the city should do to become successful participant of the Covenant of Mayors. Case study from Ukraine and Georgia – Lviv, 2013 – 57p.

NEFCO news. Information bulletin of Nordic Environment Finance Corporation #1/15, June 2015.

Jody Zall Kusek, Ray C. Rist. Ten steps to a result-based monitoring and evaluation system: a handbook for development practitioners / The International Bank for Re- construction and Development / The World Bank. - 2004.

Reform Cooperation in Eastern Europe, the Western Balkans and Turkey - a summary of Sweden’s strategy for 2014-2020

Results Oriented Monitoring Handbook March 2015 (Version 2.0). Instructions and guidance for ROM reviews and support to end-of-project results reporting for projects and programmes financed by the European Union within the framework of its external assistance.

45 Swiss cooperation strategy for Ukraine: 2015 - 2018 / Swiss Agency for Development and Cooperation (SDC), the State Secretariat for Economic Affairs (SECO), the Direc- torate of Political Affairs (DP). - 2015.

The Right to a Better Life. Strategy for Denmark’s Development Cooperation

Third Interim Narrative Report of the project ‘Covenant of Mayors Capacity Building Model for Ukraine and Georgia - Model Solution for Eastern Partnership and Central Asian Countries for the period 30.12.2013 - 29.12.2014.

Grant application Form: Covenant of Mayors Capacity Building Model for Ukraine and Georgia / Model Solution for Eastern Partnership and Central Asian Countries.

46 WEB-SITES

«Covenant of Mayors Capacity Building Model for Ukraine and Georgia» Project web-site http://eecu-comogrant.org.ua/ Association «Energy Efficient Cities of Ukraine» web-site http://enefcities.org.ua Energy Efficiency Centre in Georgia web-site http://www.eecgeo.org The Covenant of Mayors web-site http://www.uhodameriv.eu/index_uk.html Novovolynsk City Council official web-site http://www.novovolynsk-rada.gov.ua Berdiansk City Council official web-site http://bmr.gov.ua Kamianets-Podilskyi City Council official web-site http://www.kam-pod.gov.ua

47 -

- Annex 1 EFFECTS Reduction of greenhouse of greenhouse Reduction emissions. gas use of renew Increased sources. able energy to directed are Savings other needs of the city for of the quali improvement of residents. ty of life RESULTS LONG-TERM There are mechanisms for mechanisms for are There financial resource attracting attracting resource financial Municipalities of Ukraine and Municipalities of Ukraine join the CoM and Georgia fulfill the obligations. of budgetary The employees are residents and institutions to the principles of committed and energy efficiency energy in daily practice. saving - - RESULTS personnel turnover turnover personnel SHORT-TERM Stable executive team and low team and low executive Stable Municipalities are aware of the CoM aware Municipalities are of joining it. procedure and the initiative have of municipalities Representatives to per and skills knowledge sufficient in the framework the obligations form of the CoM. are Strategies Energy City Sustainable and implemented. approved of municipalities structures Relevant are executors responsible adapted, are appointed. renew and efficiency energy Increased in buildings of public usage able energy in pilot cities, demonstrated sector comfort. and increased advantages on climate awareness general Increased in the among the community change pilot cities. efficiency energy support for Developed implementation. measures and on the benefits Information and energy saving principles of energy target for different available is efficiency groups. - - efficient measures measures efficient PRODUCTS Local authority understands authority understands Local importance and support energy and support energy importance Programme software is adapted and is adapted software Programme trained. are professionals of the Supporting Struc Consultants tures and the Energy Agency on the Agency and the Energy tures trained. CoM issues are - devel cities are in the project SEAPs oped and approved. cities is in one of the project SEAP plan. an investment into transformed for system management Energy in public buildings is implemented cities. the project of sites demonstration Equipped social services (schools, budgetary lighting). street kindergartens, of infor experience Documented work with and educational mational and students. youth in mass announcements Regular media. bulletin EECU modern web-site, EECU publishment. regular Materials on the Covenant of Mayors of Mayors on the Covenant Materials city councils. for developed are - on national level level on national There is political support is political There PROCESSES emission registry 2 "Sustainable Energy Days" holding. Days" Energy "Sustainable Selection of appropriate methodologies methodologies Selection of appropriate tools and their adaptation and software conditions. and Georgian Ukrainian to based on the guidelines course Training tools. and adapted of the and promotion Development in Georgia. Supporter Covenant of the and promotion Development in Ukraine. Agency Energy Covenant cities in the the project Support for prototype. of SEAP development cities in the the project Support for of municipal energy development system. management cities in the de the project Support for management of an energy velopment their public buildings and for system СО Development of guidelines on political of guidelines on political Development for preparation and organizational Mayors of Covenant in the participation city councils for Energy efficiency and renewable energy energy renewable and efficiency Energy public buildings in the for measures pilot cities. - mate and educational Informational in coverage and topic users rials for media. ASSUMPTIONS: practices practices finances EC funds EC personnel personnel personnel personnel THEORY OF CHANGES OF «Covenant of Mayors Capacity Building Model for Ukraine and Georgia» Project and Georgia» Ukraine Capacity Building Model for of Mayors OF «Covenant OF CHANGES THEORY for direction for Local budget budget Local CONTRIBUTIONS Local authority Local assistance in theassistance Political support Political Experience of best Experience of best framework of CoM framework EECU experienced experienced EECU Expert and technical Project financing by financing Project supporting structuressupporting

48 Annex 2

TEMPLATE OF LOGICAL FRAMEWORK

according to the annex on standard package of documents which have been used for development of the EC new projects since January 1, 2015

Resources and Intervention logic Indicators Basic Target methods for review Assumptions

General goal: Wider long-term changes Long-term Ideally set in Ideally set in National data from effect which will take place changes are the country the country the country strategy as a result of certain measured on a strategy strategy documents. events and activity of level of country documents. documents. governmental and donor or sector. For institutions influenced example, literacy (indirectly) by ACTIVITIES rate. funded by the European Union.

Specific goals: Medium-term effects Usually the Entry level or Value of Sources of Factors beyond result of the project activity project cannot current value indicator information the control usually appear in behavior collect such data of indicator. which is and methods of project changes as a result of the itself. Changes planned to for collecting management, project activity. Activity of factors that reach. and reporting which may affect funded by the EC lead to determine result (indicating who, the relationship these changes. are measured. when and how between project For example, often collects). products and number of results. children enrolled in/graduated from school (data broken down by gender).

Products Direct/tangible products Same as above Same as Same as Sources of Factors beyond (infrastructure, goods for the relevant above for above for information and the control and services) produced indicator. the relevant the relevant methods for of project as a result of the project indicator. indicator. collecting and management, activities. They can reporting which may affect be directly controlled (Indicating who, the relationship and financed by donor when and how between project support. often collects) products and results.

49 Annex 3 Додаток 3 PHOTOS TAKEN DURING MONITORING VISITS СВІТЛИНИ З МОНІТОРИНГОВИХ ВІЗИТІВ Kamianets-Podilskyi Кам'янець-Подільський TheДемонстраційний demonstration об'єкт: facility: ко тautonomousельня автономног heatingо опалення boiler and та reconstruction заміна систем of waterводо- таand теплопостачання heat supply systems у дитячом in theу садку kindergarten

51 50 Novovolynsk

DemonstrationНововолинськ facility: windows reconstruction and individual heat point in the secondary school Демонстраційний об'єкт: заміна вікон та встановлення індивідуального теплового пункту у середній школі

52 51 Berdiansk Бердянськ

TheДемонстраційний demonstration об'єкт: facility: ут еплення,heat insulation, встановлення solar сонячнихcollectors коinstallation,лекторів, heat supplyзаміна систsystemеми reconstruction теплопостачання in у the дитячом kindergartenу садку

52 Rustavi Руставі The demonstration facility: heat insulation, solar collectors installation, win- dowsДемо нandстр аheatційн supplyий об' єsystemкт: уте reconstructionплення, встано inвл еtheнн яkindergarten сонячних колекторів, заміна вікон та системи теплопостачання у дитячому садку

53 Gori Ґорі The demonstration facility: heat insulation, solar collectors installation, win- dowsДемо нandстр аheatційн supplyий об' єsystemкт: уте reconstructionплення, встано inвл еtheнн яkindergarten сонячних колекторів, заміна вікон та системи теплопостачання у дитячому садку

Додаток 4

55 54 SEMI-STRUCTURES INTERVIEW QUESTIONNAIRE

Good day! On behalf of the Association «Energy Efficient Cities of Ukraine», I perform an evaluation of the project «Covenant of Mayors Capacity Build- ing Model for Ukraine and Georgia», implemented during December 2011 – September 2015. Thank you for your time and participating in this study. The evaluation goal is to determine how effectively and efficiently the project objectives were implemented. The evaluation is carried out on the basis of the project implementation, and its results will be used for improvement of further projects planning, development, implementation and monitoring.

______date ______time

______city

1. Please, indicate your role in the project Participants (noted): The project representative Local authority representative Representative of the institution Representative of the contracting organization Member of public Participant of training Consultant Other 2. Are you aware of the project main goals? 3. On your opinion were the measures for the project stated goals chosen correctly? 4. What activity would be worth to add, which were inappropriate? 5. What are the project main lessons learned? 6. Where the activity implemented efficiently and in full? 7. Are there any additional (not foreseen by the project) results, consequences? Which in particular (positive, negative)? 8. What obstacles did you face with? 9. Are the achieved results stable? Did the project give an impetus to new initiatives (which ones)? 10. How did the city benefit from the participating in the project? What is

55 the economic effect of the project? What is the social effect of the project? 11. What were the differences between project implementation processes in the partner cities in Ukraine? How was the communication and coordination with other cities of the project provided? What were the results of such communication? 12. What could have been done differently/better during the project planning and implementation?

13. How was the communication between EECU workers, partners in other cities, which participated in the project implementation, provided? – Did you get the information in time from the project head office? – Did you receive printed (informational) materials? Were they in sufficient amount? – Were you provided with written guidelines on the project reporting? Did you get the report schedule?

Site visits: 1. Why this specific site was chosen? How was the decision on its priority adopted? 2. Is it fully brought into operation? What was the project contribution? The city contribution? 3. What are the economic consequences? How were the calculations made (were there initial, primary data, which could be compared to current situation)? 4. What are the social consequences of its launching? Who benefited the most from its launching? 5. How does the community appreciate this? And direct consumers (such as)?

Involvement/mobilization of the community: 6. How is support on the project initiative for the community provided? 7. How is the community informed? 8. How did Stable Energy Days take place? 9. What other events were held? Which of them will be continued after the project completion?