Ex Post Evaluation Europe for Citizens 2007-2013
Total Page:16
File Type:pdf, Size:1020Kb
Ex-post evaluation of the Europe for Citizens Programme 2007-2013 Annexes to the Final report Coffey International and Deloitte September 2015 EUROPEAN COMMISSION EUROPEAN COMMISSION Directorate-General for Migration and Home Affairs Directorate A – Strategy and General Affairs Unit A1 — Inter-institutional Relations and Citizenship European Commission B-1049 Brussels EUROPEAN COMMISSION Ex-post evaluation of the Europe for Citizens Programme 2007-2013 Annexes to the Final report EUROPEAN COMMISSION Europe Direct is a service to help you find answers to your questions about the European Union. Freephone number (*): 00 800 6 7 8 9 10 11 (*) The information given is free, as are most calls (though some operators, phone boxes or hotels may charge you). LEGAL NOTICE This document has been prepared for the European Commission however it reflects the views only of the authors, and the Commission cannot be held responsible for any use which may be made of the information contained therein. More information on the European Union is available on the Internet (http://www.europa.eu). Luxembourg: Publications Office of the European Union, 2015 ISBN [number] doi:[number] © European Union, 2015 Reproduction is authorised provided the source is acknowledged. EUROPEAN COMMISSION Ex post evaluation of the Europe for Citizens Programme 2007-2013 Authors: Bradford Rohmer and Irina Jefferies, with the support of David Kerr, Bryony Hoskins and Wiel Veugelers Contents 1. SYSTEMATIC REVIEW ............................................................................................2 2. INTERVIEWS AND FOCUS GROUP WITH KEY STAKEHOLDERS ................................... 34 3. SURVEY OF UNSUCESSFUL APPLICANTS ................................................................ 47 4. CASE STUDIES ................................................................................................... 58 5. BENCHMARKING ............................................................................................... 131 September 2015 1 EUROPEAN COMMISSION 1. SYSTEMATIC REVIEW Introduction During the data collection phase, our initial analysis of the EFCP was complemented by a systematic review of literature aimed at scrutinising the programme’s intervention logic, and its underlying assumptions, in relation to existing knowledge about participatory citizenship. The systematic review was based on sources suggested by the evaluation’s expert panel. These included: Background documentation on the EFCP reviewed during the evaluation’s inception phase (as listed in Annex 1 of the inception report) EFCP website1 Web of Science™ Core Collection2 (35,976,408 records) Evidence for Policy and Practice Information and Co-ordinating Centre (EPPI- Centre)3 The Campbell Collaboration4 (Paper) issues of the Citizens Studies journal (vol. 1 to 19) The output of the systematic review was the collection of evidence informing how participatory citizenship works and what explanatory factors exist of the effects of certain interventions aimed at fostering participation. Methodology The starting point for the systematic review was an assessment of the underlying assumptions in the programme’s design. These were identified through the review of background documentation on the EFCP (e.g. policy documentation, programme guide, reports from prior evaluations etc.) and an in-depth examination of its intervention logic. These assumptions point out to specific mechanisms which are understood as the (assumed) drivers of change. Based on some key concepts in the underlying assumptions (marked in bold in Table 1 overleaf), the evaluators developed a list of key words to conduct a rapid search on 1 https://eacea.ec.europa.eu/europe-for-citizens_en 2 The Web of Science™ Core Collection provides access to worldwide citation databases, covering over 12,000 journals across more than 250 disciplines. 3 The EPPI-Centre is part of the Social Science Research Unit of the Institute of Education at the University of London (http://eppi.ioe.ac.uk/cms/) 4 The Campbell Collaboration is an international research network that produces systematic reviews of the effects of social interventions in Crime & Justice, Education, International Development, and Social Welfare (http://www.campbellcollaboration.org/) September 2015 2 EUROPEAN COMMISSION Web of Science™ Core Collection and other sources. The purpose of this search was to find empirical evidence that supported/contradicted the assumptions, mechanisms and processes that are part of the EFCP’s design. This included the search for evidence that may have not been taken into account during the programme’s design, but that would be relevant to consider in the future. Table 1: Underlying assumptions of the EFCP’s intervention logic Theme Description Intensity and complexity Complex processes, related to civic engagement, can be adequately influenced by relatively small projects (for example one-off twinning events), where the intervention dosage (or the treatment intensity) is quite limited. Attitudinal and behavioural EU-citizens would participate more actively in public life if they: change - … felt more European - … were more aware of EU’s achievements - … had more knowledge about European values - … had a better understanding of different cultures - … had a critical understanding of European history In other words, behavioural change, understood as civic participation, is closely interlinked with attitudinal change towards the EU, its history, values and culture. Shared values In the context of a growing diversity in the European Union, shared values such as human dignity, democracy and tolerance are increasingly important and seen as central building blocks for developing a sense of belonging. Direct personal experience Among the programme stakeholders, there is a strong tendency to recognise the importance of learning-by-doing. This line of thinking can be expressed as follows: a direct, personal experience of what a European citizenship means in practice, for example through citizens dialogues, is a contributing factor to civic engagement. Learning from the past A participatory citizenship is based on shared values, which are fundamentally opposed to totalitarian ideologies, such as freedom, equality and solidarity. Showing where breaching these principles might lead to, for example, via the commemoration of mass crimes committed by the Nazi and Stalinist regimes, plays a role in stimulating a civic engagement, which is based on the principles of democracy and rule of law. An active civil society A participatory citizenship at the EU-level requires an effective cooperation with intermediaries and multipliers, most notably civil society organisations. Mutual understanding Mutual understanding and a sense of belonging are crucial elements when involving citizens in public life. These elements can be developed by transnational meetings, exchanges and debates, which tend to build trust and understanding between citizens, as opposed to adversity, opposition and disagreements. High-visibility events High-visibility events, such as "Golden Stars" and Presidency Conferences, can contribute to the creation of a public arena, but also to an increased understanding of EU’s achievements, thereby stimulating a sense of belonging. September 2015 3 EUROPEAN COMMISSION Theme Description Micro-macro mechanisms A plausible impact can be achieved through a variety of local projects, organised by different NGOs, think thanks, municipalities and individual citizens. In the literature, this kind of assumption is labelled as a micro-macro mechanism, since it anticipates that concrete activities, concerning interactions between various organisations and/or regular citizens, eventually will affect decision-making. Macro-micro mechanisms A sense of European identity can be developed at local level, by directly involving citizens in transnational projects, through a European funding instrument. In the literature, this kind of assumption is labelled as a macro-micro mechanism, since it anticipates that activities at a more aggregated level, in this case the institutional one, will trickle down and affect behaviours among regular citizens. Dissemination and When project results are disseminated, rational decision-makers valorisation will implement good practices, which lead to sustainable results and a structural impact. Cross-fertilisation The act of bringing together people and organisations from different countries and levels (i.e. cross-fertilisation), reinforces the programme's effectiveness, particularly through multiplier effects and improved synergies across Europe. The keywords used for the systematic search were: civic participation communication Europe / EU civic engagement memory of events ceremonies social participation / remembrance collaborative participation projects arrangements learning (by doing) attitudes events cohesion (shared) values rituals awareness demonstration multiplier projects A total of 10 searches were made on Web of Science™ Core Collection by combining the different keywords in the list. This resulted in a list of 149 articles/papers related to those terms (Table 2).5 Then, the evaluators read the abstracts of the articles and selected 30 (approx.) for in-depth review. 5 Additional searches were made to complement those listed in Table 2. This included a search on The Campbell Collaboration (1 result) and the EPPI-Centre (1 result). In addition, the evaluators consulted a number of experts working on the fields of civic