Documents Collection DOC Technical Documents Series Intergenerational Programmes Evaluation Mariano Sánchez (Director) Documents Collection Technical Documents Series N.º 21003 COLLECTION DESIGNED BY: Onoff Imagen y Comunicación First Edition, 2007 First English Edition, 2009 © Spanish National Institute for Older Persons and Social Services EDITED BY: Ministry of Health and Social Policy General Secretary for Social Policy and Consumption Spanish National Institute for Older Persons and Social Services Avda. De la Ilustración, s/n. c/v. Ginzo de Limia, 58 – 28029 Madrid Phone: +34 91 363 89 35 - Fax: +34 91 363 88 80 E-mail: [email protected] http://www.seg-social.es/imserso/documentacion/pub.html NIPO: 216-07-021-9 ISBN: 978-84-8446-093-0 D.L.: M-15.904-2007 CONTENTS Foreword…………………………………………………………………….….. 4 Chapter 1. Components of an Intergenerational Programme ………….… 6 References ………………………………………………………………………………………….. 12 Chapter 2. What Does It Mean to Evaluate an Intergenerational 13 Programme …………………………………………………………………….. References …………………………………………………………………………………………... 23 Chapter 3. The Construction of the Design of the IP Evaluation: From 25 Why to What Evaluate ..………………………………………………………. Introduction ……………………………………………………………………………………………. 26 1. Introductory Points. The Need and Justification for Designing an IP Evaluation …………… 26 2. Steps Preceding the Construction of an IP Design …………………………………………..... 28 3. Why Evaluate? Grounding the Design (I) ……………………………………………………... 29 4. What to Evaluate? Grounding the Design (II) ………………………………………………… 32 5. Where to Obtain the Information? When and How to Evaluate? Grounding the Design (III) ………………………………………………………………………….. 35 6. Final Thoughts …………………………………………………………………………………..… 38 References ……………………………………………………………………………………….…... 39 Chapter 4. Introduction to Some Useful Methods and Techniques for 45 Evaluating Intergenerational Programmes ……………………………….… 1. Qualitative Methodology ………………………………………………………………………… 47 2. Quantitative Methodology ………………………………………………………………………… 55 3. The Experimental Method …………………………………………………………………….… 61 References ………………………………………………………………………………………….. 61 Chapter 5. Data Analysis and Interpretation, Report Preparation and CONTENTS Outcome Dissemination Applied to Intergenerational Programmes 64 2 Evaluation ………………………………………………………………...…..… 1. Data Analysis and Interpretation …………………………………………………………….…. 66 2. Report Preparation and Outcome Dissemination: The Research Report, After Research 76 and the Presentation of Results …………………………………………………………………. References ………………………………………………………………………………………….. 79 Chapter 6. The Interview as a Technique to Obtaining Information in 84 Intergenerational Programmes ………………………………………….…… Introduction. The Possibilities for Interviews in Intergenerational Practices and 85 Programmes …………………………………………………………………………………………. 1. Some Interview Styles …………………………………………………………………….……… 86 2. Process in the IP Interview: Planning, Conducting and Recording ………………………… 89 3. How to Use the Information/Data Obtained From Participants in Intergenerational 95 Programmes …………………………………………………………………………………………. 4. Final Thoughts ……………………………………………………………………………….……. 100 References ………………………………………………………………………………………….. 101 Chapter 7. Evaluating Intergenerational Programmes to Improve Community …………………….……………………………………………… 103 1. Introduction …………………………………………………………………………………….….. 104 2. Assessing Change in Individuals ……………………………………………………………… 105 3. Assessing Change in The Community ……………………………………………………….. 111 4. A Participatory Orientation for Evaluation ……………………………………………………. 113 5. Considerations Related to Assessing Characteristics of the Physical Environment ….. 115 6. Employing Diverse Methods …………………………………………………………………… 116 References ………………………………………………………………………………………..….. 119 Chapter 8. Effective Practices in the Evaluation of Intergenerational Programmes. Six Examples From Around the World …………………….. 122 References ………………………………………………………………………………………….. 137 Note: The original Spanish edition of this book included nine chapters. Chapter nine consisted of the Spanish translation of Bernard, M. & Ellis, S. CONTENTS (2004). ‘How Do You Know That Intergenerational Practice Works?’ Stoke- 3 on-Trent: The Beth Johnson Foundation. This publication is available in English at http://www.centreforip.co.uk/ FOREWORDS The book you are looking at has, above all else, two characteristics that make it unique. First, it is a pioneering publication: never before has a monographic work on the evaluation of intergenerational programmes been published in Spain. Second, this book constitutes proof that the efforts made by IMSERSO (Spanish National Institute for Older Persons and Social Services) in the area of specialised training do not end, to put it colloquially, on the last day of class. This book would never have come into being if it had not been for the decision by IMSERSO to organise, in September of 2006, a course with the same title as the one this book now has. At the time, the course instructors prepared training materials especially for the occasion; now, several months later, the materials have been adapted and expanded, new reflections have been added, and they are being published with a view to reaching a larger audience. Interest in intergenerationality is most definitely on the rise. If we look behind us, in search of the explanations for this growing interest, in the distance we will see, as a fundamental milestone, the Second World Assembly on Ageing that took place in Spain in 2002. The Madrid International Plan of Action on Ageing, which was adopted at the Assembly, included an Issue specifically devoted to intergenerational solidarity. The first few words of each of the two paragraphs that comprise the issue highlight the importance of the subject: “Parr. 42. Solidarity between generations at all levels –in families, communities and nations– is fundamental for the achievement of a society for all ages.” “Parr. 43. At the family and community level, intergenerational ties can be valuable for everyone.” The Plan of Action concluded that all sectors of society, including Governments, should aim to strengthen these ties. There is no doubt that these reflections have prompted both public and private actors to ask themselves about what is being done to support intergenerational solidarity, something which came naturally in the past, especially in the family setting, but which can now be seen to be slowly fading away. The movement to promote intergenerational activities, projects and programmes first began to take shape in the mid 1960s in North America. At that time there was a certain amount of concern about something called the generation gap, evidenced by the increase in negative stereotypes about older people and in the growing distance between older people and other members of society; in addition, at the other end of the life cycle, the number of children and young people in need of attention, care, support, education and other resources was growing inexorably. The pioneers of the intergenerational field decided to get to work: organising projects that enabled mutually enriching encounters to take place between the various generations would be a good way, they thought, to help stop the process that seriously threatened social harmony and cohesion. Over three decades later, and with the significant contribution made by the aforementioned Plan of FOREWORDS Action, that initial effort, far from slowing down, has become stronger and broader. In Europe, the 4 creation in 1999 of the International Consortium for Intergenerational Programmes (ICIP) represented a landmark event. This organisation managed to bring together the experiences of both sides of the Atlantic to make them more efficient and accessible world over. In the case of Spain, IMSERSO has been making valuable contributions to this effort for the past few years. The Specialised Training Programme that spurred the authors to write this book organised in Madrid, in June of 2005, the conference entitled Intergenerational Programmes in Spain. Analysis of current situation and development potential, which more than one hundred people attended. This event was the first action, in recent times, of a series of activities that included the creation of the Intergenerational Network (www.imserso.redintergeneracional.es), the training of specialists in intergenerational intervention, the creation of a database on intergenerational programmes, the funding of research on the current situation of these programmes in Spain and the organisation of the evaluation course mentioned above. Specific actions like these, combined with other similar ones, have culminated in IMSERSO adopting the subject of intergenerational relations as a primary line of action in its efforts to promote active ageing in older people. At this stage we can safely say that the awakening of the intergenerational field (the sum of intergenerational policies, theories, studies and practices) in Spain is unstoppable. What are the consequences of this development? It is still too early to see results. However, books like this one will help do something that is considered vital: evaluate the impact of the many intergenerational projects and programmes that are underway. Only if we have strong evidence of the benefits to children, young people, adults and older people, whether dependent or not, will such practices earn the respect, confidence and recognition they deserve. A few years ago, the organisation Generations Together, one of the