JA impact Meeting targets, measuring results
Year 2016 - 2017 Summary of the longitudinal impact study results regarding the effectiveness of the Junior Achievement educational programmes
Acknowledgements
......
We would like to thank the following schools which foster entrepreneurial education, financial literacy and work readiness through Fundación Junior Achievement’s programmes, especially because of their commitment to this project: CEIP Miguel de Cervantes-La Aljorra (Murcia), CEIP Plurilingüe de Seixalbo, reception centres, children’s homes and day centres (Madrid), Colegio Casa de la Virgen (Madrid), Colegio Ciudad de los Muchachos (Madrid), Colegio Claret (Segovia), Colegio Corpus Christi (Madrid), Colegio Hogar del Buen Consejo (Madrid), Colegio La Inmaculada Escolapios (Madrid), Colegio Los Angeles (Canary Islands), Colegio Los Olmos (Madrid), Colegio Mare de Déu dels Àngels (Catalonia), Colegio Menesiano (Madrid), Colegio Mirabal (Madrid), Colegio Natividad de Nuestra Señora (Madrid), Colegio Nueva Escuela (Madrid), Colegio Patrocinio de María (Madrid), Colegio Pia Sant Antoni (Catalonia), Colegio Ponce de León (Madrid), Colegio Pureza de María (Madrid), Colegio Raimundo Lulio (Madrid), Colegio Sagrada Familia (Madrid), Colegio Sagrada Familia Jorge Juan (Madrid), Colegio Sagrado Corazón de Jesús (Madrid), Colegio San Alfonso (Madrid), Colegio San Miguel Arcangel (Canary Islands), Colegio Santa Gema Galgani (Madrid), Colegio Santa Mª del Camino (Madrid), Colegio Santísimo Sacramento (Madrid), Colegio Santo Domingo (Madrid), Colegio Valdefuentes (Madrid), Colegio Virgen Niña (Valladolid), IES Alonso Quesada (Canary Islands), IES Arnau Cadell (Catalonia), IES Baleares (Valencia), IES Barrio Simancas (Madrid), IES Calderón de la Barca (Madrid), IES Carabelas (Huelva), IES Carreño Miranda (Avilés), IES Conde Orgaz (Madrid), IES Constantí i Perafort (Catalonia), IES Emilio Castelar (Madrid), IES Emperatriz María de Austria (Madrid), IES Front Maritim (Catalonia), IES Manuel Fraga (Madrid), IES Margarita Salas (Madrid), IES Mendillori (Navarra), IES Pérez Galdós (Madrid), IES Ramiro de Maeztu (Madrid), IES Ramón y Cajal (Madrid), IES Salvador Espriu (Catalonia) and IPSI (Madrid).
JA impact43
Project organiser
......
Fundación Junior Achievement
Junior Achievement is one of the world’s largest non- reati it an entreprene ria inte igen e and profit youth organisations. By implementing innovative bridging the gap between schools and the and experiential programmes in financial literacy, workplace. At present, Junior Achievement carries work readiness and entrepreneurship, it helps young out its programmes at p i , partially subsidised and people to design their path towards employability and private schools as a result of its collaboration with job creation, enabling them to meet their goals in a numerous companies and institutions. context of freedom and responsibility. Every year, our During the 2016-2017 academic year, Junior network of over 470,000 volunteers deals with over Achievement Spain carried out a total of 2,824 10 million students in more than 100 countries. programmes, which benefited 31,210 students from sta ishe 17 years ago in Spain in 2001, schools in all the Spanish regions thanks to the Fundación Junior Achievement has an collaboration of 2,777 volunteers. educational plan developed by expert educationalists aimed at students aged between 7 and 30. The educational programmes, based on “learning by doing” methodo og , are *Junior Achievement’s activities have been imp emente by entrepreneurs and professional endorsed as Best Practice by the European o nteers who are willing to ontri te to the Union. i ing o values, attitudes and an entrepreneurial spirit o o ng peop e. They also motivate students by providing them with an overview of the real world of work, developing their confidence,
4 4Longitudinal Impact Study
.
......
Ildefonso Méndez - Universidad de Murcia
He has a Master’s Degree in Economics with honours Assessment” at Murcia University and of the project from Pompeu Fabra University and a PhD in Economics called “Non-cognitive skills, school performance and from CEMFI. He is a senior lecturer at the Applied wellbeing”, which provides training and materials to Economics Department of Murcia University. He is stimulate the non-cognitive skills of children from also the head researcher in projects funded, among the second cycle of preschool to the end of primary others, by Fundación Ramón Areces, Fundación education. Séneca and the Spanish Ministry of Economy and Competitiveness. His research interests focus on education economics and, in particular, on non- cognitive skills. He has published science articles in major international journals and has worked as an education consultant for the OECD.
He has been the Director of the Autism Chair at Murcia University since its creation in 2015, fostering the research o non-cognitive skills in general and the executive functions, in particular regarding the autism spectrum disorder (ASD) and the learning difficulties.
He is also the head researcher of the research group called “Education Economics and Economic
JA impact45
1. Introduction to the report
......
1.1 Why conducting a longitudinal impact assessment?
From a continuous improvement Therefore, the research aimed to pro i e scientific standpoint, Fundación Junior Achievement evidence to support the benefits of the Junior has aunched this research project in Achievement’s method and programmes, highlighting collaboration with Murcia University. As a result of the importance in education of such skills, which will the assessment and research, we have obtained ultimately ensure the wellbeing and happiness of our scientific evidence to support the effectiveness youngsters. “ of our long-term programmes, that enable us to design high impact educational programmes. The study analyses the actual annual and longitudinal effect on the beneficiaries of each educational programme and of the Foundation’s overall activity. This assessment and research provide scientific evidence to support the This type of assessment can be made since the effectiveness of our programmes programmes have a number of common and trans ersa features. Some of them are the “learning by doing” methodo ogy1 used by Fundación Junior Achievement or the rans ersa work for the non-cognitive skills or executive functions. Non-cognitive skills are those not related to the theoretical knowledge a isition such as autonomy, personal initiative, leadership, decision making, managing and planning, critical and creative thinking, flexibility and adaptation to the context and to its changes, cooperative work, having and reinforcing values and attitudes in line with ethics and society.
Click on the following link to see the full report by Ildefonso Méndez: http://fundacionjaes.org/news/estudiodeimpacto2016-2017
(1) “Learning by doing” is a practical and active method which turns students into the protagonists of their own learning, enabling them to develop critical thinking, creativity, reasoning, effective communication, team work, self-assessment and other skills
JA impact47 ja PROGRAMMES
Financial literacy Entrepreneurial education Work readiness
Longitudinal Targets met study Opportunities generated Youth guidance Evidence and positive impact of JA Financial e u ation an training training on the benefi iaries Equal opportunities
Findings
Some results Higher impact
+ 10%-20% in academic performance oungsters from less favourable so ioe onomi onte ts
+ 6,5% in educational expectations Youngsters with lower academic performance Young school repeaters - in un usti e absen es from lass
Youngsters who have previously received JA programs + 22% in the entrepreneurial spiritr + 37% in the growth mindset Since the 2015-2016 academic “ year, we have analysed over 3,400 student surveys and assessed 10 programmes
8 4Longitudinal Impact Study 1.2 Method used
The research o the impact of Junior o p e o ee s hose in i ators themse es are Achievement’s programmes began in the part o the o n ation s o e ti es s h as 2015-2016 academic year. During these two reducing schoo drop ou ra es an increasing years, we have analysed over 3,400 student he en reprenuria spiri o e a ate the results, surveys. we use secondary databases which enable us to analy e the behaviour of youngsters who did We have assessed 10 programmes through not take the nior hie ement s surveys conducted among volunteers and programmes, and they were used as students from various Spanish provinces, which counterfactual to the results obtained from those were completed before and after the specific who did take them. Examples of the diverse training. The survey results enable us to analyse statistical tools se to minimise the potential the cognitive and non-cognitive changes measurement error are the studies 2440 and experienced by the students. 2753 by the Spanish Sociological Research The surveys include questions to analyse the Centre (CIS), which provide information about the importance given by the students to certain valuation given by Spanish youngsters aged qualities or values related to the non-cognitive between 15 and 19 to certain qualities which skills which correspond to the list analysed by represent non-cognitive skills and how Méndez (2014), based on the World Values acceptable are some types of avoidant eha io rs Survey. In line with the values and attitudes o responsi i it oungsters from the CIS study fostered by Fundación Junior Achievement, we se e te rom simi ar sociodemographic also measure the civic capital in which the hara teristi s are ompare to those students judge certain types of behaviour such as participating in Junior Achievement’s programmes, copying in exams and not paying for bus or train thus con ras ing the differences between the tickets. The surveys also include questions students who received the training and those about their socioeconomic context, family who did not. Another factor that prevents potential background and other areas such as their errors and ma es the study more rigorous and academic performance in different subjects, reliable is the elimination o the effects which are their training and work expectations and the statistically not significant in the analysis, i.e. those number of unjustified absences in the ast with an incidence of less than 5%.
Scientific evidence and national Breakdown of results and international standards Design of the 2015-2016 and 2016/2017 academic year ienti literature assessment and Over 3,400 student surveys World Values Survey questionnaires 10 JA programmes involved Sociological Research Centre (CIS) Over 50 schools
Summary of results Comparison Programmes
RESULTS OBTAINED análisis de la muestra General conclusions drawn from Junior Systematisation of the results Achievement’s programmes obtaine ifferentiation bet een primar an Creation and analysis of Creation of the sample’s control secondary education programmes results models omparison bet een programmes
JA impact49 CAROL DWECK Heckman Walter Mischel Perry preschool study Luigi Guiso et al. Marshmallow test Growth mindset (David Weikart et al.) (Daniel Goleman) Non-cognitive skills Civic capital ela e grati ation ienti evi en e ienti evi en e ienti evi en e Informative content Informative content ienti evi en e Informative content Informative content
Civic Non-cognitive Hard work capital skills