For young people in May 2017

One of four mini research projects exploring how to evaluate ‘place-making’: joint working for social outcomes, regeneration, and quality of life in a neighbourhood.

In London we focused particularly on the first of London Bubble (SE London) and Immediate our place-making themes; building on a (Hackney) each brought a case study. previous event about joint working for social outcomes which shared our Arts and Cultural Commissioning Toolkit. This workshop went further, considering how to evaluate in this context. Three theatres working with young people shared practice, and hosted a conversation about their place and evaluation challenge. It was easy for conversations to drift to conclusions, and we learnt an important lesson for all our workshops - to maintain a stronger Immediate focus on creating an evidence-base, to balance a tendency to jump to creative solutions. We discussed trading skills and expertise with different partners, offering our unique creative input to partners rich in data and reminding ourselves of the importance of the artistic London experience. We learnt about Project Oracle Bubble and opportunities through Integrated Youth Support Services IYSS. And we glimpsed the huge benefits of a real city side sharing, through In order for PYL to be involved the work needed London’s Datastore and the Centre for Youth to contribute to the Vision for Young Londoners Impact. (which highlights a cultural offer for young people) by focusing on social outcomes. What we did with whom The workshop Why you might be interested We used a ‘problem solving team building’ • young people, including early years exercise to ask: how do we use evaluation • Bridge organisation and regional youth collaboratively to answer the challenges we unit partners have in this place? • Urban environment There were four workshop elements: • Two projects were part of the evaluation • A life story – residents’ cradle to grave experience initiative Project Oracle which shares useful • A local story – cold spots and strengths evaluation guidance. • What evaluation questions did that identify? • One used Randomised Control Trials. • How can we do better joined up evaluation?

Partners See our guidance on how to run a workshop using our learning in Coventry, London, Partners with Make Culture Work were the Lincolnshire and Lancashire. London Bridge organisation A New Direction (A.N.D.) and London’s regional youth unit Partnership for Young London (PYL). Ovalhouse (Southwark) hosted the event, and other theatres

1 • Making culture work: London Our learning The initial bid to the Cultural Education Challenge had been a shared approach with a Why people came housing association who would recruit young people to a theatre programme based on their Because this was an open invite and people estates. Establishing principles together early on came from across London participants were made it easier to involve the housing more interested in learning about evaluation association in the evaluation later. than working together on place making. The evaluation framework was co-produced with the young associates (except for the What went well and not so well basics, monitoring postcodes for example). The As the first of our events we learnt we needed key question was ‘how can we be accountable to focus more explicitly on evaluation to the needs of the young people in our own techniques – people need some basic tools and ‘backyard’? Rather than imposing the aims of a step by step process. It is easy for the work on the young people, they were asked conversations to drift from evaluation to an open question ‘what are you interested in?’ delivery; from thinking about how to get the They wanted the evaluation to cover diverse evidence to solve a problem, to solving the issues, from punctuality to mental health problem itself (in fact it’s hard to avoid). outcomes. They agreed the indicators In terms of the ‘local story’, people really valued together, and the Young Associates were the geographic mapping of opportunities, trained as evaluators. which our facilitators’ plan explains. In one Ovalhouse staff, three Young Associates and case study, the seriousness and sensitivity of the two housing provider staff members allowed the type of issues our young person was facing event participants to interrogate this evaluation meant the conversation about a ‘life story’ was in-depth. We discussed: muted. • the role of the housing association as a new, Case study hosts found it very useful to develop embedded, sustainable partner in local a real action plan on the day. areas (like older relationships with schools) • attitudes of young people to place and to Our insights about evaluation the arts, especially the importance of trusted Word of Mouth and resistance to travel We noticed that in discussion people find it hard to focus on evaluation and tend to solve • the empowerment of young people and problems from experience. They struggle to the effectiveness of using them as evaluators: distinguish actual outcomes from what was they bring “personal as well as professional hoped for – more expertise in this would help expertise” and empathy. They can encourage people to use evaluation understand the issues because they “come formatively, and be more objective about what from her [the participant’s] back yard”. is achieved. Ovalhouse had in mind two new evaluation See the case studies below for the three questions that they wanted help with, ‘how do evaluation questions we explored, and local we evaluate progression?’ And the one that we actions to develop their strategies. worked on together: ‘how to use evaluation to configure Ovalhouse to fit locally (in a network Place-based or cross sector of Lambeth provision) as it moves to Brixton?’ evaluation Learning from the case study coupled with brainstorming from the wider group created a long list of opportunities. These actions were The theatre’s case studies were from work then agreed for a new evaluation strategy that delivered together with housing providers or would continue to build the relationship with other children’s services. housing providers and start relationships in the Case studies and ideas for action new location: • Start culture change internally towards a At Ovalhouse the case study we built on was more evidence-based approach, by joining their Cultural Education Partnership evaluation, up data especially with the marketing team. delivered in partnership with an academic All youth bookings now go through Spektrix. specialising in socially engaged arts and • Keep working on the housing partnership to: Ovalhouse Young Associates.

2 • Making culture work: London - run joint community days that can gather The three approaches they use are: data from people who already know • Staff observations matrix looking for ‘soft’ about Brixton. skills and arts skills - Develop relationships with their • Baseline and end evaluation forms for neighbourhood officers who have a lot young people including Cantril’s ladder of local data. which measures Life Satisfaction - Offer in return creative, engaging • Parent/guardian feedback activities for young residents. • Include young ambassadors on steering In discussion we learnt about the need to groups and pay young associates to do consider both data and young people’s outreach. feedback. These two approaches to evaluating (and therefore scoping future Immediate Theatre’s evaluation was developed services) – what young people want, and what as part of Project Oracle by Artistic Director, Jo data tells us they need – are relevant to Carter. It has a ‘standards of evidence’ different parts of the service. It is vital that framework. young people feedback about delivery, so they turn up week after week. But objective data is more important in evaluating the longer-term programme and scoping new programmes based on longer term need.

Immediate used the workshop to consider why there had been a downturn in demand for the age group 12+. It was interesting to show that evaluation isn’t only about the experience and impact of a service, but can be about wider Immediate has achieved Standard 2 validation need or management issues – again thinking for its Estate Based Youth Theatre programme about formative evaluation and linking it more which provides long term engagement with strongly into market research. young people. Their question was ‘how do we use evaluation to improve and adapt what we do?’ They decided to create a more strategic and joined up approach to evaluation: • Go back to young people again to review what they felt • Form a network with Hall and other participatory arts providers to: - go to London Borough of Hackney to get

to grips with Integrated Youth Support The group showing their increased life satisfaction, Services (IYSS) confidence and team working skills - Map the boundaries within which partners Immediate Theatre learnt from the Oracle are working training the need to triangulate data, getting - Explore getting demographic data of different perspectives to be more certain of non-attenders results. Tools were developed with group - Use IYSS tools – all services for young leaders – essential in overcoming their people in Hackney input data into the evaluation scepticism. IYSS system Useful links Project Oracle provides further details on the Estate Based Youth Theatre, including a Theory Of Change.

3 • Making culture work: London London Bubble’s evaluation case study is also including the report by Dr Barnes and the UEL validated Standard 2 by Project Oracle. This report. experience gave them the confidence to run a Even with such good practice in evaluation, Randomised Control Trial (RCT) a demanding there is still the appetite to learn and develop. form of evaluation which comes from clinical Having spent a lot of energy on a methodology practice. that would be recognised outside the sector, The report, Randomised Controlled Trials (RCTs) this discussion focused on making sure that the for Projects with Children and Young People unique offer of the arts is not lost in working explains more. towards social outcomes: ‘how do we use London Bubble has a focus on creating theatre evaluation to capture the artistic experience?’ with, for and by their community. The project The ideas discussed included: we featured was Speech Bubbles, a Key Stage • Understanding ‘flow’ – using neuroscience 1 intervention that supports children with to understand changes to the brain communication needs. It is delivered with • Artistic response – using a visual artist to ‘just Teaching Assistants and has been developed draw’, creating an account of a moment of with Speech and Language Therapists and creative inspiration and valuing that Educational Psychologists. subjective account. The work could then be taken into interviews to prompt evaluative discussion. The group felt it was important to be clear that this is not visual minutes or an advocacy tool, but is instead a piece of artistic practice in its own right, used to trigger further engagement – as shown below.

In 2016 the pre and post project assessment for teachers showed that 87% of children taking part showed improvements in learning, speaking and listening and 88% showed improvements in emotional and conduct behaviours. After they had worked on an evaluation with Dr Jonathan Barnes of Canterbury Christ Church Universities arts and health centre, they embarked on an RCT with Dr Heather Price, Psychosocial Studies Research Group UEL. The evaluation concluded that: “Speech Bubbles offers what appears to be highly effective and sustainable … it reminds us that a focus on children’s wellbeing in school generates increased social, behavioural and educational capital cheaply and effectively.” This robust evaluation gave London Bubble the evidence to support their ‘social franchising’ approach, creating a more sustainable business Part of Liz Atkin’s Speech Bubble Artwork: model and sharing good practice, as other see more at London Bubble theatres can buy into the methodology and deliver it locally. • Artistic response – inviting a storyteller, dancer or other artist to create a response, They are now undertaking a much larger RCT possibly after talking to kids or parents with 25 schools and other theatre partners as • Evaluating each other’s projects in this way part of the Learning about Culture programme from the RSA. They are also engaged in further evaluation using cost benefit analysis with EY, a partnership made by Pro Bono Economics. There are a variety of materials available about the work from London Bubble website –

4 • Making culture work: London Pan London action A gift

In addition to local learning, some pan-London One of the delightful surprises of the London issues emerged which A.N.D and PYL are workshop was some spoken word by one of the exploring: Ovalhouse young associates. Who’d have thought you could make a poem about place- Research and evaluation based evaluation?!

There are lots of strategic reasons why evaluation practice is poor in the sector, but Place-making that isn’t a bad approach, also some very basic lack of expertise which I owe the think tanks a standing ovation such could be addressed more nimbly at grass roots innovation could help my imagination catapult, level. Passed social housing blues to show the box tickers, statistics too have a pulse, Partners discussed:

• Promoting the London Datastore, an open Is my estate a giant lab where professionals data-sharing portal come into study and fix us? • Publicising the Centre for Youth Impact’s My breast milk was chased with the hardship quarterly practitioner events to the cultural traumas of wind-rush, sector I took my first footsteps in cuffs, raised around • Hosting sandpit events with a facilitator to the stars of crime-watch, share evaluation expertise (funded by My close minded peers all kept in touch, so if I attendees) scrap the residue of my soul, • Including the cultural sector in a portfolio And give you the last bit of this trust, I ask that offer to universities being developed by PYL you meet me half way,

And about Place-making I don’t want to be conned to fill out forms, I will remove the chip from my shoulder but why One of the benefits of a partnership approach is force me to confirm when I also bring culture, the relationships that are built and the spin-offs I’m Leonardo Da Vinci with a spray can, that can arise. I turned my estate wall into a canvas but my 1. One of the biggest barriers to participation in hearts in a state coz, the arts for young people is travel and If it’s not in a gallery its urban does art have a transport – having a strategic partnership status? makes it easier to engage other strategic agencies and ideas will be pursued with TfL. Does theatre have a colour, do art centre in my 2. The way young people hear about good arts community have a footfall preference, opportunities and progression is through Do I even belong? word of mouth (WOM), but this is a matter of Are they here in efforts to look cool, chance which leaves many young people Amongst the infrastructure assisting out in the cold. After the Make Culture Work gentrification, adding colour to a dark estate, event, Benna (the poet above) and others Or am I also welcome? participated in PYL’s Visioning event to increase equality of opportunities and plans I got all this potential; without those expertise for a ‘Youth Friendly City’ were shared with my options will harbour fate, the deputy mayor. I am John Boyega with confidence nailed to 3. With challenges in school partnerships, rock bottom sitting on top of the acting skills god, housing associations are another potential Moulded into my potential I feel lost, coz the partner. There is the opportunity to be part creative industries are worth 84 billion to the of the Housing Association for Youth network UK economy, which is working with the Centre for Youth Still my family tells me to get a real job. Impact. 5 January 2017 Benna – Spoken Word Artist & Social Entrepreneur. @AbstractBenna

5 • Making culture work: London Thanks

Our thanks especially to Sharon Long of PYL, and Steve Moffit of A.N.D for being our organising partners, and Ovalhouse for hosting. Thanks also to: Ovalhouse case study: • Reuben Braithwaite, Mehak Hussain, Stephanie Clarke and Cherona Clark - Young Associates, • Sophie McKechnie and Kelly Thompson – Hyde and Metropolitan Housing Associations • Naomi Shoba – Ovalhouse • Chrissie Tiller – external evaluator

Immediate case study: • Jo Carter and Sanctuary Housing

London Bubble case study: • Adam Annand and Amelia Bird of London Bubble • Alison Hale, freelance practitioner • Tracy Brook, former SENCO and current member of Speech Bubbles Advisory Group

Note also support to London Bubble from Pro Bono Economics (PBE) for the next stage of their evaluation journey. Pro Bono Economics helps charities and social enterprises understand and improve the impact and value of their work.

6 • Making culture work: London