Active People Survey 5-7 Technical Report Updated to include APS6 (July 2013) Controlled document - Issue 4 TNS BMRB JN 260105344 March 2013 Controlled document - Issue 6 Contents 1. Overview and methodological summary ........................................ 1 2. Questionnaire design and piloting ................................................ 4 3. Sampling and respondent selection ............................................ 37 4. Fieldwork administration ........................................................... 41 5. Sample management rules and response rates ............................ 52 6. 16-25 Boost Survey ................................................................. 57 7. Data processing and weighting .................................................. 60 8. Development work ................................................................... 68 9. Appendices ............................................................................. 82 i Active People Survey 6 – Technical Report 1. Overview and methodological summary 1.1 Background, aims and objectives This document outlines the methodological and technical aspects used in the Active People Survey 5-7. The approach described in this document is predominately the same as the approach used for the previous Active People Surveys in order to provide statistically reliable measures comparable with the baseline data provided by APS1 and APS2. The Active People Survey (APS) is being carried out for Sport England, the non- departmental public body sponsored by the Department for Culture, Media and Sport. Sport England takes a leading role in all aspects of sport and physical recreation which require administration, representation, or co-ordination in England and operate with the aim of establishing a world-leading community sport environment. They work with a range of Governing Bodies, Local Authorities, Higher and Further Education Institutions, Charities, Olympic Organisations and other funded partners to ensure that sporting opportunities are created in every community in the country, with the fundamental aim of increasing participation and improving performance at all levels of English sport. The survey boasts the largest sample size ever established for a sport and recreational survey. It primarily allows analysis of how participation varies from place to place and between a range of different demographics groups in the population such as gender, ethnicity, social class, age and disability. A plethora of other important measures are also captured by the survey, including; the proportion of the adult population (aged 16 and over) taking part in at least 30 minutes of moderate intensity sport three times a week, current levels of club membership, how many people are currently in receipt of tuition and coaching, levels of involvement in organised sport/competition and also, overall satisfaction with levels of sporting provision in the country. The survey is also designed to measure a number of Sport England’s key participation targets, including once a week participation in the different funded sports. January 2012 saw the introduction of the 2012-17 Youth and Community Strategy, launched by Sport England to ensure as many people create a sporting habit for life, in particular, by increasing the numbers of 14-25 year olds playing sport. In the new 5 year strategy, £1 billion of funding will be spent over the five year period, to assist in the funding of the major National Governing Bodies of Sport (NGB’s), investment in facilities - building on the success of the Places People Play scheme - local investment to ensure that impact is felt in the heart of local communities, and the School Games, to motivate and inspire millions of young people across the country to take part in competitive sport. 1.2 Scope and methodology Active People Survey 5-7 was commissioned by Sport England in 2010. The first four waves of the survey had been conducted by IPSOS MORI; however, following a period of competitive tendering, TNS BMRB was awarded the contract to conduct the survey between 2010 and 2013. The table below summarises the fieldwork dates and 1 Active People Survey 6 – Technical Report interviews achieved throughout the project so far. In Active People 6, 157,1001 interviews were achieved within the fieldwork period which ran from 15th October 2011 to 14th October 2012. Number of Survey year Fieldwork dates interviews achieved APS1 13th October 2005 to 16th October 2006 363,724 APS2 15th October 2007 to 14th October 2008 191,325 APS3 15th October 2008 to 14th October 2009 193,947 APS4 15th October 2009 to 14th October 2010 188,354 APS5 15th October 2010 to 14th October 2011 166,805 APS6 15th October 2011 to 14th October 2012 157,100 The sample universe comprised all individuals aged 16+ living in England. Although it has to be noted that the methodology used means that people that live in households that do not have a landline are omitted from the sample frame. The study is designed to achieve a minimum of 500 interviews in most of the Local Authorities (LAs) in England2. Each Local Authorities was given the opportunity to boost their sample size. In APS5, five Local Authorities opted for this boost: Blackburn with Darwen (total of 1,000 interviews) Gateshead (1,000) Hounslow (1,000) Stoke-on-Trent (1,000) Liverpool (2,500) In APS6, just Blackburn with Darwen opted for the additional sample boost, once again opting for 1,000 interviews. The survey was conducted by telephone using Random Digit Dialling (RDD) to generate a sample of telephone numbers. The RDD sample was drawn by selecting numbers from a database of randomly generated numbers in Great Britain. The database was constructed by using known, directory listed numbers from a recent point in time which, following a cleaning process, were used to identify exchange codes and working blocks of 100 telephone numbers. Samples of numbers were then generated by random selection of these final 3 digits of the telephone number. In households with only one person aged 16 or over, this person was selected for interview. In households with more than one person aged 16 or over, one respondent was randomly selected from the eligible household members using the Rizzo3 method where the CATI system randomly selects the eligible respondent. 1 This figure represents only interviews conducted on the main APS6 CATI survey. Additional interviews were conducted in an experimental face-to-face survey, details of which can be found in chapter 8 2 The two exceptions are the City of London (100 interviews) and the Isles of Scilly (150 interviews) 3 Rizzo, L. Brick, JM and Park, I (2004) "A minimally intrusive method of for sampling persons in random digit dial surveys" in Public Opinion Quarterly 68:2 Active People Survey 6 – Technical Report 2 This works as follows: Two adult households. CATI randomly selects either the screener respondent or the other adult. Three adult households. CATI randomly selects one of the three adults. If this is the screener respondent then this person is interviewed. If one of the other two adults is selected then the one with the ‘next birthday’ is the eligible respondent. Four adult households. CATI randomly selects one of the four adults. If this is the screener respondent then this person is interviewed. If one of the other three adults is selected then the one with the ‘next birthday’ is the eligible respondent. Etc. The LA each respondent lives in was confirmed using the respondent’s postcode and address, and in cases where this could not be verified via the respondents telephone number. Survey data were weighted to be representative of the 16+ population of each reporting geography (i.e. Local Authority, County Council, etc.). Data within each reporting geography were weighted by Age within Gender, Ethnicity (White / Non White), Socio-economic classification (NS SEC), Household size, Working status within Gender. 1.3 Structure of the technical report This report is divided into eight main chapters and an appendix. This first chapter introduces the report before providing an overview and methodological summary of the survey. Chapter 2, Questionnaire design and piloting, outlines how the Active People Survey was designed and developed. Chapter 3, Sampling and respondent selection, covers the sample size, sample frame, interview distribution and targets, household definition and respondent selection. Chapter 4 covers Fieldwork administration and includes a brief overview of the survey, fieldwork procedures, interviewer training and quality control, interviewer briefings, key elements of the survey, and an explanation of how respondents are matched to local authority. Chapter 5 covers sample management rules and response rate analysis. Chapter 6 covers the 16-25 boost survey Chapter 7 provides an overview of data processing and data weighting. Chapter 8 covers the development work which was conducted across the survey, in APS5 and 6, including the face-to-face survey that was conducted during the APS6 fieldwork year The Appendices, cover the achieved sample size by local authority, a copy of the APS questionnaire and interviewer briefing manuals, the activities database list, an explanation of sample management rules and sample response analysis, and an overview of the NS-SEC Classification. The report was written by the project team at TNS BMRB – Angela Charlton (Project Manager), Luke Taylor (Research Manager), Michael Potter (Research Manager), Peter Smale (Research Executive) and Gillian Prior (Project