The Work Programme: Factors Associated with Differences in the Relative Effectiveness of Prime Providers
Total Page:16
File Type:pdf, Size:1020Kb
The Work Programme: factors associated with differences in the relative effectiveness of prime providers August 2016 The Work Programme: factors associated with differences in the relative effectiveness of prime providers DWP ad hoc research report no. 26 A report of research carried out by NIESR on behalf of the Department for Work and Pensions. © Crown copyright 2016. You may re-use this information (not including logos) free of charge in any format or medium, under the terms of the Open Government Licence. To view this licence, visit http://www.nationalarchives.gov.uk/doc/open-government-licence/or write to the Information Policy Team, The National Archives, Kew, London TW9 4DU,or email: [email protected]. This document/publication is also available on our website at: https://www.gov.uk/government/collections/research-reports If you would like to know more about DWP research, please email: [email protected] First published 2016. ISBN 978-1-78425-617-3 Views expressed in this report are not necessarily those of the Department for Work and Pensions or any other Government Department The Work Programme: factors associated with differences in the relative effectiveness of prime providers Summary The Work Programme is delivered by 18 private, public and voluntary sector organisations, working under contract to DWP. These organisations are known as prime providers, or "primes", and operate within a geographical Contract Package Area (CPA). Each CPA has either two or three primes and individuals entering the Work Programme are randomly assigned to one of these. Comparing the outcomes of individuals assigned to each prime within a CPA provides robust estimates of relative effectiveness. Overall, there are 40 contracts across Britain, allowing 26 within-CPA comparisons. An interim report confirmed both that randomisation had worked well and that there was statistically significant variation in outcomes between primes. This report extends the interim analysis to relate the variation in outcomes to differences in the services offered by primes. By doing so, it aims to understand what makes some primes more effective than others. The results provide evidence of certain aspects of service being more associated with better outcomes than others and that much of this is concentrated among particular subgroups. Several relationships have been revealed which could provide some clues as to what is driving the variation in provider performance. However, the analytical approach provides evidence of an association only and does not enable us to establish whether these relationships are causal in nature. In addition, much of the variation in performance is not associated in a statistically significant way with the provider characteristics that we have been able to measure. This may suggest that the key characteristics have not been taken into account. The Work Programme: factors associated with differences in the relative effectiveness of prime providers Contents List of tables ....................................................................................................................................................... 3 Acknowledgements ........................................................................................................................................... 4 Authors ................................................................................................................................................................ 5 Glossary of Terms ............................................................................................................................................. 6 Abbreviations ...................................................................................................................................................... 8 1 Executive summary .................................................................................................................................... 9 1.1 Introduction ............................................................................................................................ 9 1.2 Empirical approach ............................................................................................................... 9 1.3 Results .................................................................................................................................. 11 1.4 Conclusion ........................................................................................................................... 12 2 Introduction ................................................................................................................................................ 13 3 An overview of the Work Programme .................................................................................................... 15 4 Data and measures of outcomes and service delivery ....................................................................... 21 4.1 Outcomes ............................................................................................................................. 21 4.2 Characterising aspects of service delivery ..................................................................... 22 4.3 Payment amounts ............................................................................................................... 23 4.4 The nature of the supply chain ......................................................................................... 23 4.5 Nature of service provided ................................................................................................ 24 4.6 Descriptive statistics on service characteristics ............................................................. 25 5 Econometric approach ............................................................................................................................. 28 5.1 Identification strategy ......................................................................................................... 28 5.2 Inference .............................................................................................................................. 30 5.3 Estimation ............................................................................................................................ 30 5.4 Subgroup analysis .............................................................................................................. 31 5.5 Time-varying service provision ......................................................................................... 32 6 Establishing service variation within CPAs ........................................................................................... 34 7 Results ........................................................................................................................................................ 36 7.1 Format of the results .......................................................................................................... 36 7.2 The nature of support ......................................................................................................... 43 7.3 The nature of the supply chain ......................................................................................... 45 8 Conclusion.................................................................................................................................................. 48 9 References ................................................................................................................................................. 51 1 The Work Programme: factors associated with differences in the relative effectiveness of prime providers Annex A - Descriptive Statistics .................................................................................................................... 52 Annex B - Summary of Phase 1 results ....................................................................................................... 56 2 The Work Programme: factors associated with differences in the relative effectiveness of prime providers List of tables Table 3-1 Work Programme Referral points and participation requirements ............................ 15 Table 3-2 Work Programme Referral points and participation requirements ............................ 16 Table 3-3 List of prime provider contracts ...................................................................................... 17 Table 3-4 Payment structure by payment group............................................................................ 20 Table 4-1 Variation in service provision, contract level ................................................................ 26 Table 4-2 Variation in service provision, contract-year level ....................................................... 27 Table 6-1 Within-CPA variation in service characteristics ............................................................ 35 Table 7-1 Aggregate correlations with impacts .............................................................................. 39 Table 7-2 Inter-quartile marginal effects ......................................................................................... 41 3 The Work Programme: factors associated with differences in the relative effectiveness of prime providers Acknowledgements The authors gratefully acknowledge the contributions of Department for Work and Pensions (DWP) colleagues; in particular, Janet Allaker and Matt Garlick. The research formed part of a broader evaluation