Measuring Public Innovation in the EU: the STARPIN Methodology 2019 Edition Measuring Public Innovation in the EU: the STARPIN Methodology 2 019 Edition
Total Page:16
File Type:pdf, Size:1020Kb
Measuring public innovation in the EU: the STARPIN methodology 2019 edition Measuring Public Innovation in the EU: the STARPIN methodology STARPIN the EU: the in Innovation Public Measuring 2 019 edition edition 019 MANUALSSTATISCTICAL AND GUIDELINES Measuring public innovation in the EU: the STARPIN methodology 2019 edition Manuscript completed in March 2019 Printed by the Publications Office in Luxembourg The Commission is not liable for any consequence stemming from the reuse of this publication. Luxembourg: Publications Office of the European Union, 2019 © European Union, 2019 Reuse is authorized provided the source is acknowledged. The reuse policy of European Commission documents is regulated by Decision 2011/833/EU (OJ L 330, 14.12.2011, p. 39). Copyright for the photographs: Cover © Dostoevsky /Shutterstock For any use or reproduction of photos or other material that is not under the copyright of the European Union, permission must be sought directly from the copyright holders. For more information, please consult: https://ec.europa.eu/eurostat/about/policies/copyright PDF: ISBN 978-92-76-01095-1 ISSN 2315-0815 doi: 10.2785/215876 KS-GQ-19-002-EN-C Print: ISBN 978-92-76-01097-5 ISSN 2363-197X doi: 10.2785/708816 KS-GQ-19-002-EN-N Content Contents Contents .............................................................................................................................................. 3 Abstract ............................................................................................................................................... 5 1. Introduction ............................................................................................................. 6 2. The StarPIN approach ............................................................................................. 8 The conceptual pillars of the StarPIN approach ........................................................................ 9 Placing public service innovation at centre stage ...................................................................... 9 Adopting an object-based approach .......................................................................................... 9 Interpreting innovation as an increase in value creation ......................................................... 11 A new hierarchy of data sources............................................................................................... 13 3. The foundations of the StarPIN approach ........................................................... 16 Combining insights from complementary strands of literature ............................................. 16 Approaches to public service innovation ................................................................................. 17 Key streams of literature on public service innovation ............................................................ 21 The literature on public service dominant logic ...................................................................... 21 The literature on ‘value creation and co-creation’ ................................................................... 22 4. Towards an analytical framework: topics, issues and variables ....................... 26 5. A classification grid .............................................................................................. 28 The identification of the target statistical unit: public institutions ........................................ 28 Which are the conditions for adopting an ‘object’ approach to measure public innovation? ..................................................................................................................... 32 The services of general interest as statistical units: a CPA-based classification................ 36 6. Methodology for data collection and data analysis ............................................ 39 The process ................................................................................................................................. 39 Current status of site-centric measurements .......................................................................... 43 Application of the site-centric measurement in two countries .............................................. 45 Pilot service waste collection ................................................................................................... 45 Keyword identification strategy ................................................................................................ 48 Web-scraping process ............................................................................................................. 49 Validation strategy ................................................................................................................... 49 Summarising and integrating collected data............................................................................ 50 Table 9: A simplified template structure to integrate data on public sector innovation in e.g. the waste management domain ............................................. 55 Pilot service Health homecare ................................................................................................. 56 7. Main results of the methodology application ..................................................... 62 Pilot service waste collection in the five pilot countries ........................................................ 62 Scaling up the indicator generated ........................................................................................... 67 Cross-sectional analysis of data ............................................................................................... 76 Measuring public innovation in the EU: the StarPIN methodology 3 Content Preliminary results for the pilot service Health homecare ..................................................... 76 8. Learning from the application of the methodology ............................................ 80 Main difficulties ........................................................................................................................... 80 Lessons learnt through the testing activity ............................................................................. 81 Directions for future improvements .......................................................................................... 82 References ................................................................................................................ 87 Annex 1: Classification Grid ................................................................................... 96 Annex 2: User manual ............................................................................................ 112 Annex 3: Keywords and keyword baskets ........................................................... 116 Annex 4: Example of data for validation and cross-sectional analyses ............. 130 Annex 5: Calculation of regional and national averages of innovativeness levels ......................................................................................... 144 Measuring public innovation in the EU: the StarPIN methodology 4 Abstract Abstract This work accounts for, and synthesises the main results of, the StarPIN project — Statistical Reporting on Public Innovation — developed by the Dipartimento di Economia, Società, Politica (DESP) of the University of Urbino, Italy, with the support of dialogic — innovatie. interactie, Utrecht, the Netherlands. The StarPIN project was supported by Eurostat’s Unit working on innovation statistics. The StarPIN team was composed of Annaflavia Bianchi, Claudio Cozza, Giovanni Marin, Robbin Te Velde, Antonello Zanfei, and Emy Zecca. Gregor Kyi and Giulio Perani were the Eurostat project managers and Stefania Panaitescu ensured editing and support. The project proposes a theoretical and a methodological framework for enriching the measurement ability of public sector innovation, and discusses the implications for data collection and analysis. A preliminary test of the framework is carried out by means of pilot applications to specific public services. The project focuses on public service innovation as a key locus of value creation for society, choosing an object-based rather than the more commonly adopted subject-based approach. Issues concerning the measurement of public service innovation are addressed in statistical terms and consistently with the official public sector functions classifications. The approach places particular emphasis on web-scraping to capture the technological level of websites used by public administrations, and to evaluate the degree of innovativeness of specific services within selected public functions. Data collected through web-scraping can be combined with administrative data at the level of individual services. The paper presents pilot applications to specific public services in a limited number of countries. The paper is structured according to the following steps: First a theoretical framework is sketched for the analysis of innovation in the public sector, focusing on service innovation and public value creation. Second, the consistency between public functions, public institutions and public service classifications is discussed. Third, the indicators of innovativeness are generated for selected public services. Fourth, the paper illustrates the main lessons learnt from the pilot application of the methodological framework, and draws implications for future research. A user manual is annexed to the paper for replicating