EUROSTAT Grant for 2016 Improvement of the use of administrative sources (ESS.VIP ADMIN WP6 pilot studies and applications) Methodological report Statistics Estonia 2018 Content Introduction .............................................................................................................................. 4 Detailed evaluation of the results of the action ...................................................................... 6 I Detailed description of the methodology ........................................................................... 11 1. Developing methodology for register-based population and housing census ........ 11 1.1 Index-based methodology of using registers ...................................................... 11 1.2 Using partnership index to correct data on household structure ....................... 18 1.2.1 Implementing the partnership index ................................................................... 18 1.2.2 Development of partnership index ....................................................................... 20 1.3 Deriving new variables from administrative variables and ensuring their compliance with census definitions and comparability .............................................. 27 1.4 Improving the use of administrative data sources ................................................ 31 1.4.1 Developing cooperation agreements with the owners of administrative data sources ............................................................................................................................. 32 1.4.2 Register of granting international protection (RAKS) ...................................... 33 1.4.3 Building identifiers for linking administrative data .......................................... 34 1.5 Compilation of activity status based on register data ........................................... 35 1.6 Adapting quality framework for the evaluation of administrative data ............. 54 1.7 Case study”How the quality of register was measured for Estonain Building Register (EBR)? .............................................................................................................. 61 1.8 Developing statistical register systems for managing statistical registers of population, businesses, agricultural holdings, buildings and dwellings. ................... 65 1.8.1 Working out methodology for housing data management in statistical register system .............................................................................................................................. 65 1.9 Integration of a new administrative sources .......................................................... 68 1.9.1 Developing register-based housing statistics ....................................................... 68 1.9.2 Building identifiers for linking administrative data .......................................... 71 1.9.3 Deriving new variables from administrative variables and ensuring that they comply with the census definitions and are comparable. ........................................... 72 2 1.10 Developing statistical output production ............................................................ 73 1.10.1 Thematic studies ................................................................................................. 80 1.10.2 Methodology for compiling daytime and night-time population, study migration ......................................................................................................................... 86 1.11 Study of confidentiality issues for renewal of PHC 2000 and PHC 2011 datasets for releasing grid-based data .......................................................................... 94 1.12 Exchange of experiences-study visits to the Dutch Statistics and Statistics Norway ............................................................................................................................ 99 II. Detailed evaluation of the results of the action including assessment of the quality of data .................................................................................................................................... 102 III.Adapting quality framework for the evaluation of administrative data ............... 105 IV. Assessment of sustainability over time and plan for implementing further changes in the statistical system as a result of the action ............................................................ 111 4.1 Two possible strategies of using index-based methodology in population statistics ........................................................................................................................................ 111 4.2 The work to develop partnership index continues .............................................. 112 4.3 Register’s data quality assessment ........................................................................ 112 4.4 Revison of parameters of indexes ......................................................................... 113 V Assessment of the possible applicability of the methodology/procedure to other context ............................................................................................................................... 115 VI. Summary of the problems encountered ................................................................... 116 VII Description of how further actions could improve the use of administrative sources ............................................................................................................................................ 118 Conclusion ......................................................................................................................... 121 ANNEXES ............................................................................................................................. 124 3 Introduction The grant (EUROSAT Grant Agreement on the ESS.VIP ADMIN WP6 pilot no 07112.2016.004-2016.586) had a dual purpose: 1. To develop the methodology for register-based population and housing census. 2. To develop methodology for measuring the data quality from data sources (registers). Results of that grant enable Statistics Estonia(SE) to reap the benefiits of using register`s data for the production of dwelling statistics and to quarantee the quality of the output using register data for register-based census. Based on the grant results SE is going and is able to carry out a register-based census second trial in 2019. According to Statistics Estonia’s strategy, there is big need to be able to meet user needs and to consistently map population changes and assess trends in a speedy manner. In order to achieve this, there is a need to use new data sources, which could make the production of statistics more varied. Therefor one of the important objective was to improve greater and better use of register data. A major achievement was production of the housing statistics based on register data. Regarding census preparatory works for the next census round, it was vital to create the prerequisites for a register-based census and to develop a system of organised and harmonised state registers, which requires contributions towards raising the level of data quality. The measures required to ensure compliance of all registers with the requirements for statistics include improvement and monitoring of data quality by Statistics Estonia on regularly base. According to the goals many problems were solved within the grant activities: 1. The management and the use of administrative data sources is better at SE. 2. Quality framework for evaluation of administrative data was adopted for census. 3. Statistical register systems was established for managing statistical registers of population, business and agricultural holdings, buildings and dwellings and was further developed for census and population statistics purposes. 4. New administrative sources (e.g. traffic register) were integrated into statistical production. 4 5. Statistical output production was developed (a thematic grid map with resolution 1 km x 1 km has been published for the whole territory of Estonia and a grid map with resolution 500 m x 500 m has been published for all cities and the adjacent areas). 6. An exchange of experiences took place, two study visits were organised – to the Dutch Statistics and Statistics Norway. As already mentioned the aim of the grant was to test the quality of the registers used to form the census characteristics, the functioning of the methodology for a register-based census. The quality level of data was determined in relation to the established criteria and the quality requirements for statistics. The methodologists have solved the following main problems connected with the forming of census characteristics: 1) Analysing the relationship of census definitions and value scales with the definitions and value scales used in registers; 2) Testing the quality of registers and making efforts to urge register holders to eliminate any shortcomings; 3) Establishing optimal rules for forming each census characteristic based on register data Implementation area of grant results: in regular population statistics, census, housing statistics. According to the timetable the grant actions took place in time. Grant activities started in October 2016 and finished in March 2018. (Annex I).Methodological report was prepared by Kristi Lehto, Kaja Sõstra, Maret Muusikus, Vassili Levenko, Ülle Valgma, Helle Visk, Pille Kool, Krista Türk, Maret Priima, Diana Beltadze. 5 Detailed evaluation of