Handbook on the Use of Mobile Phone Data for Official Statistics
Total Page:16
File Type:pdf, Size:1020Kb
Handbook on the Use of Mobile Phone Data for Official Statistics UN Global Working Group on Big Data for Official Statistics September 2019 1 Table of Contents Introduction ........................................................................................................................... 4 List of Definitions and Abbreviations .................................................................................... 5 1 Applications ................................................................................................................... 9 1.1 Mobile positioning data used in official statistics production ................................... 9 Travel statistics in Estonia .............................................................................................. 9 Inbound cross-border visitor arrival statistics in Indonesia .............................................. 9 1.2 Mobile positioning data used in research and pilots applicable for statistics ........... 10 Domain: Tourism and event statistics ........................................................................... 10 Domain: Population statistics ........................................................................................ 12 Domain: Migration statistics ......................................................................................... 14 Domain: Commuting statistics ...................................................................................... 15 Domain: Traffic flow statistics ...................................................................................... 16 Domain: Employment statistics on border and seasonal workers ................................... 18 Other applications ......................................................................................................... 19 2 Data sources ................................................................................................................. 21 2.1 Data from systems of mobile network operators .................................................... 21 Central storage systems ................................................................................................ 22 Probing and signalling data ........................................................................................... 22 Active positioning data ................................................................................................. 23 2.2 Mobile phone event data – passive positioning data ............................................... 24 Forms of mobile data .................................................................................................... 25 Subscriber-related identities .......................................................................................... 25 Equipment-related identities ......................................................................................... 26 Time attributes.............................................................................................................. 26 Location-related attributes ............................................................................................ 27 Location and routing area identity ................................................................................. 28 Cell identity .................................................................................................................. 29 Coverage area of the antennae ...................................................................................... 30 Additional attributes for events data .............................................................................. 31 Additional attributes for network data ........................................................................... 32 Additional attributes for subscribers ............................................................................. 32 2.3 General data extraction process.............................................................................. 33 Data preparation ........................................................................................................... 33 Data anonymisation ...................................................................................................... 33 2 Data encryption ............................................................................................................ 36 Data transmission ......................................................................................................... 36 Data archiving .............................................................................................................. 36 The logical order of steps in the process of data extraction ............................................ 37 3 Access to mobile phone data and partnership models .................................................... 38 3.1 Introduction ........................................................................................................... 38 3.2 Enabling environment for access to mobile phone data for official statistics .......... 40 Partnership models for using mobile phone data for official statistics............................ 41 ITU project on big data for measuring the information society ...................................... 47 Understanding Stakeholders: Roles, Capacities, and Mandates ..................................... 49 4 Methods ....................................................................................................................... 54 4.1 Concepts and definitions ........................................................................................ 54 Concepts related to trips ............................................................................................... 55 Concepts relevant for several domains of statistics ........................................................ 56 Some concepts related to tourism domain of statistics ................................................... 57 4.2 Data processing methodology ................................................................................ 58 4.3 Quality assurance framework for producing statistics with mobile network data .... 61 4.4 Coping with under-/over-coverage ......................................................................... 62 Annex 1 - Case Study: France .............................................................................................. 71 Annex 2 - Case study: Indonesia .......................................................................................... 78 3 Introduction Mobile phone data has surfaced in recent years as one of the big data sources with great promise for its use in official statistics. There is an expectation that mobile phone data could fill data gaps especially for developing countries given their high penetration rates. In its 2018 report1, the International Telecommunication Union (ITU) shows cellular telephone subscriptions keep growing, even when there are already more subscriptions than people on Earth. Developing countries and least developed countries will continue to reduce the gap with developed countries. This goes to show how pervasive mobile phone use is. ITU elaborates that rural areas are still lagging behind urban areas, and this should be considered in studies using mobile phone data, but it is clear that the coverage of this data is global. Almost every person in the world lives within reach of a mobile cellular signal. The Task Team on Mobile Phone Data has been reviewing the development in the use of mobile phone data for official statistics and drafted this guide to give elaborations for countries which are in the process of designing a project for using mobile phone data for their official statistics or are in the implementation process. The guide is to be published only in electronic format and in English and is expected to be reviewed and amended as projects are being advanced. The guide comprises four chapters (Applications, Data sources, Access to mobile phone data and partnership models, Methods), followed up by two country case studies. This handbook has been composed by and edited by members of the Global Working Group on Big Data and specifically the Task Team on Mobile Phone Data. 1 Measuring the Information Society Report 2018: https://www.itu.int/en/ITU-D/Statistics/Pages/publications/misr2018.aspx 4 List of Definitions and Abbreviations Definitions used in the handbook 1. Mobile phone data or mobile positioning data (MPD) in the context of this handbook is any type of mobile phone event data that includes a subscriber identifier, time attribute and location. 2. Mobile network operator (MNO) also known as a wireless service provider, wireless carrier, cellular company, or mobile network carrier, is a provider of wireless communications services that owns or controls all the elements necessary to sell and deliver services to an end user. A key defining characteristic of a mobile network operator is that an MNO must own or control access to a radio spectrum license from a regulatory or government entity. A second key defining characteristic of an MNO is that it must own or control the elements of the network infrastructure necessary to provide services to subscribers over the licensed spectrum. 3. Domestic data – Any location events occurring within the network of the specific MNO. 4. Inbound roaming data – Any location event by a foreign MNO subscriber in the local MNO’s network 5. Outbound roaming data – Any location event by a local MNO subscriber conducted in another network (usually