Frontiers of Data Science for Government: Ideas, Practices, and Projections

Total Page:16

File Type:pdf, Size:1020Kb

Frontiers of Data Science for Government: Ideas, Practices, and Projections Frontiers of Data Science for Government: Ideas, Practices, and Projections 15-16 September 2016 University of Cambridge dataforpolicy.org | @dataforpolicy | #DataFrontiers About Data for Policy Initiative Launched at the inaugural conference that was hosted by the University of Cambridge in 2015, Data for Policy has been established as an independent initiative to promote “Policy- making in the Big Data Era: Opportunities and Challenges” interdisciplinary and cross-sectorial discussion on the use of Data Science research to enhance government operations and policy-making. The inaugural conference hosted top-level presentations from UK and EU government bodies, prestigious national and international universities, non-profit institutions, and major industrial stakeholders. We are grateful to the following prestigious institutions • University of Cambridge for supporting this initiative: – Computer Laboratory, Centre for Science and Policy, • European CommissionCambridge Big Data Strategic Research Initiative, Digital Humanities Network, • Alan Turing InstituteCambridge Public Policy Initiative • Imperial College London • London School of Economics & Political Sciences – Data Science Institute • University College London – Department of Methodology • University of Oxford – Department of Computer Science, UCL Public • Office for National StatisticsPolicy, The Bartlett – UCL Faculty of the Built Environment • Royal Statistical Society– Oxford Internet Institute • New York University • Leiden University • Technopolis Group – The GovLab, Open Governance Research Exchange – Centre for Innovation 1 Data for Policy 2016 Conference sectors Data Science is emerging as a key interdisciplinary research field to address major contemporary challenges across . Particular focus on the government sector offers huge potentials to advance citizen services and collective decision-making processes. To reflect the diversity of skills and knowledge required to tackle challenges in this domain, the conference offers an open discussion forum for all stakeholders. Data for Policy 2016 invited individual and/or group submissions from all relevant disciplines and application domains. Topics covered included but were not limited to Government & Policy:the following: Digital era governance and citizen services, public demand vs. government response, using data in the policy process, open source and open data movements, policy laboratories, citizen expertise for government, public opinion and participation in democratic processes, distributed data bases and data streams, Policy finformation and evidence in policy context, case studies and best practices.or Data & Management: Data collection, storage, and access; psychology/behaviour of decision; privacy, trust, public rights, free speech, ethics and law; data security/ownership/linkage; provenance, curation, expiration; private/public Data Analysis:sector/non-profit collaboration and partnership, etc. Computational procedures for data collection, storage, and access; large- scale data processing, dealing with biased/imperfect/uncertain data, human interaction with data, statistical/computational models, technical challenges, communicating Methodologies:results, visualisation, etc. Qualitative/quantitative/mixed methods, gaps in theory and practice, secondary data analysis, web scraping, randomised controlled trials, sentiment analysis, Bayesian approaches and graphical models, biologically inspired models, real-time and historical data processing, simulation and modeling, small area estimation, correlation & Data Sources:causality based models, and other relevant methods. Government administrative data, official statistics, commercial and non- profit data, user-generated web content (blogs, wikis, discussion forums, posts, chats, tweets, podcasting, pins, digital images, video, audio files, advertisements, etc.), search engine data, data gathered by connected people and devices (e.g. wearable technology, mobile devices, Internet of Things), tracking data (including GPS/geolocation data, traffic and other transport sensor data, CCTV images etc.,), satellite and aerial imagery, Policy/Application Domains:and other relevant data sources. Security, health, cities, public administration, economy, science and innovation, finance, energy, environment, social policy areas (education, migration, etc.) and other relevant domains. 2 Organisers Advisory Committee: Bacon Benoit Prof. Jean , Computer Laboratory, University of Cambridge Prof. Kenneth Cleevely , Department of Methodology, London School of Economics and Political ScienceCrowcroft Dr. David Finkelstein, Centre for Science and Policy, University of Cambridge Prof. Jon Giovannini, Computer Laboratory, University of Cambridge Prof. Anthony , Chief Scientific Advisor, Government Office for Science, UK Prof. Enrico Hand , Co-Chair, UN Data Revolution Group & University of Rome “Tor Vergata”, Italy Haskel Prof. David Howarth, Winton Capital Management and Imperial College Prof. Jonathan , Data Science Institute, Imperial College London Prof. David Margetts, Department of Politics and International Studies, University of CambridgeNoveck Prof. Helen Oates , Oxford Internet Institute, University of Oxford Prof. Beth Procter , The GovLab, New York University & MIT Media Lab, US Mr. Bill Reid, Chief Data Scientist, Office for National Statistics, UK Prof. Rob Shawe-, Department of Computer Science, University of WarwickTaylor Prof. Graeme Smith , University College London Prof. John , Department of Computer Science, University College London Prof. Peter Taysom, ESRC Administrative Data Research Centre for England and University of Southampton Prof. John Treleaven, University College London, University of Cambridge, Harvard UniversityWolfe Prof. Philip Wallace, Department of Computer Science, University College London Prof. Patrick Watson , Deputy Director, The Alan Turing Institute, UK Prof. Sir David Williams , University of Cambridge Mr. Glen Wyatt, Director-General, Office for National Statistics, UK Prof. Robin , School of Social and Political Science, University of Edinburgh Prof. Derek , Chair, Royal Trinity Hospice; NHS Innovations South East, UK Executive Committee: Engin Dr. Zeynep Bharath , Chief Organiser, Data for Policy 2016; University College London; University of Cambridge Dr. Anil Gokpinar, Data Science Institute & Dept. of Bioengineering, Imperial College London Agarwal Dr. Bilal , School of Management, University College London Dr. Prabhat , European Commission Programme Committee: Alexander Castro Dr. Anne Demange, Digital Humanities Network, University of Cambridge, UK Mr. Daniel Demirsoy, Director, Centre for Data Innovation, US Prof. Gabrielle de Montjoye, Paris School of Economics, France Dr. Suleyman , Director, London Innovation Society, UK Dr. Yves-Alexandre , Harvard University, US 3 Dyer-Smith Ghani Dr. Clare McPherson , Cambridge Big Data SRI, University of Cambridge Dr. Rayid Meyer, Centre for Data Science and Public Policy, University of Chicago, US Dr. Ella Michaylov, Department of Sociology, University of Cambridge Prof. Eric , Oxford Internet Institute, University of OxfordMoat Dr. Slava Mortier, Department of Political Science, University College London Assoc. Prof. Suzy Moy , Warwick Business School, University of Warwick Dr. Richard Musolesi , Computer Laboratory, University of Cambridge Mr. Will , Director, Full Fact, UKPreis Dr. Mirco Poel , Department of Geography, University College London Assoc. Prof. Tobias Powell , Warwick Business School, University of Warwick Dr. Martijn , Technopolis Group Dr. Alison Sausman, Media and Communications, London School of Economics and Political ScienceSchroder Dr. Charlotte Shimshon, Cambridge Public Policy SRI, University of Cambridge Prof. Ralph Singh , Oxford Internet Institute, University of Oxford Drs. Gideon Stevenson , Director, Centre for Innovation, Leiden University, Netherlands Dr. Jatinder Tastan , Computer Laboratory, University of Cambridge Dr. Olivia , UCL Public Policy Dr. Mesut Ubaldi, Department of Finance, London School of Economics and Political Science Ms. Barbara Vlad-Calcic, The Organisation for Economic Co-operation and Development (OECD) Žliobaitė Ms. Diana , European Commission Dr. Indrė , Uni. of Helsinki, Aalto Uni., Helsinki Inst. for Information Technology (HIIT), Finland 4 Conference Programme Thursday, 15 September 2016 09:30 – 10:00 Arrivals & Registration 10:00 – 10:20 Welcome & Introductions (Room – LT1) Hopper, Andy Professor of Computer Technology and Head of Department, Computer Laboratory, University of CambridgeEngin, Zeynep Chief Organiser, Data for Policy 2016 ; Senior Research Associate, Urban Dynamics Lab, UCL; Policy Fellow, Centre for Science and Policy, University of Cambridge 10:20 – 11:20 Opening Plenary Session (Room – LT1) “Big Data Analytics and EU Policy-making – huge potential, significant challenges" Rute Maive , Deputy Director-General of Joint Research Centre, European “CPlatform Government and a Data Science for Policyommission -making?” Margetts “Helen Algorithmic Regulation:, Director of the Oxford Internet Institute, University of Oxford Using Blockchain smart contract technology to rev olutionise Financial Regulation” Treleaven Philip , Professor of Computing and Director of the Financial Chair: Computing CentreCrowcroft , University College London Jon , Marconi Professor of Communications Systems, Computer Laboratory, University of Cambridge; The Alan Turing Institute 11:20 – 11:40 Break 11:40 – 12:40 Parallel Session 1 Session
Recommended publications
  • Program, List of Abstracts, and List of Participants and of Participating Institutions
    Wellcome to the Econophysics Colloquium 2016! In this booklet you will find relevant information about the colloquium, like the program, list of abstracts, and list of participants and of participating institutions. We hope you all have a pleasant and productive time here in São Paulo! Program Wednesday, 27 Thursday, 28 Friday, 29 8.30 – Registration 9:15 am 9:15 – Welcome 9.30 am Universality in the interoccurrence Multiplex dependence structure of Measuring economic behavior using 9.30 - times in finance and elsewhere financial markets online data 10.30 am (C. Tsallis) (T. Di Matteo) (S. Moat) 10.30- Coffee Break Coffee Break Coffee Break 11.00 am Portfolio optimization under expected Financial markets, self-organized Sensing human activity using online 11.00- shortfall: contour maps of estimation criticality and random strategies data 12.00 am error (A. Rapisarda) (T. Preis) (F. Caccioli) 12.00- Lunch Lunch Lunch 2.00 pm Trading networks at NASDAQ OMX Complexity driven collapses in large 2.00-3.00 IFT-Colloquium Helsinki random economies pm (R. Mantegna) (R. Mantegna) (G. Livan) Financial market crashes can be 3.00-4.00 Poster Session quantitatively forecasted Parallel Sessions 2A and 2B pm (S.A. Cheong) 4.00-4.30 Coffee Break Coffee Break Closing pm Macroeconomic modelling with Discussion Group: Financial crises and 4.30-5.30 heterogeneous agents: the master systemic risk - Presentation by Thiago pm equation approach (M. Grasselli) Christiano Silva (Banco Central) 5.45-6.45 Discussion Group: Critical transitions in Parallel Sessions 1A and 1B pm markets 7.00- Dinner 10.00 pm Wednesday, 27 July Plenary Sessions (morning) Auditorium 9.30 am – 12 pm 9.30-10.30 am Universality in the Interoccurence times in finance and elsewhere Constantino Tsallis (CBPF, Brazil) A plethora of natural, artificial and social systems exist which do not belong to the Boltzmann-Gibbs (BG) statistical-mechanical world, based on the standard additive entropy SBG and its associated exponential BG factor.
    [Show full text]
  • WRAP 0265813516687302.Pdf
    Original citation: Seresinhe, Chanuki Illushka, Moat, Helen Susannah and Preis, Tobias. (2017) Quantifying scenic areas using crowdsourced data. Environment and Planning B : Urban Analytics and City Science . 10.1177/0265813516687302 Permanent WRAP URL: http://wrap.warwick.ac.uk/87375 Copyright and reuse: The Warwick Research Archive Portal (WRAP) makes this work of researchers of the University of Warwick available open access under the following conditions. This article is made available under the Creative Commons Attribution 3.0 (CC BY 3.0) license and may be reused according to the conditions of the license. For more details see: http://creativecommons.org/licenses/by/3.0/ A note on versions: The version presented in WRAP is the published version, or, version of record, and may be cited as it appears here. For more information, please contact the WRAP Team at: [email protected] warwick.ac.uk/lib-publications Urban Analytics and Article City Science Environment and Planning B: Urban Quantifying scenic areas Analytics and City Science 0(0) 1–16 ! The Author(s) 2017 using crowdsourced data Reprints and permissions: sagepub.co.uk/journalsPermissions.nav DOI: 10.1177/0265813516687302 Chanuki Illushka Seresinhe, journals.sagepub.com/home/epb Helen Susannah Moat and Tobias Preis Warwick Business School, University of Warwick, UK; The Alan Turing Institute, UK Abstract For centuries, philosophers, policy-makers and urban planners have debated whether aesthetically pleasing surroundings can improve our wellbeing. To date, quantifying how scenic an area is has proved challenging, due to the difficulty of gathering large-scale measurements of scenicness. In this study we ask whether images uploaded to the website Flickr, combined with crowdsourced geographic data from OpenStreetMap, can help us estimate how scenic people consider an area to be.
    [Show full text]
  • Prof Helen MARGETTS Director and Professor of Society and the Internet, Oxford Internet Institute, University of Oxford
    Prof Helen MARGETTS Director and Professor of Society and the Internet, Oxford Internet Institute, University of Oxford Helen Margetts is the Director of the OII, and Professor of Society and the Internet. She is a political scientist specialising in digital era governance and politics, investigating political behaviour, digital government and government-citizen interactions in the age of the internet, social media and big data. She has published over a hundred books, articles and major research reports in this area, including Political Turbulence: How Social Media Shape Collective Action (with Peter John, scott Hale and Taha Yasseri, 2015); Paradoxes of Modernization (with Perri 6 and Christopher Hood, 2010); Digital Era Governance (with Patrick Dunleavy, 2006); and The Tools of Government in the Digital Age (with Christopher Hood, 2007). In 2003 she and Patrick Dunleavy won the 'Political Scientists Making a Difference' award from the UK Political Studies Association, in part for a series of policy reports on Government on the Internet for the UK National Audit Office (1999, 2002 and 2007), and she continues working to maximise the policy impact of her research. She sits on the Digital Advisory Board of the UK Government Digital Service and the World Economic Forum Global Agenda Council on the Future of Government. She is editor-in-chief of the journal Policy and Internet. She is a fellow of the Academy of Social Sciences. From 2011- 2014 she held the ESRC professorial fellowship 'The Internet, Political Science and Public policy: Re-examining Collective Action, Governance and Citizen-Governance Interactions in the Digital Era'. Professor Margetts joined the OII in 2004 from University College London where she was a Professor in Political Science and Director of the School of Public Policy.
    [Show full text]
  • Download Book
    Challenges to Democracy Political Studies Association Yearbook Series Titles include: Keith Dowding, James Hughes and Helen Margetts (editors) CHALLENGES TO DEMOCRACY Ideas, Involvement and Institutions Chris Pierson and Simon Tormey (editors) POLITICS AT THE EDGE The PSA Yearbook 1999 Political Studies Association Yearbook Series Standing Order ISBN 978-0-333-91373-4 (outside North America only) You can receive future titles in this series as they are published by placing a standing order. Please contact your bookseller or, in case of difficulty, write to us at the address below with your name and address, the title of the series and the ISBN quoted above. Customer Services Department, Macmillan Distribution Ltd, Houndmills, Basingstoke, Hampshire RG21 6XS, England Challenges to Democracy Ideas, Involvement and Institutions The PSA Yearbook 2000 Edited by Keith Dowding Professor of Political Science London School of Economics James Hughes Senior Lecturer in Comparative Economics London School of Economics and Helen Margetts Professor of Political Science Director, School of Public Policy University College London in association with Political Studies Association © Political Studies Association 2001 Softcover reprint of the hardcover 1st edition 2001 978-0-333-78982-7 All rights reserved. No reproduction, copy or transmission of this publication may be made without written permission. No paragraph of this publication may be reproduced, copied or transmitted save with written permission or in accordance with the provisions of the Copyright, Designs and Patents Act 1988, or under the terms of any licence permitting limited copying issued by the Copyright Licensing Agency, 90 Tottenham Court Road, London W1P 0LP. Any person who does any unauthorised act in relation to this publication may be liable to criminal prosecution and civil claims for damages.
    [Show full text]
  • Violent Protest and Heterogeneous Diffusion
    BRITAIN FIRST AND THE UK INDEPENDENCE PARTY: SOCIAL MEDIA AND MOVEMENT-PARTY DYNAMICS1 Thomas Davidson and Mabel Berezin2 FORTHCOMING IN DECEMBER 2018 ISSUE OF MOBILIZATION. PLEASE CITE THE PUBLISHED VERSION. Social movement scholars have recently turned their attention to the interactions between political parties and social movements, but little is known about how social media have impacted these relationships, despite widespread adoption of these technologies. We present a case study of the relationship between Britain First, a far-right anti-Muslim social movement, and the U.K. Independence Party, the Eurosceptic political party that spearheaded the Brexit campaign. The movement appeared marginal in the press but it dominated social media, using this presence to support to the party. We examine the dynamics of the relationship between these groups from 2013 until 2017, drawing upon data from social media, newspapers, and other online sources, and focusing on interactions between elites and rank-and-file supporters. Our findings illustrate how far-right groups have used new technologies to generate an unprecedented amount of popular support and to attempt to influence the political mainstream. A number of western democracies have recently experienced a resurgence of right-wing political activity in both the parliamentary and extra-parliamentary sphere (Akkerman, de Lange, and Rooduijn 2016; Mudde 2016; Muis and Immerzeel 2017). In Germany, the unprecedented electoral performance of the anti-immigrant Alternative for Germany (AfD) party
    [Show full text]
  • Training Tomorrow's Analysts
    64 www.efmd.org/globalfocus 10101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101 01010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010 10101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101 01010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010 10101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101 01010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010 10101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101010101
    [Show full text]
  • The Digital Treasure Trove
    background in computer science. My PhD gave me the a large scale,” says Preis. “Google provides the possibility chance to bring all these different disciplines together, of looking at the early stages of collective decision making. to try and understand the vast amounts of data generated Investors are not disconnected from the world, they’re by the financial world. So everything I’m doing today is hugely Googling and using various platforms and services to collect interdisciplinary, involving large volumes of data.” information for their decisions.” In effect, these new sources In the era of big data, Preis’s research looks at what of data can predict human behaviour. The events of the world he calls the “digital traces”, the digital detritus, the granules are Googled before they happen. The next challenge for these of information and insight we leave behind in our interactions researchers is to be able to identify key words and phrases at with technology and the internet in particular. His research the time they are being used rather than historically. is probably best described as “computational social science”, an emerging interdisciplinary field which aims to exploit such The risks of diversification data in order to better understand how our complex social world operates. Preis’s fascination with big data and financial markets also led to his involvement in a study of the US market index, the Dow Positive traces Jones. His research analysed the daily closing prices of the 30 stocks forming the Dow Jones Industrial Average from March One intriguing source of information used by Preis’s research 15, 1939, to December 31, 2010.
    [Show full text]
  • Quantifying Trading Behavior in Financial Markets Using Google Trends : Scientific Reports : Nature Publishing Group
    13-4-27 Quantifying Trading Behavior in Financial Markets Using Google Trends : Scientific Reports : Nature Publishing Group nature.com Sitemap Cart Login Register Search 2013 April Article SCIENTIFIC REPORTS | ARTICLE OPEN Quantifying Trading Behavior in Financial Markets Using Google Trends Tobias Preis, Helen Susannah Moat & H. Eugene Stanley Scientific Reports 3, Article number: 1684 doi:10.1038/srep01684 Received 25 February 2013 Accepted 03 April 2013 Published 25 April 2013 Crises in financial markets affect humans worldwide. Detailed market data on trading decisions reflect some of thPerint complex human behavior that has led to these crises. We suggest that massive new data sources resulting from human interaction with the Internet may offer a new perspective on the behavior of market participants in periods of large market movements. By analyzing changes in Google query volumes for search terms related to finance, we find patterns that may be interpreted as “early warning signs” of stock market moves. Our results illustrate the potential that combining extensive behavioral data sets offers for a better understanding of collective human behavior. Subject terms: Computational science Applied physics Information theory and computation Statistical physics, thermodynamics and nonlinear dynamics Introduction The increasing volumes of ‘big data’ reflecting various aspects of our everyday activities represent a vital new opportunity for scientists to address fundamental questions about the complex world we inhabit1, 2, 3, 4, 5, 6, 7. Financial markets are a prime target for such quantitative investigations8, 9. Movements in the markets exert immense impacts on personal fortunes and geopolitical events, generating considerable scientific attention to this subject10, 11, 12, 13, 14, 15, 16, 17, 18, 19.
    [Show full text]
  • Analysis of Financial News with Newsstream
    Date: 2015-11-01 IJS-DP-11965 Analysis of Financial News with NewsStream Petra Kralj Novak, Miha Grˇcar,Borut Sluban and Igor Mozetiˇc JoˇzefStefan Institute Ljubljana, Slovenia petra.kralj.novak, miha.grcar, borut.sluban, igor.mozetic @ijs.si { } Abstract Unstructured data, such as news and blogs, can provide valuable in- sights into the financial world. We present the NewsStream portal, an in- tuitive and easy-to-use tool for news analytics, which supports interactive querying and visualizations of the documents at different levels of detail. It relies on a scalable architecture for real-time processing of a continu- ous stream of textual data, which incorporates data acquisition, cleaning, natural-language preprocessing and semantic annotation components. It has been running for over two years and collected over 18 million news articles and blog posts. The NewsStream portal can be used to answer the questions when, how often, in what context, and with what sentiment was a financial entity or term mentioned in a continuous stream of news and blogs, and therefore providing a complement to news aggregators. We illustrate some features of our system in four use cases: relations between the rating agencies and the PIIGS countries, reflection of financial news on credit default swap (CDS) prices, the emergence of the Bitcoin digital currency, and visualizing how the world is connected through news. Keywords: stream processing architecture, unstructured data, financial news, sentiment analysis, ontology-based entity recognition, visual analytics 1 Introduction Tens of thousands of news articles are being published daily on the world wide arXiv:1508.00027v2 [cs.IR] 7 Nov 2015 web by thousands of news sources.
    [Show full text]
  • Curriculum Vita Pippa Norris
    PIPPA NORRIS CURRICULUM VITAE 7/25/2021 JOHN F. KENNEDY SCHOOL OF GOVERNMENT • HARVARD UNIVERSITY CAMBRIDGE MA 02138 • TEL: (857) 4 4 5 - 9105 E - MAIL [email protected] TWITTER: @PIPPAN15 WWW.PIPPANORRIS.COM WWW.ELECTORALINTEGRITYPROJECT.COM PIPPA NORRIS CURRICULUM VITAE CONTENTS MAIN FIELDS OF RESEARCH ............................................................................................. 2 AGE ....................................................................................................................................... 2 EDUCATION ......................................................................................................................... 2 QUALIFICATIONS ................................................................................................................ 2 FULLTIME APPOINTMENTS: .............................................................................................. 2 MAJOR HONORS: ................................................................................................................. 3 CITATION IMPACT: ............................................................................................................. 4 TEACHING: .......................................................................................................................... 4 PROFESSIONAL ACTIVITIES AND MEMBERSHIPS: .......................................................... 4 EDITORIAL BOARDS: .......................................................................................................... 5 AUTHORED
    [Show full text]
  • Estimating Tourism Statistics with Wikipedia Page Views
    View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by Warwick Research Archives Portal Repository Original citation: Alis, Christian M., Letchford, Adrian, Moat, Helen Susannah and Preis, Tobias (2015) Estimating tourism statistics with Wikipedia page views. In: WebSci '15 Web Science Conference, Oxford, 28 Jun - 1 Jul 2015. Published in: WebSci '15 Proceedings of the ACM Web Science Conference pp. Article 33. Permanent WRAP URL: http://wrap.warwick.ac.uk/79613 Copyright and reuse: The Warwick Research Archive Portal (WRAP) makes this work by researchers of the University of Warwick available open access under the following conditions. Copyright © and all moral rights to the version of the paper presented here belong to the individual author(s) and/or other copyright owners. To the extent reasonable and practicable the material made available in WRAP has been checked for eligibility before being made available. Copies of full items can be used for personal research or study, educational, or not-for profit purposes without prior permission or charge. Provided that the authors, title and full bibliographic details are credited, a hyperlink and/or URL is given for the original metadata page and the content is not changed in any way. Publisher’s statement: "© ACM, 2015. This is the author's version of the work. It is posted here by permission of ACM for your personal use. Not for redistribution. The definitive version was published in WebSci '15 Proceedings of the ACM Web Science Conference http://doi.acm.org/10.1145/2786451.2786925 A note on versions: The version presented here may differ from the published version or, version of record, if you wish to cite this item you are advised to consult the publisher’s version.
    [Show full text]
  • Predicting the Present with Google Trends
    Predicting the Present with Google Trends Hyunyoung Choi, Hal Varian∗ December 18, 2011 Abstract In this paper we show how to use search engine data to forecast near-term values of economic indicators. Examples include automobile sales, unemployment claims, travel destination planning, and consumer confidence. Government agencies periodically release indicators of the level of economic activity in various sectors. However, these releases are typically only available with a reporting lag of several weeks and are often revised a few months later. It would clearly be helpful to have more timely forecasts of these economic indicators. Nowadays there are several sources of data on real-time economic activity available from private sector companies such as Google, MasterCard, Federal Express, UPS, Intuit and many others. In this paper we examine Google Trends, which is a a real-time daily and weekly index of the volume of queries that users enter into Google. We have found that these query indices are often correlated with various economic indicators and may be helpful for short-term economic prediction. We are not claiming that Google Trends data can help in predicting the future. Rather we are claiming that Google Trends may help in predicting the present. For example, the volume of queries on automobile sales during the second week in June may be helpful in predicting the June auto sales report which is released several weeks later in July. It may also be true that June queries help to predict July sales, but we leave that question for future research, as this depends very much on the particular time series in question.
    [Show full text]