What Makes Citizen Science Projects Successful, and What Can We Learn from Them for Future Projects?

Total Page:16

File Type:pdf, Size:1020Kb

What Makes Citizen Science Projects Successful, and What Can We Learn from Them for Future Projects? Technion – Israel Institute of Technology What makes Citizen Science projects successful, and what can we learn from them for future projects? Literature review of Citizen Science projects Yaela Naomi Golumbic Academic advisor: Boris Koichu Technion Citizen Science Project (TCSP) 2015 Table of Content Executive summary ................................................................................................................. 2 Definitions ................................................................................................................................ 9 Classifications of Citizen Science projects .......................................................................... 12 Principals for choosing and assessing cases ...................................................................... 15 Case studies ............................................................................................................................ 17 CoCoRaHS- Community Collaborative Rain, Hail and Snow Network ......................... 17 eBird .................................................................................................................................... 22 Foldit ................................................................................................................................... 27 Galaxy Zoo .......................................................................................................................... 31 OPAL- The Open Air Laboratories .................................................................................... 34 PatientsLikeMe .................................................................................................................. 40 What makes projects successful? ........................................................................................... 45 Appendix ................................................................................................................................. 48 References ............................................................................................................................... 53 1 Executive summary This report provides a systematic review and meta-analysis for Citizen Science projects, submitted to the Technion Citizen Science Project (TCSP). The aim of this report is to better understand what makes Citizen Science projects successful, and to highlight what can be learned and implemented in future practice, from existing successful projects. For this report, we defined principals for choosing projects for case study assessment, according to the definitions of the TCSP, which include scientific excellence, innovation and citizen scientists' participation. In the attempt to choose well known and acknowledged Citizen Science projects, indicating successful management and project planning, we reviewed six established Citizen Science reviews (Bonney et al. 2009, European commission report 2013, Silvertown 2009, Dickinson 2010, Wiggins and Crowston 2011, Franzonia and Sauermann 2014), listing Citizen Science projects. A total of 139 projects were collectively mentioned in these reviews (see Appendix A). After filtering the list of projects by being cited in at least three of the six reviews, having over five unique scientific publications and matching similar topics, six final project were chosen for further assessment: CoCoRaHS, eBird, Fold It, Galaxy Zoo, OPAL and Patients-like-me. The chosen projects were reviewed and analyzed in order to shape the understanding of successful Citizen Science projects that have the capability to serve as models for future project planning. A summary of the projects main features, and the main element the can be learned from each project is hereby presented. CoCoRaHS Summary CoCoRaHS (Community Collaborative Rain, Hail and Snow Network) is a community-based network of volunteers working together to measure and map precipitation (rain, hail and snow) across North America. CoCoRaHS originated at the Colorado Climate Center at Colorado State University (CSU) in the spring of 1998 and is now the largest provider of daily precipitation observations in the United States and most of North America. CoCoRaHS primary goal is to provide accurate high-quality precipitation data for natural resource, education and research applications. Data collection is done by participants throughout North America who record daily precipitation observation using a standard rain gauge. Volunteers can also submit reports of intense rain or hail (estimate of the total rainfall over a limited time and flooding indications), or quick reports that includes starting time, approximate hailstone size and texture and any evidence of damage. Data is submitted using an online form or by phone. Accessibility- The network has an active website, blog, Facebook page and twitter feed with reports about project progress, developments and recent findings. All meteorological information is available online and is presented as a daily precipitation map or as summarized in tables, bar charts, and graphs. Among the many end users of CoCoRaHS data, are the National Weather Service, meteorologists, hydrologists, emergency managers and more. 2 What can TCSP learn from CoCoRaHS? CoCoRaHS defines itself as a community-based network. As such, all information collected by volunteers is clearly presented in the website and is disseminated for the use of many organizations and private users free of charge. Since the task of measuring precipitation includes several different activities, CoCoRaHS organizes face-to-face work-shops and training session that help participants learn how to install and use equipment and how to accurately read measurements. Training information is also available on the CoCoRaHS home page with specialized slides, videos and manuals. eBird summary eBird is an online tool for collecting and distributing basic information on bird abundance and distribution in diverse spatial and temporal measures. It was launched in 2002 by the Cornell Lab of Ornithology and National Audubon Society, and provides a simple and intuitive web-based interface for submitting and viewing bird observations. eBird is to date, one of the largest biodiversity data resources, with over one-million bird observations reported every month from tens of thousands of participants, and with more than 100,000 people entering data every year. eBird’s goal is to is to maximize the use and accessibility of the many bird observations made each year by recreational and professional bird watchers. Data collection is done by participants from a broad range of professional backgrounds, including both amateur and expert bird observers. All data is submitted using an online checklist program, participants simply enter when, where, and how they went birding, then fills out a checklist of all the birds seen and heard during that time. Data are validated with an automated data quality filters, developed by regional bird experts, before they enter the database, local experts review unusual records that are flagged by the filters. Data are then classified and grouped according to species, location and time of observation. Accessibility- The project has an active website, Facebook page and twitter feed with recent report about project progress, developments and interesting findings and photos. All birding information is available on the project website and application and can be accessed in English, Spanish, French, Portuguese and Chinese. Data can be presented as tables, bar charts, line graphs or presented on a map and are also available for download fur further use and analysis. What can TCSP learn from eBird? eBird started out from the assumption, that there is an unconsolidated amateur birdwatcher community, and focused their work on providing services that would appeal to this community and consolidate it. The tool built by eBird enables both the formulation of a birding community and contributes to in-depth scientific research and knowledge construction. Taking this approach of what the public wants and needs, is the main source 3 for eBirds' success, according to eBird initiators, and resulted in extensive growth of eBird project, in terms of the number of participants and the amount of data submitted. An additional feature that is important for a project of this magnitude is the assistance of volunteers who serve as reviewers of the submitted data and support the data quality verification. The project initiators and directors cannot review all the amounts of data that flows through the system every day and hence the assistance of these volunteers is essential. Foldit Summary Foldit is a multiplayer online game in which players compete and collaborate to find well folded protein structures. Puzzles that are presented to players are computational unsolvable, highlighting the players' contribution to science. The game was initially launched in May 2008 by a group of scientists from the University of Washington, and by September of that year it had engaged 50,000 users. One year after launch there were about 200,000 active Foldit players and activity remains steady with about 2,000 active players who play more than once a week. Foldits' primary goal is to produce accurate protein structure models through gameplay. Data collection is done by recording gameplay data from participants. Data collected includes biochemical structures, scores, algorithms, tool and algorithm usage, progress, and time played. Structures built and modified by players are reviewed
Recommended publications
  • Zooniverse: Observing the World's Largest Citizen Science Platform
    Zooniverse: Observing the World’s Largest Citizen Science Platform Robert Simpson Kevin R. Page David De Roure Department of Physics Oxford e-Research Centre Oxford e-Research Centre University of Oxford University of Oxford University of Oxford United Kingdom United Kingdom United Kingdom [email protected] [email protected] [email protected] ABSTRACT data is shown to users in the form of images, video and au- This paper introduces the Zooniverse citizen science project dio via one of the Zooniverse websites. Volunteers are shown and software framework, outlining its structure from an ob- how to perform that required analysis via a simple guide or servatory perspective: both as an observable web-based sys- tutorial such that they can then identify, classify, mark, and tem in itself, and as an example of a platform iteratively label them as researchers would do. developed according to real-world deployment and used at The first Zooniverse project, Galaxy Zoo [4, 3], launched scale. We include details of the technical architecture of Zo- in July 2007 and successfully engaged 165,000 volunteers in oniverse, including the mechanisms for data gathering across the morphological classification of images of galaxies. The the Zooniverse operation, access, and analysis. We consider early success of this first project led the team behind it to the lessons that can be drawn from the experience of design- explore new research domains and types of task and user ing and running Zooniverse, and how this might inform de- interface. velopment of other web observatories.
    [Show full text]
  • Rapport-Houllier-2016.Pdf
    Les Sciences participatives en France État des lieux, bonnes pratiques & recommandations Février 2016 Rapport élaboré à la demande des ministres en charge de l’Éducation nationale, de l’Enseignement supérieur et de la Recherche, sous la direction de François Houllier, Président-Directeur général de l’Inra et Président d’AllEnvi. Né en 1959, François Houllier est nommé ingénieur du Génie rural, des eaux et des forêts à sa sortie de l’Ecole polytechnique. Titulaire d’une thèse de doctorat et d’une habilitation à diriger des recherches, il travaille auprès de l’Inventaire forestier national et enseigne à l’École nationale du génie rural des eaux et des forêts avant d’être nommé Directeur de l’Institut français de Pondichéry en Inde. Il rejoint l’Institut national de la Recherche agronomique en 1998 au sein duquel il exerce diverses responsabilités (Directeur d’unité mixte de recherche, chef de département, Directeur scientifique et Directeur général délégué) avant d’être nommé Président-Directeur général de l’institut par le Président de la République le 26 juillet 2012. Il préside également l’Alliance nationale de recherche pour l’environnement (alimentation, eau, climat, territoires) depuis 2012. Rapporteur : Jean-Baptiste Merilhou-Goudard, Conseiller du Président de l’Inra Né en 1987, Jean-Baptiste Merilhou-Goudard est diplômé en biologie, en médiations des sciences et en administration des entreprises. Il rejoint l’Institut national de la Recherche agronomique en 2011 en tant que chef du service événements puis intègre le cabinet de son Président-Directeur général. Il est nommé Conseiller du Président de l’Inra en 2015.
    [Show full text]
  • Zooniverse Planet Hunters: Your Feedback
    Zooniverse Planet Hunters: your feedback Page 1: The Planet Hunters team needs your feedback! We are evaluating the Planet Hunters platform to understand its impact; gain a better understanding of who takes part and why volunteers engage; and explore the possible benefits and barriers to volunteers. We want to hear your feedback so we can learn how to improve Planet Hunters TESS and other projects on Zooniverse. Please complete this short survey and let us know your thoughts. This survey should take around 5-10 minutes to complete. How will my data be used? We will use your data for the purposes of understanding who is engaging with Zooniverse Planet Hunters, and exploring your experiences of the project. This feedback will inform the overall learning and evaluation of Planet Hunters. The results will be published in a case study that will be publicly available on our Planet Hunters blog page and the University of Oxford webpages. Please note, your responses will be anonymised and no names will be published. If you have a concern about any aspect of the evaluation, please email [email protected]. For Zooniverse's User Agreement and Privacy Policy, please visit www.zooniverse.org/privacy. For for further details about how your data will be used in this survey, see Privacy Notice. Who is conducting this evaluation and why? Annaleise Depper (Public Engagement with Research Evaluation Officer, University of Oxford). I work with researchers at Oxford who are engaging the public through their research and support 1 / 24 researchers to explore and evidence the impact of their engagement activities.
    [Show full text]
  • Crowd Science: the Organization of Scientific Research in Open Collaborative Projects
    Crowd Science: The Organization of Scientific Research in Open Collaborative Projects Chiara Franzoni DIG, Politecnico di Milano P. Leonardo da Vinci 32, Milano, 20133 [email protected] Henry Sauermann Georgia Institute of Technology, Scheller College of Business 800 W Peachtree St., Atlanta, GA 30308 [email protected] Abstract A rapidly growing amount of scientific research is done in an open collaborative fashion, in projects that are sometimes labeled as “crowd science”, “citizen science”, or “networked science”. This paper seeks to gain a more systematic understanding of crowd science and to provide scholars with a conceptual framework and a research agenda for studying this important phenomenon. First, we briefly present three case examples that span different fields of science and illustrate the heterogeneity concerning what crowd science projects do and how they are organized. Second, in an attempt to more clearly define what crowd science is, we identify organizational features that are common among crowd science projects while distinguishing them from projects in “traditional” science as well as other emerging knowledge production regimes. Third, we draw on the broader organizational literature to discuss potential organizational challenges crowd science may face, and conjecture how these challenges may be addressed. Finally, we conclude with a brief agenda for future research. Given the considerable promise crowd science holds, this discussion should be of interest not only to science and innovation scholars, but also to scientists as well as to policy makers, funding agencies, and science-based firms. Keywords: crowd science; community-based production; research collaboration; knowledge disclosure; open science. PRELIMINARY DRAFT – PLEASE DO NOT DISTRIBUTE; COMMENTS WELCOME We are grateful for comments and suggestions from Rhiannon Crain, Carolin Haeussler, Alex Oettl, Cristina Rossi-Lamastra, Arfon Smith, Jose Urbina, and participants in the 10th International Open and User Innovation Workshop.
    [Show full text]
  • Galaxy Zoo / Zooniverse
    Citizen Science Case Study: Galaxy Zoo / Zooniverse Nathan R. Prestopnik Syracuse University [email protected] Abstract Galaxy Zoo and other “Zooniverse” websites are citizen science projects designed to allow individuals to aid with scientific inquiry through annotating various astronomical photographs or other assets online. Galaxy Zoo is specifically designed to have individuals from around the world classify galaxies photographed by various space telescope platforms. The classifications submitted are used to paint a more detailed picture of the universe we live in. This case study is an examination of Galaxy Zoo and its sister citizen science websites as interactive technology artifacts, with emphasis placed on design decisions, technical implementation, and how these two antecedents affect users, participants, and the overall success of these projects. In addition to providing a clear view of how the Galaxy Zoo platform is designed and functions, our purpose is to inform future citizen science technical implementations. It is hoped that by studying a successful implementation such as Galaxy Zoo and the Zooniverse, we may begin to suggest best practices for the deployment of web or mobile-based platforms for a variety of citizen science dependent investigations. Associated Links The following links are to projects and related work mentioned in this case study: Galaxy Zoo: http://www.galaxyzoo.org Moon Zoo: http://www.moonzoo.org Old Weather: http://www.oldweather.org Zooniverse: http://www.zooniverse.org 1. Introduction Galaxy Zoo is a citizen science project originally developed by researchers at the University of Oxford to assist with the classification of galaxies. Ground and space-based observation platforms such as the Sloan Digital Sky Survey and the Hubble Space Telescope have produced large quantities of sky images featuring galaxies and other astronomical objects of interest.
    [Show full text]
  • Improving Crowdsourcing and Citizen Science As a Policy Mechanism for NASA
    Improving Crowdsourcing and Citizen Science as a Policy Mechanism for NASA Brittany Balcom cooperate.across all levels of Government and with non- profit organizations, businesses, and individuals in the private Space Policy Institute, Washington, District of Columbia. sector’’). These three traits make up the Open Government Principles. It directed the White House chief technology of- ABSTRACT ficer to work with the director of the Office of Management This article examines citizen science projects, defined as ‘‘a form and Budget and the Administrator of the General Services of open collaboration where members of the public participate in Administration to develop recommendations for an Open the scientific process, including identifying research questions, Government Directive, laying out specific actions to be taken 1 collecting and analyzing the data, interpreting the results, and to forward these three principles. problem solving,’’ as an effective and innovative tool for National This article will focus on the participatory and collaborative Aeronautics and Space Administration (NASA) science in line principles, specifically with regard to how the continued use with the Obama Administration’s Open Government Directive. and development of innovative crowdsourced research and Citizen science projects allow volunteers with no technical citizen science can benefit the National Aeronautics and training to participate in analysis of large sets of data that would Space Administration (NASA) and other space-related groups. otherwise constitute prohibitively tedious and lengthy work for Citizen science does not yet have a single widely accepted research scientists. Zooniverse.com hosts a multitude of popular definition. A product of the Internet, it is relatively new to space-focused citizen science projects, many of which have been science, is still evolving, and exists in a multitude of forms.
    [Show full text]
  • Robert Simpson • Oxford University
    Robert Simpson • Oxford University Friday, 24 June 2011 Friday, 24 June 2011 GALAXY ZOO: SUPERNOVAE GALAXY ZOO: MERGERS SOLAR STORMWATCH GALAXY ZOO: HUBBLE MOON ZOO OLD WEATHER THE MILKY WAY PROJECT PLANET HUNTERS Friday, 24 June 2011 40,000,000 CLASSIFICATIONS 320,000 VOLUNTEERS www.galaxyzoo.org Friday, 24 June 2011 2,150,000 IMAGES 3.1 SWITZERLANDS 50,000 SQUARE MILES 60,000 378,000 VOLUNTEERS DISNEYLANDS www.moonzoo.org Friday, 24 June 2011 17,000 VOLUNTEERS 490,000 PAGES www.oldweather.org Friday, 24 June 2011 24,000 VOLUNTEERS 380,000 BUBBLES 1,500,000 DRAWINGS www.milkywayproject.org Friday, 24 June 2011 3,000,000 LIGHT CURVES 30,000 VOLUNTEERS 69 PLANETS www.planethunters.org Friday, 24 June 2011 COMMUNITY The Zooniverse is equivalent to 4 Wembley Stadiums or 9 Wrigley Fields! We are now more than twice the size of the world’s largest stadium in North Korea! Friday, 24 June 2011 COMMUNITY There are only 11 armies in the world that are larger than the Zooniverse! (China, USA, India, North Korea, Russia, South Korea, Pakistan, Iran, Turkey, Egypt and Vietnam) Friday, 24 June 2011 Friday, 24 June 2011 COGNITIVE SURPLUS 1 FACEBOOK-HR = 43,000 MAN-HRS 1 ANGRY BIRDS-HR = 3.3 MILLION MAN-HRS Friday, 24 June 2011 Friday, 24 June 2011 Friday, 24 June 2011 Friday, 24 June 2011 Friday, 24 June 2011 Friday, 24 June 2011 Friday, 24 June 2011 DATA Extended WW1 Period 280 vessels 750,000 log pages 65% complete Friday, 24 June 2011 Friday, 24 June 2011 Friday, 24 June 2011 Friday, 24 June 2011 Friday, 24 June 2011 Friday, 24 June 2011 USER STATISTICS
    [Show full text]