I CWSM Wikipedia, a Social Pedia: Research Challenges and Opportunities Papers from the 2015 ICWSM Workshop Technical Report WS-15-19 AAAI Press Association for the Advancement of Artificial Intelligence Wikipedia, a Social Pedia: Research Challenges and Opportunities Papers from the 2015 ICWSM Workshop Technical Report WS-15-19 AAAI Press Palo Alto, California Copyright © 2015, AAAI Press The Association for the Advancement of Artificial Intelligence 2275 East Bayshore Road, Suite 160 Palo Alto, California 94303 USA AAAI maintains compilation copyright for this technical report and retains the right of first refusal to any publication (including electronic distribution) arising from this AAAI event. Please do not make any inquiries or arrangements for hardcopy or electronic publication of all or part of the papers contained in these working notes without first explor- ing the options available through AAAI Press and AI Magazine (concur- rent submission to AAAI and an another publisher is not acceptable). A signed release of this right by AAAI is required before publication by a third party. Distribution of this technical report by any means including electronic (including, but not limited to the posting of the papers on any website) without permission is prohibited. ISBN 978-1-57735-737-7 WS-15-19 Manufactured in the United States of America Organizers Chairs Robert West (Stanford University) Leila Zia (Wikimedia Foundation) Jure Leskovec (Stanford University) iii This AAAI-sponsored workshop was collocated with ICWSM-15 and held Tuesday, May 26, 2015 in Oxford, UK iv Contents Preface / vii Robert West, Leila Zia, Jure Leskovec Wikipedia, Academia, and Science / 2 Eduard Aibar On the Evolution of Wikipedia: Dynamics of Categories and Articles / 6 Ramakrishna B. Bairi, Mark Carman, Ganesh Ramakrishnan Collaborative Visualizations for Wikipedia Critique and Activism / 11 Stefano De Sabbata, Kathryn Eccles, Scott Hale, Ralph Straumann, Arzu Çöltekin Unpacking the Structure of Knowledge Diffusion in Wikipedia: Local Biases, Noble Prizes and the Wisdom of Crowds / 17 Pierpaolo Dondio, Niccolò Casnici, Flaminio Squazzoni Eliciting Disease Data from Wikipedia Articles / 26 Geoffrey Fairchild, Sara Y. Del Valle, Lalindra De Silva, Alberto M. Segre What Women Like: A Gendered Analysis of Twitter Users' Interests Based on a Twixonomy / 34 Stefano Faralli, Giovanni Stilo, Paola Velardi A Lightly Supervised Approach to Role Identification in Wikipedia Talk Page Discussions / 43 Oliver Ferschke, Diyi Yang, Carolyn P. Rosé Towards Better Visual Tools for Exploring Wikipedia Article Development — The Use Case of "Gamergate Controversy" / 48 Fabian Flöck, David Laniado, Felix Stadthaus, Maribel Acosta Let's Talk about Talks: Supporting Knowledge Exchange Processes on Wiki Discussion Pages / 56 Sven Heimbuch, Daniel Bodemer Inconsistency between Salience and the Dynamics of Changes: The Information War on Wikipedia (Research Proposal) / 62 Elena Labzina Quo Vadis? On the Effects of Wikipedia's Policies on Navigation / 64 Daniel Lamprecht, Denis Helic, Markus Strohmaier User Engagement on Wikipedia: A Review of Studies of Readers and Editors / 67 Marc Miquel Ribé v Determining the Influence of Reddit Posts on Wikipedia Pageviews / 75 Daniel Moyer, Samuel L. Carson, Thayne Keegan Dye, Richard T. Carson, David Goldbaum Multilingual Wikipedia: Editors of Primary Language Contribute to More Complex Articles / 83 Sungjoon Park, Suin Kim, Scott A. Hale, Sooyoung Kim, Jeongmin Byun, Alice Oh Exploratory Access to Wikipedia through Faceted Dynamic Taxonomies / 89 Giovanni Maria Sacco The Transmission of Scientific Knowledge to Wikipedia / 96 Misha Teplitskiy, Grace Lu, Eamon Duede vi Preface Wikipedia is one of the most popular sites on the Web, a main source of knowledge for a large fraction of Internet users, and one of very few projects that make not only their con- tent but also many activity logs available to the public. For these reasons, Wikipedia has become an important object of study for researchers across many subfields of the computa- tional and social sciences, such as social-network analysis, social psychology, education, anthropology, political science, human-computer interaction, cognitive science, artificial intelligence, linguistics, and natural-language processing. The goal of this workshop is to create a forum for researchers exploring all social aspects of Wikipedia, including the cre- ation and consumption of content, participation in discussions and their dynamics, task management and the evolution of hierarchies, finding consensus on editorial issues, etc. With a member of the Wikimedia Foundation's research team in the organizing committee and a keynote speaker from the Foundation, we aim to establish a direct exchange of ideas between the organization that operates Wikipedia and the researchers that are interested in studying it. – Robert West, Leila Zia, Jure Leskovec vii I CWSM Workshop Papers Wikipedia, a Social Pedia: Research Challenges and Opportunities: Papers from the 2015 ICWSM Workshop Wikipedia, Academia, and Science Eduard Aibar Universitat Oberta de Catalunya [email protected] Abstract issues, in order to see how the non-expert nature of most of This paper presents some results of an ongoing research its editors and the open collaborative style of Wikipedia project on the interactions between Wikipedia and academ- shapes the way science and technology issues are depicted ia. The first part of the project analyses the perception and in its articles. practices of academic faculty about Wikipedia. It also in- cludes a study on 52 teaching experiences at universities around the world where lecturers have used Wikipedia for designing assignments involving students to edit the free Wikipedia and Academic Faculty encyclopedia. The second part of the project, still ongoing, Recent empirical studies show that Wikipedia is heavily is aimed at analyzing the scientific content of Wikipedia, in and frequently used by a large majority of university stu- order to see how the non-expert nature of most of its editors shapes the way science and technology issues are presented dents to carry out different assignments and tasks in its articles. (Wannemacher and Schulenburg 2010). Though there are very few studies with substantive empirical data on the attitude of university faculty members about Wikipedia– Introduction see, as a recent exception, Soules (2015)–the common view is that they do not seem to be so positive: academics Though so-called commons-based peer production and scientists are thought to perceive Wikipedia with skep- (Benkler 2006) projects share many features with tradi- ticism or cynicism and very few become actual editors, tional scientific practices–peer review, open publication of improving or creating articles. results, intensive collaboration and commons-oriented Our study is based on a large online survey (913 valid production–there are also important differences regarding responses) to all faculty members (3,639 people) in two authorship, publishing, collaboration styles, and laypeople large public universities in Catalonia, Spain (Universitat involvement. The present movement towards Open Sci- Oberta de Catalunya and Universitat Pompeu Fabra) in ence and Open Research pleads for importing some peer order to analyze their perceptions, attitudes and practices production mechanisms into the realm of science and aca- on Wikipedia. Our results show (±2.81% for overall data in demia (Nielsen 2011), but it is not clear whether both cul- the case of maximum uncertainty; p=q=0.5; confidence tures and ways of knowledge production are fully compati- level 95%) that the overall quality of Wikipedia articles is ble. highly valued and most faculty members are also regular Our research project tries to explore the interactions users, mainly for information seeking. between these two realms–science and Wikipedia–and The results of our survey do not support, contrary to analyze possible conflicts, tensions or mutual enrichment widespread opinion, an overwhelming negative or skepti- processes. To put it bluntly we are interested to see both cal attitude among university faculty towards Wikipedia. (1) what scientists do and think about Wikipedia and (2) On the one hand, not only do most of them see it as a use- what Wikipedia does to science. The first part of the pro- ful teaching recourse (46.8%, while only 18.8% don’t) but ject, already completed, studies the perception and practic- few feel uncomfortable about students using it as a source of information (23.1%). On the other hand, the overall es of academic faculty–taken as a good proxy for ‘scien- quality of Wikipedia articles is rather positively valued. tists’–about Wikipedia. The second part, still ongoing, is From the three questions asking about quality, reliability aimed at analyzing the scientific content of Wikipedia, i.e. and updating got a striking majority of positive answers– the subset of articles dealing with science and technology only articles’ comprehensiveness received a slightly nega- tive evaluation. The common assumption that most faculty Copyright © 2015, Association for the Advancement of Artificial Intelli- members perceive Wikipedia as an inaccurate and unrelia- gence (www.aaai.org). All rights reserved. ble source of information is not supported by our survey. 2 When considering their level of use of Wikipedia both Science and Technology in Wikipedia for professional and personal matters but without focusing specifically on teaching activities,