The Future of Academic Research A
Total Page：16
File Type：pdf, Size：1020Kb
Publon #1 The Future of Academic Research A. R. H. Preston and D. R. Johnston The manner in which academic research is published has remained remarkably static relative to the upheaval currently underway in most other publishing industries. In this paper we examine the incentive structure that caused this outcome, outline a strategic approach to creating a system that encourages collaboration and faster scientific development, and introduce publons.com, our implementation of these ideas. Introduction In 1905 Albert Einstein published four papers in Annalen der Physik and changed the world.1 The first, published in June, introduced the concept of the photon and explained the photoelectric effect. The second, published in July, explained Brownian motion in a way that provided strong proof for the existence of the atom. The final two papers, published in September and November, introduced special relativity. It was truly the annus mirabilis, heralding modern physics and triggering a century of spectacular discoveries. Physics would never be the same. Yet the manner in which academic research is published has remained remarkably static. The concept of the scientific journal has its roots in the 17th and 18th centuries.2 It was a great technological advance. Up to that point new results were communicated either by word of mouth, letter, or monograph. The journal standardized the way novel results were collated, validated (via editors and peer-review), and disseminated. In short, communication became more efficient, and research moved forward at a faster rate. By any measure this technology has developed into an essential facet of academic research. This year, tens of thousands of journals will publish millions of articles which will be read by at least as many researchers.3 Perhaps most importantly, billions of dollars4 in research funding and academic positions will be allocated based largely on academic publication records.5 To support this an ecosystem has evolved comprised of four key players: academics, journals, libraries, and funding agencies, each of whom has somewhat conflicting goals. 1 Einstein’s Miraculous Year: Five Papers that Changed the Face of Physics; Princeton University Press 2005. 2 David Kronick - A History of Scientific & Technical Periodicals: The Origins and Development of the Scientific and Technical Press, 1665-1970, 2nd ed; Scarecrow Press, 1976. 3 Information Research 14, 391 (2009). 4 http://www.quora.com/What-are-the-largest-sources-of-funding-for-scientific-research 5 http://en.wikipedia.org/wiki/Publish_or_perish This system is by no means perfect. Most journals charge significant fees to access their content. For example, a subscription to most of the hard science journals will cost a library thousands of dollars per year.6 Even more astonishingly, access to a single article will cost an individual more than most books.7 This, for a publication written and reviewed by authors who receive absolutely no direct income from the journal. Even if you ignore the money, the current system has costs. Journals and journal articles may encourage the sharing of completed work, but their hegemony means that more open collaboration, or even experiments with different forms of collaboration, is in some sense discouraged. Likewise, peer-review as it stands is flawed. Peer-review serves an essential role as the gatekeeper to research, allowing readers to approach published literature in a more credulous manner. However, there is no inherent reason that only one or two experts in a field should determine the validity of a paper, that the review process should take months, or that their critiques of the paper should be hidden from other interested parties. This is an accident of history, a result of the logistical issues involved in two-way communication between large groups of people before the advent of the internet. Innovation In the last few years the internet has significantly disrupted virtually every publishing industry (e.g., music, tv, movies, books, and newspapers). Historically, economic models tend to change whenever a new communication medium is developed,8 so it is surprising to see such little experiment and innovation in the way academic research is published. To be fair, each of the entrenched players (researchers, journals, libraries, and funding agencies) has made tentative steps online. In physics, for example, major publishers have recently launched online only open access journals.9 The Cornell University library hosts the enormously successful arXiv.10 A number of prominent researchers blog their results and ideas.11 And, although not yet common in physics, some major funding agencies (the NIH in particular), have begun to mandate that any research they fund must be published in open access journals.12 However, institutions tend to try to preserve the problem to which they are the solution.13 No entrenched player is going to produce innovations that threaten their livelihood, and this is 6 http://www.library.illinois.edu/scholcomm/journalcosts.html 7 32 USD when attempting to access e.g., doi:10.1038/nature10602 on November 23, 2011. 8 Tim Wu - The Rise and Fall of Information Empires; Knopf 2010. 9 See e.g., Phys. Rev. X by The American Physical Society, and AIP Advances by The American Institute of Physics. 10 http://arxiv.org 11 Some of our favorites: Cosmic Variance, Ross McKenzie’s Condensed Concepts, Doug Natelson’s Nanoscale Views, Tommaso Dorigo’s A Quantum Diaries Survivor, and Shaun Hendy’s A Measure of Science. 12 http://publicaccess.nih.gov/ 13 Clay Shirky - Cognitive Surplus: Creativity and Generosity in a Connected Age; Penguin 2011. reflected in the innovations they attempt. For example, most open access journals require authors to pay a publication fee. Likewise, authors have proven unwilling to switch from high impact factor journals to less well-regarded open access systems.14 In any case, while open access might be important, it is not revolutionary. It may decrease the cost of access to information but it will not (alone) speed up the rate of discovery or distribution of new ideas; it is a necessary, but not sufficient, part of the future of the academic publishing industry. A truly innovative approach will result in new tools that increase the rate at which human knowledge is developed and disseminated, just as the development of the journal drastically improved the efficiency with which we created new knowledge in the 20th century. It is hard to say exactly what these new tools will be. Their development will require a great deal of experiment and iteration. Therefore, instead of attempting to a priori identify and build the right tool, we need to develop a framework (and culture) in which experimentation with different forms of collaboration is encouraged. Incentives In order to build a culture of innovation, we need to understand why there is so little of it today. It is sometimes said that most of economics can be summarized in four words: “people respond to incentives”, and this can often lead to paradoxical outcomes.15 We believe that while the incentive structures created by the journal system originally encouraged a culture of open collaboration, they now stifle innovation. These incentives are best illustrated by introducing the publon, the facetious particle that is to academic research what an electron is to charge. It is brilliantly described by Peter Koveski: “Originally discovered in Oxford, the publon is the elementary particle of scientific publication. It has long been known that publons are mutually repulsive. The chances of finding more than one publon in a paper are negligible. Even more intriguing is the apparent ability of the same publon to manifest itself at widely separated instants in time. One reason why this has not emerged until now seems to be that a publon can manifest itself with different words and terminology … defeating observations with even the most powerful database scanners.”16 This humorous notion underscores an uneasy truth in academia: your publication record determines your success in obtaining research funding, jobs, and academic prestige. The more you publish the more you get paid. This is fundamentally a result of the fact that it is hard to spot a good researcher. As the business of research grew during the 20th century, so did the number of researchers. It became important for funding agencies and employers to have an efficient and somewhat objective 14 Hence the perceived need for mandates by funding agencies like the NIH. 15 S. Levitt and S. Dubner - Freakonomics: A Rogue Economist Explores the Hidden Side of Everything; William Morrow 2009. 16 http://www.csse.uwa.edu.au/~pk/publons.html measure of research performance. Publication and citation records fit that bill. They are easily measured, and derivative metrics, like the h-index, are easily calculated.17 In this way professional academic research and the journal developed symbiotically, to the point where it is now almost impossible to imagine a different system for communicating results or allocating funding. This is our theory: in order to build innovative systems for collaboration we need to modify this incentive structure. A corollary of this is that any new approach must augment the current system, at least initially. Too many players have too much invested in the status quo for a sudden change to occur. Any change in incentive structure will be gradual, but we believe that once those changes reach critical mass everything else will follow. Our Strategy We intend to create a platform for experimenting with these ideas. Our research indicates that academics are interested in three general features: the ability to discuss published research; better indicators (than citations) of the value of their contributions; and recommendation engines to help them discover relevant research. This is roughly the order in which we intend to develop our platform. In the first phase, we have built a framework for discussing published journal articles.