Task Force Report
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Promoting an Open Research Culture
Promoting an open research culture Brian Nosek University of Virginia -- Center for Open Science http://briannosek.com/ -- http://cos.io/ The McGurk Effect Ba Ba? Da Da? Ga Ga? McGurk & MacDonald, 1976, Nature Adelson, 1995 Adelson, 1995 Norms Counternorms Communality Secrecy Open sharing Closed Norms Counternorms Communality Secrecy Open sharing Closed Universalism Particularlism Evaluate research on own merit Evaluate research by reputation Norms Counternorms Communality Secrecy Open sharing Closed Universalism Particularlism Evaluate research on own merit Evaluate research by reputation Disinterestedness Self-interestedness Motivated by knowledge and discovery Treat science as a competition Norms Counternorms Communality Secrecy Open sharing Closed Universalism Particularlism Evaluate research on own merit Evaluate research by reputation Disinterestedness Self-interestedness Motivated by knowledge and discovery Treat science as a competition Organized skepticism Organized dogmatism Consider all new evidence, even Invest career promoting one’s own against one’s prior work theories, findings Norms Counternorms Communality Secrecy Open sharing Closed Universalism Particularlism Evaluate research on own merit Evaluate research by reputation Disinterestedness Self-interestedness Motivated by knowledge and discovery Treat science as a competition Organized skepticism Organized dogmatism Consider all new evidence, even Invest career promoting one’s own against one’s prior work theories, findings Quality Quantity Anderson, Martinson, & DeVries, -
Open Science in Archaeology
Marwick, B. et al. (2017) Open science in archaeology. SAA Archaeological Record, 17(4), pp. 8-14. There may be differences between this version and the published version. You are advised to consult the publisher’s version if you wish to cite from it. http://eprints.gla.ac.uk/148887/ Deposited on: 29 September 2017 Enlighten – Research publications by members of the University of Glasgow http://eprints.gla.ac.uk Open Science in Archaeology Ben Marwick*, Jade d’Alpoim Guedes, C. Michael Barton, Lynsey A. Bates, Michael Baxter, Andrew Bevan, Elizabeth A. Bollwerk, R. Kyle Bocinsky, Tom Brughmans, Alison K. Carter, Cyler Conrad, Daniel A. Contreras, Stefano Costa, Enrico R. Crema, Adrianne Daggett, Benjamin Davies, B. Lee Drake, Thomas S. Dye, Phoebe France, Richard Fullagar, Domenico Giusti, Shawn Graham, Matthew D. Harris, John Hawks, Sebastian Heath, Damien Huffer, Eric C. Kansa, Sarah Whitcher Kansa, Mark E. Madsen, Jennifer Melcher, Joan Negre, Fraser D. Neiman, Rachel Opitz, David C. Orton, Paulina Przystupa, Maria Raviele, Julien Riel-Salvatore, Philip Riris, Iza Romanowska, Néhémie Strupler, Isaac I. Ullah, Hannah G. Van Vlack, Ethan C. Watrall, Chris Webster, Joshua Wells, Judith Winters, Colin D. Wren * corresponding author, [email protected] Introduction In archaeology, we are accustomed to investing great effort into collecting data from fieldwork, museum collections, and other sources, followed by detailed description, rigorous analysis, and in many cases ending with publication of our findings in short, highly concentrated reports or journal articles. Very often, these publications are all that is visible of this lengthy process, and even then, most of our journal articles are only accessible to scholars at institutions paying subscription fees to the journal publishers. -
Downloads Presented on the Abstract Page
bioRxiv preprint doi: https://doi.org/10.1101/2020.04.27.063578; this version posted April 28, 2020. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made available under aCC-BY 4.0 International license. A systematic examination of preprint platforms for use in the medical and biomedical sciences setting Jamie J Kirkham1*, Naomi Penfold2, Fiona Murphy3, Isabelle Boutron4, John PA Ioannidis5, Jessica K Polka2, David Moher6,7 1Centre for Biostatistics, Manchester Academic Health Science Centre, University of Manchester, Manchester, United Kingdom. 2ASAPbio, San Francisco, CA, USA. 3Murphy Mitchell Consulting Ltd. 4Université de Paris, Centre of Research in Epidemiology and Statistics (CRESS), Inserm, Paris, F-75004 France. 5Meta-Research Innovation Center at Stanford (METRICS) and Departments of Medicine, of Epidemiology and Population Health, of Biomedical Data Science, and of Statistics, Stanford University, Stanford, CA, USA. 6Centre for Journalology, Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Canada. 7School of Epidemiology and Public Health, Faculty of Medicine, University of Ottawa, Ottawa, Canada. *Corresponding Author: Professor Jamie Kirkham Centre for Biostatistics Faculty of Biology, Medicine and Health The University of Manchester Jean McFarlane Building Oxford Road Manchester, M13 9PL, UK Email: [email protected] Tel: +44 (0)161 275 1135 bioRxiv preprint doi: https://doi.org/10.1101/2020.04.27.063578; this version posted April 28, 2020. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. -
Total Scicomm: a Strategy for Communicating Open Science
publications Communication Total SciComm: A Strategy for Communicating Open Science Manh-Toan Ho * , Manh-Tung Ho and Quan-Hoang Vuong Centre for Interdisciplinary Social Research, Phenikaa University, Hanoi 100803, Vietnam; [email protected] (M.-T.H.); [email protected] (Q.-H.V.) * Correspondence: [email protected] Abstract: This paper seeks to introduce a strategy of science communication: Total SciComm or all-out science communication. We proposed that to maximize the outreach and impact, scientists should use different media to communicate different aspects of science, from core ideas to methods. The paper uses an example of a debate surrounding a now-retracted article in the Nature journal, in which open data, preprints, social media, and blogs are being used for a meaningful scientific conversation. The case embodied the central idea of Total SciComm: the scientific community employs every medium to communicate scientific ideas and engages all scientists in the process. Keywords: preprints; open science; science communication; social media; Total SciComm 1. Introduction Growing skepticism towards scientific findings makes capturing attention from the public an urgent and serious issue for scientists. The attention will help raise the scien- Citation: Ho, M.-T.; Ho, M.-T.; tists’ profiles and provide scientists a channel to communicate through scientific ideas. Vuong, Q.-H. Total SciComm: A On YouTube, and a new form of radio—podcast—the rise of the Intellectual Dark Web Strategy for Communicating Open group is a prominent example of an effort for good and effective science communication [1]. Science. Publications 2021, 9, 31. -
The Reproducibility Crisis in Research and Open Science Solutions Andrée Rathemacher University of Rhode Island, [email protected] Creative Commons License
University of Rhode Island DigitalCommons@URI Technical Services Faculty Presentations Technical Services 2017 "Fake Results": The Reproducibility Crisis in Research and Open Science Solutions Andrée Rathemacher University of Rhode Island, [email protected] Creative Commons License This work is licensed under a Creative Commons Attribution 4.0 License. Follow this and additional works at: http://digitalcommons.uri.edu/lib_ts_presentations Part of the Scholarly Communication Commons, and the Scholarly Publishing Commons Recommended Citation Rathemacher, Andrée, ""Fake Results": The Reproducibility Crisis in Research and Open Science Solutions" (2017). Technical Services Faculty Presentations. Paper 48. http://digitalcommons.uri.edu/lib_ts_presentations/48http://digitalcommons.uri.edu/lib_ts_presentations/48 This Speech is brought to you for free and open access by the Technical Services at DigitalCommons@URI. It has been accepted for inclusion in Technical Services Faculty Presentations by an authorized administrator of DigitalCommons@URI. For more information, please contact [email protected]. “Fake Results” The Reproducibility Crisis in Research and Open Science Solutions “It can be proven that most claimed research findings are false.” — John P. A. Ioannidis, 2005 Those are the words of John Ioannidis (yo-NEE-dees) in a highly-cited article from 2005. Now based at Stanford University, Ioannidis is a meta-scientist who conducts “research on research” with the goal of making improvements. Sources: Ionnidis, John P. A. “Why Most -
2020 Impact Report
Center for Open Science IMPACT REPORT 2020 Maximizing the impact of science together. COS Mission Our mission is to increase the openness, integrity, and reproducibility of research. But we don’t do this alone. COS partners with stakeholders across the research community to advance the infrastructure, methods, norms, incentives, and policies shaping the future of research to achieve the greatest impact on improving credibility and accelerating discovery. Letter from the Executive Director “Show me” not “trust me”: Science doesn’t ask for Science is trustworthy because it does not trust itself. Transparency is a replacement for trust. Transparency fosters self-correction when there are errors trust, it earns trust with transparency. and increases confidence when there are not. The credibility of science has center stage in 2020. A raging pandemic. Partisan Transparency is critical for maintaining science’s credibility and earning public interests. Economic and health consequences. Misinformation everywhere. An trust. The events of 2020 make clear the urgency and potential consequences of amplified desire for certainty on what will happen and how to address it. losing that credibility and trust. In this climate, all public health and economic research will be politicized. All The Center for Open Science is profoundly grateful for all of the collaborators, findings are understood through a political lens. When the findings are against partners, and supporters who have helped advance its mission to increase partisan interests, the scientists are accused of reporting the outcomes they want openness, integrity, and reproducibility of research. Despite the practical, and avoiding the ones they don’t. When the findings are aligned with partisan economic, and health challenges, 2020 was a remarkable year for open science. -
1 Maximizing the Reproducibility of Your Research Open
1 Maximizing the Reproducibility of Your Research Open Science Collaboration1 Open Science Collaboration (in press). Maximizing the reproducibility of your research. In S. O. Lilienfeld & I. D. Waldman (Eds.), Psychological Science Under Scrutiny: Recent Challenges and Proposed Solutions. New York, NY: Wiley. Authors’ Note: Preparation of this chapter was supported by the Center for Open Science and by a Veni Grant (016.145.049) awarded to Hans IJzerman. Correspondence can be addressed to Brian Nosek, [email protected]. 1 Alexander A. Aarts, Nuenen, The Netherlands; Frank A. Bosco, Virginia Commonwealth University; Katherine S. Button, University of Bristol; Joshua Carp, Center for Open Science; Susann Fiedler, Max Planck Institut for Research on Collective Goods; James G. Field, Virginia Commonwealth University; Roger Giner-Sorolla, University of Kent; Hans IJzerman, Tilburg University; Melissa Lewis, Center for Open Science; Marcus Munafò, University of Bristol; Brian A. Nosek, University of Virginia; Jason M. Prenoveau, Loyola University Maryland; Jeffrey R. Spies, Center for Open Science 2 Commentators in this book and elsewhere describe evidence that modal scientific practices in design, analysis, and reporting are interfering with the credibility and veracity of the published literature (Begley & Ellis, 2012; Ioannidis, 2005; Miguel et al., 2014; Simmons, Nelson, & Simonsohn, 2011). The reproducibility of published findings is unknown (Open Science Collaboration, 2012a), but concern that is lower than desirable is widespread - -
8. Making Research Data Accessible
8. Making Research Data Accessible Diana Kapiszewski Sebastian Karcher1 Published as Kapiszewski, Diana, and Sebastian Karcher. 2020. “Making Research Data Accessible.” In The Production of Knowledge: Enhancing Progress in Social Science, edited by Colin Elman, James Mahoney, and John Gerring, 197–220. Strategies for Social Inquiry. Cambridge: Cambridge University Press. https://doi.org/10.1017/9781108762519.008. One of the key themes in this volume is that social science takes place in a community setting. As social scientists develop and answer their questions, they adhere to the norms and practices of their respective research communities. Over time, understandings of what being a responsible community member entails change. Today, members of social science communities are increasingly expected to provide access to the data they generate and use in their research (within ethical and legal constraints). Of course, discussions about openness in social science research have deep roots. In 1985, for example, Fienberg, Martin and Straf (1985, 25) called for sharing data to become a regular practice. A decade later, political scientist Gary King (1995) highlighted the importance of making available replication data and associated materials underpinning quantitative and qualitative research publications. The last few years, however, have seen a marked acceleration in discussions about expanding access to research data across the social sciences—spurred on by broader technological and societal changes, as well as policy interventions by the White House, National Science Foundation, National Institutes of Health, and others. There is currently increasing momentum towards making openness the default position in social science research, and towards requiring that exceptions be based on established grounds. -
Walking the Plank: How Scholarly Piracy Affects Publishers, Libraries and Their Users
Walking the Plank: How Scholarly Piracy Affects Publishers, Libraries and Their Users Laurie Morrison, Carol Stephenson, and Elizabeth Yates* Introduction The arrival of technology supporting peer-to-peer (P2P) file sharing in scholarly communication has, until -re cently, had minimal impact on libraries. However, threats posed by pirate sites including Library Genesis Project (LibGen) and Sci-Hub are now impacting both library users and library licensing agreements with publishers. Publishers are nervous as they witness their proprietary content leaking out of paywalled systems—not just hundreds of thousands of articles, but millions. Accordingly, publishers are monitoring activities in licensed products very closely for any behavior that they deem suspicious. When a user’s activities cause a publisher to question whether materials are being pirated, the outcomes can vary. Consequences can range from relatively minor inconvenience for blocked users, who must find workarounds to access scholarly content—to the poten- tial for major disruption of a centuries-old proprietary publishing system. This article uses a case study involving a student at Brock University to highlight significant challenges facing libraries and the rights of their users in the current environment of piracy-wary academic publishers. Case Study: Access Denied “I feel like I’m being penalized for my honesty.” That’s how a graduate student at Brock University felt in January 2016, after her legitimate quest to download several hundred articles for a meta-analysis project turned into a protracted—and ultimately unsuccessful—negotiation with the American Psychological Association. Sarah† had downloaded about 20 articles from the PsycINFO database when she received the following screen prompt: The APA PsycNET Terms and Conditions prohibit “Systematic downloading of content, whether done manually or by technological means.” Please contact [email protected] if you are inter- ested in data mining or wish to conduct a systematic review or meta analysis with PsycINFO data. -
Using the OSF (Open Science Framework)
Using the OSF Center for Open Science at BITSS 2014 Johanna Cohoon & Caner Uguz Pull out your laptop and visit www.osf.io Anderson, Martinson, & DeVries, 2007 NORMS COUNTERNORMS Communality Secrecy Open sharing Closed Universalism Particularism Evaluate research on own merit Evaluate research by reputation Disinterestedness Self interestedness Motivated by knowledge and discovery Treat science as a competition Organized skepticism Organized dogmatism Consider all new evidence, even Invest career promoting one’s own against one’s prior work theories, findings Quality Quantity COUNTERNORMS NORMS Incentives Incentives for individual success are focused on getting it published, not getting it right. Change the incentives. Center for Open Science COMMUNITY INFRASTRUCTURE METASCIENCE Community ■ Foster discussion of transparency and reproducibility issues ■ Support community efforts to increase openness in the sciences ■ Promote the establishment of reporting standards Center for Open Science COMMUNITY INFRASTRUCTURE METASCIENCE Infrastructure ■ Tools for scientists that increase transparency and access to resources ■ Connect services and allow users to easily organize and share their work Center for Open Science COMMUNITY INFRASTRUCTURE METASCIENCE Metascience ■ How are scientists currently behaving? ■ Do transparency and replication have a positive impact on research? ■ Reproducibility Project: Psychology and Cancer Biology; Many Labs 1, 2, and 3; Archival Project; CREP Open your laptop! www.osf.io OSF Nudge the incentive system ■ Support pre-registration ■ Create alternative means of measuring impact ■ Enable sharing of materials Facilitate good research ■ Organize files ■ Allow collaboration meanwhile Logs Commenting Tags Statistics Download counts Addons OSF Nudge the incentive system ■ Support pre-registration ■ Create alternative means of measuring impact ■ Enable sharing of materials Facilitate good research ■ Organize files ■ Allow collaboration In the future ■ Check lists ■ Notifications ■ Messaging ■ Dataverse, Evernote, Trello, Plot.ly. -
Open Access + Preprints
Open Access + Preprints Journals and scholars take action Presented by: Contents Open Access + Preprints, pg. 3 Preprints and Modern Publishing, pg. 4 •The origin of scholarly journals: 300 years with little change •Preprints and the modern web •What researchers are saying about preprints •Preprints reshaping the research experience The Role of Preprints in Journal Publishing, pg. 8 •Preprints and Green OA •How journals can facilitate Green OA via preprints •Importance of clear preprint policies •Questions surrounding preprint publications •Journals pioneering new preprint publishing models Looking to the Future of Preprints and OA Publishing, pg. 13 OpenTitle Accessof Ebook + Preprints 2 Open Access + Preprints As academics transition to digital journal publishing, the Open Access (OA) movement, which aims to make research freely available at or soon after publication, is picking up record speed. According to a recent Simba report titled Open Access Journal Publishing 2016-2020, “the number of OA research articles published annually is growing at double the rate of the complete spectrum of research articles.” The report also found that about a third of all research articles currently published are OA, when factoring in those with complete embargo periods. The rise in OA publishing comes as a result of scholars banding together to reveal the mounting cost of research access for institutions and individuals, such as those behind The Cost of Knowledge who started a boycott of monolith publisher Elsevier, which now has profit margins exceeding 30%. At the same time governments and funding bodies have introduced new OA mandates and calls for early sharing of research, such as the Wellcome Trust, Bill & Melinda Gates Foundation, and others who this February urged journals and funding agencies to sign a pledge to make all Zika virus research OA in the wake of the public health crisis. -
Open Scientific Journals: Emerging Practices and Approaches
Information Services & Use 37 (2017) 475–488 475 DOI 10.3233/ISU-170862 IOS Press Open scientific journals: Emerging practices and approaches Andre Luiz Appel a,∗, Sarita Albagli b and Maria Lucia Maciel c a Programa de Pós-Graduação em Ciência da Informação, Instituto Brasileiro de Informação em Ciência e Tecnologia, Universidade Federal do Rio de Janeiro, Rua Lauro Müller, 455, Rio de Janeiro, RJ 22290-160, BRA E-mail: [email protected] b Coordenação de Ensino e Pesquisa, Instituto Brasileiro de Informação em Ciência e Tecnologia, Rua Lauro Müller, 455, Rio de Janeiro, RJ 22290-160, BRA E-mail: [email protected] c Universidade Federal do Rio de Janeiro, Rua Lauro Müller, 455, Rio de Janeiro, RJ 22290-160, BRA E-mail: [email protected] Abstract. This study aims to show how the concept of openness has been manifested and amplified in the universe of open access scholarly journals, pointing out emerging characteristics and practices linked to processes of submission, evaluation, revision, editing, publishing, editing, distribution, access and use of texts for publication. We proceeded to an overview and discussion of the pertinent literature and the identification and analysis of open access journals which have addressed the issue, and to the identification and analysis of cases of open access journals which have been adopting innovative practices, based on information on editorial policies available on their websites. Among the results, we have pointed out aspects of the publications examined, such as the types of licenses used, policies regarding access to research data, publishing formats, charges and alternative metrics of evaluation.