Preprints and COVID-19: Analysis of 2020 Pandemic-Related Works from a Single Institution

Total Page:16

File Type:pdf, Size:1020Kb

Preprints and COVID-19: Analysis of 2020 Pandemic-Related Works from a Single Institution Preprints and COVID-19: Analysis of 2020 Pandemic-related Works from a Single Institution Medical Library, Memorial Sloan Kettering Cancer Center Konstantina Matsoukas, MLIS; Jeanine McSweeney, MLIS; Donna Gibson, MLS; Robin O’Hanlon, MIS; Marina Chilov, MLS; Johanna Goldberg, MSLIS; Lindsay Boyce, MLIS; Fig 1. Preprint Server Choice Fig 5. Links between Preprint & Journal Article Objectives 1. Preprint record links to Journal Article DOI arXiv - 3.0% The coronavirus pandemic accelerated the acceptance of preprints by Authorea - 6.1% the clinical research community, with the need to rapidly share new bioRxiv - 24.2% research findings even leading to the inclusion of COVID preprints in bioRxiv Bull World Health Organ. - 24.2% 3.0% PubMed/PMC. This occurred even though preprints are not properly chemRxiv - 3.0% medRxiv vetted, final published versions of works, but rather preliminary scientific 51.5% medRxiv - 51.5% research reports that have not yet been evaluated and certified by peer ResearchSquare - 3.0% review. To enhance our understanding of health science preprint server SSRN - 6.1% 2. PubMed Preprint record links to both posting adoption, we characterized/analyzed the 2020 research manuscripts related to COVID-19 posted to preprint servers by researchers at our institution. Fig 2. Preprint Indexing, Publication & Linking Methods 3. PMC Preprint record links to both Yes No Thirty-three preprints meeting our inclusion criteria were identified via 54.6% 45.5% Indexed targeted searching. The preprint server, PubMed/PMC, and journal in 18/33 Pubmed publisher records were consulted to verify: manuscript posting, revision, 61.3% 38.7% and publication dates; author and affiliation information; linkage to the Published as 19/31 Journal final published versions on the preprint and PubMed/PMC Articles records. Altmetrics and Dimensions, both products of Digital Science, 57.9% 42.1% Server linked to 11/19 were used to capture online attention and any citations received by the Journal preprints and their subsequent peer-reviewed articles. Article 60 50 40 30 20 10 0 10 20 30 40 % of Preprints Results Fig 3. Time from Preprint 4. PMC Article record links to both Of the 33 preprints, two were duplicates: one a revised preprint version to Journal Article with title change, the second a submission of the same preprint to two 1 different servers. Eight different servers were used overall, with 51.5% 2 posted to medRxiv and 24.2% to bioRxiv. PubMed indexed 54.6% of the 3 Mean: 102.3 days 4 preprints, with 19/31 preprints eventually being published in a peer- 5 6 reviewed journal. 11/19 published papers were linked to from their 7 8 preprint server record and 79% were published in NPG, Elsevier, 9 10 Springer, or Wiley journals. Of the 31 unique preprints, 90% included co- 11 5. PubMed Article record links to both 12 authors from other institutions, with 14/31 involving international 13 14 collaborators. Of the 19 preprints published in journals, posting to a 15 Preprints Published as Journal Articles 16 server accelerated the release of the manuscript to the public record by 17 a mean of 102.3 days. Preprints indexed in PubMed (16/31) garnered a 18 19 6. Journal Article does not link to Preprint record mean of 2.8 times more citations than preprints not indexed in PubMed 0 50 100 150 200 250 300 # of Days (15/31), which approached statistical significance (t(29)=2.04; p=0.051). Conclusions Fig 4. Citations to Preprints by PubMed Indexing During COVID times, it was assumed that the motivation for posting to a 10 preprint server was closely tied to a desire to get information out as References widely and as quickly as possible. Our findings suggest that posting a 8 7.43 Indexed In PubMed manuscript as a preprint was generally worth the effort in terms of Not Indexed in • NIH Preprint Pilot Update.NIH Preprint Pilot 6 PubMed accelerating research sharing and visibility. Future research exploring Update. NLM Tech Bull. 2021 Mar-Apr;(439):e2. whether authors who utilized preprint servers during the pandemic will 4 • New NIH Preprint Pilot Librarian Toolkit Available. continue to do so post-COVID will be interesting for establishing if this 2.64 NLM Tech Bull. 2020 Nov-Dec;(437):b6. # of Citations to Preprints experience will have changed researcher behavior with regards to 2 • NLM Announces NIH Preprint Pilot to Provide preprints going forward. Early Access to COVID-19 Research. NLM Tech 0 Bull. 2020 May-June;(434):e3. *Dimensions citation scores collected 4/13/2021.
Recommended publications
  • “Altmetrics” Using Google Scholar, Twitter, Mendeley, Facebook
    Pre-Print Version Altmetrics of “altmetrics” using Google Scholar, Twitter, Mendeley, Facebook, Google-plus, CiteULike, Blogs and Wiki Saeed-Ul Hassan, Uzair Ahmed Gillani [email protected] Information Technology University, 346-B Ferozepur Road, Lahore (Pakistan) Abstract: We measure the impact of “altmetrics” field by deploying altmetrics indicators using the data from Google Scholar, Twitter, Mendeley, Facebook, Google- plus, CiteULike, Blogs and Wiki during 2010- 2014. To capture the social impact of scientific publications, we propose an index called alt-index, analogues to h-index. Across the deployed indices, our results have shown high correlation among the indicators that capture social impact. While we observe medium Pearson’s correlation (ρ= .247) among the alt-index and h-index, a relatively high correlation is observed between social citations and scholarly citations (ρ= .646). Interestingly, we find high turnover of social citations in the field compared with the traditional scholarly citations, i.e. social citations are 42.2% more than traditional citations. The social mediums such as Twitter and Mendeley appear to be the most effective channels of social impact followed by Facebook and Google-plus. Overall, altmetrics appears to be working well in the field of “altmetrics”. Keywords: Altmetrics, Social Media, Usage Indicators, Alt-index Pre-Print Version Introduction In scholarly world, altmetrics are getting popularity as to support and/or alternative to traditional citation-based evaluation metrics such as impact factor, h-index etc. (Priem et. al., 2010). The concept of altmetrics was initially proposed in 2010 as a generalization of article level metrics and has its roots in the #altmetrics hashtag (McIntyre et al, 2011).
    [Show full text]
  • Medical Journals Drastically Speed up Their Publication Process for Covid-19
    bioRxiv preprint doi: https://doi.org/10.1101/2020.04.18.045963; this version posted April 18, 2020. The copyright holder for this preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made available under aCC-BY 4.0 International license. Pandemic Publishing: Medical journals drastically speed up their publication process for Covid-19 Author Serge P.J.M. Horbach*,1,2 [email protected] +31243652730 ORCID: 0000-0003-0406-6261 *Corresponding author 1 Radboud University Nijmegen, Faculty of Science, Institute for Science in Society, P.O. box 9010, 6500 GL Nijmegen, The Netherlands 2 Centre for Science and Technology Studies (CWTS), Faculty of Social Sciences, Leiden University, Wassenaarseweg 62A, 2333 AL Leiden, The Netherlands Abstract In times of public crises, including the current Covid-19 pandemic, rapid dissemination of relevant scientific knowledge is of paramount importance. The duration of scholarly journals’ publication process is one of the main factors hindering quick delivery of new information. While proper editorial assessment and peer review obviously require some time, turnaround times for medical journals can be up to several months, which is undesirable in the era of a crisis. Following initiatives of medical journals and scholarly publishers to accelerate their publication process, this study assesses whether medical journals have indeed managed to speed up their publication process for Covid-19 related articles. It studies the duration of 14 medical journals’ publication process both during and prior to the current pandemic. Assessing a total of 669 articles, the study concludes that medical journals have indeed drastically accelerated the publication process for Covid-19 related articles since the outbreak of the pandemic.
    [Show full text]
  • Is Sci-Hub Increasing Visibility of Indian Research Papers? an Analytical Evaluation Vivek Kumar Singh1,*, Satya Swarup Srichandan1, Sujit Bhattacharya2
    Journal of Scientometric Res. 2021; 10(1):130-134 http://www.jscires.org Perspective Paper Is Sci-Hub Increasing Visibility of Indian Research Papers? An Analytical Evaluation Vivek Kumar Singh1,*, Satya Swarup Srichandan1, Sujit Bhattacharya2 1Department of Computer Science, Banaras Hindu University, Varanasi, Uttar Pradesh, INDIA. 2CSIR-National Institute of Science Technology and Development Studies, New Delhi, INDIA. ABSTRACT Sci-Hub, founded by Alexandra Elbakyan in 2011 in Kazakhstan has, over the years, Correspondence emerged as a very popular source for researchers to download scientific papers. It is Vivek Kumar Singh believed that Sci-Hub contains more than 76 million academic articles. However, recently Department of Computer Science, three foreign academic publishers (Elsevier, Wiley and American Chemical Society) have Banaras Hindu University, filed a lawsuit against Sci-Hub and LibGen before the Delhi High Court and prayed for Varanasi-221005, INDIA. complete blocking these websites in India. It is in this context, that this paper attempts to Email id: [email protected] find out how many Indian research papers are available in Sci-Hub and who downloads them. The citation advantage of Indian research papers available on Sci-Hub is analysed, Received: 16-03-2021 with results confirming that such an advantage do exist. Revised: 29-03-2021 Accepted: 25-04-2021 Keywords: Indian Research, Indian Science, Black Open Access, Open Access, Sci-Hub. DOI: 10.5530/jscires.10.1.16 INTRODUCTION access publishing of their research output, and at the same time encouraging their researchers to publish in openly Responsible Research and Innovation (RRI) has become one accessible forms.
    [Show full text]
  • Sci-Hub Provides Access to Nearly All Scholarly Literature
    Sci-Hub provides access to nearly all scholarly literature A DOI-citable version of this manuscript is available at https://doi.org/10.7287/peerj.preprints.3100. This manuscript was automatically generated from greenelab/scihub-manuscript@51678a7 on October 12, 2017. Submit feedback on the manuscript at git.io/v7feh or on the analyses at git.io/v7fvJ. Authors • Daniel S. Himmelstein 0000-0002-3012-7446 · dhimmel · dhimmel Department of Systems Pharmacology and Translational Therapeutics, University of Pennsylvania · Funded by GBMF4552 • Ariel Rodriguez Romero 0000-0003-2290-4927 · arielsvn · arielswn Bidwise, Inc • Stephen Reid McLaughlin 0000-0002-9888-3168 · stevemclaugh · SteveMcLaugh School of Information, University of Texas at Austin • Bastian Greshake Tzovaras 0000-0002-9925-9623 · gedankenstuecke · gedankenstuecke Department of Applied Bioinformatics, Institute of Cell Biology and Neuroscience, Goethe University Frankfurt • Casey S. Greene 0000-0001-8713-9213 · cgreene · GreeneScientist Department of Systems Pharmacology and Translational Therapeutics, University of Pennsylvania · Funded by GBMF4552 PeerJ Preprints | https://doi.org/10.7287/peerj.preprints.3100v2 | CC BY 4.0 Open Access | rec: 12 Oct 2017, publ: 12 Oct 2017 Abstract The website Sci-Hub provides access to scholarly literature via full text PDF downloads. The site enables users to access articles that would otherwise be paywalled. Since its creation in 2011, Sci- Hub has grown rapidly in popularity. However, until now, the extent of Sci-Hub’s coverage was unclear. As of March 2017, we find that Sci-Hub’s database contains 68.9% of all 81.6 million scholarly articles, which rises to 85.2% for those published in toll access journals.
    [Show full text]
  • Open Access Availability of Scientific Publications
    Analytical Support for Bibliometrics Indicators Open access availability of scientific publications Analytical Support for Bibliometrics Indicators Open access availability of scientific publications* Final Report January 2018 By: Science-Metrix Inc. 1335 Mont-Royal E. ▪ Montréal ▪ Québec ▪ Canada ▪ H2J 1Y6 1.514.495.6505 ▪ 1.800.994.4761 [email protected] ▪ www.science-metrix.com *This work was funded by the National Science Foundation’s (NSF) National Center for Science and Engineering Statistics (NCSES). Any opinions, findings, conclusions or recommendations expressed in this report do not necessarily reflect the views of NCSES or the NSF. The analysis for this research was conducted by SRI International on behalf of NSF’s NCSES under contract number NSFDACS1063289. Analytical Support for Bibliometrics Indicators Open access availability of scientific publications Contents Contents .............................................................................................................................................................. i Tables ................................................................................................................................................................. ii Figures ................................................................................................................................................................ ii Abstract ............................................................................................................................................................
    [Show full text]
  • How Comprehensive Is the Pubmed Central Open Access Full-Text Database? ⋆
    View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by Illinois Digital Environment for Access to Learning and Scholarship Repository How comprehensive is the PubMed Central Open Access full-text database? ⋆ Jiangen He1[0000−0002−3950−6098] and Kai Li1[0000−0002−7264−365X] Department of Information Science, Drexel University, Philadelphia PA, 19104, USA. [email protected], [email protected] Abstract. The comprehensiveness of database is a prerequisite for the quality of scientific works established on this increasingly significant infrastructure. This is especially so for large-scale text-mining analy- ses of scientific publications facilitated by open-access full-text scientific databases. Given the lack of research concerning the comprehensiveness of this type of academic resource, we conducted a project to analyze the coverage of materials in the PubMed Central Open Access Subset (PMCOAS), a popular source for open-access scientific publications, in terms of the PubMed database. The preliminary results show that the PMCOAS coverage is in a rapid increase in recent years, despite the vast difference by MeSH descriptor. Keywords: Database coverage · PubMed Central Open Access· PubMed. 1 Introduction Database has become a central piece of scientific infrastructure in our contem- porary data-driven mode of scientific practice. The increasing volumes of data stored in structured formats gradually became an indispensable source for scien- tific discoveries in nearly every knowledge domain. However, one question that often shrouds this source is how comprehensive the database is as compared to the reality the database is claimed to represent. A large number of studies in the field of quantitative studies of science have been devoted to this question since the end of the 20th century: they have compared various parameters, especially the number of documents, references, and journals covered, among databases such as Web of Science, Scopus, and Google Scholar [2, 3, 5, 8, 6, 7].
    [Show full text]
  • A Scientometric Study of Pubmed-Indexed Endodontic Articles: a Comparison Between Iran and Other Regional Countries
    EDITORIAL 1 2 3 Mohammad Jafar Eghbal DDS, MS, Negar Davari Ardakani MSc, PhD, Saeed Asgary DDS, MS A Scientometric Study of PubMed-Indexed Endodontic Articles: A Comparison between Iran and Other Regional Countries 1. Dental Research Center, Iranian Center for Endodontic Research, Dental School, Shahid Beheshti University of Medical Sciences, Tehran, Iran 2. Linguistics Department, Literature Faculty, Shahid Beheshti University of Medical Sciences, Tehran, Iran 3. Iranian Center for Endodontic Research, Dental Research Center, Dental School, Shahid Beheshti University of Medical Sciences, Tehran, Iran Introduction: Based on Iran’s 20-year prospective national vision document, Iran may be seen as the most developed country in science and technology in the region by 2025. In this report, bibliometric indicators are used to compare the research productivity in endodontics between Iran and 28 selected Asian countries. Materials and Methods: Medical Subject Headings keyword-searching of PubMed up to 2012 was conducted to compare the scientific publications in Iran and neighboring countries (Middle East, Middle Asia, Caucasus and EMRO countries). Highest 5 PubMed-indexed endodontic journals were also searched to retrieve the number of published articles of the top five countries. Data were extracted, tabulated and compared to identify the ranks as well as trends. Results: The results confirm that there are many differences in scientific endodontic publications between the studied countries; Iran ranked second in endodontic research productivity compared to Turkey in 2011. However, Iran attained first place in 2010 as well as the most positive publication trend in PubMed-indexed endodontic journals. Conclusion: Although Iran was in second rank in the region last year, the positive trend in published endodontic research papers is considered a sign of future success in acquiring Iran’s vision.
    [Show full text]
  • An Initiative to Track Sentiments in Altmetrics
    Halevi, G., & Schimming, L. (2018). An Initiative to Track Sentiments in Altmetrics. Journal of Altmetrics, 1(1): 2. DOI: https://doi.org/10.29024/joa.1 PERSPECTIVE An Initiative to Track Sentiments in Altmetrics Gali Halevi and Laura Schimming Icahn School of Medicine at Mount Sinai, US Corresponding author: Gali Halevi ([email protected]) A recent survey from Pew Research Center (NW, Washington & Inquiries 2018) found that over 44 million people receive science-related information from social media channels to which they subscribe. These include a variety of topics such as new discoveries in health sciences as well as “news you can use” information with practical tips (p. 3). Social and news media attention to scientific publications has been tracked for almost a decade by several platforms which aggregate all public mentions of and interactions with scientific publications. Since the amount of comments, shares, and discussions of scientific publications can reach an audience of thousands, understanding the overall “sentiment” towards the published research is a mammoth task and typically involves merely reading as many posts, shares, and comments as possible. This paper describes an initiative to track and provide sentiment analysis to large social and news media mentions and label them as “positive”, “negative” or “neutral”. Such labels will enable an overall understanding of the content that lies within these social and news media mentions of scientific publications. Keywords: sentiment analysis; opinion mining; scholarly output Background Traditionally, the impact of research has been measured through citations (Cronin 1984; Garfield 1964; Halevi & Moed 2015; Moed 2006, 2015; Seglen 1997). The number of citations a paper receives over time has been directly correlated to the perceived impact of the article.
    [Show full text]
  • Google Scholar, Sci-Hub and Libgen: Could They Be Our New Partners?
    Purdue University Purdue e-Pubs Proceedings of the IATUL Conferences 2017 IATUL Proceedings Google Scholar, Sci-Hub and LibGen: Could they be our New Partners? Louis Houle McGill University, [email protected] Louis Houle, "Google Scholar, Sci-Hub and LibGen: Could they be our New Partners?." Proceedings of the IATUL Conferences. Paper 3. https://docs.lib.purdue.edu/iatul/2017/partnership/3 This document has been made available through Purdue e-Pubs, a service of the Purdue University Libraries. Please contact [email protected] for additional information. GOOGLE SCHOLAR, SCI-HUB AND LIBGEN: COULD THEY BE OUR NEW PARTNERS? Louis Houle McGill University Canada [email protected] Abstract Since its debut I November 2004, librarians have raised several criticisms at Google Scholar (GS) such as its inconsistency of coverage and its currency and scope of coverage. It may have been true in the early years of Google Scholar but is this still through twelve years after? Is this sufficient to ignore it totally either in our information literacy programs or evaluate its value against the values of subscription-based abstracts and indexes? In this era of severe budget constraints that libraries are facing, can we imagine of substituting most or all of our subject databases with the free access of Google Scholar for discoverability? How much overlap between our databases and Google Scholar? How reliable is Google Scholar? How stable is its content over time? Open Access is getting to be the predominant form of getting access to peer reviewed articles. Many new non-traditional tools (institutional repositories, social media and peer to peer sites) are available out there to retrieve the full-text of peer reviewed articles.
    [Show full text]
  • Piracy of Scientific Papers in Latin America: an Analysis of Sci-Hub Usage Data
    Developing Latin America Piracy of scientific papers in Latin America: An analysis of Sci-Hub usage data Juan D. Machin-Mastromatteo Alejandro Uribe-Tirado Maria E. Romero-Ortiz This article was originally published as: Machin-Mastromatteo, J.D., Uribe-Tirado, A., and Romero-Ortiz, M. E. (2016). Piracy of scientific papers in Latin America: An analysis of Sci-Hub usage data. Information Development, 32(5), 1806–1814. http://dx.doi.org/10.1177/0266666916671080 Abstract Sci-Hub hosts pirated copies of 51 million scientific papers from commercial publishers. This article presents the site’s characteristics, it criticizes that it might be perceived as a de-facto component of the Open Access movement, it replicates an analysis published in Science using its available usage data, but limiting it to Latin America, and presents implications caused by this site for information professionals, universities and libraries. Keywords: Sci-Hub, piracy, open access, scientific articles, academic databases, serials crisis Scientific articles are vital for students, professors and researchers in universities, research centers and other knowledge institutions worldwide. When academic publishing started, academies, institutions and professional associations gathered articles, assessed their quality, collected them in journals, printed and distributed its copies; with the added difficulty of not having digital technologies. Producing journals became unsustainable for some professional societies, so commercial scientific publishers started appearing and assumed printing, sales and distribution on their behalf, while academics retained the intellectual tasks. Elsevier, among the first publishers, emerged to cover operations costs and profit from sales, now it is part of an industry that grew from the process of scientific communication; a 10 billion US dollar business (Murphy, 2016).
    [Show full text]
  • Global Scientific Research on Coronavirus : a Scientometric Study
    University of Nebraska - Lincoln DigitalCommons@University of Nebraska - Lincoln Library Philosophy and Practice (e-journal) Libraries at University of Nebraska-Lincoln September 2020 Global Scientific Research on Coronavirus : a Scientometric Study Pooja P. Dadhe [email protected] Manju N. Dubey [email protected] Follow this and additional works at: https://digitalcommons.unl.edu/libphilprac Dadhe, Pooja P. and Dubey, Manju N., "Global Scientific Research on Coronavirus : a Scientometric Study" (2020). Library Philosophy and Practice (e-journal). 4277. https://digitalcommons.unl.edu/libphilprac/4277 Global Scientific Research on Coronavirus : a Scientometric Study Dr. Pooja P. Dadhe Assistant Librarian Dr. V.B. Alias Bhausaheb Kolte Knowledge Resource Centre R.T.M. Nagpur University, Nagpur, India [email protected] Dr. Manju N. Dubey Librarian R.S Mundle Dharampeth Arts and Commerce College, Nagpur, India [email protected] Abstract To understand the global research trend of the scientific publication on coronavirus, this scientometric study was carried out for the period 2002 to 2019 based on scientometric indicators such as growth of publication, productive authors and institutions, collaboration among authors and institutions, the hotspot of research area and the citation pattern. A total of 8541 records downloaded from PubMed formed the dataset for the study and were analysed using Bibexcel and VOSviewer. The findings reveal that the research on coronavirus was noticeable but it was not significant. A correlation between the number of publications and emergence of SARS in 2002 and MERS in 2012 was also visible. The trend of publication was found to be fluctuating during the period of study. The findings demonstrate that collaboration among institutions was not very strong.
    [Show full text]
  • Do You Speak Open Science? Resources and Tips to Learn the Language
    Do You Speak Open Science? Resources and Tips to Learn the Language. Paola Masuzzo1, 2 - ORCID: 0000-0003-3699-1195, Lennart Martens1,2 - ORCID: 0000- 0003-4277-658X Author Affiliation 1 Medical Biotechnology Center, VIB, Ghent, Belgium 2 Department of Biochemistry, Ghent University, Ghent, Belgium Abstract The internet era, large-scale computing and storage resources, mobile devices, social media, and their high uptake among different groups of people, have all deeply changed the way knowledge is created, communicated, and further deployed. These advances have enabled a radical transformation of the practice of science, which is now more open, more global and collaborative, and closer to society than ever. Open science has therefore become an increasingly important topic. Moreover, as open science is actively pursued by several high-profile funders and institutions, it has fast become a crucial matter to all researchers. However, because this widespread interest in open science has emerged relatively recently, its definition and implementation are constantly shifting and evolving, sometimes leaving researchers in doubt about how to adopt open science, and which are the best practices to follow. This article therefore aims to be a field guide for scientists who want to perform science in the open, offering resources and tips to make open science happen in the four key areas of data, code, publications and peer-review. The Rationale for Open Science: Standing on the Shoulders of Giants One of the most widely used definitions of open science originates from Michael Nielsen [1]: “Open science is the idea that scientific knowledge of all kinds should be openly shared as early as is practical in the discovery process”.
    [Show full text]