Correlation Between Cost of Publication and Journal Impact
Total Page:16
File Type:pdf, Size:1020Kb
ORIGINAL REPORTS Correlation Between Cost of Publication and Journal Impact. Comprehensive Cross-sectional Study of Exclusively Open-Access Surgical Journals D1XJasonX YuenD2XXD3SamiulX MuquitD4XXand D5XPeterX C. WhitfieldD6XX South West Neurosurgery Centre, Derriford Hospital, Plymouth, United Kingdom OBJECTIVES: As open-access journals have become consider cautiously when submitting to these journals. increasingly common, it has provided more options for ( J Surg Ed 76:107À119. Crown Copyright 2018 Pub- researchers to publish their work and improved access lished by Elsevier Inc. on behalf of Association of Pro- of information to the public. However, some open- gram Directors in Surgery. All rights reserved.) access journals charge the authors processing fee on KEY WORDS: surgical research, open access, h-index, submission. In certain cases, this can be rather expen- SCImago journal rank indicator, eigenfactor, journal sive. This study is the first study to specifically assess the impact cost of publishing in exclusively open-access, peer- reviewed surgical journals, and their correlation with COMPETENCIES: Systems-Based Practice, Medical journal impact, in the form of 6 bibliometrics. Knowledge DESIGN AND SETTING: This is a cross-sectional study. A list of journals is compiled using the SCImago Journal & Country Rank and Directory of Open Access Journals. 6 INTRODUCTION indices are measured À impact factor, SCOPUS h-index, SCImago journal rank indicator (SJR), Eigenfactor, Arti- Open-access (OA) has become an increasingly common cle Influence Score and Google h5 index. The cost of policy in many medical journals.1 This provides a more publication (in USD$) of a research article (maximum of accessible means for researchers and the general public 6 pages) is used as a baseline. to consult published research. In the United Kingdom, 2 RESULTS: 89 research journals are included. The median the Finch Report encouraged Government, Research cost of publication is USD$100 (range [0-2580]). 47% are Councils, Funding Councils and universities to make free of charge. 13% can cost more than USD$2000 per commitment to the development of OA for this reason. article. SJR and Google h5 index appear to be the only However, these often come with a price tag for the indices that correlate linearly with the cost (p = 0.015 authors as publishers commonly ask for article process- and 0.041, respectively), although the correlations are ing charge (APC) in order to fund the journals. weak. 3 indices, namely impact factor, SJR and Article In the UK, publication of articles in a peer-reviewed Influence Score appear to have very strong correlations journals is an essential criterion for certification of 3,4 with each other (Pearson coefficient > 0.90). completion of training in several surgical specialties. However, as most trainee doctors are in full-time train- CONCLUSIONS: From this study, the cost of publishing ing, they often do not have the research funding that, in open-access journals bears little correlation to their for example, a post-graduate university student or a impact; this poses a dilemma for researchers without sig- professional researcher may have available funds to nificant funding. Therefore, authors and funders must pay for these publication costs.5 Some research fund- ing organizations such as the Wellcome Trust (United Correspondence: Inquiries to Jason Yuen, South West Neurosurgery Centre, Kingdom),6 provide specific funding streams for publi- Derriford Hospital, Plymouth, PL6 8DH United Kingdom; fax: 0845 155 8235; e-mail: [email protected] cations in OA journals. Open APC Foundation main- This research did not receive any specific grant from funding agencies in the pub- tains a database that measures fees paid for open- lic, commercial, or not-for-profit sectors. access journal articles. This shows that large sums are Journal of Surgical Education Crown Copyright © 2018 Published by Elsevier Inc. on behalf of Association of 1931-7204/$30.00 107 Program Directors in Surgery. All rights reserved. https://doi.org/10.1016/j.jsurg.2018.06.029 being paid by universities and research institutions to SCImago Journal Rank Indicator these OA journals.7 However, in a cash-tight publicly- The SCImago journal rank (SJR) indicator is another index funded health system, such as the National Health Ser- based on the SCOPUS database.17 It utilizes a similar vice, it is difficult to find funding for such OA publica- method as the Eigenfactor (see below), where different tions. Also if funding is provided for submissions to a weight is assigned to citations depending on the "pres- paid journal, it is sensible to ensure that the journal tige" of the citing journal without the influence of journal has the impact worthy of its cost. self-citations.18 This is analogous to the PageRank algo- There are different routes to open access through a rithm used by the Google search engine when searching number of models e.g. “access without payment” to a for the most relevant webpages. It has been widely used version of a “publication through a repository” (often in studying publications in medical specialties such as gas- called “green open access”), or via the journal’s own troenterology, respiratory medicine, obstetrics and ortho- platform (often termed “gold open access”).8 In general, paedics.19-22 It is based on 3-year citation data. journals with an OA policy either publish free of charge and provide optional OA at an additional fee (“hybrid”), Eigenfactor or they are exclusively open-access. In this study, we will investigate the costs of publication in exclusively The Eigenfactor is a recently developed index which har- OA surgical journals, and whether or not there is a corre- vests information from the structure of citation network. lation of cost with journal kudos, in terms of their Its algorithm takes into account not only the number of Impact Factor (IF), and 5 freely available bibliometric citations but also where these citations are from.23 indicators - h-index from Scopus, SCImago journal rank Hence citation from a more prestigious journal has more indicator (SJR), Eigenfactor, Article Influence Score (AIS) weight than that from a less respected one. Eigenfactor and Google h5 index. is computed using citation data from the Clarivate Ana- lytics Journal Citation Reports (JCRs), similar to the IF (see below). It is based on 5-year citation data. The score is additive: to find the Eigenfactor of a group of journals, H-INDEX one can simply sum the Eigenfactors of each journal in the group.24 More details are available on the Eigenfactor The h-index, short for the Hirsch index,9 is a benchmark website and in various publications.23,25-31 citation metrics used to measure the impact of publica- tions by an author or journal, similar to the more com- Article Influence Score monly used IF (see below). It is defined as the value (h) Article Influence Score (AIS) is a metric based on the if the journal or researcher has h publications that have Eigenfactor (equals to the Eigenfactor divided by the each been cited at least h times. For example, an h-index number of citable papers). It is also available on the of 5 means that a scientist or journal has published 5 JCRs, as well as on the Eigenfactor website free of papers that each have at least 5 citations.10 Studies indi- charge.31,32 It is supposed to reflect a journal’s prestige cate that the h index is better than certain other indica- by measuring the average influence per article using 5- tors (e.g. total citation count, citations per paper, and year data. This measure is roughly analogous to the 5- total paper count) in quantifying scientific achievement Year Journal IF but with an algorithm based on the same relative to other benchmarks.11 Also h-indices À unlike principle as the Eigenfactor. It is normalized to one such citations-per-paper measures such as the IF À are not that a score greater than 1.00 indicates that each article based on average number of citations per article and in the journal has above-average influence, and vice hence are not skewed by a small number of individual, versa. For example, an article with an AIS of 3 means highly cited articles.12 that its articles are on average 3 times as influential as We will study the h-index from 2 sources in our study the average article in the JCR database.25 À one be based on the SCOPUS database and one based on the Google Scholar database.13,14 The former is based Why Not Just the Impact Factor? on 3-year data and the latter is based on 5-year data (“Google h5 index”). The IF is a measure of the average number of citations SCOPUS is a large Citation Index launched by Elsevier that a journal’s articles receive over the 2 calendar years in 2004. It claims to be “the largest abstract and citation following publication.33 For example, assuming in 2017 database of peer-reviewed literature” with “1.4 billion Journal Y has 101 citations in total and 23 citations were cited references dating back to 1970”.15 Google Scholar citations to articles published in 2015 and in 2016. Dur- is a popular, freely available online database owned by ing these 2 years, 17 articles were published. Then the the Google search engine.16 IF would be 23/17 = 1.35. This is reasonably easy to 108 Journal of Surgical Education Volume 76 /Number 1 January/February 2019 understand and has been used widely in the scientific Country Rank (which contains an OA filter) and Direc- community. It is compiled annually by Clarivate Analyt- tory of Open Access Journals (DOAJ). Data of h-indices ics (previously known as Institute of Scientific Informa- and SJR indicators is recorded from the SCImago database tion, Thomson Reuters) in the JCRs.34 However, it does (2016).