1 Scientometric Indicators and Their Exploitation by Journal Publishers

Total Page:16

File Type:pdf, Size:1020Kb

1 Scientometric Indicators and Their Exploitation by Journal Publishers Scientometric indicators and their exploitation by journal publishers Name: Pranay Parsuram Student number: 2240564 Course: Master’s Thesis (Book and Digital Media Studies) Supervisor: Prof. Fleur Praal Second reader: Dr. Adriaan van der Weel Date of completion: 12 July 2019 Word count: 18177 words 1 Contents 1. Introduction ............................................................................................................................ 3 2. Scientometric Indicators ........................................................................................................ 8 2.1. Journal Impact Factor ...................................................................................................... 8 2.2. h-Index .......................................................................................................................... 10 2.3. Eigenfactor™ ................................................................................................................ 11 2.4. SCImago Journal Rank.................................................................................................. 13 2.5. Source Normalized Impact Per Paper ........................................................................... 14 2.6. CiteScore ....................................................................................................................... 15 2.6. General Limitations of Citation Count .......................................................................... 16 3. Conceptual Framework ........................................................................................................ 18 3.1. Academic Publishing..................................................................................................... 18 3.2. Academic Journal Publishing ........................................................................................ 21 3.2.1. Researcher Considerations ..................................................................................... 23 4. Scientometric Indicators and Journal Publishers ................................................................. 27 4.1. Use of Scientometric Indicators .................................................................................... 27 4.1.1. Journal Pricing ........................................................................................................ 28 4.2. Manipulation of Scientometric Indicators ..................................................................... 32 4.2.1. Article Type ............................................................................................................ 32 4.2.2. Co-authorship and Subject Area ............................................................................. 33 4.2.3. Manipulation of Citable Items ................................................................................ 35 4.2.4. Self-citation ............................................................................................................ 36 4.2.5. Accessibility ........................................................................................................... 37 4.3. Alternative to Scientometric Indicators......................................................................... 43 4.4. Open Science ................................................................................................................. 45 5. Conclusion ........................................................................................................................... 47 Bibliography ............................................................................................................................ 50 2 1. Introduction The emergence of the Web has shown considerable promise as a means to transform academic communication.1 This is because the Web offers academics and various research institutions to ‘publish, annotate, review, discover and make links between research outputs’.2 Given these affordances, governments and funding agencies in many countries are now able to get directly involved in systematically evaluating the scientific outputs of universities and research institutions and their research productivity and quality. This systematic evaluation aids with providing measures to improve the performance of a given institution and provides a basis for decision-making about the allocation of research funding. The major means for determining the overall scientific output of an institution is scientometrics.3 In this thesis, I will shed light on how journal publishers exploit and manipulate this dependence of universities and research institutions on scientometrics for their own commercial interests. This chapter of the thesis provides a brief introduction of scientometrics and its use in the context of my research question. Until around 1970, research regarding the growth and development of academic and, in particular, scientific knowledge, was considered to be a philosophical field. More emphasis was laid on the validity of knowledge. However, the question regarding how this knowledge was being produced was not focused on. The latter question was considered to belong to the realm of the social sciences.4 Then, in 1969, the term scientometrics was coined in Russia. This term was intended to examine all aspects of the literature of science and technology. By 1978, the term had attained wide recognition because of the establishment of a journal called Scientometrics in Hungary.5 This journal is still in publication today, and it deals with ‘the quantitative features and characteristics of science and scientific research’.6 Furthermore, Tague-Sutcliffe provides a simple definition of scientometrics as follows: ‘Scientometrics is the study of the quantitative aspects of science as a discipline or economic activity.’7 1 J. Stewart, R. Procter, R. Williams & M. Poschen, ‘The role of academic publishers in shaping the development of Web 2.0 services for scholarly communication’, New Media & Society, 15:3 (2013), p. 414. 2 Ibid., p. 414. 3 D. Pontille & D. Torny, ‘The controversial policies of journal ratings: Evaluating social sciences and humanities’, Research Evaluation, 19:5 (2010), pp. 347–348. 4 L. Leydesdorff, The challenge of scientometrics: The development, measurement, and self-organization of scientific communications, (Universal Publishers, 2011), p. 15. 5 W. Hood & C. Wilson, ‘The literature of bibliometrics, scientometrics, and informetrics’, Scientometrics, 52:2 (2001), p. 293. 6 Anon., ‘Description’, Scientometrics <https://link.springer.com/journal/11192> (10 June 2019). 7 J. Tague-Sutcliffe, ‘An introduction to informetrics’, Information Processing & Management, 28:1 (1992), p. 1. 3 Scientometrics is related to and has overlapping fields with bibliometrics.8 Bibliometrics has been in use in different forms for over a century or more. However, the term was officially coined only in 1969,9 around the same time as scientometrics. The major difference between bibliometrics and scientometrics is that the former mainly focuses on the quantitative aspects of the literature of science and scholarship, whereas the latter considers the literature as well as other aspects of science and technology, such as researcher practices, socio-organizational structures, research and development management and governmental regulations.10 Inherently, both concepts are used as a tool to measure research output in the form of publications, and as such, the terms have been used inconsistently and inter- changeably in existing literature. However, as scientometrics is a broader concept, it fits better in the context of this thesis; therefore, I will be using this term throughout. The two basic metrics involved in scientometrics are the number of publications and the number of citations that these publications receive. These metrics can be evaluated at different levels and for different objects such as a single publication, a researcher, a researcher unit, an institution or a country.11 Conventional scientometrics only provides raw data about the publication and citation count, which is generally derived from databases such as Web of Science, Scopus, PubMed, Google Scholar and others. To interpret this data, more sophisticated indicators have been implemented, for example, journal impact factor (IF), h- index, field normalized citation indicators, Eigenfactor™ (EF), SCImago journal rank (SJR), source normalised impact per paper (SNIP) and CiteScore. The reason for the introduction of these indicators is that publication and citation trends differ by disciplines and even sub- disciplines. Therefore, more objective and normalized indicators are required for comparisons between disciplines.12 One of the first scientometric indicators was the IF,13 and it was proposed in the 1950s.14 Since then, scientometric indicators have gradually become one of the main means for characterisation of research evolution.15 Scientometric indicators are an effective means of determining the evolution of research in a given field and can hence help 8 Hood & Wilson, ‘The literature of bibliometrics’, p. 291. 9 Ibid., p. 292. 10 Ibid., pp. 293–294. 11 J. Wilsdon, J. Bar-Ilan, R. Frodeman, E. Lex, I. Peters & P.F. Wouters, ‘Next-generation metrics: Responsible metrics and evaluation for open science,’ Report of the European Commission Expert Group on Altmetrics, (2017), <https://openaccess.leidenuniv.nl/bitstream/handle/1887/58254/report.pdf?> (10 June 2019), p. 8. 12 Ibid., p. 9. 13 J.C. Oosthuizen & J.E. Fenton, ‘Alternatives to the impact factor’, The
Recommended publications
  • How to Search for Academic Journal Articles Online
    How to search for Academic Journal Articles Online While you CAN get to the online resources from the library page, I find that getting onto MyUT and clicking the LIBRARY TAB is much easier and much more familiar. I will start from there: Within the Library tab, there is a box called “Electronic Resources” and within that box is a hyperlink that will take you to “Research Databases by Name.” Click that link as shown below: The page it will take you looks like the picture below. Click “Listed by Name.” This will take you to a list starting with A, and the top selection is the one you want, it is called “Academic Search Complete.” Click it as pictured below: THIS SECTION IS ONLY IF YOU ARE ON AN OFF-CAMPUS COMPUTER: You will be required to log-in if you are off campus. The First page looks like this: Use the pull-down menu to find “University of Toledo” The Branch should default to “Main Campus,” which is what you want. Then click “Submit.” Next it will ask for you First and Last Name and your Rocket ID. If you want to use your social security number, that is also acceptable (but a little scary.). If you use your rocket ID, be sure to include the R at the beginning of the number. Then click Submit again and you are IN. The opening page has the searchbox right in the middle. When searching, start narrow and then get broader if you do not find enough results. For Example, when researching Ceremony by Leslie Silko, you may want your first search to be “Silko, Ceremony.” If you don’t find enough articles, you may then want to just search “Silko.” Finally, you may have to search for “Native American Literature.” And so on and so forth.
    [Show full text]
  • Sci-Hub Provides Access to Nearly All Scholarly Literature
    Sci-Hub provides access to nearly all scholarly literature A DOI-citable version of this manuscript is available at https://doi.org/10.7287/peerj.preprints.3100. This manuscript was automatically generated from greenelab/scihub-manuscript@51678a7 on October 12, 2017. Submit feedback on the manuscript at git.io/v7feh or on the analyses at git.io/v7fvJ. Authors • Daniel S. Himmelstein 0000-0002-3012-7446 · dhimmel · dhimmel Department of Systems Pharmacology and Translational Therapeutics, University of Pennsylvania · Funded by GBMF4552 • Ariel Rodriguez Romero 0000-0003-2290-4927 · arielsvn · arielswn Bidwise, Inc • Stephen Reid McLaughlin 0000-0002-9888-3168 · stevemclaugh · SteveMcLaugh School of Information, University of Texas at Austin • Bastian Greshake Tzovaras 0000-0002-9925-9623 · gedankenstuecke · gedankenstuecke Department of Applied Bioinformatics, Institute of Cell Biology and Neuroscience, Goethe University Frankfurt • Casey S. Greene 0000-0001-8713-9213 · cgreene · GreeneScientist Department of Systems Pharmacology and Translational Therapeutics, University of Pennsylvania · Funded by GBMF4552 PeerJ Preprints | https://doi.org/10.7287/peerj.preprints.3100v2 | CC BY 4.0 Open Access | rec: 12 Oct 2017, publ: 12 Oct 2017 Abstract The website Sci-Hub provides access to scholarly literature via full text PDF downloads. The site enables users to access articles that would otherwise be paywalled. Since its creation in 2011, Sci- Hub has grown rapidly in popularity. However, until now, the extent of Sci-Hub’s coverage was unclear. As of March 2017, we find that Sci-Hub’s database contains 68.9% of all 81.6 million scholarly articles, which rises to 85.2% for those published in toll access journals.
    [Show full text]
  • Open Access Availability of Scientific Publications
    Analytical Support for Bibliometrics Indicators Open access availability of scientific publications Analytical Support for Bibliometrics Indicators Open access availability of scientific publications* Final Report January 2018 By: Science-Metrix Inc. 1335 Mont-Royal E. ▪ Montréal ▪ Québec ▪ Canada ▪ H2J 1Y6 1.514.495.6505 ▪ 1.800.994.4761 [email protected] ▪ www.science-metrix.com *This work was funded by the National Science Foundation’s (NSF) National Center for Science and Engineering Statistics (NCSES). Any opinions, findings, conclusions or recommendations expressed in this report do not necessarily reflect the views of NCSES or the NSF. The analysis for this research was conducted by SRI International on behalf of NSF’s NCSES under contract number NSFDACS1063289. Analytical Support for Bibliometrics Indicators Open access availability of scientific publications Contents Contents .............................................................................................................................................................. i Tables ................................................................................................................................................................. ii Figures ................................................................................................................................................................ ii Abstract ............................................................................................................................................................
    [Show full text]
  • Market Power in the Academic Publishing Industry
    Market Power in the Academic Publishing Industry What is an Academic Journal? • A serial publication containing recent academic papers in a certain field. • The main method for communicating the results of recent research in the academic community. Why is Market Power important to think about? • Commercial academic journal publishers use market power to artificially inflate subscription prices. • This practice drains the resources of libraries, to the detriment of the public. How Does Academic Publishing Work? • Author writes paper and submits to journal. • Paper is evaluated by peer reviewers (other researchers in the field). • If accepted, the paper is published. • Libraries pay for subscriptions to the journal. The market does not serve the interests of the public • Universities are forced to “double-pay”. 1. The university funds research 2. The results of the research are given away for free to journal publishers 3. The university library must pay to get the research back in the form of journals Subscription Prices are Outrageous • The highest-priced journals are those in the fields of science, technology, and medicine (or STM fields). • Since 1985, the average price of a journal has risen more than 215 percent—four times the average rate of inflation. • This rise in prices, combined with the CA budget crisis, has caused UC Berkeley’s library to cancel many subscriptions, threatening the library’s reputation. A Comparison Why are prices so high? Commercial publishers use market power to charge inflated prices. Why do commercial publishers have market power? • They control the most prestigious, high- quality journals in many fields. • Demand is highly inelastic for high-quality journals.
    [Show full text]
  • Don's Conference Notes
    Don’s Conference Notes by Donald T. Hawkins (Freelance Conference Blogger and Editor) <[email protected]> Information Transformation: Open. Global. Plenary Sessions Collaborative: NFAIS’s 60th Anniversary Meeting Regina Joseph, founder of Sibylink (http://www.sibylink.com/) and co-founder of pytho (http://www.pytho.io/), consultancies that Column Editor’s Note: Because of space limitations, this is an specialize in decision science and information design, said that we are abridged version of my report on this conference. You can read the gatekeepers of knowledge and information. Information has never full article which includes descriptions of additional sessions at been more accessible, in demand, but simultaneously under attack. https://against-the-grain.com/2018/04/nfaiss-60th-anniversary- There is both a challenge and an opportunity in information system meeting/. — DTH availability and diversity. News outlets have become organs of influ- ence, and social networks are changing our consumption of information (for example, 26% of news retrieval is through social media). We are In 1958, G. Miles Conrad, director of Biological Abstracts, con- willingly allowing ourselves to be controlled. How will we be able to vened a meeting of representatives from 14 information services to harness the advantages of open access to information when the ability collaborate and cooperate in sharing technology and discussing issues of to access it might be compromised? We need people with multiple mutual interest. The National Federation of Abstracting and Indexing areas of specialist knowledge but who are also connected with broad (now Advanced Information) Services (NFAIS) was formed as a result and general knowledge.
    [Show full text]
  • Scientometrics1
    Scientometrics1 Loet Leydesdorff a and Staša Milojević b a Amsterdam School of Communication Research (ASCoR), University of Amsterdam, Kloveniersburgwal 48, 1012 CX Amsterdam, The Netherlands; [email protected] b School of Informatics and Computing, Indiana University, Bloomington 47405-1901, United States; [email protected]. Abstract The paper provides an overview of the field of scientometrics, that is: the study of science, technology, and innovation from a quantitative perspective. We cover major historical milestones in the development of this specialism from the 1960s to today and discuss its relationship with the sociology of scientific knowledge, the library and information sciences, and science policy issues such as indicator development. The disciplinary organization of scientometrics is analyzed both conceptually and empirically. A state-of-the-art review of five major research threads is provided. Keywords: scientometrics, bibliometrics, citation, indicator, impact, library, science policy, research management, sociology of science, science studies, mapping, visualization Cross References: Communication: Electronic Networks and Publications; History of Science; Libraries; Networks, Social; Merton, Robert K.; Peer Review and Quality Control; Science and Technology, Social Study of: Computers and Information Technology; Science and Technology Studies: Experts and Expertise; Social network algorithms and software; Statistical Models for Social Networks, Overview; 1 Forthcoming in: Micheal Lynch (Editor), International
    [Show full text]
  • Mapping the Future of Scholarly Publishing
    THE OPEN SCIENCE INITIATIVE WORKING GROUP Mapping the Future of Scholarly Publishing The Open Science Initiative (OSI) is a working group convened by the National Science Communi- cation Institute (nSCI) in October 2014 to discuss the issues regarding improving open access for the betterment of science and to recommend possible solutions. The following document summa- rizes the wide range of issues, perspectives and recommendations from this group’s online conver- sation during November and December 2014 and January 2015. The 112 participants who signed up to participate in this conversation were drawn mostly from the academic, research, and library communities. Most of these 112 were not active in this conversa- tion, but a healthy diversity of key perspectives was still represented. Individual participants may not agree with all of the viewpoints described herein, but participants agree that this document reflects the spirit and content of the conversation. This main body of this document was written by Glenn Hampson and edited by Joyce Ogburn and Laura Ada Emmett. Additional editorial input was provided by many members of the OSI working group. Kathleen Shearer is the author of Annex 5, with editing by Dominque Bambini and Richard Poynder. CC-BY 2015 National Science Communication Institute (nSCI) www.nationalscience.org [email protected] nSCI is a US-based 501(c)(3) nonprofit organization First edition, January 2015 Final version, April 2015 Recommended citation: Open Science Initiative Working Group, Mapping the Future of Scholarly
    [Show full text]
  • A Quick Guide to Scholarly Publishing
    A QUICK GUIDE TO SCHOLARLY PUBLISHING GRADUATE WRITING CENTER • GRADUATE DIVISION UNIVERSITY OF CALIFORNIA • BERKELEY Belcher, Wendy Laura. Writing Your Journal Article in 12 Weeks: A Guide to Academic Publishing Success. Thousand Oaks, CA: SAGE Publications, 2009. Benson, Philippa J., and Susan C. Silver. What Editors Want: An Author’s Guide to Scientific Journal Publishing. Chicago: University of Chicago Press, 2013. Derricourt, Robin. An Author’s Guide to Scholarly Publishing. Princeton, NJ: Princeton University Press, 1996. Germano, William. From Dissertation to Book. 2nd ed. Chicago Guides to Writing, Editing, and Publishing. Chicago: University of Chicago Press, 2013. ———. Getting It Published: A Guide for Scholars and Anyone Else Serious about Serious Books. 3rd ed. Chicago: University of Chicago Press, 2016. Goldbort, Robert. Writing for Science. New Haven & London: Yale University Press, 2006. Harman, Eleanor, Ian Montagnes, Siobhan McMenemy, and Chris Bucci, eds. The Thesis and the Book: A Guide for First- Time Academic Authors. 2nd ed. Toronto: University of Toronto Press, 2003. Harmon, Joseph E., and Alan G. Gross. The Craft of Scientific Communication. Chicago: University of Chicago Press, 2010. Huff, Anne Sigismund. Writing for Scholarly Publication. Thousand Oaks, CA: SAGE Publications, 1999. Luey, Beth. Handbook for Academic Authors. 5th ed. Cambridge, UK: Cambridge University Press, 2009. Luey, Beth, ed. Revising Your Dissertation: Advice from Leading Editors. Updated ed. Berkeley: University of California Press, 2007. Matthews, Janice R., John M. Bowen, and Robert W. Matthews. Successful Scientific Writing: A Step-by-Step Guide for the Biological and Medical Sciences. 3rd ed. Cambridge, UK: Cambridge University Press, 2008. Moxley, Joseph M. PUBLISH, Don’t Perish: The Scholar’s Guide to Academic Writing and Publishing.
    [Show full text]
  • The Serials Crisis and Open Access: a White Paper for the Virginia Tech Commission on Research
    The Serials Crisis and Open Access A White Paper for the Virginia Tech Commission on Research Philip Young University Libraries Virginia Tech December 2, 2009 This work is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 United States License. 1 Introduction This white paper offers an introduction to open access as well as a look at its current development. The open access movement is an attempt to free scholarly communication from restrictions on access, control, and cost, and to enable benefits such as data mining and increased citations. Open access has gained significant momentum through mandates from research funders and universities. While open access can be provided in parallel with traditional publishing, it is increasingly available as a publishing option. While open access is approached here from the problem of subscription inflation, it is important to recognize that open access is not merely a library issue, but affects the availability of research to current and future students and scholars. The Serials Crisis The phrase “serials crisis” has been in use for more than a decade as shorthand for the rise in costs for academic journals and the inability of libraries to bring these costs under control. Price inflation for academic journals significantly exceeds the consumer price index (see graph, next page). The most recent data show that journal prices increased at an average rate of 8% in 2007.1 Because journal subscriptions are a large part of the collections budget at academic libraries, any reduction in funding usually results in a loss of some journals. And the high rate of annual inflation means that academic library budgets must increase every year simply to keep the same resources that students and faculty need.
    [Show full text]
  • Using Bibliometric Big Data to Analyze Faculty Research Productivity in Health Policy and Management Christopher A. Harle
    Using Bibliometric Big Data to Analyze Faculty Research Productivity in Health Policy and Management Christopher A. Harle, PhD [corresponding author] Joshua R. Vest, PhD, MPH Nir Menachemi, PhD, MPH Department of Health Policy and Management, Richard M. Fairbanks School of Public Health, Indiana University 1050 Wishard Blvd. Indianapolis IN 46202-2872 PHONE: 317-274-5396 Keywords: big data, faculty productivity, bibliometrics, citation analysis ___________________________________________________________________ This is the author's manuscript of the article published in final edited form as: Harle, C. A., Vest, J. R., & Menachemi, N. (2016). Using Bibliometric Big Data to Analyze Faculty Research Productivity in Health Policy and Management. The Journal of Health Administration Education; Arlington, 33(2), 285–293. ABSTRACT Bibliometric big data and social media tools provide new opportunities to aggregate and analyze researchers’ scholarly impact. The purpose of the current paper is to describe the process and results we obtained after aggregating a list of public Google Scholar profiles representing researchers in Health Policy and Management or closely-related disciplines. We extracted publication and citation data on 191 researchers who are affiliated with health administration programs in the U.S. With these data, we created a publicly available listing of faculty that includes each person’s name, affiliation, year of first citation, total citations, h-index and i-10 index. The median of total citations per individual faculty member was 700, while the maximum was 46,363. The median h-index was 13, while the maximum was 91. We plan to update these statistics and add new faculty to our public listing as new Google Scholar profiles are created by faculty members in the field.
    [Show full text]
  • ARL: a Bimonthly Newsletter of Research Library Issues and Actions, 2001
    DOCUMENT RESUME ED 458 891 IR 058 402 AUTHOR Barrett, G. Jaia, Ed. TITLE ARL: A Bimonthly Newsletter of Research Library Issues and Actions, 2001. INSTITUTION Association of Research Libraries, Washington, DC. ISSN ISSN-1050-6098 PUB DATE 2001-00-00 NOTE 90p.; Published bimonthly. For the 1999 issues, see ED 437 979. AVAILABLE FROM Association of Research Libraries, 21 Dupont Circle, Washington, DC 20036 ($25 per year subscription, ARL members; $50 per year subscription plus $36 shipping and handling, nonmembers) .Tel: 202-296-2296; Web site: http://www.arl.org/newsltr. PUB TYPE Collected Works Serials (022) JOURNAL CIT ARL; n214-219 Feb-Dec 2001 EDRS PRICE MF01/PC04 Plus Postage. DESCRIPTORS Academic Libraries; Electronic Journals; Federal Regulation; Higher Education; Information Services; Libraries; Library Statistics; *Research Libraries; Scholarly Communication; Scholarly Journals IDENTIFIERS *Association of Research Libraries; Digitizing ABSTRACT This document consists of six issues of the ARL (Association of Research Libraries) Newsletter, covering the year 2001. Each issue of the newsletter includes some or all of the following sections: "Current Issues," reports from the Office of Scholarly Communication, Office for Management Services, and Coalition for Networked Information, "Federal Relations," "Statistics and Measurement," "Diversity," "ARL Activities," and a calendar of events. Topics covered include: the handbook "Declaring Independence: A Guide to Creating Community-Controlled Science Journals"; ALA and ARL file brief
    [Show full text]
  • Machine Learning in Scientometrics
    DEPARTAMENTO DE INTELIGENCIA ARTIFICIAL Escuela Tecnica´ Superior de Ingenieros Informaticos´ Universidad Politecnica´ de Madrid PhD THESIS Machine Learning in Scientometrics Author Alfonso Iba´nez˜ MS Computer Science MS Artificial Intelligence PhD supervisors Concha Bielza PhD Computer Science Pedro Larranaga˜ PhD Computer Science 2015 Thesis Committee President: C´esarHerv´as Member: Jos´eRam´onDorronsoro Member: Enrique Herrera Member: Irene Rodr´ıguez Secretary: Florian Leitner There are no secrets to success. It is the result of preparation, hard work, and learning from failure. Acknowledgements Ph.D. research often appears a solitary undertaking. However, it is impossible to maintain the degree of focus and dedication required for its completion without the help and support of many people. It has been a difficult long journey to finish my Ph.D. research and it is of justice to cite here all of them. First and foremost, I would like to thank Concha Bielza and Pedro Larra~nagafor being my supervisors and mentors. Without your unfailing support, recommendations and patient, this thesis would not have been the same. You have been role models who not only guided my research but also demonstrated your enthusiastic research attitudes. I owe you so much. Whatever research path I do take, I will be prepared because of you. I would also like to express my thanks to all my friends and colleagues at the Computa- tional Intelligence Group who provided me with not only an excellent working atmosphere and stimulating discussions but also friendships, care and assistance when I needed. My special thank-you goes to Rub´enArma~nanzas,Roberto Santana, Diego Vidaurre, Hanen Borchani, Pedro L.
    [Show full text]