Bibliometrics As a Research Field

Total Page:16

File Type:pdf, Size:1020Kb

Bibliometrics As a Research Field BIBLIOMETRICS AS A RESEARCH FIELD A course on theory and application of bibliometric indicators W. GLÄNZEL COURSE HANDOUTS 2003 2 CONTENT General Introduction ....................................................................................................5 1. Historical remarks..................................................................................................6 1.1 The origin of the name ‘Bibliometrics’ .................................................................. 6 1.2 The pioneers in bibliometrics................................................................................. 6 1.3 Bibliometrics since deSolla Price .......................................................................... 8 1.4 The three “components” of present-day bibliometrics .......................................... 9 2. The elements of bibliometric research and their mathematical background .......11 2.1 Basic concepts of elements, units and measures of bibliometric research .......... 12 2.2 Data sources of bibliometric research................................................................. 13 2.3 Minimum bibliographic description for paper identification .............................. 16 2.4 Mathematical models and the “distributional” approach................................... 17 2.4.1 Historical sketch of mathematical methods used in bibliometrics....................... 17 2.4.2 Basic postulates and the “axiomatic approach” to bibliometrics ....................... 20 2.4.3 Deterministic models of productivity and citation processes............................... 23 2.4.4 The stochastic approach to bibliometrics ........................................................... 28 3. Indicators of publication activity.........................................................................36 3.1 Counting schemes and main levels of aggregation.............................................. 36 3.2 Problems of subject assignment........................................................................... 38 3.3 Statistics on scientific productivity: Frequency distributions vs. rank statistics................................................................................................. 40 3.4 Factors influencing publication activity, subject characteristics in publication activity........................................................................................... 45 3.5 Publication profiles of institutional and national research activity..................... 48 3.5.1 Publication profiles by discipline......................................................................... 49 3.5.2 Publication profiles by sectors............................................................................. 51 3.5.3 Publication profiles by funding............................................................................ 51 3.5.4 Characterising research dynamics of institutions, regions or countries ............. 52 4. Indicators of citation impact ................................................................................53 4.1. The notion of citations in information science and bibliometrics........................ 53 4.2 The role of self-citations....................................................................................... 56 4.3 Factors influencing citation impact ..................................................................... 60 4.4 Journal citation measures: the Impact Factor..................................................... 63 4.5 Relative citation indicators .................................................................................. 66 5. Indicators of scientific collaboration ...................................................................73 5.1 Co-authorship as a measure of scientific collaboration ...................................... 73 5.2 Indicators of co-operativity and co-publication networks ................................... 76 6. Indicators and advanced data-analytical methods ...............................................81 6.1 Bibliometric transaction matrices ....................................................................... 81 6.2 Bibliographic coupling and co-citation analysis ................................................. 83 6.3 Co-word, Co-heading and Co-author Clustering Techniques............................. 85 6.4 Techniques of Matrix Analysis............................................................................. 86 3 7. The borderland of bibliometric research..............................................................89 7.1. Linkage between science and technology ............................................................ 89 7.2. New horizons: bibliometric methods in webometrics .......................................... 91 8. Introduction to bibliometric technology .............................................................93 8.1 Outlines of cleaning-up and computerised data processing of bibliographic data................................................................................................ 93 8.2 Bibliometric sortware .......................................................................................... 97 References.................................................................................................................103 APPENDIX: List of recommended readings............................................................111 4 GENERAL INTRODUCTION Bibliometrics has become a standard tool of science policy and research management in the last decades. All significant compilations of science indicators heavily rely on publication and citation statistics and other, more sophisticated bibliometric techniques. Examples for such compilations are: − National Science Board − Observatoire des Sciences et des Techniques − European Report on S&T Indicators − Het Nederlands Observatorium van Wetenschap en Technologie: Wetenschaps- en Technologie-Indicatoren − Vlaams Indicatorenboek In addition, many extensive bibliometric studies of important science fields appeared during the last two decades. Aim of these studies was to measure national research performance in the international context or to describe the development of a science field with the help of bibliometric means (for instance, Braun et al., 1987). It is a common misbelief that bibliometrics is nothing else but publication and citation based gauging of scientific performance or compiling of cleaned-up bibliographies on research domains extended by citation data. In fact, scientometrics is a multifaceted endeavour encompassing subareas such as structural, dynamic, evaluative and predictive scientometrics. Structural scientometrics came up with results like the re-mapping of the epistemological structure of science based, for instance, on co-citation, ”bibliographic coupling” techniques or co-word techniques. Dynamic scientometrics constructed sophisticated models of scientific growth, obsolescence, citation processes, etc. These models are not only of theoretical interest but can also be usefully applied in evaluation and prediction. Beyond policy relevant applications of bibliometric results, there are recently important applications in the context of studying the linkage between science and technology, or applications to related fields such as library and information science and most recently also Webometrics. Examples for the latter ones are the large ongoing projects EICSTES (European Indicators, Cyberspace and the Science-Technology- Economy System) and WISER (Web indicators for scientific, technology and innovation research). Today, bibliometrics is one of the rare truly interdisciplinary research fields to extend to almost all scientific fields. Bibliometric methodology comprises components from mathematics, social sciences, natural sciences, engineering and even life sciences. The following pages will provide a systematic description of the research structure of the field and a detailed overview of the state-of-the-art in bibliometric methodology. 5 1. HISTORICAL REMARKS 1.1 The origin of the name ‘Bibliometrics’ The terms bibliometrics and scientometrics were almost simultaneously introduced by Pritchard and by Nalimov and Mulchenko in 1969. While Pritchard explained the term bibliometrics as “the application of mathematical and statistical methods to books and other media of communication”, Nalimov and Mulchenko defined scientometrics as “the application of those quantitative methods which are dealing with the analysis of science viewed as an information process”. According to these interpretations the speciality scientometrics is restricted to the measurement of science communication, whereas bibliometrics is designed to deal with more general information processes. The anyhow fuzzy borderlines between the two specialities almost vanished during the last three decades, and nowadays both terms are used almost as synonyms. Instead, the field informetrics took the place of the originally broader speciality bibliometrics. The term informetrics was adopted by VINITI (Gorkova, 1988) and stands for a more general subfield of information science dealing with mathematical- statistical analysis of communication processes in science. In contrast to the original definition of bibliometrics, informetrics also deals with electronic media and thus includes topics such as the statistical analysis of the (scientific) text and hypertext systems, library circulations, information measures in electronic libraries, models for Information Production Processes and quantitative aspects of information
Recommended publications
  • Jackson: Choosing a Methodology: Philosophical Underpinning
    JACKSON: CHOOSING A METHODOLOGY: PHILOSOPHICAL UNDERPINNING Choosing a Methodology: Philosophical Practitioner Research Underpinning In Higher Education Copyright © 2013 University of Cumbria Vol 7 (1) pages 49-62 Elizabeth Jackson University of Cumbria [email protected] Abstract As a university lecturer, I find that a frequent question raised by Masters students concerns the methodology chosen for research and the rationale required in dissertations. This paper unpicks some of the philosophical coherence that can inform choices to be made regarding methodology and a well-thought out rationale that can add to the rigour of a research project. It considers the conceptual framework for research including the ontological and epistemological perspectives that are pertinent in choosing a methodology and subsequently the methods to be used. The discussion is exemplified using a concrete example of a research project in order to contextualise theory within practice. Key words Ontology; epistemology; positionality; relationality; methodology; method. Introduction This paper arises from work with students writing Masters dissertations who frequently express confusion and doubt about how appropriate methodology is chosen for research. It will be argued here that consideration of philosophical underpinning can be crucial for both shaping research design and for explaining approaches taken in order to support credibility of research outcomes. It is beneficial, within the unique context of the research, for the researcher to carefully
    [Show full text]
  • Science, Technology, Policy Fellowship Program Step Into Our Community and Shape Science for Society!
    STeP Science, Technology, Policy Fellowship Program Step into our community and shape science for society! A LANDMARK PROGRAM OF THE INTER-AMERICAN INSTITUTE FOR GLOBAL CHANGE RESEARCH (IAI) 2021 IAI WHO WE ARE The Inter-American Institute for Global Change Research (IAI) is an intergovernmental organization supported by 19 countries in the Americas, dedicated to pursuing the principles of scientific excellence, international cooperation, capacity building, and the full and open exchange of scientific information to increase the understanding of global change phenomena and their social-economic implications. The IAI enables a well-informed, inclusive and sustainable America, which collaboratively meets the challenges posed by global change by supporting flexible science-based policies and actions. History of the IAI In 1992, 12 nations of the Americas came together in Montevideo, Uruguay to establish the IAI. The 12 governments, in the Declaration of Montevideo, called for the Institute to develop the best possible international coordination of scientific and economic research of global change in the Americas. Since then, 7 additional nations have acceded to the treaty, and the IAI has now 19 parties in the Americas. IAI INTER-AMERICAN INSTITUTE FOR GLOBAL CHANGE RESEARCH SCIENCE, TECHNOLOGY, POLICY FELLOWSHIP The Science, Technology, Policy (STeP) Fellowship Program is an innovative landmark program of the IAI to enhance human and institutional capacities in IAI member countries and to support the provision of expert scientific advice to policy makers for the development of public policy relevant to global change. Fellows in the STeP program are placed at host government or private organizations to engage first-hand with policy and decision-makers and facilitate the uptake of scientific knowledge into policy processes.
    [Show full text]
  • Is Sci-Hub Increasing Visibility of Indian Research Papers? an Analytical Evaluation Vivek Kumar Singh1,*, Satya Swarup Srichandan1, Sujit Bhattacharya2
    Journal of Scientometric Res. 2021; 10(1):130-134 http://www.jscires.org Perspective Paper Is Sci-Hub Increasing Visibility of Indian Research Papers? An Analytical Evaluation Vivek Kumar Singh1,*, Satya Swarup Srichandan1, Sujit Bhattacharya2 1Department of Computer Science, Banaras Hindu University, Varanasi, Uttar Pradesh, INDIA. 2CSIR-National Institute of Science Technology and Development Studies, New Delhi, INDIA. ABSTRACT Sci-Hub, founded by Alexandra Elbakyan in 2011 in Kazakhstan has, over the years, Correspondence emerged as a very popular source for researchers to download scientific papers. It is Vivek Kumar Singh believed that Sci-Hub contains more than 76 million academic articles. However, recently Department of Computer Science, three foreign academic publishers (Elsevier, Wiley and American Chemical Society) have Banaras Hindu University, filed a lawsuit against Sci-Hub and LibGen before the Delhi High Court and prayed for Varanasi-221005, INDIA. complete blocking these websites in India. It is in this context, that this paper attempts to Email id: [email protected] find out how many Indian research papers are available in Sci-Hub and who downloads them. The citation advantage of Indian research papers available on Sci-Hub is analysed, Received: 16-03-2021 with results confirming that such an advantage do exist. Revised: 29-03-2021 Accepted: 25-04-2021 Keywords: Indian Research, Indian Science, Black Open Access, Open Access, Sci-Hub. DOI: 10.5530/jscires.10.1.16 INTRODUCTION access publishing of their research output, and at the same time encouraging their researchers to publish in openly Responsible Research and Innovation (RRI) has become one accessible forms.
    [Show full text]
  • The Rhetoric of Positivism Versus Interpretivism: a Personal View1
    Weber/Editor’s Comments EDITOR’S COMMENTS The Rhetoric of Positivism Versus Interpretivism: A Personal View1 Many years ago I attended a conference on interpretive research in information systems. My goal was to learn more about interpretive research. In my Ph.D. education, I had studied primarily positivist research methods—for example, experiments, surveys, and field studies. I knew little, however, about interpretive methods. I hoped to improve my knowledge of interpretive methods with a view to using them in due course in my research work. A plenary session at the conference was devoted to a panel discussion on improving the acceptance of interpretive methods within the information systems discipline. During the session, a number of speakers criticized positivist research harshly. Many members in the audience also took up the cudgel to denigrate positivist research. If any other positivistic researchers were present at the session beside me, like me they were cowed. None of us dared to rise and speak in defence of positivism. Subsequently, I came to understand better the feelings of frustration and disaffection that many early interpretive researchers in the information systems discipline experienced when they attempted to publish their work. They felt that often their research was evaluated improperly and treated unfairly. They contended that colleagues who lacked knowledge of interpretive research methods controlled most of the journals. As a result, their work was evaluated using criteria attuned to positivism rather than interpretivism. My most-vivid memory of the panel session, however, was my surprise at the way positivism was being characterized by my colleagues in the session.
    [Show full text]
  • A Comprehensive Framework to Reinforce Evidence Synthesis Features in Cloud-Based Systematic Review Tools
    applied sciences Article A Comprehensive Framework to Reinforce Evidence Synthesis Features in Cloud-Based Systematic Review Tools Tatiana Person 1,* , Iván Ruiz-Rube 1 , José Miguel Mota 1 , Manuel Jesús Cobo 1 , Alexey Tselykh 2 and Juan Manuel Dodero 1 1 Department of Informatics Engineering, University of Cadiz, 11519 Puerto Real, Spain; [email protected] (I.R.-R.); [email protected] (J.M.M.); [email protected] (M.J.C.); [email protected] (J.M.D.) 2 Department of Information and Analytical Security Systems, Institute of Computer Technologies and Information Security, Southern Federal University, 347922 Taganrog, Russia; [email protected] * Correspondence: [email protected] Abstract: Systematic reviews are powerful methods used to determine the state-of-the-art in a given field from existing studies and literature. They are critical but time-consuming in research and decision making for various disciplines. When conducting a review, a large volume of data is usually generated from relevant studies. Computer-based tools are often used to manage such data and to support the systematic review process. This paper describes a comprehensive analysis to gather the required features of a systematic review tool, in order to support the complete evidence synthesis process. We propose a framework, elaborated by consulting experts in different knowledge areas, to evaluate significant features and thus reinforce existing tool capabilities. The framework will be used to enhance the currently available functionality of CloudSERA, a cloud-based systematic review Citation: Person, T.; Ruiz-Rube, I.; Mota, J.M.; Cobo, M.J.; Tselykh, A.; tool focused on Computer Science, to implement evidence-based systematic review processes in Dodero, J.M.
    [Show full text]
  • Open Access Availability of Scientific Publications
    Analytical Support for Bibliometrics Indicators Open access availability of scientific publications Analytical Support for Bibliometrics Indicators Open access availability of scientific publications* Final Report January 2018 By: Science-Metrix Inc. 1335 Mont-Royal E. ▪ Montréal ▪ Québec ▪ Canada ▪ H2J 1Y6 1.514.495.6505 ▪ 1.800.994.4761 [email protected] ▪ www.science-metrix.com *This work was funded by the National Science Foundation’s (NSF) National Center for Science and Engineering Statistics (NCSES). Any opinions, findings, conclusions or recommendations expressed in this report do not necessarily reflect the views of NCSES or the NSF. The analysis for this research was conducted by SRI International on behalf of NSF’s NCSES under contract number NSFDACS1063289. Analytical Support for Bibliometrics Indicators Open access availability of scientific publications Contents Contents .............................................................................................................................................................. i Tables ................................................................................................................................................................. ii Figures ................................................................................................................................................................ ii Abstract ............................................................................................................................................................
    [Show full text]
  • A Mixed Methods Bibliometric Study
    The Qualitative Report Volume 24 Number 12 Article 2 12-2-2019 Collaboration Patterns as a Function of Research Experience Among Mixed Researchers: A Mixed Methods Bibliometric Study Melanie S. Wachsmann Sam Houston State University, [email protected] Anthony J. Onwuegbuzie Sam Houston State University, [email protected] Susan Hoisington Sam Houston State University, [email protected] Vanessa Gonzales Sam Houston State University, [email protected] Rachael Wilcox Sam Houston State University, [email protected] See next page for additional authors Follow this and additional works at: https://nsuworks.nova.edu/tqr Part of the Education Commons, Quantitative, Qualitative, Comparative, and Historical Methodologies Commons, and the Social Statistics Commons Recommended APA Citation Wachsmann, M. S., Onwuegbuzie, A. J., Hoisington, S., Gonzales, V., Wilcox, R., Valle, R., & Aleisa, M. (2019). Collaboration Patterns as a Function of Research Experience Among Mixed Researchers: A Mixed Methods Bibliometric Study. The Qualitative Report, 24(12), 2954-2979. https://doi.org/10.46743/ 2160-3715/2019.3852 This Article is brought to you for free and open access by the The Qualitative Report at NSUWorks. It has been accepted for inclusion in The Qualitative Report by an authorized administrator of NSUWorks. For more information, please contact [email protected]. Collaboration Patterns as a Function of Research Experience Among Mixed Researchers: A Mixed Methods Bibliometric Study Abstract Onwuegbuzie et al. (2018) documented that the degree of collaboration is higher for mixed researchers than for qualitative and quantitative researchers. The present investigation examined the (a) link between the research experience of lead authors and their propensity to collaborate (Quantitative Phase), and (b) role of research experience in collaborative mixed research studies (Qualitative Phase).
    [Show full text]
  • The Privilege to Select. Global Research System, European Academic Library Collections, and Decolonisation
    The Privilege to Select Global Research System, European Academic Library Collections, and Decolonisation Schmidt, Nora DOI: 10.5281/zenodo.4011296 2020 Document Version: Publisher's PDF, also known as Version of record Link to publication Citation for published version (APA): Schmidt, N. (2020). The Privilege to Select: Global Research System, European Academic Library Collections, and Decolonisation. Lund University, Faculties of Humanities and Theology. https://doi.org/10.5281/zenodo.4011296 Total number of authors: 1 Creative Commons License: CC BY General rights Unless other specific re-use rights are stated the following general rights apply: Copyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright owners and it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights. • Users may download and print one copy of any publication from the public portal for the purpose of private study or research. • You may not further distribute the material or use it for any profit-making activity or commercial gain • You may freely distribute the URL identifying the publication in the public portal Read more about Creative commons licenses: https://creativecommons.org/licenses/ Take down policy If you believe that this document breaches copyright please contact us providing details, and we will remove access to the work immediately and investigate your claim. LUND UNIVERSITY PO Box 117 221 00 Lund +46 46-222 00 00 Download date: 06. Oct. 2021 The Privilege to Select To European social sciences and humanities researchers, substantial parts of potentially relevant literature published in the “Global South” are invisible.
    [Show full text]
  • Sci-Hub Downloads Lead to More Article Citations
    THE SCI-HUB EFFECT:SCI-HUB DOWNLOADS LEAD TO MORE ARTICLE CITATIONS Juan C. Correa⇤ Henry Laverde-Rojas Faculty of Business Administration Faculty of Economics University of Economics, Prague, Czechia Universidad Santo Tomás, Bogotá, Colombia [email protected] [email protected] Fernando Marmolejo-Ramos Julian Tejada Centre for Change and Complexity in Learning Departamento de Psicologia University of South Australia Universidade Federal de Sergipe [email protected] [email protected] Štepánˇ Bahník Faculty of Business Administration University of Economics, Prague, Czechia [email protected] ABSTRACT Citations are often used as a metric of the impact of scientific publications. Here, we examine how the number of downloads from Sci-hub as well as various characteristics of publications and their authors predicts future citations. Using data from 12 leading journals in economics, consumer research, neuroscience, and multidisciplinary research, we found that articles downloaded from Sci-hub were cited 1.72 times more than papers not downloaded from Sci-hub and that the number of downloads from Sci-hub was a robust predictor of future citations. Among other characteristics of publications, the number of figures in a manuscript consistently predicts its future citations. The results suggest that limited access to publications may limit some scientific research from achieving its full impact. Keywords Sci-hub Citations Scientific Impact Scholar Consumption Knowledge dissemination · · · · Introduction Science and its outputs are essential in daily life, as they help to understand our world and provide a basis for better decisions. Although scientific findings are often cited in social media and shared outside the scientific community [1], their primary use is what we could call “scholar consumption.” This phenomenon includes using websites that provide subscription-based access to massive databases of scientific research [2].
    [Show full text]
  • Lessons from the History of UK Science Policy
    Lessons from the History of UK Science Policy August 2019 2 Science Policy History Foreword The British Academy is the UK’s national body for the humanities and social sciences. Our purpose is to deepen understanding of people, societies and cultures, enabling everyone to learn, progress and prosper. The Academy inspires, supports and promotes outstanding achievement and global advances in the humanities and social sciences. We are a fellowship of over 1000 of the most outstanding academics, an international community of leading experts focused on people, culture and societies, and are the voice for the humanities and social sciences.1 The British Academy aims to use insights from the past and the present to help shape the future, by influencing policy and affecting change in the UK and overseas. Given this, the Academy is well-placed to bring humanities and social science insight from the past into policymaking for the present and the future. One way to do this is in using historical insights to inform policymaking – ‘looking back to look forward’. To support these efforts, the Academy’s public policy team in collaboration with the Department for Business, Energy and Industrial Strategy, has undertaken a new programme of work on policy histories. The policy histories series develop historical analyses for individual policy areas. These analyses are used to provide: • a structured, rigorous and objective account of the history of a given policy area and the significance of key milestones in context, • an informed basis for analysis and insights from the timelines as well as dialogue and discussion about what history can tell us about the future.
    [Show full text]
  • PDF Download Starting with Science Strategies for Introducing Young Children to Inquiry 1St Edition Ebook
    STARTING WITH SCIENCE STRATEGIES FOR INTRODUCING YOUNG CHILDREN TO INQUIRY 1ST EDITION PDF, EPUB, EBOOK Marcia Talhelm Edson | 9781571108074 | | | | | Starting with Science Strategies for Introducing Young Children to Inquiry 1st edition PDF Book The presentation of the material is as good as the material utilizing star trek analogies, ancient wisdom and literature and so much more. Using Multivariate Statistics. Michael Gramling examines the impact of policy on practice in early childhood education. Part of a series on. Schauble and colleagues , for example, found that fifth grade students designed better experiments after instruction about the purpose of experimentation. For example, some suggest that learning about NoS enables children to understand the tentative and developmental NoS and science as a human activity, which makes science more interesting for children to learn Abd-El-Khalick a ; Driver et al. Research on teaching and learning of nature of science. The authors begin with theory in a cultural context as a foundation. What makes professional development effective? Frequently, the term NoS is utilised when considering matters about science. This book is a documentary account of a young intern who worked in the Reggio system in Italy and how she brought this pedagogy home to her school in St. Taking Science to School answers such questions as:. The content of the inquiries in science in the professional development programme was based on the different strands of the primary science curriculum, namely Living Things, Energy and Forces, Materials and Environmental Awareness and Care DES Exit interview. Begin to address the necessity of understanding other usually peer positions before they can discuss or comment on those positions.
    [Show full text]
  • Will Web Search Engines Replace Bibliographic Databases in the Systematic Identification of Research?
    Will Web Search Engines Replace Bibliographic Databases in the Systematic Identification of Research? Bates, J., Best, P., McQuilkin, J., & Taylor, B. (2016). Will Web Search Engines Replace Bibliographic Databases in the Systematic Identification of Research? Journal of Academic Librarianship. https://doi.org/10.1016/j.acalib.2016.11.003 Published in: Journal of Academic Librarianship Document Version: Peer reviewed version Queen's University Belfast - Research Portal: Link to publication record in Queen's University Belfast Research Portal Publisher rights © 2016 Elsevier Inc. All rights reserved. This manuscript version is made available under the CC-BY-NC-ND 4.0 license http://creativecommons.org/licenses/by-nc-nd/4.0/ which permits distribution and reproduction for non-commercial purposes, provided the author and source are cited. General rights Copyright for the publications made accessible via the Queen's University Belfast Research Portal is retained by the author(s) and / or other copyright owners and it is a condition of accessing these publications that users recognise and abide by the legal requirements associated with these rights. Take down policy The Research Portal is Queen's institutional repository that provides access to Queen's research output. Every effort has been made to ensure that content in the Research Portal does not infringe any person's rights, or applicable UK laws. If you discover content in the Research Portal that you believe breaches copyright or violates any law, please contact [email protected]. Download date:30. Sep. 2021 Will web search engines replace bibliographic databases in the systematic identification of research? Abstract The availability of web search engines provides opportunities in addition to those provided by bibliographic databases for identifying academic literature, but their usefulness for retrieving research is uncertain.
    [Show full text]