The Study of Association Between Altmetrics Activity Indicators and Citation Quality Indicators in Iranian Medical Journals

Total Page:16

File Type:pdf, Size:1020Kb

The Study of Association Between Altmetrics Activity Indicators and Citation Quality Indicators in Iranian Medical Journals Original Article The Study of Association between Altmetrics Activity Indicators and Citation Quality Indicators in Iranian Medical Journals Abstract Mansoureh Serati Background: Given the limitations of traditional citation indicators, more indicators are needed Shirazi 1 , to examine the effectiveness and improvement of existing indicators. The present study aimed to Mahdieh Arian2, investigate the association between Altmetrics activity and quality citation indicators in Iranian 3* journals based on Clarivate Analytics, Scopus, and Medline. Methods: The research was carried Ali Valinejadi , 4 out using Altmetrics method through scientometric approach. The population of the present study Ali Mohammadpour was Iranian medical journals, which were available at three databases of Clarivate Analytics, 1Islamic World Science Citation Scopus, and Medline. In order to obtain quality information, we’ve used the indicators of CiteScore, Center (ISC), Shiraz, Iran, 2 SJR, and SNIP at Scopus database as well as the impact factor at JCR database; besides, to find Student Research Committee, Altmetrics indicators and Altmetrics scores of articles, the Altmetrics explorer database was used. Semnan University of Medical Sciences, Semnan, Iran, Results: About 16% of the articles in the reviewed journals were cited at least once in the social 3Social Determinants of Health media and had Altmetrics scores. Among the reviewed journals, the highest rate of social media Research Center, Semnan coverage was related to the Iranian Journal of Basic Medical Sciences, and the highest Altmetrics University of Medical Sciences, score obtained from the mean Altmetrics score of the papers was related to Cell Journal (Yakhteh). Semnan, Iran, 4Department of A review of quality indicators of journals with Altmetrics coverage and Altmetrics score of journals Health Information Technology, showed that there was a significant and positive correlation between the Altmetrics score and impact Faculty of Allied Medical factor. However, any significant association was neither found between the journal’s coverage Sciences, Hamadan University and SiteScore, SNIP, SJR, nor between the journal’s Altmetrics score and quality indicators. of Medical Sciences, Hamadan, Iran Conclusions: According to the results of this study, policy makers of scientific journals should adopt strategies that bring about social media presence; thus, we will find further Iranian articles in the social media. Keywords: Altmetrics, bibliometrics, clarivate analytics, journal impact factor, medline, scopus, social media Introduction aspects of impact has developed, such as social, cultural, and education impacts, Altmetrics indicators which are derived which were neglected by traditional from the social web are increasingly methods of impact assessment.[1] Taylor becoming popular and are used as the referred to Altmetrics indicators as a primary impact factors. Altmetrics—stands revolution in scientometrics[4]; and Lin and for alternative metrics—means alternative Fenner described it as a new paradigm in indicators, which is a term to describe research evaluation.[5] Altmetrics focuses web‑based indexes to impact the research on research outputs in social networks such articles and emphasizes the social media Address for correspondence: as Facebook, Twitter, blogs, news outlet Dr. Ali Valinejadi, for data collection. The concept was first and reference management tools, and goes Social Determinants of introduced in 2010 by Priem et al.[1] The beyond citation in analyzing academic Health Research Center, web age has provided a new environment Semnan University of Medical activities. Instead of just analyzing the for the discussion and dissemination of Sciences, Semnan, Iran. articles of scientific journals, Altmetrics E‑mail: valinejadi.a@semums. research information and according to considers the impact of scientific output ac.ir this new environment there is a need in different formats.[1] Altmetrics, unlike for more indicators to examine the the citation‑based indicators, such as the impact and to complete the existing Access this article online [2] journal’s impact factor or the H‑index, indicators. Altmetrics indicators have evaluates the impact of publication of a Website: eliminated several limitations of traditional www.ijpvmjournal.net/www.ijpm.ir single article.[6] The indicators of article citation‑based indicators,[3] in which other DOI: level measure the impact of a single article 10.4103/ijpvm.IJPVM_59_20 through quantitative indicators, such as Quick Response Code: This is an open access journal, and articles are distributed under the terms of the Creative Commons Attribution‑NonCommercial‑ShareAlike 4.0 License, which How to cite this article: Serati Shirazi M, allows others to remix, tweak, and build upon the work Arian M, Valinejadi A, Mohammadpour A. The study non‑commercially, as long as appropriate credit is given and of association between Altmetrics activity indicators the new creations are licensed under the identical terms. and citation quality indicators in Iranian medical 11 For reprints contact: [email protected] journals. Int J Prev Med 2020; . © 2020 International Journal of Preventive Medicine | Published by Wolters Kluwer - Medknow 1 Serati Shirazi, et al.: Association between Altmetrics and Citation Indicators counting the number of times that an article is downloaded shortly after publication; and the spent time on the or shared on Twitter, as well as quality indicators such publication of the article may reduce the value of the as media coverage or blog posts by the experts in that content. Therefore, the use of articles in online social field.[7] However, some scientometrics experts consider networks can be effective in updating the publications. Altmetrics as a threat to the alignment process and quality Hence, it is essential to assess the Altmetrics approach in control of research activities[8]; nevertheless, pursuing medical sciences articles, in order to be used in research the use of scientific articles in social media means that policies and in evaluating the publications quality. researchers are able to examine the impact of these Since the Altmetric activity of Iranian medical journals has products more extensively[9]; hence, along with the citation, not been studied so far, thus, the objective of this study these indicators should be investigated and their impact was to investigate the association between Altmetrics should be considered. Salajegheh and Diari examined activity and quality citation indicators in Iranian journals the association between citation indices and Altmetrics on three databases of Clarivate Analytics, Scopus, and in 111 medical sciences journals in Scopus database. Medline. Altmetrics data was obtained from Altmetrics official website According to their results, there was a correlation The results of this study can persuade policymakers that between the citation indicators (except the impact factor) they should pay more attention to the social media and the and the mean scores of Altmetrics.[10] Goltaji, and Jowkar rules governing them such as limitations and filtering. They studied the extent of availability of medical informatics should inform everyone especially the scientific community articles in social media through Altmetrics approach. about social networks and the way to be an active one in The results showed that the scientific outputs were often using them and also their benefits. used through social networks. In this study, a significant In addition, they can encourage researchers to publish their positive association was found between most of Altmetrics research in online and open access format, and can make indicators and the number of received citations on the Web research policy to promote faculty members based on their [11] of Science platform. The study of Erfanmanesh on the Altmetric score. relationship between Altmetrics activity and quality of the library and information sciences journals showed that Methods the published articles in higher quality scientific journals The research was carried out using Altmetrics method were more widely seen on social networks, and attracted through scientometric approach. The research population more attention of users.[12] consisted of Iranian medical journals, which were available Serati Shirazi and Goltaji carried out a research on on databases of Clarivate Analytics, Scopus, and Medline. Scientific Articles of “Health Literacy” in Social Media. In order to obtain quality information, the indicators of The results of their study revealed that Mendeley and CiteScore, SJR, SNIP were used, which were extracted Twitter are the most used social media by health literacy from the Scopus database, and the impact factors of scholars for sharing scientific outputs and there is journals were obtained from SJR database. During the significant relationship between most alternative metrics research, since the last calculation for these indicators was and the number of citations in Web of Science.[13] in 2017, the same year was considered for data collection. Zahedi, Costas and Wouters studied the use of Web of The Altmetric Explorer was used to obtain Altmetrics Science journals at Mendeley, as well as the articles’ indices and Altmetrics scores. citation indexes through the Impactstory website, and The Altmetric Explorer database provides the possibility reported a moderate correlation between these two of searching articles in a variety of ways, such as the indicators.[14]
Recommended publications
  • Ten-Year Analysis of Hepatitis-Related Papers in the Middle East
    Turk J Gastroenterol 2017; 28: 20-5 Liver Ten-year analysis of hepatitis-related papers in the Middle East: a web of science-based scientometric study Mohammad Saeid Rezaee-Zavareh1,2,3, Seyed Moayed Alavian2,3 1Student Research Committee, Baqiyatallah University of Medical Sciences, Tehran, Iran 2Baqiyatallah Research Center for Gastroenterology and Liver Diseases (BRCGL), Baqiyatallah University of Medical Sciences, Tehran, Iran 3Scientometrics Institute of Middle East Liver Diseases (MELD) Center, Tehran, IR Iran ABSTRACT Background/Aims: In the Middle East (ME), the proper understanding of hepatitis, especially viral hepatitis, is considered to be extremely important. However, no published paper has investigated the status of hepatitis- related research in the ME. A scientometric analysis based on the Web of Science database was conducted on hepatitis-related papers in the ME to determine the current status of research on this topic. Original Article Materials and Methods: A scientometric analysis using the Web of Science database, specifically articles from the Expanded Science Citation Index and Social Sciences Citation Index, was conducted on work published between 2005 and 2014 using the keyword “hepatitis” in conjunction with the names of countries in the ME. Results: Of 103,096 papers that used the word “hepatitis” in their title, abstract, or keywords, only 6,540 papers (6.34%) were associated with countries in the ME. Turkey, Iran, Egypt, Israel, and Saudi Arabia were the top five countries in which hepatitis-related papers were published. Most papers on hepatitis A, B, and D and autoim- mune hepatitis were published in Turkey, and most papers on hepatitis C were published in Egypt.
    [Show full text]
  • Effects of Scientific Collaboration Between Domestic and Foreign Authors on Quality Indices of Journals
    Webology, Volume 15, Number 2, December, 2018 Home Table of Contents Titles & Subject Index Authors Index Effects of Scientific Collaboration between Domestic and Foreign Authors on Quality Indices of Journals Masoud Mohammadi Department of Medical Library & Information Sciences, Faculty of Allied Medical Sciences, Tehran University of Medical Sciences, Tehran, Iran. Golestan University of Medical Sciences, Gorgan, Iran. ORCID. E-mail: [email protected] Mohsen Mansouri Department of Computer engineering, Islamic Azad University, Gorgan Branch, Gorgan, Iran. E-mail: [email protected] Mojtaba Azghandi Shahri Central library, Research and Technology Deputy, Gonabad University of Medical Sciences, Gonabad, Iran. E-mail: [email protected] Fatemeh Sheikhshoaei Faculty of Allied Medical Science, Tehran University of Medical Sciences, Tehran, Iran. ORCID. E-mail: [email protected] Auwal Abdullahi Abubakar Department of Library and Information Science, School of Continuing Education, Bayero University Kano, Nigeria. E-mail: [email protected] Morvarid Daemi Golestan University of Medical Sciences, Gorgan, Iran. E-mail: [email protected] Maryam Banisafar* *Corresponding author, Golestan University of Medical Sciences, Gorgan, Iran. E-mail: [email protected] Received June 12, 2018; Accepted November 25, 2018 133 http://www.webology.org/2018/v15n2/a176.pdf Abstract The aim of the study was to determine the effect of scientific collaboration between domestic (Iranian) and foreign authors on their quality indices in articles published in Iranian medical journals, indexed in the Web of Science citation database. The present scientometric study was conducted on the 22 Iranian medical journals that indexed in Web of Science from 2010 to 2016.
    [Show full text]
  • Google Scholar Journal Metrics: Comparison with Impact Factor and Scimago Journal Rank Indicator for Nuclear Medicine Journals Original Article
    Google Scholar journal metrics: Comparison with impact factor and SCImago journal rank indicator for nuclear medicine journals Article Original Leili Zarifmahmoudi1, Jamshid Jamali2, Ramin Sadeghi1 1Nuclear Medicine Research Center, Mashhad University of Medical Sciences, Mashhad, Iran 2Department of Biostatistics, School of Medicine, Shiraz University of Medical Sciences, Shiraz, Iran (Received 23 December 2013, Revised 6 June 2014, Accepted 11 June 2014) ABSTRACT Introduction: In the current study, we compared h5-index provided by Google Scholar (GS), impact factor (IF) provided by web of sciences (WOS), and SCImago journal rank indicator (SJR) provided by SCOPUS for quality assessment of nuclear medicine journals. Methods: 2013 h5-index, 2012 IF, and 2011 SJR of nuclear medicine journals were extracted from their publishers namely GS, WOS, and SCOPUS. Rank of each journal according to each index was provided. Spearman correlation was used for evaluation of the correlation between metrics. Results: Overall 22 journals were identified. Spearman correlation coefficients between h5-index and other journal metrics were 0.907 for 2012 IF, 0.979 for 2011 JCR, and 0.978 for 2011 SCOPUS h-index (all p-values<0.00001). Wilcoxon signed ranks test showed no statistically meaningful difference between rankings according to h5-index and other journal metrics (p values of 0.589, 0.565, and 0.542 for 2012 IF, 2011 SJR, and 2011 SCOPUS h-index respectively). Conclusion: The new GS journal metrics are reliable tools for quality assessment of the nuclear medicine journals. In our opinion, h5-index, IF, and SJR should be used in a combination as their combination would give a more holistic view of journal quality.
    [Show full text]
  • Hepatitis Monthly, an International Journal in the Field of Hepatology
    Hepat Mon. 2016 March; 16(3):e37015. doi: 10.5812/hepatmon.37015. Published online 2016 March 12. Editorial Hepatitis Monthly, an International Journal in the Field of Hepatology Mohammad Saeid Rezaee-Zavareh,1,2 Seyed Hassan Sa’adat,3 and Seyed Moayed Alavian2,4,* 1Students’ Research Committee, Baqiyatallah University of Medical Sciences, Tehran, IR Iran 2Middle East Liver Diseases Center, Tehran, IR Iran 3Behavioral Sciences Research Center, Baqiyatallah University of Medical Sciences, Tehran, IR Iran 4Baqiyatallah Research Center for Gastroenterology and Liver Diseases (BRCGL), Baqiyatallah University of Medical Sciences, Tehran, IR Iran *Corresponding author: Seyed Moayed Alavian, Baqiyatallah Research Center for Gastroenterology and Liver Diseases (BRCGL), Baqiyatallah University of Medical Sciences, Tehran, IR Iran. Tel: +98-2188945186, Fax: +98-2188945188, E-mail: [email protected] Received 2016 February 10; Accepted 2016 February 23. Keywords: Hepatitis, Iran, Journal Impact Factor 1. Hepatitis Monthly, a Short History final goals for that journal. Only with this approach, a jour- nal can be promoted in its field. Raising the level of a jour- Hepatitis monthly (HM), the thirteen-year-old publica- nal in a region clearly can help in promoting the level of tion of the Baqiyatallah research center for gastroenterol- knowledge of readers of that journal, who are physicians, ogy and liver diseases, is a journal in the field of hepa- healthcare personnel, and health policy makers in the case tology. The purpose of establishing this journal was to of HM. Consequently, this growth in knowledge level can enhance the knowledge of gastroenterologists, hepatolo- lead to an increase in the regional health status.
    [Show full text]
  • The More Publication, the Higher Impact Factor: Citation Analysis Of
    The Brilliant Future of Publishing Hepat Mon.2012;12(12):e8467 DOI: 10.5812/hepatmon.8467 www.KowsarPub.com Official Monthly Journal of the Baqiyatallah Research Center for Gastroenterology and Liver Diseases ISSN: Print 1735-143x, Online 1735-3408 KOWSAR Article Online Submission at: www.HepatMon.com WWW.HEPATMON.COM The More Publication, the Higher Impact Factor: Citation Analysis of Top Nine Gastroenterology and Hepatology Journals Pegah Karimi Elizee 1, 2, Romina Karimzadeh Ghassab 1*, Azam Raoofi 1, Seyyed Mohammad Miri 1, 2 1 Kowsar Corporation, Hoensbroek, The Netherlands 2 Baqiyatallah Research Center for Gastroenterology and Research Center, Tehran, IR Iran ARTICLE INFO ABSTRACT Article type: Background: The impact factor (IF), as the most important criterion for journal’s quality Research Article measurement, is affected by the self-citation and number of publications in each jour- nal. Article history: Objectives: To find out the relationship between the number of publications and self- Received: 30 Jul 2012 citations in a journal, and their correlations with IF. Revised: 20 Aug 2012 Materials and Methods: Self-citations and impact factors of nine top gastroenterol- Accepted: 8 Oct 2012 ogy and hepatology journals were assessed during the seven recent years (2005-2011) through Journal Citation Reports (JCR, ISI Thomson Reuters). Keywords: Results: Although impact factors of all journals increased during the study, five out of Self-Citation nine journals increased the number of publications from 2005 to 2011. There was an in- Journal Impact Factor crease in self-citation only in the journal of HEPATOLOGY (499 in 2005 vs. 707 in 2011). Gastroenterology Impact factors of journals (6.5 ± 3.5) were positively correlated with total number of pub- lications (248.6 ± 91.7) (R: 0.688, P < 0.001).
    [Show full text]
  • About the Size of Google Scholar: Playing the Numbers
    About the size of Google Scholar: playing the numbers Enrique Orduña-Malea1, Juan Manuel Ayllón2, Alberto Martín-Martín2, Emilio Delgado López-Cózar2 1 EC3: Evaluación de la Ciencia y de la Comunicación Científica, Universidad Politécnica de Valencia (Spain) 2 EC3: Evaluación de la Ciencia y de la Comunicación Científica, Universidad de Granada (Spain) ABSTRACT The emergence of academic search engines (Google Scholar and Microsoft Academic Search essentially) has revived and increased the interest in the size of the academic web, since their aspiration is to index the entirety of current academic knowledge. The search engine functionality and human search patterns lead us to believe, sometimes, that what you see in the search engine’s results page is all that really exists. And, even when this is not true, we wonder which information is missing and why. The main objective of this working paper is to calculate the size of Google Scholar at present (May 2014). To do this, we present, apply and discuss up to 4 empirical methods: Khabsa & Giles’s method, an estimate based on empirical data, and estimates based on direct queries and absurd queries. The results, despite providing disparate values, place the estimated size of Google Scholar in about 160 million documents. However, the fact that all methods show great inconsistencies, limitations and uncertainties, makes us wonder why Google does not simply provide this information to the scientific community if the company really knows this figure. KEYWORDS Google Scholar / Academic Search Engines / Size Estimation methods. EC3’s Document Serie: EC3 Working Papers Nº 18 Document History Version 1.0, Published on 23 July 2014, Granada Cited as Orduña-Malea, E.; Ayllón, J.M.; Martín-Martín, A.; Delgado López-Cózar, E.
    [Show full text]
  • Open Source Software and Open Access Resources for Enhancing Library Services: an Exploratory Study
    OPEN SOURCE SOFTWARE AND OPEN ACCESS RESOURCES FOR ENHANCING LIBRARY SERVICES: AN EXPLORATORY STUDY BY PAWAN R. AGRAWAL THESIS SUBMITTED FOR THE DEGREE OF DOCTOR OF PHILOSOPHY IN LIBRARY AND INFORMATION SCIENCE RESEARCH GUIDE DR. SHYAMA RAJARAM DEPARTMENT OF LIBRARY AND INFORMATION SCIENCE FACULTY OF ARTS THE MAHARAJA SAYAJIRAO UNIVERSITY OF BARODA VADODARA-390002 GUJARAT, INDIA MAY 2014 CERTIFICATE This is to certify that the research titled ‘Open Source Software and Open Access Resources for Enhancing Library Services: An Exploratory Study’, incorporates the results of an independent study carried out by Mr. Pawan R. Agrawal under the guidance of Dr. Shyama Rajaram for the degree of Doctor of Philosophy in Library and Information Science. The contents presented herein have not been submitted for the award of any other Degree or Diploma of this or any other university. (Mr. Pawan R. Agrawal) (Dr Shyama Rajaram) Research Candidate Research Guide DECLARATION I hereby declare that the research work presented in this thesis has been prepared and carried out by me. The descriptions and narrations found therein are entirely original. I also declare that such material as has been obtained from other sources has been duly acknowledged. Date: Pawan R. Agrawal Place: Vadodara Research Candidate Table of Contents Acknowledgement……………………………………………………………………………………...i Preface…………..…………………………………………………………………………………….iii List of Abbreviation….………………………………………………………………………………...v CHAPTER I: INTRODUCTION ...........................................................................................................
    [Show full text]
  • 2019 Journal Citation Reports Full Journal List
    2019 Journal Citation Reports Full journal list Every journal has a story to tell About the Journal Citation Reports Each year, millions of scholarly works are published containing tens of millions of citations. Each citation is a meaningful connection created by the research community in the process of describing their research. The journals they use are the journals they value. Journal Citation Reports aggregates citations to our selected core of journals, allowing this vast network of scholarship to tell its story. Journal Citation Reports provides journal intelligence that highlights the value and contribution of a journal through a rich array of transparent data, metrics and analysis. jcr.clarivate.com 2 Journals in the JCR with a Journal Impact Factor Full Title Abbreviated Title Country/Region SCIE SSCI 2D MATERIALS 2D MATER ENGLAND ! 3 BIOTECH 3 BIOTECH GERMANY ! 3D PRINTING AND ADDITIVE 3D PRINT ADDIT MANUF UNITED STATES ! MANUFACTURING 4OR-A QUARTERLY JOURNAL OF 4OR-Q J OPER RES GERMANY ! OPERATIONS RESEARCH AAPG BULLETIN AAPG BULL UNITED STATES ! AAPS JOURNAL AAPS J UNITED STATES ! AAPS PHARMSCITECH AAPS PHARMSCITECH UNITED STATES ! AATCC JOURNAL OF AATCC J RES UNITED STATES ! RESEARCH AATCC REVIEW AATCC REV UNITED STATES ! ABACUS-A JOURNAL OF ACCOUNTING FINANCE AND ABACUS AUSTRALIA ! BUSINESS STUDIES ABDOMINAL RADIOLOGY ABDOM RADIOL UNITED STATES ! ABHANDLUNGEN AUS DEM ABH MATH SEM MATHEMATISCHEN SEMINAR GERMANY ! HAMBURG DER UNIVERSITAT HAMBURG ACADEMIA-REVISTA LATINOAMERICANA DE ACAD-REV LATINOAM AD COLOMBIA ! ADMINISTRACION
    [Show full text]