The Study of Association Between Altmetrics Activity Indicators and Citation Quality Indicators in Iranian Medical Journals
Total Page:16
File Type:pdf, Size:1020Kb
Original Article The Study of Association between Altmetrics Activity Indicators and Citation Quality Indicators in Iranian Medical Journals Abstract Mansoureh Serati Background: Given the limitations of traditional citation indicators, more indicators are needed Shirazi 1 , to examine the effectiveness and improvement of existing indicators. The present study aimed to Mahdieh Arian2, investigate the association between Altmetrics activity and quality citation indicators in Iranian 3* journals based on Clarivate Analytics, Scopus, and Medline. Methods: The research was carried Ali Valinejadi , 4 out using Altmetrics method through scientometric approach. The population of the present study Ali Mohammadpour was Iranian medical journals, which were available at three databases of Clarivate Analytics, 1Islamic World Science Citation Scopus, and Medline. In order to obtain quality information, we’ve used the indicators of CiteScore, Center (ISC), Shiraz, Iran, 2 SJR, and SNIP at Scopus database as well as the impact factor at JCR database; besides, to find Student Research Committee, Altmetrics indicators and Altmetrics scores of articles, the Altmetrics explorer database was used. Semnan University of Medical Sciences, Semnan, Iran, Results: About 16% of the articles in the reviewed journals were cited at least once in the social 3Social Determinants of Health media and had Altmetrics scores. Among the reviewed journals, the highest rate of social media Research Center, Semnan coverage was related to the Iranian Journal of Basic Medical Sciences, and the highest Altmetrics University of Medical Sciences, score obtained from the mean Altmetrics score of the papers was related to Cell Journal (Yakhteh). Semnan, Iran, 4Department of A review of quality indicators of journals with Altmetrics coverage and Altmetrics score of journals Health Information Technology, showed that there was a significant and positive correlation between the Altmetrics score and impact Faculty of Allied Medical factor. However, any significant association was neither found between the journal’s coverage Sciences, Hamadan University and SiteScore, SNIP, SJR, nor between the journal’s Altmetrics score and quality indicators. of Medical Sciences, Hamadan, Iran Conclusions: According to the results of this study, policy makers of scientific journals should adopt strategies that bring about social media presence; thus, we will find further Iranian articles in the social media. Keywords: Altmetrics, bibliometrics, clarivate analytics, journal impact factor, medline, scopus, social media Introduction aspects of impact has developed, such as social, cultural, and education impacts, Altmetrics indicators which are derived which were neglected by traditional from the social web are increasingly methods of impact assessment.[1] Taylor becoming popular and are used as the referred to Altmetrics indicators as a primary impact factors. Altmetrics—stands revolution in scientometrics[4]; and Lin and for alternative metrics—means alternative Fenner described it as a new paradigm in indicators, which is a term to describe research evaluation.[5] Altmetrics focuses web‑based indexes to impact the research on research outputs in social networks such articles and emphasizes the social media Address for correspondence: as Facebook, Twitter, blogs, news outlet Dr. Ali Valinejadi, for data collection. The concept was first and reference management tools, and goes Social Determinants of introduced in 2010 by Priem et al.[1] The beyond citation in analyzing academic Health Research Center, web age has provided a new environment Semnan University of Medical activities. Instead of just analyzing the for the discussion and dissemination of Sciences, Semnan, Iran. articles of scientific journals, Altmetrics E‑mail: valinejadi.a@semums. research information and according to considers the impact of scientific output ac.ir this new environment there is a need in different formats.[1] Altmetrics, unlike for more indicators to examine the the citation‑based indicators, such as the impact and to complete the existing Access this article online [2] journal’s impact factor or the H‑index, indicators. Altmetrics indicators have evaluates the impact of publication of a Website: eliminated several limitations of traditional www.ijpvmjournal.net/www.ijpm.ir single article.[6] The indicators of article citation‑based indicators,[3] in which other DOI: level measure the impact of a single article 10.4103/ijpvm.IJPVM_59_20 through quantitative indicators, such as Quick Response Code: This is an open access journal, and articles are distributed under the terms of the Creative Commons Attribution‑NonCommercial‑ShareAlike 4.0 License, which How to cite this article: Serati Shirazi M, allows others to remix, tweak, and build upon the work Arian M, Valinejadi A, Mohammadpour A. The study non‑commercially, as long as appropriate credit is given and of association between Altmetrics activity indicators the new creations are licensed under the identical terms. and citation quality indicators in Iranian medical 11 For reprints contact: [email protected] journals. Int J Prev Med 2020; . © 2020 International Journal of Preventive Medicine | Published by Wolters Kluwer - Medknow 1 Serati Shirazi, et al.: Association between Altmetrics and Citation Indicators counting the number of times that an article is downloaded shortly after publication; and the spent time on the or shared on Twitter, as well as quality indicators such publication of the article may reduce the value of the as media coverage or blog posts by the experts in that content. Therefore, the use of articles in online social field.[7] However, some scientometrics experts consider networks can be effective in updating the publications. Altmetrics as a threat to the alignment process and quality Hence, it is essential to assess the Altmetrics approach in control of research activities[8]; nevertheless, pursuing medical sciences articles, in order to be used in research the use of scientific articles in social media means that policies and in evaluating the publications quality. researchers are able to examine the impact of these Since the Altmetric activity of Iranian medical journals has products more extensively[9]; hence, along with the citation, not been studied so far, thus, the objective of this study these indicators should be investigated and their impact was to investigate the association between Altmetrics should be considered. Salajegheh and Diari examined activity and quality citation indicators in Iranian journals the association between citation indices and Altmetrics on three databases of Clarivate Analytics, Scopus, and in 111 medical sciences journals in Scopus database. Medline. Altmetrics data was obtained from Altmetrics official website According to their results, there was a correlation The results of this study can persuade policymakers that between the citation indicators (except the impact factor) they should pay more attention to the social media and the and the mean scores of Altmetrics.[10] Goltaji, and Jowkar rules governing them such as limitations and filtering. They studied the extent of availability of medical informatics should inform everyone especially the scientific community articles in social media through Altmetrics approach. about social networks and the way to be an active one in The results showed that the scientific outputs were often using them and also their benefits. used through social networks. In this study, a significant In addition, they can encourage researchers to publish their positive association was found between most of Altmetrics research in online and open access format, and can make indicators and the number of received citations on the Web research policy to promote faculty members based on their [11] of Science platform. The study of Erfanmanesh on the Altmetric score. relationship between Altmetrics activity and quality of the library and information sciences journals showed that Methods the published articles in higher quality scientific journals The research was carried out using Altmetrics method were more widely seen on social networks, and attracted through scientometric approach. The research population more attention of users.[12] consisted of Iranian medical journals, which were available Serati Shirazi and Goltaji carried out a research on on databases of Clarivate Analytics, Scopus, and Medline. Scientific Articles of “Health Literacy” in Social Media. In order to obtain quality information, the indicators of The results of their study revealed that Mendeley and CiteScore, SJR, SNIP were used, which were extracted Twitter are the most used social media by health literacy from the Scopus database, and the impact factors of scholars for sharing scientific outputs and there is journals were obtained from SJR database. During the significant relationship between most alternative metrics research, since the last calculation for these indicators was and the number of citations in Web of Science.[13] in 2017, the same year was considered for data collection. Zahedi, Costas and Wouters studied the use of Web of The Altmetric Explorer was used to obtain Altmetrics Science journals at Mendeley, as well as the articles’ indices and Altmetrics scores. citation indexes through the Impactstory website, and The Altmetric Explorer database provides the possibility reported a moderate correlation between these two of searching articles in a variety of ways, such as the indicators.[14]