81 Discrepancies Among Scopus, Web of Science, and Pubmed Coverage of Funding Information in Medical Journal Articles
Total Page:16
File Type:pdf, Size:1020Kb
81 SURVEYS AND STUDIES DOI: dx.doi.org/10.5195/jmla.2018.181 Discrepancies among Scopus, Web of Science, and PubMed coverage of funding information in medical journal articles Peter Kokol, PhD; Helena Blažun Vošner, PhD, PhD See end of article for authors’ affiliations. Objective: The overall aim of the present study was to compare the coverage of existing research funding information for articles indexed in Scopus, Web of Science, and PubMed databases. Methods: The numbers of articles with funding information published in 2015 were identified in the three selected databases and compared using bibliometric analysis of a sample of twenty-eight prestigious medical journals. Results: Frequency analysis of the number of articles with funding information showed statistically significant differences between Scopus, Web of Science, and PubMed databases. The largest proportion of articles with funding information was found in Web of Science (29.0%), followed by PubMed (14.6%) and Scopus (7.7%). Conclusion: The results show that coverage of funding information differs significantly among Scopus, Web of Science, and PubMed databases in a sample of the same medical journals. Moreover, we found that, currently, funding data in PubMed is more difficult to obtain and analyze compared with that in the other two databases. This article has been approved for the Medical Library Association’s Independent Reading Program <http://www.mlanet.org/page/independent-reading-program>. INTRODUCTION In previous studies, Boyack showed that articles As funding is a significant factor enabling research resulting from large grants were cited more than projects [1], research institutions compete for grants those from small grants [5], and Wang and Shapira on a routine basis [2]. Institutions with more grant found that funded publications had more impact in funding have a greater ability to hire eminent terms of journal rankings and numbers of citations researchers, provide access to advanced technology [6]. Consequently, knowledge about funding and research equipment, cooperate in major patterns found in funding statements could be of international scientific networks, gather new vital importance to researchers who are seeking knowledge at top conferences, and/or hire leading grants and others who are interested in assessing the external organizations to support the preparation of impact and outcomes of funding [7]. Funding competitive project proposals. Subsequently, such patterns can be used for strategic intelligence institutions perform better research, publish more applications, such as mapping funding landscapes high-quality publications, and attract more citations and generating funding organization portfolios [8], [3, 4]. and can be used to identify top-funded topics and jmla.mlanet.org 106 (1) January 2018 Journal of the Medical Library Association 82 Kokol and Blažun Vošner DOI: dx.doi.org/10.5195/jmla.2018.181 themes, acquire lists of funding organizations, and databases: The Lancet, Journal of American Medical locate successful grant holders for possible Association (JAMA), and British Medical Journal (BMJ). collaboration. Funding information can be obtained from Some research funding information can be various fields in the three databases. Funding obtained directly from funding agency reports or information can appear in the funding organization, databases. For example, in their analysis of the grant number, and funding acknowledgment text impact of federal life sciences funding for university fields in WoS; the funding sponsor and grant research and development programs, Blume- acronym fields of Scopus; and the grant number and Kohout, Kumar, and Sood used datasets from the publication type fields of PubMed. Preliminary US National Science Foundation and US National analysis showed that the field identifying the largest Institutes of Health to measure funding number of funded articles (FAs) in a database also expenditures [9]. However, not all such data are covers all FAs identified by the other fields in that easily accessible, if at all. Hence, Wang and Shapira database. Hence, we selected the funding proposed the possibility of analyzing funding organization field for WoS, the funding sponsor information acknowledgments found in field for Scopus, and the grant number field for bibliographical databases [10]. However, Rigby PubMed. To form a list of all possible funding warned that the uncritical use of funding organizations and sponsors, we used a wildcard information found in bibliographic databases might character (*) to represent a string of characters of any lead to bias in interpreting search results [11]. For length. Two corpuses (one for FAs and one for all instance, Tang et al. noted limitations in the funding articles) from each database were created for articles information found in Web of Science (WoS) published in 2015 (Table 1). (Thomson Reuters, USA), with English language WoS and Scopus databases allowed us to articles showing greater coverage than articles in directly extract the number of all articles and other languages and engineering, as well as number of FAs for each journal using built-in biomedical articles showing greater coverage than services. However, for PubMed, we first exported social sciences and humanities articles [12]. the corpus to BibTex and then to MS Excel Of the more than 100 bibliometric databases, (Microsoft, USA), in which we performed the only WoS, Scopus (Elsevier, Netherlands), and analysis using the crosstab function. PubMed (National Library of Medicine, United We found that some BMJ journals were not States) databases provide funding information for indexed by all three databases, so these journals indexed articles. Whereas Scopus and WoS are were omitted from subsequent analyses. The general subscription databases, PubMed is a numbers of articles published in the remaining publicly accessible database covering mostly journals were compared between databases using biomedical literature. Of these, Scopus indexes the paired Student’s t-tests. Finally, we performed an largest number of publications. The overall aim of analysis of the document types of FAs. this study was to determine differences between WoS, Scopus, and PubMed databases in terms of the accessibility, scope, and volume of funding RESULTS information for indexed articles. We identified 28 journals containing 16,927 articles in Scopus, 25 journals containing 14,494 articles in METHODS WoS, and 34 journals containing 16,967 articles in PubMed. Of these articles, there were 1,306 FAs in The authors analyzed funding information for Scopus, 4,206 FAs in WoS, and 2,482 FAs in articles published in three prestigious families of PubMed. journals indexed in WoS, Scopus, and PubMed Journal of the Medical Library Association 106 (1) January 2018 jmla.mlanet.org Discrepancies among Scopus, Web of Science, and PubMed 83 DOI: dx.doi.org/10.5195/jmla.2018.181 Table 1 Search strings used to retrieve articles with funding information Database Search string Web of Science (WoS) so = (jama* or BMJ* or Lancet*) and py = 2015 and FO = (a* or b* or c* or d* or e* or f* or g* or h* or i* or j* or k* or l* or m* or n* or o* or p* or q* or r* or s* or t* or u* or v* or z* or x* or y* or w* or 1* or 2* or 3* or 4* or 5* or 6* or 7* or 8* or 9* or 0*) Scopus SRCTITLE(Lancet or BMJ or jama) and pubyear = 2015 and fund-sponsor = (a* or b* or c* or d* or e* or f* or g* or h* or i* or j* or k* or l* or m* or n* or o* or p* or q* or r* or s* or t* or u* or v* or z* or x* or y* or w* or 1* or 2* or 3* or 4* or 5* or 6* or 7* or 8* or 9* or 0*) PubMed ((((((((((((((((((((((((((((((((((((((((((("BMJ open"[Journal]) OR "BMJ (Clinical research ed.)"[Journal]) OR "BMJ case reports"[Journal]) OR "BMJ quality & safety"[Journal]) OR "BMJ clinical evidence"[Journal]) OR "BMJ supportive & palliative care"[Journal]) OR "BMJ quality improvement reports"[Journal]) OR "BMJ open diabetes research & care"[Journal]) OR "BMJ open respiratory research"[Journal]) OR "BMJ open sport & exercise medicine"[Journal]) OR "BMJ open gastroenterology"[Journal]) OR "BMJ innovations"[Journal]) OR "BMJ global health"[Journal]) OR "BMJ outcomes"[Journal]) OR "Lancet (London, England)"[Journal]) OR "The Lancet. Oncology"[Journal]) OR "The Lancet. Infectious diseases"[Journal]) OR "The Lancet. Neurology"[Journal]) OR "The Lancet. Respiratory medicine"[Journal]) OR "The Lancet. Diabetes & endocrinology"[Journal]) OR "The Lancet. Global health"[Journal]) OR "The Lancet. Psychiatry"[Journal]) OR "The Lancet. HIV"[Journal]) OR "The Lancet. Hematology"[Journal]) OR "The Lancet. Gastroenterology & hepatology"[Journal]) OR "JAMA"[Journal]) OR "JAMA internal medicine"[Journal]) OR "JAMA dermatology"[Journal]) OR "JAMA ophthalmology"[Journal]) OR "JAMA neurology"[Journal]) OR "JAMA surgery"[Journal]) OR "JAMA pediatrics"[Journal]) OR "JAMA otolaryngology-- head & neck surgery"[Journal]) OR "JAMA psychiatry"[Journal]) OR "JAMA oncology"[Journal]) OR "JAMA facial plastic surgery"[Journal]) OR "JAMA cardiology"[Journal]) AND ("2015"[Date - Publication] : "2015"[Date - Publication]))))) Although there were large differences among these differences were not statistically significant databases in both the number of all articles and the (p>0.05). number of FAs in individual journals, the largest The analysis of document types revealed that all variations among databases were seen in the FAs identified in Scopus were classified as articles. numbers of FAs. WoS identified the largest The most frequent types of FAs in WoS were articles percentage of FAs for all journals. Scopus identified (73%), editorials (12%), reviews (8%), and letters the lowest percentage of FAs for all journals, except (6%), whereas the most frequent types of FAs in BMJ Open, for which a lower percentage of FAs was PubMed were articles (75%), reviews (7%), letters identified in PubMed. The largest difference among (6%), and editorials (3%). databases was observed for the journal Lancet Diabetes & Endocrinology, for which there were 0.4% of identified FAs in Scopus, 23.6% in WoS, and DISCUSSION 17.3% in PubMed.