Integrity of Databases for Literature Searches in Nursing 3

Home , MEDLINE, Our Research

1 citation analy- predatory nursing , Key words: esearch, evidence-based practice,ity qual- improvement studies, and other nursing literature , scholarly projects typicallyerature begin with review. a Inthe lit- research, literature the describesabout review existing the of knowledge topic,research questions reveals to gaps bevides answered, and a and pro- further study. rationale In for evidence-basedature practice, engaging review the in liter- providesclinical evidence a questions to new cisions. and answer Quality makebegin informed improvement with a de- studies search ofavailable the also knowledge literature about to a gather problemplore and ex- interventions usedThe appearance of in journals that other areby published settings. predatory publishersdanger has that reviews introduced of the the literature include DUMC 3322,([email protected]). 307 Trent Dr,DOI: 10.1097/ANS.0000000000000349 Durham, NC 27710 R Advances in Nursing Science Vol. 00, No. 00, pp.Copyright 1–9 © 2020 The Authors. Published by Wolters Kluwer Health, Inc. Advances in nursing knowledge , Duke University School of Marilyn H. Oermann, PhD, RN, search engines , , is a member of our research team knowledge dissemination

, journals sis The quality of literature usedThe as purpose the of foundation this to study wasincluded any to research in analyze or the scholarly credible extent project toLiterature is databases, which (CINAHL), critical. predatory MEDLINE, and nursing Cumulative journals Scopus,formation. were commonly Index Findings used to indicated by Nursing that nurseMEDLINE no and scholars or predatory Allied when CINAHL, nursing searching Health in and journals for predatory only in- were nursing currently one journals indexedbut journal are in rather was not through in likely Google found Scopus. or in Citations Google a to search Scholar articles using search these published engines. curated databases

Marilyn H. Oermann, PhD, RN,Leslie ANEF, H. FAAN; Nicoll, Jordan PhD, Wrigley, MA, MBA,Heather MSLS; RN, Carter-Templeton, FAAN; PhD, Leila RN-BC, S. FAAN; Ledbetter,Alison MLIS, H. AHIP; Edie, DNP, APRN, FNP-BC Author Afﬁliations: and contributed tomanuscript. the study and preparation ofThe the authors haveicant disclosed relationships that with, theycommercial or have companies ﬁnancial pertaining no interest to signif- this in, article. any This isthe an termsNon open-access of Commercial-No article DerivativesNC-ND), the where License it is distributed Creative permissible 4.0the to download work (CCBY- Commons under and provided share it Attribution- be is changed properly in cited. anypermission way The or from work the used cannot journal. commercially without Correspondence: Nursing Science ANEF, FAAN, Duke University School of Nursing, Nursing, Durham, North Carolina (Drsand Edie); Oermann Center for ResearchScholarship, Data University and Libraries, University Digital of Colorado Boulder, Boulder (Ms Wrigley);Desk Maine LLC, Portland, Maine (DrUniversity Nicoll); Medical Duke Center Library, Durham,Carolina North (Ms Ledbetter); and CapstoneNursing, College The of University ofCarter-Templeton). Alabama, Tuscaloosa (Dr Peggy L. Chinn, PhD, RN, FAAN, Editor,

Literature Searches in Nursing Avoiding Predatory Journals Integrity of Databases for

Downloaded from https://journals.lww.com/advancesinnursingscience by BhDMf5ePHKav1zEoum1tQfN4a+kJLhEZgbsIHo4XMi0hCywCX1AWnYQp/IlQrHD3i3D0OdRyi7TvSFl4Cf3VC1y0abggQZXdgGj2MwlZLeI= on 12/20/2020 Downloaded from https://journals.lww.com/advancesinnursingscience by BhDMf5ePHKav1zEoum1tQfN4a+kJLhEZgbsIHo4XMi0hCywCX1AWnYQp/IlQrHD3i3D0OdRyi7TvSFl4Cf3VC1y0abggQZXdgGj2MwlZLeI= on 12/20/2020 2ADVANCES IN NURSING SCIENCE/00 2020

to the topic. The ease of searching using Statement of Significance a web browser (now commonly referred What is known or assumed to be true to as “googling”) has increased the risk about this topic: of finding sources published in predatory The quality of nursing literature used and low-quality journals that have not met is vital for the development of research the standards of research and scholarship studies, application of evidence in clini- that can be trusted as credible and reliable cal settings, and other scholarly projects. evidence. Nurse scholars need to be confident as The purpose of this article is to present they search the literature that they are an analysis of the extent to which predatory accessing sound information sources and nursing journals are included in MEDLINE, not articles from predatory nursing jour- CINAHL, and Scopus databases, used by nals, which do not adhere to quality nurse researchers and other nurses when and ethical publishing standards. Cita- searching for information, and in the Direc- tions of articles in predatory nursing tory of Open Access Journals. This directory journals may be found when searching indexes “high-quality, open access, peer- Google and Google Scholar, making these reviewed journals” and should not include citations easy to access but potentially re- any predatory journals.2 sulting in the integration of poor quality research into the nursing literature. On the other hand, searches through cred- PREDATORY JOURNALS ible databases—MEDLINE, CINAHL, and Scopus—are less likely to yield citations Many studies have documented the prob- from predatory publications. lem of predatory journals. These journals do What this article adds: not adhere to quality and ethical publish- This study helps validate the trustwor- ing standards, often use deceptive language thiness of these databases for conducting in emails to encourage authors to submit searches in nursing. their manuscripts to them, are open access but may not be transparent with the article processing charge, may have quick but inadequate, poorly designed, and low-quality questionable peer review, and may publish in- information being used as “evidence”— accurate information on their Web sites such raising the possibility of risky and harmful as impact factor and indexing.3-6 Predatory practice. Researchers and authors should be publishing is an issue in many fields includ- confident in the literature they cite; readers ing nursing. In a recent study, 127 predatory should have assurance that the literature re- journals were identified in nursing.7 view is based on sound, authoritative sources. Citations acknowledge the ideas of others When predatory journals are cited, that trust and give credit to the authors of the original is eroded. No matter what type of study or work. When articles are cited in a subsequent project is being done, the quality of litera- publication, those citations disseminate the ture is critical for the development of nursing information beyond the original source, and knowledge and for providing up-to-date infor- the article in which it is cited might in turn mation, concepts, theories, and approaches be referenced again, transferring knowledge to care.1 from one source to yet another. When ar- An effective literature review requires ticles in predatory journals are cited, the searching various reliable and credible same process occurs. Those citations transfer databases such as MEDLINE (through knowledge from the predatory publication PubMed or Ovid) and the Cumulative In- beyond that source. Studies have found that dex to Nursing and Allied Health Literature authors are citing articles published in preda- (CINAHL), among others that are relevant tory journals in nursing as well as other Integrity of Databases for Literature Searches in Nursing 3

ﬁelds.7-10 Nurse scholars need to be conﬁdent and other groups.15 Beginning in June 2020, as they search the literature that they are ac- as a pilot program, preprints reporting re- cessing sound information sources and not search funded by the NIH also can be articles from predatory journals. deposited in PMC.16

NATIONAL LIBRARY OF MEDICINE CINAHL AND SCOPUS INFORMATION RESOURCES The journal assessment and indexing pro- The National Library of Medicine (NLM) cesses for CINAHL and Scopus are similar to supports researchers and clinicians through those used by the NLM. However, as private its multiple health information resources in- corporations, EBSCO (CINAHL) and Elsevier cluding PubMed, MEDLINE, and PubMed (Scopus) are not required to make journal Central (PMC). PubMed serves as the search selection processes publicly available or ex- engine to access the MEDLINE database, plicit. CINAHL has an advisory board for PMC, and books, chapters, and other doc- journal selection. A CINAHL representative uments that are indexed by the NLM. provided the following criteria for indexing PubMed is free and publicly available: by us- of journals in CINAHL: high impact factor; using PubMed, researchers can search more age in reputable subject indexes (eg, the NLM than 30 million citations to the biomed- catalog); peer-reviewed journals covered by ical literature.11 The majority of records other databases (eg, Web of Science and Sco- in PubMed are from MEDLINE, which has pus); top-ranked journals by industry studies; citations from more than 5200 scholarly jour- and article quality (avoiding low-quality journals. For inclusion in MEDLINE, journals are nals) (personal communication, October 19, assessed for their quality by the Literature Se- 2020). lection Technical Review Committee.12 Five Elsevier’s Scopus provides a webpage areas are included in this assessment: scope referring to the journal selection and assess- of the journal (ie, in a biomedical subject); ment processes. Journals being considered quality of the content (validity, importance for indexing in Scopus are evaluated by of the content, originality, and contribu- the Content Selection and Advisory Board tion of the journal to the coverage of the and must meet the following criteria: peer- field); editorial standards and practices; pro- reviewed with a publicly available descrip- duction quality (eg, layout and graphics); tion of the peer review process; published on and audience (content addresses health care a regular basis; has a registered International professionals). Standard Serial Number (ISSN); includes ref- PMC includes journal citations and full-text erences in Roman (Latin) script; has English articles that are selected by the NLM for digi- language titles and abstracts; and has publicly tal archiving. To be included in PMC, journals available publication ethics and publication are evaluated for their scope and scientific, malpractice statements.17 editorial, and technical quality.13 Journals considered for inclusion are evaluated by independent individuals both inside and out- LITERATURE REVIEW side PMC.14 PMCservesastherepository for articles to meet the compliance require- Studies have shown that in health care ments of the National Institutes of Health fields, researchers, clinicians, faculty, and (NIH) and other funding agencies for pub- students regularly search MEDLINE for their lic access to funded research. About 12% of research and other scholarly and clinical the articles in PMC are deposited by individ- information.18-21 De Groote et al18 found that ual authors to be in compliance with funders 81% of health science faculty used MEDLINE and 64% by publishers, scholarly societies, to locate articles for their research. MEDLINE 4ADVANCES IN NURSING SCIENCE/00 2020 wasusedbythemajorityoffacultyineach MEDLINE (searched via PubMed), CINAHL individual health care field including nursing (EBSCO), and Scopus (Elsevier) and in the (75%) and medicine (87.5%) for searching Directory of Open Access Journals. the literature and finding articles. In another study of 15 different resources, medical faculty and residents reported that PubMed METHODS was used most frequently for searching the databases of the NLM, primarily MEDLINE.20 In an earlier study, 127 predatory nurs- Few studies have focused on the search ing journals were identified and assessed practices of nurses. In a review of the for characteristics of predatory publications. literature, Alving et al22 found that hospi- That dataset was used for the current study. tal nurses primarily searched Google for For each predatory nursing journal, informa- information on evidence-based nursing. tion was retrieved from the NLM Catalog, They used Google more than bibliographic Ulrichsweb, and journal and publisher Web databases. sites. Ulrichsweb27 provides bibliographic The quality of content that is retrieved and publisher information on academic and when using PubMed as a search engine is scholarly journals, open access journals, important considering its widespread use for peer-reviewed titles, magazines, newspapers, accessing scholarly and clinical information and other publications. Journal titles of the in nursing and other fields. Manca et al23 predatory journals were often similar to reported that articles published in predatory nonpredatory journals and could be easily journals were being retrieved when con- mistaken. To ensure accuracy, the infor- ducting searches using PubMed and were mation for each journal was checked for a concern for researchers. Based on their consistency between these sources using studies of predatory journals in neurology24 the ISSN, exact journal title, and publisher and rehabilitation,25 they concluded that name. The purpose of an ISSN is to identify predatory journals “leaked into PubMed” a publication and distinguish it from other through PMC because of less stringent cri- publications with similar names. An ISSN is teria for inclusion of journals.23 Citations mandatory for all publications in many coun- to articles from predatory journals then tries and having one assigned is considered could be found using the PubMed search a journal best practice.28 For each predatory engine. However, in a letter to the editor, journal, the following data were collected Topper et al26 from the NLM clarified that if available: complete journal title; abbrevi- individual articles published in predatory ated journal title; acronym; ISSN (electronic journals might be deposited in PMC to and/or print); DOI prefix; publisher name meet the requirements of research fund- and Web site URL; NLM index status; num- ing and be searchable in PubMed. Topper ber of predatory journal articles cited in and colleagues make a clear distinction MEDLINE and PMC (when searching using between journals indexed in MEDLINE or PubMed), in CINAHL, and in Scopus; if the PMC and citations of individual articles that journal was indexed in the Directory of Open were deposited in PMC to meet funder Access Journals; status in Ulrichsweb; and requirements. Google Scholar profile URL. Counts of articles cited were checked in- dividually by journal title, publisher, and/or Purposes ISSN. Once ISSNs (both electronic and print The aim of this study was to determine where available) were assembled, a search whether predatory nursing journals were algorithm was created, which included all re- included in databases used by nurse retrieved journal ISSNs. MEDLINE was searched searchers and other nurses when searching via PubMed using a combination of NLM jour- for information. These databases included nal title abbreviations and ISSNs. CINAHL, Integrity of Databases for Literature Searches in Nursing 5

Scopus, and the Directory of Open Access were indexed in CINAHL based on full jour- Journals were searched using a combina- nal title, title abbreviation, ISSN, or publisher. tion of ISSN, journal title abbreviation, full Two journals in the dataset were found in the title, and publisher. Results were visually DirectoryofOpenAccessJournals. inspected for accuracy and alignment with When searching PubMed, we found cita- dataset fields. tions of articles from 16 predatory nursing journals. The number of citations ranged from 1 to 372 citations (from one of the jour- Data analysis nals indexed earlier in MEDLINE but sold to Data were collected between January and a predatory publisher). The second highest April 2020. Data were entered into an Excel number of citations (n = 168) was of arti- spreadsheet and organized by predatory jour- cles from a predatory nursing journal that had nal name; abbreviated journal title; acronym; been depositing articles in PMC (and thus ISSN (electronic, print); DOI prefix; Web site were retrievable when searching PubMed) URL; entry in NLM Catalog (yes/no); index but is no longer adding new material to PMC. status; number of articles cited in PubMed, The other citations were of articles deposited CINAHL, and Scopus; Directory of Open in PMC to meet requirements of NIH and Access Journals (included/not included); Ul- other research funding. The predatory jour- richsweb status (active/ceased); publisher; nals in which these articles were published, and Google Scholar profile URL. Frequencies however, are not indexed in MEDLINE or and medians are reported. PMC. There were no articles from predatory nursing journals cited in CINAHL. Scopus has RESULTS citations from the 2 predatory nursing journals that are no longer indexed there: 616 that Of the 127 predatory nursing journals in were published in one of the journals and 120 the dataset, only 102 had ISSNs to use for the from the other. Articles from a third preda- search. Eighteen of the journals had records tory nursing journal in the study dataset, in the NLM Catalog, but only 2 of those which is currently indexed in Scopus, totaled had ever been indexed in MEDLINE, and nei- 173 (see Table). ther are currently indexed. These 2 journals This analysis documented that none of had been published earlier by a reputable the predatory nursing journals in the study publisher but then were sold to one of the dataset were currently indexed in MEDLINE large predatory publishers. The NLM Cata- or CINAHL, and only one journal is still log record for these journals indicates that in Scopus. Most of the citations of articles citations of articles from them appeared in from predatory journals found in a search of MEDLINE through 2014 for one of the jour- these databases are from earlier years before nals and 2018 for other, but following their the journals were sold to one of the large transition to the new publisher are no longer predatory publishers. Other citations are to included. Consistent with the MEDLINE re- articles deposited in PMC in compliance with sults, these same 2 journals had been indexed research funder requirements. in Scopus as well. Citations of articles from one of these journals were added to Scopus up to 2014, with no articles cited thereafter. DISCUSSION Articles from the second journal continue to be added through 2020. One additional By using PubMed as a search engine and journal from the predatory journal dataset is entry point to the databases of the NLM, currently in Scopus, however, only through researchers can search millions of records 2014. None of the predatory nursing journals included in MEDLINE, or in process for 6ADVANCES IN NURSING SCIENCE/00 2020

Table. Citations to Articles From Predatory Nursing Journals

Number of Citations

Predatory Nursing Journalsa PubMedb Scopus CINAHL A 372 616 0 B 168 173 0 C1200 D700 E 5 120 0 F300 G300

Abbreviation: CINAHL, Cumulative Index to Nursing and Allied Health Literature. aPredatory nursing journals with 3 or more citations to articles. bSearch using PubMed. inclusion, and articles from PMC deposited types of literature, such as theses, disserta- by publishers or authors for compliance tions, and fugitive (or “gray” literature),31 are with funders. Six million records, and about unlikely to be found in any of these databases, 5500 journals, can be searched in CINAHL even though those citations may be impor- Complete,29 and Scopus, the largest of the tant or relevant sources. Given this, it is proprietary databases, provides access to easy to understand the intuitive appeal of 24000 journals and 60 million records.30 Re- Google Scholar, which provides “one stop sults from this study show that very few shopping”: “From one place, you can search articles published in predatory nursing jour- across many disciplines and sources: articles, nals find their way into a search done using theses, books, abstracts and court opinions, PubMed and Scopus and none into CINAHL. from academic publishers, professional so- In a prior study, 814 citations of articles cieties, online repositories, universities and in predatory nursing journals were found other web sites. Google Scholar helps you in articles published in nonpredatory nurs- find relevant work across the world of schol- ing journals.7 Based on this current study, arly research.”32 Google and Google Scholar the conclusion can be made that these ci- were founded with a mission to become the tations are not coming from searches in most comprehensive search engines in the MEDLINE/PubMed, CINAHL, or Scopus and world. While this allows someone to scour are likely from searches done using Google the World Wide Web and Internet for some or Google Scholar as the search engine. The of the most obscure facts available, at the databases examined in this study are curated same time, little is done to verify or validate by organizations with a vested interest in the results that are returned. Thus, it falls maintaining and improving the quality of the on the searcher to be diligent and evaluate research literature in those databases. the results of a Google or Google Scholar Searching multiple databases using differ- search, which will include citations of articles ent search engines can be frustrating and time in predatory journals. This is easily confirmed consuming. There is overlap among MED- by the fact that many predatory journal Web LINE, CINAHL, and Scopus. However, these sites promote the Google Scholar logo as a are curated databases and, as this study found, sign of indexing or a badge of legitimacy. are unlikely to return many, if any, predatory Another vexing issue that was revealed in citations as part of the search results. Still, it this study is that of reputable journals that falls on the searcher to eliminate duplicates have been bought by predatory publishers. and redundant citations. Further, certain This study found 2 journals in this category. Integrity of Databases for Literature Searches in Nursing 7

Brown33 reported on 16 medical specialty and Google Scholar can be a “quick and journals that were purchased from 2 Cana- easy” way to get started but will require that dian commercial publishers by a predatory you carefully review and evaluate the results. publisher. In all these cases, it is the same If you need to venture to other more spe- predatory publisher, although some of the cialized databases, such as PsycInfo or ERIC purchases were made under a different busi- (Education Resources Information Center), ness imprint, adding further confusion to an it is important to carefully inspect the re- already muddied situation. Jeffrey Beall, who sults that you receive. To reduce the risk coined the term “predatory publisher” and of including a predatory journal article in maintained the blog “Scholarly Open Access” research, nursing scholars should use rep- for almost a decade, was quoted by Brown33: utable bibliographic databases, which have “[The company] is not only buying journals, clear criteria for journal indexing, for their it is buying metrics and indexing, such as searches. the journals’ impact factors and listing in Sco- Third, when you come across a journal ti- pus and PubMed, in order to look legitimate.” tlethatisnotfamiliar,taketimetoresearch One positive finding from this study was that it, visit the journal Web site and evaluate the the 2 purchased journals that were identified information at the Web site, and determine were quickly de-accessioned by the NLM and whether it is a credible source to include are no longer indexed in MEDLINE, although in your results. If something seems irregu- citations from their pre-predatory era remain lar, then it is worth your time to do more intact. investigating—either on your own or by enlisting the help of a knowledgeable colleague or librarian. Journals change publishers all Recommendations the time, and while most of these business All of this presents a confusing picture, transfers are benign and probably will not butitispossibletomakesomespecific impact you as an end consumer of the liter- recommendations to aid researchers, clini- ature, that is not always the case. Likewise, cians, faculty, and students in their literature the major publishers in the world today are searches. First, become familiar with the jour- large, multinational conglomerates that regu- nals and publications in your field. This is larly spin off or purchase other companies. a basic foundation of scholarship. As you While this probably will not impact you on a read articles, remember where they were day-to-day basis, it is important to investigate published, learn journal titles, and focus on any irregularities when conducting a search sources as well as the content. As you come of the literature. across predatory journals in nursing and Last, because these issues are complex and health care, make note of them and learn multifaceted, it is always wise to consult with their titles too. Remember that many preda- a librarian who can assist you in every step of tory journals adopt names that are intended the search process. Their knowledge and ex- to be confusing and may differ from a le- pertise in information literacy, data sources, gitimate journal by only one letter, such as and searching techniques can help to ensure “Africa” and “African.” that you find the information you need from Second, consider carefully how to ap- sources that are reliable and credible. proach your search from the outset. If you choose to start with MEDLINE (searched via PubMed), CINAHL, or Scopus, then you can SUMMARY have some assurance that the results will not return citations from predatory journals— Researchers, clinicians, faculty, and stu- although you should still verify every citation dents need to be careful not to include that you receive. On the other hand, Google citations from predatory sources in their 8ADVANCES IN NURSING SCIENCE/00 2020 literature searches and articles. Predatory not include citations to predatory publica- journals publish low-quality studies and cit- tions. Google and Google Scholar searches, ing this work erodes the scholarly literature in however, may very well include predatory nursing. The findings of this study offer some citations, and in that case, it is the searcher’s reassurance to those who search the profes- responsibility to carefully evaluate the out- sional nursing literature: if you begin a search put and discard findings from nonlegitimate in a database such as MEDLINE, CINAHL, sources. Enlisting the help of a librarian is or Scopus, then the results will probably always beneficial and highly recommended.

REFERENCES

1. Chinn PL, Nicoll LH, Carter-Templeton HD, 14. PMC. Journal Selection for PMC. US National Li- Oermann MH. An analysis of nursing citations brary of Medicine. https://www.ncbi.nlm.nih.gov/ and disciplinary characteristics in 79 articles that pmc/pub/journalselect/. Published 2019. represent excellence in nursing publication. Nurs 15. PMC. PMC Overview. https://www.ncbi.nlm.nih. Inq. 2019;26(3):e12296. gov/pmc/about/intro/. Published June 8, 2020. Up- 2. DOAJ (Directory of Open Access Journals) home dated 2020. Accessed June 1, 2020. page. https://doaj.org/. Published 2020. Accessed 16. PMC. NIH Preprint Pilot. https://www.ncbi.nlm.nih. July 22, 2020. gov/pmc/about/nihpreprints/. Published June 29, 3. Edie AH, Conklin JL. Avoiding predatory journals: 2020. Accessed June 1, 2020. quick peer review processes too good to be true. 17. Elsevier. Content policy and selection. https: Nurs Forum. 2019;54(3):336-339. //www.elsevier.com/solutions/scopus/how-scopus- 4. McCann TV, Polacsek M. False gold: safely navi- works/content/content-policy-and-selection. gating open access publishing to avoid predatory Published 2020. publishers and journals. JAdvNurs. 2018;74(4):809- 18. De Groote SL, Shultz M, Blecic DD. Information- 817. seeking behavior and the use of online resources: a 5. Oermann MH, Conklin JL, Nicoll LH, et al. Study snapshot of current health sciences faculty. JMed of predatory open access nursing journals. JNurs Libr Assoc. 2014;102(3):169-176. Scholarsh. 2016;48(6):624-632. 19. Dunn K, Marshall JG, Wells AL, Backus JEB. Ex- 6. Oermann MH, Nicoll LH, Chinn PL, et al. Quality amining the role of MEDLINE as a patient care of articles published in predatory nursing journals. information resource: an analysis of data from the Nurs Outlook. 2017;66(1):4-10. Value of Libraries study. J Med Libr Assoc. 2017; 7. Oermann MH, Nicoll LH, Carter-Templeton H, et al. 105(4):336-346. Citations of articles in predatory nursing journals. 20. Quesenberry AC, Oelschlegel S, Earl M, Leonard K, Nurs Outlook. 2019;7(6):664-670. Vaughn CJ. The impact of library resources and ser- 8. Frandsen TF. Are predatory journals undermining vices on the scholarly activity of medical faculty and the credibility of science? A bibliometric analysis of residents. Med Ref Serv Q. 2016;35(3):259-265. citers. Scientometrics. 2017;113(4):1513-1528. 21. Williamson PO, Minter CIJ. Exploring PubMed as 9. Nwagwu WE, Ojemeni O. Penetration of Nigerian a reliable resource for scholarly communications predatory biomedical open access journals 2007- services. J Med Libr Assoc. 2019;107(1):16-29. 2012: a bibiliometric study. Learn Publ. 2015;28(1): 22. Alving BE, Christensen JB, Thrysøe L. Hospital 23-34. nurses’ information retrieval behaviours in rela- 10. Ross-White A, Godfrey CM, Sears KA, Wilson R. tion to evidence based nursing: a literature review. Predatory publications in evidence syntheses. JMed Health Info Libr J. 2018;35(1):3-23. Libr Assoc. 2019;107(1):57-61. 23. Manca A, Moher D, Cugusi L, Dvir Z, Deriu F. How 11. National Library of Medicine. PubMed Overview. predatory journals leak into PubMed. CMAJ. 2018; https://pubmed.ncbi.nlm.nih.gov/about/. Accessed 190(35):E1042-E1045. July 9, 2020. 24. Manca A, Martinez G, Cugusi L, Dragone D, Dvir Z, 12. National Library of Medicine. Fact Sheet. MEDLINE® Deriu F. The surge of predatory open-access in neu- Journal Selection. https://www.nlm.nih.gov/lstrc/ rosciences and neurology. Neuroscience. 2017;353: jsel.html. Published 2019. Accessed July 9, 2020. 166-173. 13. PMC. How to Include a Journal in PMC. https:// 25. Manca A, Martinez G, Cugusi L, Dragone D, Mercuro www.ncbi.nlm.nih.gov/pmc/pub/addjournal/. Pub- G, Deriu F. Predatory open access in rehabilitation. lished 2019. Accessed July 9, 2020. Arch Phys Med Rehabil. 2017;98(5):1051-1056. Integrity of Databases for Literature Searches in Nursing 9

26. Topper L, Marill J, Kelly C, Funk K. Rigorous policies 30. Elsevier. What content is indexed in Scopus? ensure integrity of NLM literature databases. CMAJ. https://service.elsevier.com/app/answers/detail/ 2019;191(10):E289-E289. a_id/11274/supporthub/scopus/. Published 2020. 27. Ulrichsweb. Frequently Asked Questions. ProQuest Accessed June 10, 2020. LLC. https://www.ulrichsweb.com/ulrichsweb/faqs. 31. Nicoll LH, Chinn PL. Writing in the Digital Age: asp#About_Ulrichs. Published 2020. Accessed May Savvy Publishing for Healthcare Professionals. 3, 2020. Philadelphia, PA: Wolters Kluwer Health/Lippincott, 28. Library of Congress U.S. ISSN Center. International Williams & Wilkins; 2015. Standard Serial Number (ISSN). https://www.loc. 32. Google Scholar. About Google Scholar. https:// gov/issn/. Published 2020. Accessed June 10, 2020. scholar.google.com/intl/en/scholar/about.html. Ac- 29. EBSCO Nursing Resources. CINAHL Complete. cessed July 15, 2020. https://www.ebscohost.com/nursing/products/ 33. Brown C. Alleged predatory publisher buys medical cinahl-databases/cinahl-complete. Published 2020. journals. CMAJ. 2016;188(16):E398. Accessed June 10, 2020.