Evidence-informed practice versus evidence- based practice educational interventions for improving knowledge, attitudes, understanding and behaviour towards the application of evidence into practice: a comprehensive of undergraduate health and social care students

Elizabeth A. Kumah, Robert McSherry, Josette Bettany-Saltikov, Sharon Hamilton, Julie Hogg, Vicki Whittaker

Submitted to the Coordinating Group of: Crime and Justice Education Disability International Development Nutrition Social Welfare Methods Knowledge Translation and

Implementation Other:

Plans to co-register: No Yes Other Maybe

Date submitted: Date revision submitted: Approval date: [Type here]

Title of the review

Evidence-informed practice versus evidence-based practice educational interventions for improving knowledge, attitudes, understanding and behaviour towards the application of evidence into practice: a comprehensive systematic review of undergraduate health and social care students

Background

Health and social care practitioners are expected to apply research evidence into practice in order to improve patient care outcomes. Several authors, such as Kelly et al (2015), Smith & Rennie (2014), Straus et al (2011), Scott & McSherry (2009), Tickel-Degnen & Bedell (2003), and Sackett et al (1996) have argued that scientific evidence must be used to guide healthcare practice and that it helps practitioners to deliver best care for service users and families. Standards of healthcare practice recognize evidence-based practice as a significant and integral element for effective healthcare delivery (Melnyk & Newhouse, 2014). Sackett et al (1996, p.71) defined evidence-based practice as the “conscientious, explicit and judicious use of current best evidence in making decisions about the care of individual patients”.

Over the past two decades, healthcare practitioners have used the term “evidence-based practice” more frequently, and in recent times, the term “evidence-informed practice” is used instead, or as well. Following the movement for evidence-based medicine (Sackett et al 1997; 2000), the awareness of evidence-based practice became a necessity in the healthcare profession (Gambrill, 2006, 2007; Gibbs, 2003; McNeil, 2006; McCracken & Marsh, 2007; Gray, Plath & Webb, 2009). The concept has since gained recognition by healthcare regulatory agencies (e.g. International Council of Nurses (ICN, 2012), Nursing and Midwifery Council, United Kingdom (NMC, 2015), General Medical Council (GMC, 2013), and the Health and Care Professions Council (HCPC, 2012)) as the gold standard for providing compassionate and safe healthcare (Gray, Plath & Webb, 2009). Glacken & Chaney (2004) observed that internationally, governments have incorporated evidence-based practice with the improvement of initiatives to expand the delivery of healthcare. It is necessary for the provision of healthcare to be based on the best available evidence rather than on tradition. Jones and Santaguida (2005) emphasized that the policies of the United Kingdom’s National Health Service (NHS) distinctly recognize the need for policy and practice to be evidence- based. According to Nevo & Slovin-Nevo (2011), the actions of health and social care practitioners must, as a matter of both ethical and professional responsibility, be guided carefully by the best empirical data relevant to their fields. It is often said that such focus improves efficiency, accountability and effectiveness, promotes transparency, supports co- operation and knowledge sharing among professionals and service users, and produces better intervention outcomes (Shlonsky & Stern, 2007).

2 The Campbell Collaboration | www.campbellcollaboration.org [Type here]

Despite the growing awareness of evidence-based practice, it remains ineffectively implemented in healthcare practice. Several researchers (for example, Nevo & Slovin-Nevo, 2011; Epstein, 2009; Rubin, 2007; Norcross, Beutler & Levant, 2006; Wolpert et al, 2006; Pawson et al, 2003; McSherry, Simmons & Abbott, 2002) have suggested reasons for the ineffective implementation of evidence-based practice. Rubin (2007) conducted a review to identify the disadvantages of evidence-based practice in the literature. He concluded that the disadvantages of evidence-based practice include the following. Firstly, evidence-based practice is too mechanistic and not clear enough. Secondly, it disregards the errors of research and makes exaggerated statements about the research findings. Thirdly, the lack of resource limitations (including training, time and supervision) makes evidence-based practice difficult to implement. Finally, the research findings are outdated by the time they are published due to the nature of the scientific process. Additionally, Glasziou (2005) confirmed that the values and preferences of patients are often not considered in evidence- based practice, particularly, in deliberations with their healthcare providers.

Proponents of evidence-based practice contend that these limitations could be managed within the context of application of evidence-based practice by ways of adaptations and modifications. Melnyk et al (2012), and Melnyk & Newhouse (2014) have proposed an interpretative, encompassing opinion of evidence that includes clinical evidence and qualitative research, randomized controlled trials and equally empirical studies. Contrary to these opinions, however, Nevo & Slovin-Nevo (2011) emphasised that there are even more fundamental problems with evidence-based practice, which are impossible to manage by just modifying the . The difficulties with evidence-based practice resulted from apparent misconceptions about the potential relation between evidence and practice, and therefore, could not simply be revised by such adjustments and modifications (Rubin, 2007; Nevo & Slovin-Nevo, 2011).

Critics (including Nevo & Slovin-Nevo, 2011; McSherry, 2007; and McSherry, Simmon & Abbot, 2002) have argued that activities and decision-making in a typical clinical setting does not occur in a prescriptive stepwise or linear manner. However, they suggest that this occurs in an integrated approach with the application of evidence-based practice being a complex process comprising of several systems and elements. This is mainly because the complexity of health and healthcare delivery makes it impossible for healthcare practitioners to make patient care decisions by merely following a series of steps. Decision-making in the clinical setting cannot occur in isolation but in the form of a complex system, with an input (for example, roles and responsibilities of the health practitioner) throughput (examples include, research awareness, application of knowledge, informed decision-making, evaluation) and an output, an empowered professional who is a critical thinker and doer (McSherry, 2007).

The difficulties with the implementation of evidence-based practice resulted in the emergence of the evidence-informed practice concept. Advocates of evidence-informed practice (Nevo & Slovin-Nevo, 2011; Rubin, 2007; McSherry, Simmons & Pearce 2002) have

3 The Campbell Collaboration | www.campbellcollaboration.org [Type here]

argued that the term “evidence-informed” should be used instead of the term “evidence- based”. Nevertheless, McSherry (2007) stated that evidence-informed practice is an integration of the processes of evidence-based practice. Based on a whole systems approach, McSherry (2007) developed an evidence-informed practice model to facilitate the effective implementation of evidence into practice. According to McSherry (2007), the significance of the evidence-informed practice model is to consolidate the status of evidence-based practice and its associated models. Evidence-informed practice, unlike evidence-based practice, recognizes healthcare practitioners as critical thinkers who would provide an all- encompassing patient-centered treatment. Evidence-informed practice is the assimilation of professional judgment and research evidence regarding efficiency of interventions (McSherry, Simmons & Pearce 2002). It gives a comprehensive and rational basis for decision-making in patient care.

The benefits of including evidence-informed practice and/or evidence-based practice teaching in undergraduate health and social care curricula have been emphasized by researchers including, Menyk (2017), Bennett, Hoffman & Arkins (2011), Long et al (2011), Myles & Loughlin (2011), Salls et al (2009), Glasziou (2005), McSherry, Simmons & Abbott (2002), Frenk et al (2010), and Dawes et al (2005). Nurses and allied health professionals are significant members of the multi-disciplinary team, who act together with doctors to deliver safe person-centered healthcare. As stated by the Association of Schools of Allied Health Professions (ASAHP), Allied health practitioners involve about 60% of healthcare professionals, and they deliver services including the identification, prevention and evaluation of diseases; rehabilitation and health systems management, and dietary and nutrition services (ASAHP, 2016). A review of the literature reveals overabundance of research examining evidence-based practice interventions and the effects of such interventions. Examples include Young et al (2015), Ilic & Maloney (2014), Fritsche et al (2002), Coomarasamy, Taylor & Khan (2003), Maggio et al (2013), and Wong et al (2013). However, few studies have examined the effectiveness of evidence-informed practice educational interventions. Almost et al, (2013) developed an online evidence-informed practice educational intervention for nurses working in correctional facilities and evaluated the acceptability and feasibility of the intervention.

The purpose of this systematic review is to compare which of the two concepts facilitates the application of evidence into practice based on available findings from studies that examine the effectiveness of evidence-informed practice and/or evidence-based practice educational interventions. No specific systematic review exists that compares the effectiveness of evidence-informed practice versus evidence-based practice educational interventions on undergraduate health and social care students’ knowledge, understanding, attitude and behaviour towards the application of evidence into practice. A recent systematic review by Rohwer et al (2017) assessed the effectiveness of e-learning of evidence-based healthcare for increasing evidence-based health care competencies in healthcare professionals. In addition,

4 The Campbell Collaboration | www.campbellcollaboration.org [Type here]

Yost et al (2015) focussed on the effectiveness of knowledge translation interventions for promoting evidence-informed decision- making among nurses.

As universities and colleges make efforts to develop policies and practices that will effectively aid the application of evidence into practice and ultimately, improve healthcare students’ outcomes, it is essential that health practitioners, stakeholders and policy makers have access to evidence on the comparison of the effectiveness of evidence-informed practice versus evidence-based practice educational interventions in facilitating the application of evidence into practice. Boaz, Baeza & Fraser, (2011) revealed that the effective application of evidence into practice results in effectual patient outcomes. Additionally, it is expected that the results of this systematic review will help stakeholders and healthcare practitioners to be aware of the gaps in evidence, particularly, regarding evidence-informed practice educational interventions in order to make informed decision.

Objectives

The primary objective of this systematic review is to evaluate and synthesize literature on the effectiveness of evidence-informed practice versus evidence-based practice educational interventions for improving knowledge, attitudes, understanding and behaviour of undergraduate health and social care students towards the application of evidence into practice.

Specifically, this systematic review will answer the following questions:

1. Is there a difference between evidence-informed practice and evidence-based practice educational interventions?

2. Do participating in an evidence-informed practice versus evidence-based practice educational interventions facilitate the application of evidence into practice

3. Do both evidence-informed practice and evidence-based practice educational interventions targeted at undergraduate health and social care students affect patient outcomes?

4. What factors affect the impact of evidence-informed practice and evidence-based practice educational interventions?

5 The Campbell Collaboration | www.campbellcollaboration.org [Type here]

Existing reviews

Advocates of evidence-based practice have conducted several systematic reviews on evidence- based practice educational interventions and the effects of such interventions. Coomarasamy & Khan (2004), and Flores-Mateo &d Argimon (2007) conducted systematic reviews on the impact of evidence-based practice educational interventions on postgraduate students. Furthermore, Dizon et al (2012) assessed the impact of teaching evidence-based practice to allied health practitioners. Moreover, other researchers have systematically reviewed the literature regarding strategies used in teaching evidence-based practice. These include evaluating the effectiveness of journal clubs (Ebbert et al, 2001; Harris et al, 2011) and methods used in teaching critical appraisal (Parkes et al, 2001; Taylor et al, 2000b, Norman & Shannnon, 1998). In addition, methods used in assessing evidence-based practice education have been systematically reviewed (Walczak et al, 2010; Shaneyfelt et al, 2006). However, no specific systematic review has been conducted on the effectiveness of evidence- informed practice educational interventions. A systematic review by Yost (2015) concentrated on the effectiveness of knowledge translation on evidence-informed decision-making among nurses. In addition, a more recent systematic review by Rohwer et al (2017) focussed on assessing the effectiveness of e-learning of evidence-based health care on increasing evidence-based health care competencies in healthcare professionals. The proposed systematic review is significantly different from Yost’s (2015) and Rohwer et al’s (2017) study on three fronts. Firstly, the present study focusses on pre-registered undergraduate health and social care students as opposed to only nurses or health care professionals. Secondly, the current study assesses the effectiveness of evidence-informed practice educational interventions while as Rohwer et al’s (2017) and Yost’s (2015) study assessed the effectiveness of e-learning of evidence-based health care and the effectiveness of knowledge translation on evidence-informed decision-making, respectively. Thirdly, the proposed systematic review focuses on comparing the effectiveness of evidence-informed practice versus evidence-based practice educational interventions on undergraduate healthcare students’ knowledge, attitudes, understanding and behaviour towards the application of evidence into practice.

It is imperative that a comprehensive systematic review of the literature that particularly compares the effectiveness of evidence-informed practice versus evidence-based practice educational interventions on undergraduate health and social care students is done. This will aid in reviewing and analysing current evidence-informed practice and evidence-based practice approaches in higher education settings. This systematic review offers originality and is significant because it compares the effectiveness of evidence-informed practice versus evidence-based practice educational interventions. Furthermore, it determines whether or not these two concepts act together, or individually to facilitate the application of evidence into practice. In addition, the present systematic review will help to identify impacts of evidence-informed practice and evidence-based practice educational interventions as well as

6 The Campbell Collaboration | www.campbellcollaboration.org [Type here]

gaps in the current literature. This is imperative because it will offer direction for practice, policy and future inquiry in this growing area of research and practice.

Intervention

This systematic review will consider studies that assess any formal evidence-informed practice and/or evidence-based practice educational interventions targeted at undergraduate health and social care students in higher education. Evidence-informed practice is broadly defined as involving the use of various types of research evidence when making decision about policy and practice. Evidence-informed practice considers: the best available research evidence, practitioner knowledge and experience, client preferences and values, and the clinical state and circumstances (Nevo & Slovin-Nevo, 2011). Evidence-based practice, on the other hand, is the “conscientious, explicit and judicious use of current best evidence in making decisions about the care of individual patients” (Sackett et al, (1996 p.71). In this systematic review, evidence-informed educational intervention refers to any formal educational program that facilitates the application of, but not limited to the evidence- informed practice model described by McSherry (2007). Moreover, evidence-based practice educational intervention refers to any formal educational program that enhances the application of evidence-based practice models. An example of such a model could be the evidence-based practice model developed by Melnyk & Fineout-Overhalt (2014). The evidence-informed practice model, as developed by McSherry (2007) is a whole systems- based model comprising of an input (for example, roles and responsibilities of the health practitioner) throughput (i.e. research awareness, application of knowledge, informed decision-making, evaluation) and an output, which is an empowered professional who is a critical thinker and doer (McSherry, 2007). The evidence-based practice model developed by Melnyk & Fineout-Overhalt (2014) comprises of a seven-step approach to the application of evidence into practice.

The mode of delivery of the educational program could be in the form of workshops, seminars, conferences, journal clubs, lectures (both face-to-face and online). The content, manner of delivery and length of the educational program may differ in each of the studies to be included as there is no standard evidence-informed practice/evidence-based practice educational program.

In this systematic review, evidence-informed practice and evidence-based practice interventions that are targeted towards health and social care postgraduate students or registered health and social care practitioners will be excluded. Comparison conditions will include educational interventions that do not advance the teaching of the principles and processes of evidence-informed practice and/or evidence-based practice in healthcare.

7 The Campbell Collaboration | www.campbellcollaboration.org [Type here]

Population

Participants in this systematic review will include pre-registered undergraduate health and social care students in higher education from any geographical area. Studies that include registered health and social care practitioners and postgraduate students will be excluded from this review.

Outcomes

The key outcomes of this systematic review will include:

Studies must report at least one of the following outcomes:

a) Participants’ knowledge of, understanding of, attitudes and behaviour towards the application of evidence into practice as a result of participating in an evidence- informed practice and/or evidence-based practice educational program.

Measurement of the above outcomes may be conducted using standardized or unstandardized instruments. Specific measures will include, but not be limited to:

• The use of a standardized questionnaire to evaluate knowledge, attitude, understanding and behaviour towards the application of evidence into practice. Examples of such questionnaires include, but not limited to the Evidence-Based Practice Belief (EBPB) Scale and Evidence-Based Practice Implementation (EBPI) scales developed by Melynk & Fineout-Overholt (2011).

• Examples of unstandardized instruments include, but not limited to reports from participants and researcher administered measures.

a) Studies that measure the impact of evidence-informed practice and/or evidence-based practice educational programs on patient outcome will be included. Examples of this include user experience, length of hospital stay, nosocomial infections, patient and health practitioner satisfaction, mortality, and morbidity rates.

Study designs

This systematic review will integrate findings from both qualitative and quantitative studies. The quantitative component of the review will consider studies that use both experimental and epidemiological research designs such as randomized controlled trials, non-randomized controlled trials, quasi-experimental, before and after studies, prospective and retrospective cohort studies for inclusion.

8 The Campbell Collaboration | www.campbellcollaboration.org [Type here]

The qualitative component of the review will consider descriptive epidemiological study designs including case series, individual case reports and descriptive cross sectional studies, focus groups, interviews and approaches such as ethnography, phenomenology, and grounded theory for inclusion.

References

Almost, J., Gifford, W. A., Doran, D., Ogilvie, L., Miller, C., Rose, D. N., & Squires, M. (2013). Correctional nursing: A study protocol to develop an educational intervention to optimize nursing practice in a unique context. Implementation science, 8, 71. http://www.implementationscience.com/content/8/1/71

Association of schools of allied health professions. (2014). Allied Health Professionals. Retrieved from http://www.asahp.org/wpcontent/uploads/2014/08/health- professions-facts.pdf

Bennett, S., Hoffmann, T., & Arkins, M. (2011). A multi-professional evidence-based practice course to improved allied health students’ confidence and knowledge. Journal of Evaluation in Clinical Practice, 17(4), 635– 639. doi: 10.1111/j.1365-2753.2010.01602.x

Boaz, A., Baeza, J. & Fraser, A., European Implementation Score Collaborative Group. (2011). Effective implementation of research into practice: An overview of systematic reviews of the health literature. BioMedical Council Research Notes, 4, 212. doi: 10.1186/1756-0500-4-212

Coomarasamy, A., Taylor, R., & Khan, K. S. (2003). A systematic review of postgraduate teaching in evidence-based medicine and critical appraisal. Medical Teacher, 25, 77- 81

Coomarasamy, A., & Khan, K. S. (2004). What is the evidence that postgraduate teaching in evidence based medicine changes anything?: A systematic review. British Medical Journal, 329, 1017. doi: https://doi.org/10.1136/bmj.329.7473.1017

Dawes, M., Summerskill, W., Glasziou, P., Cartabellotta, A., Martin, J., & Hopayian, K. (2005). Sicily statement on evidence-based practice. BioMed Council Medical Ethics, 5(1), 1. https://doi.org/10.1186/1472-6920-5-1

Dizon, J. M. R., Grimmer-Somers, K. A., & Kumar, S. (2012). Current evidence on evidence- based practice training in allied health: A systematic review of the literature. International Journal of Evidence-based Healthcare, 10, 347-360. doi: 10.1111/j.1744-1609.2012.00295.x.

9 The Campbell Collaboration | www.campbellcollaboration.org [Type here]

Epstein, I. (2009). Promoting harmony where there is commonly conflict: evidence-informed practice as an integrative strategy. Social Work in Health Care, 48, 216–231. doi:10.1080/00981380802589845

Ebbert, J. O., Montori, V. M., & Schultz, H. J. (2001). The journal club in postgraduate medical education: A systematic review. Medical Teacher, 23, 455-461. doi:10.1080/01421590120075670 Flores-Mateo, G., & Argimon, J. M. (2007). Evidence-based practice in postgraduate healthcare education: A systematic review. BioMed Council Health Services Research, 7, 119. doi:10.1186/1472-6963-7-119

Frenk, J., Chen, L., Bhutta, Z., Cohen, J. Crisp, N., & Evans, T. (2010). Health professionals for a new century: Transforming education to strengthen health systems in an interdependent world. The Lancet, 376, 1923–1958. doi:10.1016/s0140- 6736(10)61854-5

Fritsche, L., Greenhalgh, T., Falck-Ytter, Y., Neumayer, H. H., & Kunz, R. (2002). Do short courses in evidence-based medicine improve knowledge and skills?: Validation of Berlin questionnaire before and after study of courses in evidence-based medicine. British Medical Journal, 325, 1338-1341. https://doi.org/10.1136/bmj.325.7376.1338

Gambrill, E. (2006). Social work practice: A critical thinker’s guide. 2nd edn. New York: Oxford University Press.

Gambrill, E. (2007). Transparency as the route to evidence-informed professional education. Research on Social Work Practice, 17, 553–560. http://journals.sagepub.com/doi/pdf/10.1177/1049731507300149

General Medical Council (2013). Good medical practice. General Medical Council: London. Retrieved from http://www.gmc-uk.org/good_medical_practice___english_1215.pdf_51527435.pdf

Gibbs, l. E. (2003). Evidence-based practice for the helping professions. Pacific Grove, California: Brooks/Cole.

Glacken, M., & Chaney, D. (2004). Perceived barriers and facilitators to implementing research findings in the Irish practice setting. Journal of Clinical Nursing, 13, 731–740. doi: 10.1111/j.1365-2702.2004.00941.x

Glasziou, P. (2005). Evidence-based medicine: Does it make a difference? Make it evidence informed with a little wisdom. British Medical Journal, 330(7482), 92. doi: 10.1136/bmj.330.7482.92-a

10 The Campbell Collaboration | www.campbellcollaboration.org [Type here]

Gray, M., Plath, D., & Webb, S. A. (2009). Evidence-based social work: A critical stance. Abingdon: Routledge. doi: https://doi.org/10.1017/s0047279410001066

Harris, J., Kearley, K., Heneghan, C., Meats, E., Roberts, N., Perera, R., & Kearley-Shiers, K. (2011). Are journal clubs effective in supporting evidence-based decision making?: A systematic review. Beme guide no. 16. Medical Teacher, 33, 9-23. doi:10.3109/0142159x.2011.530321

Health Care and Professions Council (2012). Standards of conduct, performance and ethics. Retrieved from http://www.hpc-uk.org/aboutregistration/standards/

Ilic, D., & Maloney, S. (2014). Methods of teaching medical trainees evidence-based medicine: A systematic review. Medical Education, 48(2), 124-135. doi: 10.1111/medu.12288

International Council of Nurses (2012). Closing the gap: From evidence to action. Retrieved from http://www.icn.ch/publications/2012-closing-the-gap-from-evidence-to-action/

Jones, R. J. E., & Santaguida, P. (2005). Evidence-based practice and health policy development: The link between knowledge and actions. Physiotherapy, 91, 14–21. doi:10.1016/j.physio.2004.07.009

Kelly, M. P., Heath, I., Howick, J., & Greenhalgh, T. (2015). The importance of values in evidence-based medicine. Biomed Central Medical Ethics, 16(1), 69. https://doi.org/10.1186/s12910-015-0063-3

Long, K., Mcevoy, M., Lewis, L., Wiles, L., Williams, M., & Olds, T. (2011). Entry-level evidenced-based practice training in physiotherapy students: Does it change knowledge, attitudes and behaviours?: A longitudinal study. The Internet Journal of Allied Health Sciences and Practice, 9(3). http://nsuworks.nova.edu/cgi/viewcontent.cgi?article=1359&context=ijahsp

Maggio, L. A., Tannery, N. H., Chen, H. C., ten Cate O, O’Brien, B. (2013). Evidence-based medicine training in undergraduate medical education: A review and critique of the literature published 2006-2011. Academic Medicine, 88(7), 1022-1028 doi: 10.1097/ACM.0b013e3182951959

McMracken, S. G., & Marsh, J. C. (2007). Practitioner expertise in evidence-based practice decision making. Research on Social Work Practice, 18, 301–310. Http://journals.sagepub.com/doi/pdf/10.1177/1049731507308143

McNeill, T. (2006). Evidence-based practice in an age of relativism: Towards a model for practice. Social work, 51, 147–156. doi: https://doi.org/10.1093/sw/51.2.147

11 The Campbell Collaboration | www.campbellcollaboration.org [Type here]

McSherry, R. (2007). Developing, exploring and refining a modified whole systems based model of evidence-informed nursing (Unpublished PhD Thesis). Middlesbrough, England, United Kingdom: School of Health and Social Care, Teesside University.

Mcsherry, R., Simmons, M., & Pearce, P. (2002). An introduction to evidence-informed Nursing. In R. Mcsherry, M. Simmons, & P. Abbott, (Eds.), Evidence-informed nursing: A guide for clinical nurses. London, Routledge, 1–13. 541.7206&rep=rep1&type=pdf

Mcsherry, R., Simmons, M., & Abbott, P. (2002). Evidence-informed nursing: a guide for clinical nurses. London: Routledge.

Melnyk, B., & Fineout-Overholt, E. (2011). Making the case for evidence-based practice and cultivating a spirit of inquiry. In B. M. Melnyk, & E. Fineout-Overholt, (Eds.) Evidence-based practice in nursing and healthcare: A guide to best practice. 2nd edn. Wolters Kluwer: Philadelphia, PA.

Melnyk, B. M., Fineout-Overholt, E., Gallagher-Ford, L., & Kaplan, L. (2012). The state of evidence-based practice in US nurses: Critical implications for nurse leaders and educators. Journal of Nursing Administration, 42(9), 410–417. doi: 10.1097/nna.0b013e3182664e0a

Melnyk, B. (2017). The difference between what is known and what is done is lethal: Evidence-based practice is a key solution urgently needed. Worldviews on Evidence- Based Nursing, 14(1), 3-4.

Melnyk, B. M., Newhouse, R., (2014). Evidence-based practice versus evidence-informed practice: A debate that could stall forward momentum in improving healthcare quality, safety, patient outcomes, and costs. Worldviews on Evidence-based nursing, 11, 6, 347- 349. doi: 10.1111/wvn.12070

Myles, A., & Loughlin, M. (2011). Models in the balance: evidence-based medicine versus evidence-informed individualized care. Journal of Evaluation in Clinical Practice, 17, 531-536. doi: 10.1111/j.1365-2753.2011.01713.x

Nevo, I., & Slonim-Nevo, V. (2011). The myth of evidence-based practice: towards evidence- informed practice. British Journal of Social Work, 41(1), 1–22. doi:https://doi.org/10.1093/bjsw/bcq149

Norcross, J. C., Beutler, L. E., & Levant, R. F. (Eds.) (2006). Evidence-based practices in mental health: Debate and dialogue on the fundamental questions. Washington, DC: American Psychological association.

12 The Campbell Collaboration | www.campbellcollaboration.org [Type here]

Norman, G. R., & Shannon, S. I. (1998). Effectiveness of instruction in critical appraisal (evidence-based medicine) skills: A critical appraisal. Canadian Medical Association Journal, 158, 177-81. http://www.cmaj.ca/content/158/2/177.full.pdf+html

Nursing and Midwifery Council (2015). The code: professional standards of practice and behaviour for nurses and midwives. Standards for proficiency for pre-registration nurse. NMC: London. Retrieved from https://www.nmc.org.uk/globalassets/sitedocuments/nmc-publications/nmc- code.pdf

Pawson, R., Boaz, A., Grayson, L., Long, A., & Barnes, C. (2003). Types and quality of knowledge in social care. London, Social care institute for excellence, Knowledge review 3

Parkes, J., Hyde, C., Deeks, J., & Milne, R. (2001). Teaching critical appraisal skills in health care settings. Cochrane Database of Systematic Review, cd001270. doi:10.1002/14651858.cd001270

Rohwer, A. Motaze, N. V., Rehfuess, E, Young, T. (2017). E-learning of evidence-based health care (EBHC) in healthcare professionals: a systematic review. Campbell Systematic Review. doi: 10.4073/csr.2017.4

Rubin, A. (2007). Improving the teaching of evidence-based practice: introduction to the special issue. Research on Social Work Practice, 17, 541–547. Retrieved from http://journals.sagepub.com/doi/pdf/10.1177/1049731507300145

Sackett, D. L., Rosenberg, W. M. C., Gray, J. A. M., Haynes R. B., & Richardson, W. S. (1996). Evidence-based medicine: what it is and what it isn’t. British Medical Journal, 7172 (2), 312. https://www.ncbi.nlm.nih.gov/pmc/articles/pmc2349778/

Sackett, D. L., Straus, S. E., Richardson, W. S., Rosenberg, W., & Haynes, R. B. (1997). Evidence-based medicine: how to practice and teach evidence-based medicine. London: Churchill Livingston.

Sackett. D. L. (2000). Evidence-based medicine: how to practice and teach evidence-based medicine. 2nd edn. Edinburgh: Churchill Livingstone.

Salls, J., Dolhi, C., Silverman, L., & Hansen, M. (2009). The use of evidence-based practice by occupational therapists. Occupational Therapy in Health Care. 23(2), 134–145. doi:10.1080/07380570902773305

13 The Campbell Collaboration | www.campbellcollaboration.org [Type here]

Scott, K., & Mcsherry, R. (2009). Evidence based nursing: clarifying the concept for nurses in practice. Journal of Clinical Nursing, 18, 1085–1095. doi:10.1111/j.13652702.2008.02588.x

Shaneyfelt, T., Baum, K. D., Bell, D., Feldstein, D., Houston, T. K., Kaatz, S., Whelan, C., & Green, M. (2006). Instruments for evaluating education in evidence-based practice: A systematic review. Journal of the American Medical Association, 296, 1116-1127. doi:10.1001/jama.296.9.1116

Shlonsky, A., & Stern, S. B. (2007). Reflections on the teaching of evidence-based practice. Research on Social Work Practice, 17, 603–611. Http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.924.8798&rep=rep1&type= pdf

Smith, R., & Rennie, D. (2014). Evidence based medicine-an oral history. British Medical Journal, 348-371. doi: https://doi.org/10.1136/bmj.g371

Straus, S. E, Glasziou, P., Richardson, W. S., & Haynes, R. B. (2011). Evidence-based medicine: how to practice and teach it. 4th edn. Toronto (On): Churchill Livingstone Elsevier.

Taylor, R., Reeves, B., Ewings, P., Binns, S., Keast, J., & Mears, R. (2000). A systematic review of the effectiveness of critical appraisal skills training for clinicians. Medical Education, 34, 120-125. doi: 10.1046/j.1365-2923.2000.00574.x

Tickle-Degnen, L., & Bedell, G. (2003). Hierarchy and hierarchy: A critical appraisal of the “levels of evidence” as a tool for clinical decision-making. The American Journal of Occupational Therapy, 75(2), 234-237. doi:10.5014/ajot.57.2.234

Walczak, J., Kaleta, A., Gabrys, E., Kloc, K., Thangaratinam, S., Barnfield, G., Weinbrenner, S., Meyerrose, B., Arvanitis, T. N., Horvath, A. R., Zanrei, G., Kunz, R., Suter, K., Burnand, B., Arditi, C., Rengerink, K. O., Harry, G., Mol, B. W. J., & Khan, K. S. (2010). How are "teaching the teachers" courses in evidence based medicine evaluated?: A systematic review. BioMed Council of Medical Education, 10. http://www.biomedcentral.com/1472-6920/10/64

Wolpert, M., Fuggle, P., Cottrell, D., Fonagy, P., Phillips, J., Phillips, S., Stein, S., & Target, M. (2006). Drawing on the evidence: Advice for mental health professionals working with children and adolescents, London: CMAHS. Retrieved from http://citeseerx.ist.psu.edu/viewdoc/download;jsessionid=71951d8f345e202280c8e99 b47913a06?doi=10.1.1.

14 The Campbell Collaboration | www.campbellcollaboration.org [Type here]

Wong, S. C., McEvoy, M. P., Wiles, L. K., & Lewis, L. K. (2013). Magnitude of change in outcomes following entry-level evidence-based practice training: A systematic review. International Journal of Medical Education, 4, 107-114. doi: 10.5116/ijme.51a0.fd25

Yost, J., Ganann, R., Thompson, D., Aloweni, F., Newman, K., Hazzan, A., McKibbon, A., Dobbins, M. &Ciliska, D. (2015). The effectiveness of knowledge interventions for promoting evidence-informed decision-making among nurses in tertiary care: A systematic review and meta-analysis. BioMed Council Implementation Science, 10, 1-15. doi: 10.1186/s13012-015-0286-1

Young, T., Rohwer, A., Volmink, J., Clarke, M. (2015). Perspectives of undergraduate module conveners at a South African academic institution on medical student training in evidence-based health care: A qualitative study. South African Family Practice. 57(6), pp. 353–9.

15 The Campbell Collaboration | www.campbellcollaboration.org [Type here]

Review authors

Lead review author: The lead author is the person who develops and co-ordinates the review team, discusses and assigns roles for individual members of the review team, liaises with the editorial base and takes responsibility for the on-going updates of the review.

Name: Elizabeth Adjoa Kumah

Title: Ms.

Affiliation: Teesside University, Institute of Health and Social Care

Address: Borough Road Middlesbrough

City, State, Province or County: Cleveland, Tees Valley

Post code: TS1 3BA

Country: United Kingdom

Phone:

Email: [email protected] [email protected]

Co-author(s) Name: Robert McSherry

Title: Professor

Affiliation: Teesside University, Institute of Health and Social Care

Address: Borough Road Middlesbrough

City, State, Province or County: Cleveland, Tees Valley

Post code: TS1 3BA

Country: United Kingdom

Phone:

Email: [email protected]

16 The Campbell Collaboration | www.campbellcollaboration.org [Type here]

Name: Josette Battany-Saltikov

Title: Dr

Affiliation: Teesside University, Institute of Health and Social Care

Address: Borough Road Middlesbrough

City, State, Province or County: Cleveland, Tees Valley

Post code: TS1 3BA

Country: United Kingdom

Phone:

Email: [email protected]

Name: Sharon Hamilton

Title: Professor

Affiliation: Teesside University, Institute of Health and Social Care

Address: Borough Road Middlesbrough

City, State, Province or County: Cleveland, Tees Valley

Post code: TS1 3BA

Country: United Kingdom

Email: [email protected]

Name: Julie Hogg

Title: Mrs

Affiliation: Teesside University

Address: Borough Road Middlesbrough

City, State, Province or County: Cleveland, Tees Valley

Post code: TS1 3BA

Country: United Kingdom

Email: [email protected]

17 The Campbell Collaboration | www.campbellcollaboration.org [Type here]

Name: Vicki Whittaker

Title: Mrs

Affiliation: Teesside University, Institute of Health and Social Care

Address: Borough Road Middlesbrough

City, State, Province or County: Cleveland, Tees Valley

Post code: TS1 3BA

Country: United Kingdom

Phone:

Email: [email protected]

18 The Campbell Collaboration | www.campbellcollaboration.org [Type here]

Roles and responsibilities

• Content and Systematic Review methodology: Ms Elizabeth Adjoa Kumah is a registered general nurse who has worked mainly in the critical care setting as a nurse supervisor and patient advocate. She has been actively engaged in teaching healthcare students in the clinical setting and serving as a mentor. She is currently pursuing a PhD Health program, with evidence-informed practice educational interventions as the area of research focus. She brings knowledge about the content both in terms of teaching healthcare students about the application of research evidence into practice and theoretically for improving knowledge of evidence-informed practice and how it enhances evidence-based practice skills, attitude and behaviour in the educational setting. Elizabeth is passionate about improving the standard of patient care and patient outcome, which she believes could be achieved by effective and consistent implementation of evidence-informed practice. She will also help with the methodological aspects of the systematic review. She has been involved as co-author on a Joanna Briggs Institute review.

• Content and Systematic review methods: Professor Robert McSherry will bring both methodological as well as content expertise relating to evidence-informed practice and the development of teaching programs to the team. His area of expertise is around evidence-informed practice, patient safety, quality and clinical governance using practice development. Practice development is about promoting person-centered care and approaches, which Rob has integrated effectively within both educational and research programs. He is the co-author of a book on systematic reviews and has over thirty years’ experience as a registered general nurse. Robs educational and professional expertise has been recognized and rewarded international and nationally. He was awarded the highly prestigious National Teaching Fellow award in the UK in 2011.

• Content and systematic review methods: Dr Josette Bettany-Saltikov will bring significant expertise of Systematic review methods and content to this systematic review, both in terms of knowledge about evidence-informed practice and knowledge about developing educational programs. She has taught systematic review methods to university students at all levels for over 15 years. She has also published a book on how to conduct a systematic review and has been involved in three Cochrane reviews, one of which she led. She has authored a number of systematic reviews on diverse topics published in other journals and has significant experience of developing educational programmes from her teaching experience as a university Senior lecturer for 23 years.

• Content and systematic review methods: Professor Sharon Hamilton will bring expertise in systematic reviewing. She is the director of the Teesside Centre for Evidence- Informed Practice: A Joanna Briggs Institute Centre of Excellence, and has conducted

19 The Campbell Collaboration | www.campbellcollaboration.org [Type here]

a number of qualiative and quantitative reviews. Sharon is a registered nurse and has research expertise in the evaluation of clinial interventions.

• Information retrieval: Mrs Julie Hogg brings Information retrieval expertise to the team. Julie is an Academic Librarian at Teesside University and will carry out a thorough and systematic search of the literature.

• Statistical analysis: Mrs Vicki Whittaker is a very experienced statistician with over 18 years of experience in teaching and advising students and academics on their research projects and clinical trials. She has been involved in data analysis and meta-analysis of numerous research projects and systematic reviews.

Funding

This systematic review forms part of a PhD study funded by the University of Teesside Research Development Studentship. It is expected that this systematic review would be completed within one year

Potential conflicts of interest

The review team declares no potential conflicts of interest.

Preliminary timeframe

• Date you plan to submit a draft protocol: December, 2017 • Date you plan to submit a draft review: November, 2018

20 The Campbell Collaboration | www.campbellcollaboration.org