Practical (Pragmatic) Clinical Trials

Total Page:16

File Type:pdf, Size:1020Kb

Practical (Pragmatic) Clinical Trials Supplement for Chapter 18 Practical (Pragmatic) Clinical Trials The recent emphasis on evidence-based practice (EBP) underscores the importance of research evidence that can be used in real-world clinical situations. However, from an EBP perspective, there are some problems with traditional phase III randomized controlled trials (RCTs). In particular, as a result of efforts to enhance the internal validity of the trial to support causal inferences about the efficacy of the new treatment, RCT designs are so tightly controlled and have such stringent eligibility criteria that the trial’s relevance to real- life applications is sometimes called into question. Concern about this situation has led to a call for practical (or pragmatic) clinical trials, which strive to maximize application to real- life settings (external validity) with minimal negative effect on the ability to attribute clini- cally important improvements to the intervention (internal validity). Tunis and colleagues (2003), in an often-cited paper, defined practical clinical trials (PCTs) as “trials for which the hypotheses and study design are formulated based on information needed to make a decision” (p. 1626, emphasis added). PCTs address practical questions about the benefits and risks of an intervention—as well as its costs—as they would unfold in routine clinical practice. PCTs are thus sensitive to the issues under scrutiny in effectiveness studies (phase IV trials), but there is an increasing interest in developing strategies to bridge the gap between efficacy and effectiveness and to address issues of practicality earlier in the testing of promising interventions. Achieving a creative tension between generalizability and internal validity is crucial. Glasgow and col- leagues (2005) proposed several research designs for PCTs, including randomization by site rather than by people (cluster randomization) and delay-of-treatment designs. Some prag- matic trials, however, rely on quasi-experimental designs, opting to put more emphasis on external validity rather than internal validity. Tunis and coauthors (2003) made a number of recommendations for PCTs. These include the following: ●● Enrollment of diverse populations with fewer exclusions of high-risk patients ●● Recruitment of participants from a variety of practice settings ●● Follow-up over a longer period ●● Inclusion of economic outcomes ●● Comparisons of clinically viable alternatives Example of a nursing pragmatic clinical trial: Glavin and coresearchers (2010) conducted a pragmatic clinical trial to test the effectiveness of support- ive counseling by public health nurses for women with postpartum depression. The program was tested in one Norwegian municipality, and women in a comparison municipality were used as the control group. 1 2 Supplement for Chapter 18 Practical (Pragmatic) Clinical Trials TIP: Godwin and colleagues (2003) prepared a useful table that contrasts features of an “explanatory trial” (i.e., a traditional phase III RCT) and a pragmatic trial. The table can be accessed at www.biomedcentral.com/content/supplementary/1471-2288-3-28-S1.doc. Some of the researchers in the forefront of promoting PCTs have developed a frame- work for intervention research that specifically seeks to address a trial’s generalizability and the transferability of intervention evidence. This framework is called the RE-AIM framework (Glasgow, 2006). The framework involves a scrutiny of five aspects of a study: its Reach, Efficacy, Adoption, Implementation, and Maintenance. Reach means reaching the intended population of potential beneficiaries, which concerns the extent to which study participants have characteristics that reflect those of that population.Efficacy concerns intervention impacts on critical outcomes. Adoption concerns the number and representativeness of set- tings and staff who are willing to implement the intervention. Implementation concerns the consistency of delivering the intervention as intended and also intervention costs. The last component, maintenance, involves a consideration of the extent to which, at the individual level, outcomes are maintained over time and, at the institutional level, the intervention becomes part of routine practices and policies. Detailed information about this framework and advice on how to assess the five components is available at www.re-aim.org. Example of a nursing study using RE-AIM: Whittemore and colleagues (2009) used the RE-AIM model as the organizing framework for their pilot study of a diabetes prevention program in primary care settings. REFERENCES Glasgow, R. E. (2006). RE-AIMing research for application: Godwin, M., Ruhland, L., Casson, I., MacDonald, S., Delva, D., Ways to improve evidence for family medicine. Journal of the Birtwhistle, R., et al. (2003). Pragmatic controlled clinical tri- American Board of Family Medicine, 19, 11–19. als in primary care: The struggle between external and inter- Glasgow, R. E., Magid, D., Beck, A., Ritzwoller, D., & nal validity. BMC Medical Research Methodology, 3, 28. Estabrooks, P. (2005). Practical clinical trials for translating Tunis, S. R., Stryer, D., & Clancy, C. (2003). Practical clinical research to practice: Design and measurement recommenda- trials: Increasing the value of clinical research for decision tions. Medical Care, 43, 551–557. making in clinical and health policy. Journal of the American Glavin, K., Smith, L., Sorum, R., & Ellefsen, B. (2010). Medical Association, 290, 1624–1632. Supportive counseling by public health nurses for women Whittemore, R., Melkus, G., Wagner, G., Dziura, J., Northrup, with postpartum depression. Journal of Advanced Nursing, 66, V., & Grey, M. (2009). Translating the diabetes prevention 1317–1327. program to primary care. Nursing Research, 58, 2–12..
Recommended publications
  • Real-World Data for Health Technology
    International Journal of Real-world data for health technology Technology Assessment in Health Care assessment for reimbursement decisions in Asia: current landscape and a way forward cambridge.org/thc Jing Lou1,* , Sarin KC2,*, Kai Yee Toh1, Saudamini Dabak2 , Amanda Adler3, Jeonghoon Ahn4 , Diana Beatriz S. Bayani1,5, Kelvin Chan6,7,8, Commentary Dechen Choiphel9, Brandon Chua10, Anne Julienne Genuino5, 5 11 1 12 *Joint first authors – contributed equally to Anna Melissa Guerrero , Brendon Kearney , Lydia Wenxin Lin , Yuehua Liu , the preparation of the first draft. Ryota Nakamura13, Fiona Pearce14, Shankar Prinja15 , Raoh-Fang Pwu16, Asrul †Joint senior authors – contributed equally to Akmal Shafie17, Binyan Sui12, Auliya Suwantika18, Yot Teerawattananon1,2,†, conceptualizing and designing the study, project management, supervising data Sean Tunis19, Hui-Min Wu16, John Zalcberg20,21, Kun Zhao12, collection and data analysis, critically revised 2,22,23, 1,24, the first draft and approved the final version. Wanrudee Isaranuwatchai † and Hwee-Lin Wee † Cite this article: Lou J et al (2020). Real-world 1Saw Swee Hock School of Public Health, National University of Singapore (NUS), Singapore, Singapore; 2Health data for health technology assessment for Intervention and Technology Assessment Program (HITAP), Ministry of Health, Mueang Nonthaburi, Thailand; reimbursement decisions in Asia: current 3National Institute for Health and Care Excellence (NICE), London, UK; 4Ewha Womans University, Seoul, South landscape and a way forward. International Korea; 5Health Technology Assessment Unit, Department of Health, Manila, Philippines; 6Sunnybrook Odette Journal of Technology Assessment in Health 7 8 – Cancer Centre, Toronto, Canada; Sunnybrook Research Institute, Toronto, Canada; Canadian Centre for Applied Care 36, 474 480.
    [Show full text]
  • Efficacy and Effectiveness Models
    Efficacy and Effectiveness models Graziano Onder Centro Medicina dell’Invecchiamento Università Cattolica del Sacro Cuore Rome - Italy EMA Workshop: Ensuring safe and effective medicines for an ageing population Definition Efficacy is the capacity to produce an effect. In medicine, it is the ability of an intervention or drug to produce a desired effect in expert hands and under ideal circumstances . Effectiveness is the capability of producing a desired result. In medicine, effectiveness relates to how well a treatment works in practice , as opposed to efficacy, which measures how well it works in RCT or laboratory studies. Ideal or real patient? Comorbidity Researchers have Multiple drugs largely shied away Physical function from the complexity Cognitive status Physical function of multiple chronic Affective status conditions Social status — avoidance that Incontinence results in expensive, COMPLEXITY COMPLEXITY Malnutrition potentially harmful care of unclear Falls benefit. Osteoporosis Tinetti M. NEJM2011 Efficacy and Effectiveness research Effectiveness research addresses practical questions about an intervention as it would occur in routine clinical practice, preserving the ‘ecology’ of care: hypothesis and study design are formulated based on information needed to make a decision. Efficacy research is aimed to better understand how and why an intervention works. Tunis SR. JAMA 2003 Efficacy and Effectiveness research 3 key features differentiates effectiveness (pragmatic or practical trials ) and efficacy research ( explanatory
    [Show full text]
  • LITERATURE SEARCHING Veterinary Medicine Year 1
    LITERATURE SEARCHING Veterinary Medicine Year 1 1 Wednesday, 11 November 2020 Literature Searching Presenter: Niala Dwarika-Bhagat Email: [email protected] 21/10/2020 2 Wednesday, 11 November 2020 Objectives To identify the 5 steps of Evidence-Based Veterinary Medicine (EBVM) To locate and determine resources for medical and health literature searching. Focus: o Database Searching – PubMed (free database) o Database Searching Ebscohost Medline (UWI Subscribed Databases) o Searching UWILinC o Locating e-Journals by subject To conduct effective hands-on online research To identify the FMS Vancouver referencing resources What is evidence-based medicine? "Evidence-based medicine (EBM) requires the integration of the best research with our clinical expertise and our patient's unique values and circumstances.“ From: Straus, Sharon E. (2005). Evidence-based medicine: How to practice and teach EBM, p. 1.[Source: https://veterinary-practice.com/article/embracing-evidence-based-medicine ] The practice of evidence-based medicine is a process of self-directed problem-based learning in which clinically relevant information about diagnosis, prognosis, and therapy is considered according to the best data available through research. [Source: https://www.medindia.net/patientinfo/evidence-based-medicine.htm#1 ] One commonly used definition of evidence-based medicine (EBM) is: “… the conscientious, explicit and judicious use of current best evidence in making decisions about the care of individual patients. The practice of EBM means integrating individual clinical expertise with the best available external clinical evidence from systematic research.” (Sackett et al., 2000) 4 Wednesday, 11 November 2020 What is EBVM? The practise of Evidence-Based Veterinary Medicine (EBVM) is the use of best available scientific evidence, in conjunction with clinical expertise and consideration of owner and patient factors, to make the best clinical decisions for patients.
    [Show full text]
  • Observational Clinical Research
    E REVIEW ARTICLE Clinical Research Methodology 2: Observational Clinical Research Daniel I. Sessler, MD, and Peter B. Imrey, PhD * † Case-control and cohort studies are invaluable research tools and provide the strongest fea- sible research designs for addressing some questions. Case-control studies usually involve retrospective data collection. Cohort studies can involve retrospective, ambidirectional, or prospective data collection. Observational studies are subject to errors attributable to selec- tion bias, confounding, measurement bias, and reverse causation—in addition to errors of chance. Confounding can be statistically controlled to the extent that potential factors are known and accurately measured, but, in practice, bias and unknown confounders usually remain additional potential sources of error, often of unknown magnitude and clinical impact. Causality—the most clinically useful relation between exposure and outcome—can rarely be defnitively determined from observational studies because intentional, controlled manipu- lations of exposures are not involved. In this article, we review several types of observa- tional clinical research: case series, comparative case-control and cohort studies, and hybrid designs in which case-control analyses are performed on selected members of cohorts. We also discuss the analytic issues that arise when groups to be compared in an observational study, such as patients receiving different therapies, are not comparable in other respects. (Anesth Analg 2015;121:1043–51) bservational clinical studies are attractive because Group, and the American Society of Anesthesiologists they are relatively inexpensive and, perhaps more Anesthesia Quality Institute. importantly, can be performed quickly if the required Recent retrospective perioperative studies include data O 1,2 data are already available.
    [Show full text]
  • NIH Definition of a Clinical Trial
    UNIVERSITY OF CALIFORNIA, SAN DIEGO HUMAN RESEARCH PROTECTIONS PROGRAM NIH Definition of a Clinical Trial The NIH has recently changed their definition of clinical trial. This Fact Sheet provides information regarding this change and what it means to investigators. NIH guidelines include the following: “Correctly identifying whether a study is considered to by NIH to be a clinical trial is crucial to how [the investigator] will: Select the right NIH funding opportunity announcement for [the investigator’s] research…Write the research strategy and human subjects section of the [investigator’s] grant application and contact proposal…Comply with appropriate policies and regulations, including registration and reporting in ClinicalTrials.gov.” NIH defines a clinical trial as “A research study in which one or more human subjects are prospectively assigned to one or more interventions (which may include placebo or other control) to evaluate the effects of those interventions on health-related biomedical or behavioral outcomes.” NIH notes, “The term “prospectively assigned” refers to a pre-defined process (e.g., randomization) specified in an approved protocol that stipulates the assignment of research subjects (individually or in clusters) to one or more arms (e.g., intervention, placebo, or other control) of a clinical trial. And, “An ‘intervention’ is defined as a manipulation of the subject or subject’s environment for the purpose of modifying one or more health-related biomedical or behavioral processes and/or endpoints. Examples include:
    [Show full text]
  • A National Strategy to Develop Pragmatic Clinical Trials Infrastructure
    A National Strategy to Develop Pragmatic Clinical Trials Infrastructure Thomas W. Concannon, Ph.D.1,2, Jeanne-Marie Guise, M.D., M.P.H.3, Rowena J. Dolor, M.D., M.H.S.4, Paul Meissner, M.S.P.H.5, Sean Tunis, M.D., M.P.H.6, Jerry A. Krishnan, M.D., Ph.D.7,8, Wilson D. Pace, M.D.9, Joel Saltz, M.D., Ph.D.10, William R. Hersh, M.D.3, Lloyd Michener, M.D.4, and Timothy S. Carey, M.D., M.P.H.11 Abstract An important challenge in comparative effectiveness research is the lack of infrastructure to support pragmatic clinical trials, which com- pare interventions in usual practice settings and subjects. These trials present challenges that differ from those of classical efficacy trials, which are conducted under ideal circumstances, in patients selected for their suitability, and with highly controlled protocols. In 2012, we launched a 1-year learning network to identify high-priority pragmatic clinical trials and to deploy research infrastructure through the NIH Clinical and Translational Science Awards Consortium that could be used to launch and sustain them. The network and infrastructure were initiated as a learning ground and shared resource for investigators and communities interested in developing pragmatic clinical trials. We followed a three-stage process of developing the network, prioritizing proposed trials, and implementing learning exercises that culminated in a 1-day network meeting at the end of the year. The year-long project resulted in five recommendations related to developing the network, enhancing community engagement, addressing regulatory challenges, advancing information technology, and developing research methods.
    [Show full text]
  • Patient Engagement in Health Research: a How-To Guide for Researchers
    Patient Engagement in Health Research: A How-to Guide for Researchers May 2018 (Version 8.0) Acknowledgement Thank you to all of the individuals and organizations who provided feedback on the iterations of this guide for researchers. • AbSPORU—Patient Engagement Platform Advisory Council (PEPAC) members • Alberta Health Services—Patient Engagement Reference Group • Alberta Health Services—Provincial Patient and Family Advisory Council • Alberta Health Services--Strategic Clinical Networks (Assistant Scientific Directors) • CIHR National Patient Engagement Working Group • IMAGINE Citizens • Individuals who took the Pragmatic Clinical Trials (PCT) course in September 2017, or participated in the PCT webinar in the Fall of 2017 Contents Overview 1 Why should I engage patients in health research? 1 How is patient engagement defined? 2 What does patient engagement in health research look like? 3 How does the “patient and researcher engagement in health research” 4 strategy differ from other participatory research approaches? How do I know I’m ready to engage patients in health research? 6 How do I use this Guide? 8 Step 1: Why 10 Why engage patients in health research? 10 What knowledge or perspectives do you seek from patients at the individual 11 level? Is research ethics approval required to engage patients in health research? 12 Step 2: Who 14 Who should I consider engaging in my research? 14 How many patients do I need to engage? 15 How do I decide how patients should be involved? 16 How do I find people to engage in my research? 19 Step
    [Show full text]
  • E 8 General Considerations for Clinical Trials
    European Medicines Agency March 1998 CPMP/ICH/291/95 ICH Topic E 8 General Considerations for Clinical Trials Step 5 NOTE FOR GUIDANCE ON GENERAL CONSIDERATIONS FOR CLINICAL TRIALS (CPMP/ICH/291/95) TRANSMISSION TO CPMP November 1996 TRANSMISSION TO INTERESTED PARTIES November 1996 DEADLINE FOR COMMENTS May 1997 FINAL APPROVAL BY CPMP September 1997 DATE FOR COMING INTO OPERATION March 1998 7 Westferry Circus, Canary Wharf, London, E14 4HB, UK Tel. (44-20) 74 18 85 75 Fax (44-20) 75 23 70 40 E-mail: [email protected] http://www.emea.eu.int EMEA 2006 Reproduction and/or distribution of this document is authorised for non commercial purposes only provided the EMEA is acknowledged GENERAL CONSIDERATIONS FOR CLINICAL TRIALS ICH Harmonised Tripartite Guideline Table of Contents 1. OBJECTIVES OF THIS DOCUMENT.............................................................................3 2. GENERAL PRINCIPLES...................................................................................................3 2.1 Protection of clinical trial subjects.............................................................................3 2.2 Scientific approach in design and analysis.................................................................3 3. DEVELOPMENT METHODOLOGY...............................................................................6 3.1 Considerations for the Development Plan..................................................................6 3.1.1 Non-Clinical Studies ........................................................................................6
    [Show full text]
  • Double Blind Trials Workshop
    Double Blind Trials Workshop Introduction These activities demonstrate how double blind trials are run, explaining what a placebo is and how the placebo effect works, how bias is removed as far as possible and how participants and trial medicines are randomised. Curriculum Links KS3: Science SQA Access, Intermediate and KS4: Biology Higher: Biology Keywords Double-blind trials randomisation observer bias clinical trials placebo effect designing a fair trial placebo Contents Activities Materials Activity 1 Placebo Effect Activity Activity 2 Observer Bias Activity 3 Double Blind Trial Role Cards for the Double Blind Trial Activity Testing Layout Background Information Medicines undergo a number of trials before they are declared fit for use (see classroom activity on Clinical Research for details). In the trial in the second activity, pupils compare two potential new sunscreens. This type of trial is done with healthy volunteers to see if the there are any side effects and to provide data to suggest the dosage needed. If there were no current best treatment then this sort of trial would also be done with patients to test for the effectiveness of the new medicine. How do scientists make sure that medicines are tested fairly? One thing they need to do is to find out if their tests are free of bias. Are the medicines really working, or do they just appear to be working? One difficulty in designing fair tests for medicines is the placebo effect. When patients are prescribed a treatment, especially by a doctor or expert they trust, the patient’s own belief in the treatment can cause the patient to produce a response.
    [Show full text]
  • Definition of Clinical Trials
    Clinical Trials A clinical trial is a prospective biomedical or behavioral research study of human subjects that is designed to answer specific questions about biomedical or behavioral interventions (vaccines, drugs, treatments, devices, or new ways of using known drugs, treatments, or devices). Clinical trials are used to determine whether new biomedical or behavioral interventions are safe, efficacious, and effective. Clinical trials include behavioral human subjects research involving an intervention to modify behavior (increasing the use of an intervention, willingness to pay for an intervention, etc.) Human subjects research to develop or evaluate clinical laboratory tests (e.g. imaging or molecular diagnostic tests) might be considered to be a clinical trial if the test will be used for medical decision-making for the subject or the test itself imposes more than minimal risk for subjects. Biomedical clinical trials of experimental drug, treatment, device or behavioral intervention may proceed through four phases: Phase I clinical trials test a new biomedical intervention in a small group of people (e.g., 20- 80) for the first time to evaluate safety (e.g., to determine a safe dosage range, and to identify side effects). Phase II clinical trials study the biomedical or behavioral intervention in a larger group of people (several hundred) to determine efficacy and to further evaluate its safety. Phase III studies investigate the efficacy of the biomedical or behavioral intervention in large groups of human subjects (from several hundred to several thousand) by comparing the intervention to other standard or experimental interventions as well as to monitor adverse effects, and to collect information that will allow the intervention to be used safely.
    [Show full text]
  • E Resources in the Medical Sciences
    E-RESOURCES IN THE MEDICAL SCIENCES E-RESOURCES IN THE MEDICAL SCIENCES Presenter: Niala Dwarika-Bhagat October 2020 OBJECTIVES • To understand literature searching within a basic EBM (Evidence Based Medicine) framework. • Online Resources: to expose participants to databases - free and library-subscribed - available for medical/health sciences research. • Search Strategy: basic introduction • Hands-on: hands-on opportunity is included and databases – free / subscribed would be explored. What is EBM and why should I care? BMJ: • It's about integrating individual clinical expertise and the best external evidence. • Good doctors use both individual clinical expertise and the best available external evidence, and neither alone is enough. • Evidence based medicine is the conscientious, explicit, and judicious use of current best evidence in making decisions about the care of individual patients. • Evidence based medicine is not “cookbook” medicine. • Without clinical expertise, practice risks becoming tyrannised by evidence, for even excellent external evidence may be inapplicable to or inappropriate for an individual patient. • Without current best evidence, practice risks becoming rapidly out of date, to the detriment of patients. • Evidence based medicine is not restricted to randomised trials and meta-analyses. It involves tracking down the best external evidence with which to answer our clinical questions. Source: https://www.bmj.com/content/312/7023/71.full.print What EBM skills do you need? • Information mastery find the best evidence for every day practice • Assessment - relevance before rigor. Is the evidence patient- oriented? • Evaluation- information about therapies, diagnostic tests, and clinical decision rules. Understand basic statistics. • Efficiency - having at fingertips "just in time" information at the point of care using web based and/or handheld computer based information and tools for clinical decision making • Evaluation - expert-based information, including colleagues, presentations, reviews and guidelines.
    [Show full text]
  • Sample Research Protocol
    Protocol REVITA 2018 April 9, 2018 A Clinical Investigation Evaluating Efficacy of a Full- Thickness Placental Allograft (Revita®) in Lumbar Microdiscectomy Outcomes Primary Investigator: Thomas Morrison III, MD Northside Hospital 1000 Johnson Ferry RD. N.E., Atlanta, GA 30342 Phone: 404-256-2633 Fax: 404-255-6532 Sponsor: StimLabs 1225 Northmeadow Parkway, Suite 104, Roswell, GA 30076 Phone: 888-346-9802 Fax: 470-719-2085 Confidential Page 1 of 19 Protocol REVITA 2018 April 9, 2018 STUDY SUMMARY A Clinical Investigation Evaluating Efficacy of a Full-Thickness Title Placental Allograft (Revita) in Lumbar Microdiscectomy Outcomes Methodology Randomized, controlled trial, blind study Estimated duration for the main protocol (e.g. from start of Study Duration screening to last subject processed and finishing the study) is approximately 2.5 years Multi-center (Polaris Spine and Neurosurgery Center, Atlanta, GA Study Center(s) and Northside Hospital, Atlanta, GA) Primary Objective: To evaluate the efficacy of Revita full thickness placental allograft in improving back and leg pain post- microdiscectomy Objectives Secondary Objectives: To evaluate post-microdiscectomy reherniation rate in patients treated with Revita Number of 182 randomized patients in two arms; Treatment and Control Subjects Inclusion Criteria - Male and female patients, 18-70 years old, in any distribution. - Symptomatic with radiating low back and leg pain for greater than 6 months prior to surgery with a clinical diagnosis of lumbar protruding disc. Diagnosis and - Consent and compliance with all aspects of the study Main Inclusion protocol, methods, providing data during follow-up contact Criteria - See methods section for full list of inclusion criteria Exclusion Criteria - Male and female patients younger than 18 years old or older than 70 years old.
    [Show full text]