Using Real-World Data and Artificial Intelligence to Advance Health Services Research

Total Page:16

File Type:pdf, Size:1020Kb

Using Real-World Data and Artificial Intelligence to Advance Health Services Research Using Real-World Data and Artificial Intelligence to Advance Health Services Research Summary Background The field of health services research (HSR) can capitalize on In recent years, advances in computing power have enabled re- burgeoning sources of real-world data to parse new and perennial searchers to leverage complex, large, and novel data sources to reveal questions about health care costs, quality, and access, as well as new insights for decision-makers. While data science has spread into potentially increase the timeliness and relevance of research find- many sectors, HSR has been relatively slow to incorporate new data ings. But first, the field must prepare the infrastructure, including sources and analytics into the field’s methodological toolbox. academia, research funding, and peer-reviewed publications, to deliver on the promise and avoid the pitfalls of greater and more so- The AcademyHealth Paradigm Project, supported by the Robert phisticated use of real-world data. While researchers have long used Wood Johnson Foundation, is a concerted, collaborative effort structured real-world data like claims to answer questions in policy to increase the relevance, timeliness, quality, and impact of HSR and practice, myriad new unstructured data sources, including free through innovation.1 AcademyHealth, through the Paradigm text in electronic health records (EHRs) and images from X-rays Project, convened a February 2021 meeting to explore using real- and other technologies, are emerging for exploration. Similarly, world data—also sometimes referred to as “big data”—and related new methodologies, such as machine learning and natural language artificial intelligence methods, such as machine learning and natu- processing, are being applied to real-world data to gain deeper ral language processing, to enhance HSR capabilities to improve insights about which care is right for which patients. This brief health and health care. Over the course of two afternoons, a group summarizes key points from a February 2021 meeting convened by of health services researchers and data experts discussed how AcademyHealth to examine greater use of real-world data in HSR real-world data and evidence can complement traditional HSR ap- and related issues, including safeguarding against the introduction proaches to identify and answer questions relevant to health policy of racial and other biases; addressing privacy concerns; establish- and practice. Among the topics explored, participants discussed: ing data standards; developing data resources as public goods; and helping researchers gain needed skills to design and conduct studies • Using nontraditional data sources and artificial intelligence meth- and interpret and disseminate findings. ods alongside traditional HSR approaches to answer questions related to health care costs, quality, and access. Genesis of this Brief: This brief is based on a meeting of researchers and research users that took place virtually on February 24-25, 2021. AcademyHealth convened the meeting as part of its Paradigm Project, a concerted, collaborative effort to increase the relevance, timeliness, quality, and impact of health services research (HSR). Funded by the Robert Wood Johnson Foundation, the project is ideating and testing new ways to ensure HSR realizes its full potential to improve health and the delivery of health care. The Paradigm Project is designed to push HSR out of its comfort zone—to ask what works now, what doesn’t, and what might work in the future. Additional information may be found on the project’s website at https://academyhealth.org/ParadigmProject. Using Real-World Data and Artificial Intelligence to Advance Health Services Research • Tapping real-world data sources to untangle the causal inference prove access,” a participant said, adding that such analyses can help of policy and practice interventions on heterogeneous subgroups. counter “policymakers routinely saying to health services research- ers, we’re too slow.” • Preparing the HSR infrastructure, including academia, research funding, and peer-reviewed publications, to capitalize on the Volume. Velocity. Variety. Veracity. Value. promise and avoid the pitfalls of real-world data. The so-called five Vs offer a helpful context to grasp the concept of big data.4 As the volume, velocity, and variety of real-world data • Applying research findings to answer real-world policy and prac- increase—fed by the exponential growth of digital information tice questions related to improving health and health care. generated in the connected world we live in—ensuring the veracity This brief summarizes the February meeting discussion, including and unlocking the value of real-world health data falls squarely in using real-world data and analytics to move beyond average effects; the HSR wheelhouse. While the field has long used structured real- safeguarding against the introduction of racial, ethnic, and other world data like claims to answer research questions, myriad new biases in real-world data analysis; addressing privacy concerns; es- unstructured data sources, including free text in EHRs and images tablishing standards; developing data resources as public goods; and from X-rays and other technologies, are emerging for exploration. helping researchers gain needed skills to design and conduct studies Similarly, new methodologies, such as machine learning and natu- and interpret and disseminate findings. The brief also examines the ral language processing, are being applied to real-world data to gain implications of greater use of real-world data for research funders, deeper insights beyond traditional randomized controlled trials. academia, peer-reviewed journals, and other aspects of the HSR ecosystem, including AcademyHealth. Because the session was off A form of artificial intelligence, machine learning essentially the record, the brief conveys the general content of the meeting enables computers to learn and adapt by analyzing and drawing without attributing specific comments to particular participants. inferences from patterns in large datasets. Algorithms, or the step- The discussion was informed by existing research though neither by-step rules used in problem-solving calculations, are the fuel of the discussion nor this brief incorporates a systematic review of the machine learning. Similarly, natural language processing, or NLP, literature related to using real-world data in HSR. A bibliography of is another form of artificial intelligence that “helps computers un- some relevant, current literature is included at the end of the brief. derstand, interpret and manipulate human language.”5 An offspring of linguistics, NLP enables computer software not only to read text Real-World Data in Health Care and hear speech but interpret language, measure sentiment, and The U.S. Food and Drug Administration defines real-world data determine importance. as “data relating to patient health status and/or the delivery of health care routinely collected from a variety of sources.”2 Along Moving Beyond Average Effects to Precision HSR with more traditional retrospective observational and survey data, Increasingly, researchers are using real-world data and machine real-world data can include information from EHRs, administrative learning to move beyond average effects captured by random- and claims data, registries, patient-reported outcomes and wearable ized controlled trials. The goal is to pin down causal inference for sensors, measures of social determinants of health, environmental subgroups that may respond differently to new drugs and medical exposures, and even clicks on a webpage, tweets, and geolocation devices post market, or perhaps even more importantly, identify- data from smartphones and other mobile devices. Common users ing more generally across practice which tests and medical proce- of real-world data and related research include pharmaceutical dures work best for which patients, according to participants at the companies, payers and purchasers, providers, policymakers, and Paradigm Project gathering. Similarly, recent studies using machine patients.3 learning to analyze large complex datasets have pinpointed patient- level differences related to physicians ordering low-value care and In one example of how real-world data may increase the timeliness the impact of increased patient cost sharing for prescription drugs. of HSR findings for policymakers, researchers are using geoloca- tion data from 45 million smartphones to understand health care In the first study, researchers created algorithmic predictions of utilization and social mobility during the COVID-19 pandemic the results of testing patients in emergency departments for heart by examining people’s visits to hospitals, physician offices, dental attacks. Using traditional analytic approaches, the testing on average offices, and other health care sites. “This dataset has allowed us to appeared to be cost-effective. But the analysis powered by machine look at these utilization patterns and see how they’re changing in learning that accounted for more granular patient-level differences real time, such that policymakers may be able to make closer to found that almost half of the tests should never have been ordered, real-time adjustments, whether in payment policy or trying to im- and even more importantly, many patients who should have been 2 Using Real-World Data and Artificial Intelligence to Advance Health Services Research tested were not.6 In the second study, researchers
Recommended publications
  • Artificial Intelligence in Health Care: the Hope, the Hype, the Promise, the Peril
    Artificial Intelligence in Health Care: The Hope, the Hype, the Promise, the Peril Michael Matheny, Sonoo Thadaney Israni, Mahnoor Ahmed, and Danielle Whicher, Editors WASHINGTON, DC NAM.EDU PREPUBLICATION COPY - Uncorrected Proofs NATIONAL ACADEMY OF MEDICINE • 500 Fifth Street, NW • WASHINGTON, DC 20001 NOTICE: This publication has undergone peer review according to procedures established by the National Academy of Medicine (NAM). Publication by the NAM worthy of public attention, but does not constitute endorsement of conclusions and recommendationssignifies that it is the by productthe NAM. of The a carefully views presented considered in processthis publication and is a contributionare those of individual contributors and do not represent formal consensus positions of the authors’ organizations; the NAM; or the National Academies of Sciences, Engineering, and Medicine. Library of Congress Cataloging-in-Publication Data to Come Copyright 2019 by the National Academy of Sciences. All rights reserved. Printed in the United States of America. Suggested citation: Matheny, M., S. Thadaney Israni, M. Ahmed, and D. Whicher, Editors. 2019. Artificial Intelligence in Health Care: The Hope, the Hype, the Promise, the Peril. NAM Special Publication. Washington, DC: National Academy of Medicine. PREPUBLICATION COPY - Uncorrected Proofs “Knowing is not enough; we must apply. Willing is not enough; we must do.” --GOETHE PREPUBLICATION COPY - Uncorrected Proofs ABOUT THE NATIONAL ACADEMY OF MEDICINE The National Academy of Medicine is one of three Academies constituting the Nation- al Academies of Sciences, Engineering, and Medicine (the National Academies). The Na- tional Academies provide independent, objective analysis and advice to the nation and conduct other activities to solve complex problems and inform public policy decisions.
    [Show full text]
  • Artificial Intelligence: the Key to Unlocking Novel Real-World Data?
    Artificial Intelligence: The Key to Unlocking Novel Real-World Data? While Artificial intelligence stands to make significant contributions to clinical research due to its unparalleled ability to translate unstructured data into real-world evidence (RWE), significant challenges remain in achieving regulatory-grade evidence. By Michele Cleary 16 | March/April 2019 Value & Outcomes Spotlight Artificial intelligence (AI) is revolutionizing healthcare services. From improving disease detection to supporting treatment decision making, AI has become ubiquitous in care delivery. Now AI is poised to transform the drug and device development process, helping researchers refine the approval process and significantly cutting both the time and the expense needed to bring products to market. While AI has long been used to facilitate recruitment of study subjects, optimize study design, and support patient adherence to study protocols, AI’s greatest contribution to clinical research may still be on the horizon— unlocking the data richness that lies within the mountains of novel real- world data (RWD) sources. This article explores how AI may improve clinical research through its ability to better translate RWD into real-world evidence (RWE), thus providing more valid evidence of clinical benefits and risks. Dan Riskin, MD, of Verantos, Rich Glinklich, MD of OM1, and Sebastian Schneeweiss, MD of Aetion all shared their valuable insights into how AI is transforming clinical research. THE SEARCH FOR REGULATORY-GRADE DATA With innovations in digital data, HEOR researchers are facing explosive growth in novel RWD sources. But as researchers move from traditional RWD sources (eg, registries and claims data) to these novel data sources, unstructured data present a significant opportunity and challenge.
    [Show full text]
  • Using Real World Data in Pharmacoeconomic Evaluations
    Using Real World Data in Pharmacoeconomic Evaluations: Challenges, Opportunities, and Approaches Andreas M. Pleil, PhD Senior Director Worldwide Medical and Outcomes Research Pfizer, Inc., La Jolla, CA Slide:2 Disclaimer and Acknowledgements The opinions expressed by the presenter are his and may not reflect the opinions or position of Pfizer, Inc., it’s Board or Management Many thanks to Lou Garrison for allowing me to steal many of these slides shamelessly Slide:3 Today’s Agenda Overview of the Landscape Where do data come from Report from the Task Force What was their charge Who did the charging What did they conclude Discussion points Is the RWTF sufficient Are there gaps in our knowledge What should we do next Applications from your world Group Project Slide:4 Where do “Data” Come From? Pre-clinical studies Provides a first assessment of the expected safety and efficacy of a compound using proven animal models Early Phase Clinical trials IND Safety focus and the beginnings of efficacy, dose ranging, and tolerability Pivotal Clinical trials Demonstrate safety and efficacy in well controlled (generally masked) randomized studies sufficient for market authorization NDA Filed Phase IIIB Expanded trials in different use situations NDA Approved or populations Phase IV Post marketing safety or “new” indications Real World Data Evaluations of safety, effectiveness and outcomes in “routine” clinical practice Slide:5 Who uses “Data”? Companies making internal decision regarding drug development Regulators responsible
    [Show full text]
  • Generating Real-World Evidence by Strengthening Real-World Data Sources
    Generating Real-World Evidence by Strengthening Real-World Data Sources Using “real-world evidence” to bring new “Every day, health care professionals are updating patients’ treatments to patients as part of the 21st electronic health records with data on clinical outcomes Century Cures Act (the “Cures Act”) is a key resulting from medical interventions used in routine clinical priority for the Department of Health and practice. As our experience with new medical products Human Services (HHS). Specifically, the Cures expands, our knowledge about how to best maximize their Act places focus on the use of real-world data benefits and minimize potential risks sharpens with each data to support regulatory decision-making, including point we gather. Every clinical use of a product produces data the approval of new indications for existing that can help better inform us about its safety and efficacy.” drugs in order to make drug development faster jacqueline corrigan-curay, md, jd and more efficient. As such, the Cures Act director of the office of medical policy in fda’s center for drug evaluation and research has tasked the Food and Drug Administration (FDA) to develop a framework and guidance for evaluating real-world evidence in the context of drug regulation.1 Under the FDA’s framework, real-world evidence (RWE) is generated by different study designs or analyses, including but not limited to, randomized trials like large simple trials, pragmatic trials, and observational studies. RWE is the clinical evidence about the use, potential benefits, and potential risks of a medical product based on an analysis of real-world data (RWD).
    [Show full text]
  • Using Real-World Evidence to Accelerate Safe and Effective Cures Advancing Medical Innovation for a Healthier America June 2016 Leadership Senator William H
    Using Real-World Evidence to Accelerate Safe and Effective Cures Advancing Medical Innovation for a Healthier America June 2016 Leadership Senator William H. Frist, MD Former U.S. Senate Majority Leader Chair, FDA: Advancing Medical Innovation Bipartisan Policy Center Representative Bart Gordon Former Member, U.S. House of Representatives Chair, FDA: Advancing Medical Innovation Bipartisan Policy Center Advisory Committee Marc M. Boutin, JD Chief Executive Officer National Health Council Mark McClellan, MD, PhD Director, Robert J. Margolis Center for Health Policy Duke University Patrick Soon-Shiong, MD Chairman and Chief Executive Officer Institute for Advanced Health Andrew von Eschenbach, MD President Samaritan Health Initiatives 1 Sta G. William Hoagland Ann Gordon Senior Vice President Writer Bipartisan Policy Center Michael Ibara, PharmD Janet M. Marchibroda Independent Consultant Director, Health Innovation Initiative and Executive Director, CEO Council on Health and Innovation Bipartisan Policy Center Tim Swope Senior Policy Analyst Bipartisan Policy Center Sam Watters Administrative Assistant Bipartisan Policy Center 2 FDA: ADVANCING MEDICAL INNOVATION EFFORT The Bipartisan Policy Center’s initiative, FDA: Advancing Medical Innovation, is developing viable policy options to advance medical innovation and reduce the time and cost associated with the discovery, development, and delivery of safe and effective drugs and devices for patients in the United States. Key areas of focus include the following: Improving the medical product development process; Increasing regulatory clarity; Strengthening the Food and Drug Administration’s (FDA) ability to carry out its mission; Using information technology to improve health and health care; and Increasing investment in medical products to address unmet and public health needs.
    [Show full text]
  • Korea Sukyeong Kim, Phd Senior Research Fellow, International Cooperation Advisor Evidence-Based Healthcare Research Division
    Real World Evidence and Local Evidence Generation: How Should it Be Approached in Asia Pacific? - Korea Sukyeong Kim, PhD Senior Research Fellow, International Cooperation Advisor Evidence-based Healthcare Research Division Real World Data & Real World Evidence • Real World Data o The data relating to patient health status and/ or the delivery of health care routinely collected from a variety of sources • Electronic health records (EHRs) • Claims and billing activities • Product and disease registries • Patient-related activities in out-patient or in-home use settings • Health-monitoring devices • Real World Evidence o The clinical evidence regarding the usage and potential benefits or risks of medical product derived from analysis of Real World Data FDA. Real World Evidence. https://www.fda.gov/ScienceResearch/SpecialTopics/RealWorldEvidence/default.htm 2 1 NHI system and Real World Data • National Health Insurance System o Operating based on Electronic Data Interchange and web-base claims submission 3 Real World Data • Medical Record o Electronic Medical Record in Hospitals and Clinics • Facilitated by electronic National Health Insurance Claims Review and Assessment system building • Tertiary hospitals have been leading Electronic Medical Record and hospital Information and Communication System • Medium and small hospitals and clinics adopted EMR system around 97% in 2014 4 2 Real World Data • National Health Insurance Information System o Electronic NHI Claims Review and Assessment System • Based on web-based claims submission 5 Real
    [Show full text]
  • Premier Healthcare Database
    WHITE PAPER: PREMIER HOSPITAL DATABASE (PHD) – March 2, 2020 Premier Healthcare Database: Data That Informs and Performs Premier Applied Sciences®, the Research Division of Premier Inc. March 2, 2020 This white paper provides a detailed description of the attributes and capabilities of the Premier Healthcare Database (PHD), which has been utilized by the pharmaceutical and device industries, academia, healthcare insurers and healthcare policy makers For clinical, financial and outcomes analyses. Since the year 2000, more than 600 publications in peer- reviewed journals – the gold standard for publishing research – have included more than 110 articles written by Premier stafF in multiple therapeutic and quality improvement/patient safety areas (Premier Applied Sciences® website). Details on data source, type and scope are outlined. Premier Applied Sciences® is the Research Division of Premier Inc. and is responsible For leveraging the HIPAA-compliant PHD through its highly proFessional and experienced team. SUGGESTED CITATION: Premier Healthcare Database White Paper: Data that informs and performs, March 2, 2020. Premier Applied Sciences®, Premier Inc. https://learn.premierinc.com/white-papers/premier-healthcare- database-whitepaper. 1 WHITE PAPER: PREMIER HOSPITAL DATABASE (PHD) – March 2, 2020 INTRODUCTION Electronic healthcare databases house “big data” and offer several advantages as a robust research tool1-3. A comprehensive hospital-based healthcare history of each patient in the healthcare system may be available. Patients and physicians are not involved in data collection, thus eliminating potential bias that may come with being observed. Since data accrues from a large diverse population, rare outcomes and long-term effects can be studied. The data reflects the state of clinical practice in the general population.
    [Show full text]
  • Optimizing Rwe Generation Fda's
    appliedclinicaltrialsonline.com Volume 28 Number 4 April 2019 YOUR PEER-REVIEWED GUIDE TO GLOBAL CLINICAL TRIALS MANAGEMENT 1992–2019 ACTAACCT 2727 e Year c of Servi STUDY DESIGN OPTIMIZING RWE GENERATION REGULATORY For personal, non-commercial use FDA’S ‘REAL-WORLD’ FRAMEWORK DATA SHARING ADOPTING GLOBAL DATA STANDARDS WASHINGTON REPORT EU REPORT CLOSING THOUGHT The Push to Broaden Clinical Translational Research Message Rise of the ‘Citizen Trial Eligibility Criteria Lost in Transmission Data Scientist’ FROM THE EDITOR Emerging Biopharma Deserve TLC from CROs arly this month, I presented on the topic was 26%, compared to 60% that went to firms that had never before E“Why Aren’t Lessons Learned from Big received an approval. Pharma/Big CROs Translating to Smaller The days of quickly selling a promising compound early on to a large Biopharma Relationships?” For years, Applied pharma company or launching a full-fledged IPO are dwindling. An Ernst Clinical Trials has been the operational re- & Young report showed 75 biotech IPOs in 2014 compared to nine in the source for clinical trials for sponsors, CROs, second half of 2016. These days, innovation hubs in major regions of the and academia. The transition of the contract country are home to a vast number of companies looking to enter clini- research industry from a small cottage to a cal trials, take their compound at least through Phase II, and some are LISA HENDERSON fully-matured one has seen numerous out- fully intending to stick it through Phase III and even make it to a com- Editor-in-Chief sourcing models from the low-touch, very fo- mercial stage company.
    [Show full text]
  • Real World Data Analysis Shows That Persistent Hypertriglyceridemia Despite Statin Therapy Is Associated with Cardiovascular Risk
    November 14, 2017 Real World Data Analysis Shows That Persistent Hypertriglyceridemia Despite Statin Therapy is Associated With Cardiovascular Risk High Triglyceride Levels Associated with 30% Increased Risk of Myocardial Infarction & Coronary Revascularization and 13% Overall Increase in Major Adverse Cardiovascular Events BEDMINSTER, N.J. and DUBLIN, Ireland, Nov. 14, 2017 (GLOBE NEWSWIRE) -- Amarin Corporation plc (NASDAQ:AMRN), a biopharmaceutical company focused on the commercialization and development of therapeutics to improve cardiovascular health, announced data analysis orally presented today at the American Heart Association (AHA) 2017 Scientific Sessions in Anaheim, California. The oral presentation used real world evidence (RWE) as a basis for the analysis. This analysis of RWE is separate from and independent of the RWE analysis referenced in Amarin's press release on November 12, 2017. The oral presentation, "Increased Cardiovascular Risk in Patients with Statin-Controlled LDL Cholesterol and Residual Hypertriglyceridemia," was done in collaboration with Gregory A. Nichols, PhD, from Kaiser Permanente Center for Health Research, and Sergio Fazio, MD, PhD, Director, Center for Preventive Cardiology, Oregon Health & Science University, Portland, OR. The study analyzed data from the Southern California and Northwest regions of Kaiser Permanente, one of America's leading health care providers and not-for-profit health plans. The patients selected had a diagnosis of atherosclerotic cardiovascular disease (ASCVD: myocardial infarction [MI], ischemic stroke, and peripheral artery disease) and had statin-controlled LDL cholesterol (LDL-C). The study concluded that during the study period, despite statin-controlled LDL-C levels, ASCVD events were greater among patients with ASCVD and high (200-499 mg/dL, n=2,361) vs.
    [Show full text]
  • Emergence of Real World Evidence in Precision Medicine
    Chapter 36 Emergence of Real World Evidence in Precision Medicine Neil A. Belson, MS, JD Law Office of Neil A. Belson, LLC, Port Tobacco, Maryland, USA Keywords: real world evidence, real world data, health economics, HEOR, drug development, drug approval, clinical evidence, drug regulation, US Food and Drug Administration, randomized clinical trials, natural history studies, rare diseases, precision medicine, personalized medicine, patient registries, disease registries, product registries, 21st Century America Cures Act, electronic health records, research and development, guidance documents, Expanded Access Program 36.1 Introduction In June 2017, the US Food and Drug Administration (FDA) approved a new indication for a medical device without requiring the device manufacturer to conduct any new clinical trials. Instead, the Agency relied on the manufacturer’s “Real World Evidence” accelerated the time to FDA approval: Relying on traditional (RWE) demonstrating safety and efficacy. Using RWE dramatically The Road from Nanomedicine to Precision Medicine Edited by Shaker A. Mousa, Raj Bawa, and Gerald F. Audette Copyright © 2020 Jenny Stanford Publishing Pte. Ltd. ISBN 978-981-4800-59-4 (Hardcover), 978-0-429-29501-0 (eBook) www.jennystanford.com Emergence of Real World Evidence in Precision Medicine clinical trials the United States had been only the 42nd nation to approve the original use of the device, a transcatheterbecome aortic valve replacement (TAVR). In contrast, using RWE in its regulatory decision-making process allowed the United States to the first country to approve a new valve-in-valve procedure for the device [1, 2]. This device approval demonstrated the emergence of RWE as a potentially transformative new tool in personalized medical care and drug development and regulation.
    [Show full text]
  • Next Steps for Using Real World Evidence
    Next steps for using real world evidence Summary report of a FORUM follow-up roundtable held on 24 January 2018 The Academy of Medical Sciences The Academy of Medical Sciences is the independent body in the UK representing the diversity of medical science. Our mission is to promote medical science and its translation into benefits for society. The Academy’s elected Fellows are the United Kingdom’s leading medical scientists from hospitals, academia, industry and the public service. We work with them to promote excellence, influence policy to improve health and wealth, nurture the next generation of medical researchers, link academia, industry and the NHS, seize international opportunities and encourage dialogue about the medical sciences. Academy of Medical Sciences’ FORUM The Academy’s FORUM was established in 2003 to recognise the role of industry in medical research, and to catalyse connections across industry, academia and the NHS. Since then, a range of FORUM activities and events have brought together researchers, research funders and research users from across academia, industry, government, and the charity, healthcare and regulatory sectors. The FORUM network helps address our strategic challenge ‘To harness our expertise and convening power to tackle the biggest scientific and health challenges and opportunities facing our society’ as set in our Strategy 2017-21. We are grateful for the support provided by the members and are keen to encourage more organisations to take part. If you would like further information on the FORUM or becoming a member, please contact [email protected]. Opinions expressed in this report do not necessarily represent the views of all participants at the event, the Academy of Medical Sciences, or its Fellows.
    [Show full text]
  • Real-World Evidence to Guide the Approval and Use of New Treatments Steven Galson, Amgen, and Gregory Simon, Group Health Research Institute
    DISCUSSION PAPER Real-World Evidence to Guide the Approval and Use of New Treatments Steven Galson, Amgen, and Gregory Simon, Group Health Research Institute October 18, 2016 Current State Effectiveness The Focus of Traditional Evidence Generation on Traditional efficacy trials typically aim to evaluate a Narrow Questions Regarding Efficacy and Safety single treatment rigorously. In contrast, patients, pro- viders, and health systems choose among alternative Research regarding new treatments (drugs, biologi- treatments on the basis of net benefit in real-world cal products, and high-risk devices) often begins with practice. Real-world effectiveness may differ substan- a broad assessment of disease epidemiology, disease tially from efficacy detected in the traditional clinical burden, and shortcomings of existing treatments. That trial setting. Factors contributing to that efficacy–effec- research may draw from diverse data sources, includ- tiveness gap include variation in practice settings, pro- ing real-world data generated by health system opera- vider decision making, patient adherence, co-occurring tions (see Figure 1). conditions, and concomitant treatments. In a clinical The clinical research phase of treatment develop- trial designed to assess efficacy, these factors would ment typically follows a well-established pathway from be considered sources of noise or error, and trial de- initial evaluation of safety to preliminary evaluation of sign would attempt to minimize variation. In everyday therapeutic efficacy to pivotal trials intended to sup- clinical practice, these sources of variation are directly port regulatory approval for marketing. Those pivotal relevant to practical decisions by patients and provid- trials focus on key questions of efficacy (typically in ers and are central to the information stakeholders comparison to placebo or some analogous control need to inform practical decisions.
    [Show full text]