Research Report

Measures and Methodology for International Comparisons of System Performance

Final Report

Laurie T. Martin, Carl Berdahl, Rachel M. Burns, Emily Hoch,

Evan D. Peet, Peter S. Hussey

C O R P O R A T I O N For more information on this publication, visit www.rand.org/t/RRA171-1

Published by the RAND Corporation, Santa Monica, Calif. © Copyright 2021 RAND Corporation R® is a registered trademark.

Limited Print and Electronic Distribution Rights This document and trademark(s) contained herein are protected by law. This representation of RAND intellectual property is provided for noncommercial use only. Unauthorized posting of this publication online is prohibited. Permission is given to duplicate this document for personal use only, as long as it is unaltered and complete. Permission is required from RAND to reproduce, or reuse in another form, any of its research documents for commercial use. For information on reprint and linking permissions, please visit www.rand.org/pubs/permissions.

The RAND Corporation is a research organization that develops solutions to public policy challenges to help make communities throughout the world safer and more secure, healthier and more prosperous. RAND is nonprofit, nonpartisan, and committed to the public interest.

RAND’s publications do not necessarily reflect the opinions of its research clients and sponsors.

www.rand.org Preface

Compared with other Organisation for Economic Co-operation and Development (OECD) member countries, the ranks lower on several notable health-related outcomes, such as infant mortality, that tend to be overemphasized by stakeholders and used as a marker of health care system performance. However, the driving factors contributing to many of these rankings could be attributed to factors outside of the health care system, such as greater inequality, less social protection, population density, and societal preferences. Concerns have also been raised around the variability in data availability and quality within the United States and abroad, which can introduce bias or make international comparisons more difficult. Given the increasingly important question of what the United States is buying for its health expenditures and interest in understanding what factors of the contribute to better health outcomes, in 2020, the Immediate Office of the Secretary of the U.S. Department of Health and Human Services (HHS) sought to identify measures that could improve the ability of the United States and other countries to learn from international comparisons of health system performance specifically. To inform the identification of measures for international comparison that could eventually be proposed to OECD, RAND Corporation researchers worked with a diverse group of 15 experts in quality measurement, clinical care, and to generate and prioritize potential measure constructs that align with HHS priorities and are particularly promising for international comparisons. With few exceptions, the measure constructs identified as most promising will require additional development work to establish their operational definitions and specifications to ensure that any measure developed is valid and feasible for international comparisons of health system performance. This report is designed to lay a strong foundation for these future refinements by noting the degree of consensus among experts about the importance, scientific acceptability, feasibility, and usability of measure constructs; summarizing the strengths and limitations of the measure constructs; and providing additional context that can be useful for informing the selection of measure constructs that might ultimately be developed into measures and proposed to OECD for consideration. This research was funded by the Office of the Assistant Secretary for Planning and Evaluation, HHS (Contract No. HHSP233201500038I), and carried out within the Payment, Cost, and Coverage Program in RAND Health Care. RAND Health Care, a division of the RAND Corporation, promotes healthier societies by improving health care systems in the United States and other countries. We do this by providing health care decisionmakers, practitioners, and consumers with actionable, rigorous, objective evidence to support their most complex decisions. For more information, see www.rand.org/health-care, or contact

iii

RAND Health Care Communications 1776 Main Street P.O. Box 2138 Santa Monica, CA 90407-2138 (310) 393-0411, ext. 7775 [email protected]

iv Abstract

In 2020, the Immediate Office of the Secretary of the U.S. Department of Health and Human Services (HHS) sought to identify measures that could improve the ability of the United States and other countries to learn from international comparisons of health system performance. To inform the identification of measures for international comparison that could eventually be proposed to the Organisation for Economic Co-operation and Development (OECD), RAND Corporation researchers worked with a diverse group of 15 experts in quality measurement, clinical care, and health economics to generate and prioritize potential measure constructs that align with HHS priorities and are particularly promising for international comparisons. The authors implemented a modified Delphi panel approach using RAND’s ExpertLens platform. This process occurred in three phases. Phase 1 involved the identification of measure constructs that should be considered for inclusion in the expert rating process. Phase 2 was the initial assessment of each measure construct by experts against prespecified rating criteria. Phase 3 was a virtual convening of experts to discuss the ratings, explore areas of disagreement, and allow experts to adjust ratings, if desired. Eight measure constructs were identified as having the most promise for international comparison, but they will require additional development work to establish their operational definitions and specifications to ensure that any measure developed is valid and feasible for international comparisons of health system performance. This report is designed to lay a strong foundation for these future refinements by noting the degree of consensus among experts about the importance, scientific acceptability, perceived feasibility, and usability of measure constructs; summarizing the strengths and limitations of the measure constructs; and providing additional context that can be useful for informing the selection of measure constructs that might ultimately be developed into measures and proposed to OECD for consideration.

v Contents

Preface ...... iii Abstract ...... v Figures ...... x Tables ...... xi Summary ...... xiii Acknowledgments ...... xix Abbreviations ...... xx 1. Introduction ...... 1 Methods ...... 2 Phase 1: Identification of Measure Constructs That Should Be Considered ...... 2 Phase 2: Evaluation of Each Measure Construct Against Prespecified Criteria ...... 3 Phase 3: Convene, Discuss, and Adjust Ratings ...... 4 Organization of This Report ...... 6 2. Measure Constructs That Hold the Most Promise for International Comparisons ...... 7 Treatment and Control of Hypertension ...... 7 Description Provided in Evidence Table ...... 7 Strengths and Limitations ...... 8 What Is Needed to Move This Measure Forward ...... 9 Access to and Coverage for Telehealth ...... 9 Description Provided in Evidence Table ...... 9 Strengths and Limitations ...... 9 What Is Needed to Move This Measure Forward ...... 11 Quality-Adjusted Life Expectancy ...... 12 Description Provided in Evidence Table ...... 12 Strengths and Limitations ...... 12 What Is Needed to Move This Measure Forward ...... 13 Insurance Coverage for Mental Health, Behavioral Health, and Substance Abuse Services ...... 13 Description Provided in Evidence Table ...... 13 Strengths and Limitations ...... 14 What Is Needed to Move This Measure Forward ...... 15 Receipt of Preference-Concordant End-of-Life Care ...... 15 Description Provided in Evidence Table ...... 15 Strengths and Limitations ...... 15 What Is Needed to Move This Measure Forward ...... 16 Care Continuity or Consistent Provider ...... 17 Description Provided in Evidence Table ...... 17 Strengths and Limitations ...... 17

vi What Is Needed to Move This Measure Forward ...... 18 Access to Mental Health Providers ...... 19 Description Provided in Evidence Table ...... 19 Strengths and Limitations ...... 19 What Is Needed to Move This Measure Forward ...... 20 Data Transfer and Interoperability ...... 20 Strengths and Limitations ...... 20 What Is Needed to Move This Measure Forward ...... 21 Conclusion ...... 22 3. Measure Constructs That Received Lower or Inconsistent Ratings After Expert Discussion ...... 23 Self-Reported Pain ...... 24 Description Provided in Evidence Table ...... 24 Strengths and Limitations ...... 24 What Is Needed to Move This Measure Forward ...... 25 Access to Primary ...... 25 Description Provided in Evidence Table ...... 25 Strengths and Limitations ...... 25 What Is Needed to Move This Measure Forward ...... 26 Prices for Brand-Name and Generic Drugs ...... 27 Description Provided in Evidence Table ...... 27 Strengths and Limitations ...... 27 What Is Needed to Move This Measure Forward ...... 28 Diffusion of and Access to New Prescription Drugs ...... 28 Description Provided in Evidence Table ...... 28 Strengths and Limitations ...... 29 What Is Needed to Move This Measure Forward ...... 30 Avoidable Emergency Department Use ...... 30 Description Provided in Evidence Table ...... 30 Strengths and Limitations ...... 30 What Is Needed to Move This Measure Forward ...... 31 The Percentage of with an Who Were Referred to or Prescribed Medication-Assisted Treatment ...... 32 Description Provided in Evidence Table ...... 32 Strengths and Limitations ...... 32 What Is Needed to Move This Measure Forward ...... 33 Estimates of Administrative Complexity and Cost ...... 33 Description Provided in Evidence Table ...... 33 Strengths and Limitations ...... 34 What Is Needed to Move This Measure Forward ...... 35 Disadoption of Ineffective Medical Services ...... 35 Description Provided in Evidence Table ...... 35

vii Strengths and Limitations ...... 36 What Is Needed to Move the Measure Forward ...... 37 Healthy Days at Home ...... 37 Description Provided in Evidence Table ...... 37 Strengths and Limitations ...... 37 What Is Needed to Move This Measure Forward ...... 38 Availability of Emergency Medical Services to Prevent Opioid Death ...... 39 Description Provided in Evidence Table ...... 39 Strengths and Limitations ...... 39 What Is Needed to Move This Measure Forward ...... 40 Conclusion ...... 40 4. Measure Constructs That Were Not Discussed by Experts ...... 41 Clinician Workforce Who Can Prescribe Medication-Assisted Treatment or Naloxone ...... 41 Description Provided in Evidence Table ...... 41 Strengths and Limitations ...... 41 Access to Opioid Treatment Centers ...... 42 Description Provided in Evidence Table ...... 42 Strengths and Limitations ...... 43 The Percentage of Patients with a Follow-Up Visit Within Four Weeks of Starting an Opioid for Chronic Pain ...... 44 Description Provided in Evidence Table ...... 44 Strengths and Limitations ...... 44 Time to Regulatory Approval for New Prescription Drugs ...... 45 Description Provided in Evidence Table ...... 45 Strengths and Limitations ...... 45 Travel Time to Provider Office ...... 46 Description Provided in Evidence Table ...... 46 Strengths and Limitations ...... 46 Health Care Spending in the Last Year of Life ...... 48 Description Provided in Evidence Table ...... 48 Strengths and Limitations ...... 48 Spending on Mental Health (Percentage of Total Health Spending) ...... 49 Description Provided in Evidence Table ...... 49 Strengths and Limitations ...... 50 Conclusion ...... 50 5. Recommended Modifications to Existing OECD Measures ...... 51 OECD Health Statistics ...... 51 Health Outcomes for Common ...... 51 Health Expenditure ...... 52 Health Workforce ...... 53 Waiting Times ...... 53 Allocation of Social Spending by Age Group ...... 54

viii Equity ...... 54 Other Expert Recommendations ...... 54 Critiques of OECD Measures ...... 55 6. Measure Constructs Requiring Development ...... 56 Important Measure Constructs Requiring Significant Development ...... 56 Measure Constructs Related to Health System Preparedness, the Public Health System, and/or the COVID-19 Pandemic ...... 58 Measure Constructs Not Clearly Related to Health Care System Performance or HHS Priorities ...... 59 Measure Constructs for Which Experts and/or Federal Advisors Raised Questions About Directionality ...... 60 7. Recommendations and Conclusion ...... 62 Limitations ...... 63 Conclusion ...... 63

References ...... 65

Appendix A. Evidence Tables ...... 73

ix Figures

Figure 2.1. Treatment and Control of Hypertension ...... 8 Figure 2.2. Access to and Coverage for Telehealth ...... 10 Figure 2.3. Quality-Adjusted Life Expectancy ...... 12 Figure 2.4. Insurance Coverage for Mental Health, Behavioral Health, and Substance Abuse Services ...... 14 Figure 2.5. Receipt of Preference-Concordant End-of-Life Care ...... 16 Figure 2.6. Care Continuity or Consistent Provider ...... 17 Figure 2.7. Access to Mental Health Providers ...... 19 Figure 2.8. Data Transfer and Interoperability ...... 21 Figure 3.1. Self-Reported Pain ...... 24 Figure 3.2. Access to Primary Palliative Care ...... 26 Figure 3.3. Prices for Brand-Name and Generic Drugs ...... 27 Figure 3.4. Diffusion of and Access to New Prescription Drugs ...... 29 Figure 3.5. Avoidable Emergency Department Use ...... 31 Figure 3.6. The Percentage of Patients with an Opioid Use Disorder Who Were Referred to or Prescribed Medication-Assisted Treatment ...... 32 Figure 3.7. Estimates of Administrative Complexity and Cost ...... 34 Figure 3.8. Disadoption of Ineffective Medical Services ...... 36 Figure 3.9. Healthy Days at Home ...... 38 Figure 3.10. Availability of Emergency Medical Services to Prevent Opioid Death ...... 39 Figure 4.1. Clinician Workforce Who Can Prescribe Medication-Assisted Treatment or Naloxone ...... 42 Figure 4.2. Access to Opioid Treatment Centers ...... 43 Figure 4.3. The Percentage of Patients with a Follow-Up Visit Within Four Weeks of Starting an Opioid for Chronic Pain ...... 44 Figure 4.4. Time to Regulatory Approval for New Prescription Drugs ...... 45 Figure 4.5. Travel Time to Provider Office ...... 47 Figure 4.6. Health Care Spending in the Last Year of Life ...... 48 Figure 4.7. Spending on Mental Health (Percentage of Total Health Spending) ...... 49

x Tables

Table S.1. Expert Reviews of Measure Constructs ...... xvi Table 1.1. Measure Constructs Included in Expert Ratings ...... 5 Table 6.1. Measure Constructs Requiring Significant Development ...... 56 Table 6.2. Measure Constructs Related to Health System Preparedness, Public Health, or COVID-19 ...... 58 Table 6.3. Measure Constructs Not Clearly Related to Health Care System Performance or HHS Priorities ...... 60 Table 6.4. Measure Constructs with Questions About Directionality ...... 61 Table A.1. Treatment and Control of Hypertension ...... 74 Table A.2. Access to and Coverage for Telehealth ...... 78 Table A.3. Quality-Adjusted Life Expectancy ...... 84 Table A.4. Insurance Coverage for Mental Health, Behavioral Health, and Substance Abuse Services ...... 90 Table A.5. Receipt of Preference-Concordant End-of-Life Care ...... 96 Table A.6. Care Continuity or Consistent Provider ...... 103 Table A.7. Access to Mental Health Providers ...... 109 Table A.8. Data Transfer and Interoperability ...... 114 Table A.9. Self-Reported Pain ...... 119 Table A.10. Access to Primary Palliative Care ...... 124 Table A.11. Prices for Brand-Name and Generic Drugs ...... 129 Table A.12. Diffusion of and Access to New Prescription Drugs ...... 135 Table A.13. Avoidable Emergency Department Use ...... 140 Table A.14. The Percentage of Patients with an Opioid Use Disorder Who Were Referred to or Prescribed Medication-Assisted Treatment ...... 144 Table A.15. Estimates of Administrative Complexity and Cost ...... 150 Table A.16. Disadoption of Ineffective Medical Services ...... 157 Table A.17. Healthy Days at Home ...... 162 Table A.18. Availability of Emergency Medical Services to Prevent Opioid Death ...... 167 Table A.19. Clinician Workforce Who Can Prescribe Medication-Assisted Treatment or Naloxone ...... 171 Table A.20. Access to Opioid Treatment Centers ...... 177 Table A.21. The Percentage of Patients with a Follow-Up Visit Within Four Weeks of Starting an Opioid for Chronic Pain ...... 181 Table A.22. Time to Regulatory Approval for New Prescription Drugs ...... 185 Table A.23. Travel Time to Provider Office ...... 190

xi Table A.24. Health Care Spending in the Last Year of Life ...... 196 Table A.25. Spending on Mental Health (Percentage of Total Health Spending) ...... 200

xii Summary

Compared with other Organisation for Economic Co-operation and Development (OECD) member countries, the United States ranks lower on several notable health-related outcomes, such as infant mortality, that tend to be overemphasized by stakeholders and used as a marker of health care system performance. However, the driving factors contributing to many of these rankings could be attributed to factors outside of the health care system, such as greater inequality, less social protection, population density, and societal preferences. Concerns have also been raised around the variability in data availability and quality within the United States and abroad, which can introduce bias or make international comparisons more difficult. Given the increasingly important question of what the United States is buying for its health expenditures and interest in understanding what factors of the health system contribute to better health outcomes, in 2020, the Immediate Office of the Secretary (IOS) of the U.S. Department of Health and Human Services (HHS) sought to identify measures that align with HHS priorities and could improve the ability of the United States and other countries to learn from international comparisons of health system performance. The IOS sought to identify new measures that are important, valid, feasible for cross-country comparisons, and useful for policymakers and are also aligned with HHS priorities. To inform the identification of measures for international comparison, RAND Corporation researchers worked with a diverse group of 15 experts in quality measurement, clinical care, and health economics to generate and prioritize potential measure constructs that are particularly promising for international comparisons. This report is designed to lay a strong foundation for decisions around these measure constructs by noting the degree of consensus among experts about their importance, scientific acceptability, perceived feasibility, and usability; summarizing the strengths and limitations of the measure constructs; and providing additional context that could be useful for informing the selection of measure constructs that might ultimately be developed into measures and proposed to OECD for consideration.

Methods We used a modified Delphi panel approach implemented using RAND’s ExpertLens platform, an online approach to expert elicitation and stakeholder engagement. This process occurred in three phases. Phase 1 involved the identification of measure constructs that should be considered for inclusion in the expert rating process. Experts submitted 142 recommendations that represented 80 unique measure constructs. RAND researchers then conducted a review of these measure constructs to identify and exclude sets of measure constructs that, while important, either were

xiii not yet specific enough for experts to provide ratings (e.g., innovation) or could warrant a separate discussion or expert review panel, such as in the case of public health preparedness. A summary of these measure constructs is presented in Chapter 6. In addition, some of the measure constructs provided by experts in Phase 1 were closely related to currently reported OECD measures. In many cases, the expert suggestions indicated potential refinements or extensions to the existing OECD measures. Because these measures are already being used by OECD in some form, offering these refinements could help to strengthen international comparisons of health system performance in the near term. Details on current OECD measures and these measure constructs are provided in Chapter 5. In total, 25 measure constructs were identified for the Phase 2 rating process. Phase 2 included an initial assessment of each of the 25 measure constructs by experts against prespecified rating criteria. Experts were provided evidence tables for each measure and asked to draw on the findings in the evidence tables and their own knowledge and expertise to evaluate each measure construct against the following four criteria: importance, scientific acceptability, feasibility for international comparisons, and usability. Experts were asked to provide a numeric rating from 1 (lowest) to 9 (highest) for each criterion, along with a brief written rationale for their rating using RAND’s ExpertLens platform. After the rating period closed, the RAND team summarized the numeric and written assessments for each measure construct. These data, coupled with the distribution of responses, were used to identify the measure constructs that would be discussed in the Phase 3 meeting. In Phase 3, the RAND team hosted a virtual convening of experts to discuss the ratings, explore areas of disagreement, and allow experts to adjust ratings, if desired. In total, of the 25 measure constructs, ratings for ten measure constructs were unambiguous, and no further discussion was warranted. However, experts asked to move two of these (self-reported pain and estimates of administrative complexity and cost) to discussion. One measure construct (treatment and control of hypertension) received such consistently high ratings by experts in Phase 2 that it was not necessary to discuss it in Phase 3. The remaining seven measure constructs were not discussed by experts in Phase 3, due to their lower initial ratings. In total, 17 measures were discussed in the Phase 3 virtual convening.

Results Of the 25 measure constructs included in the expert rating process, eight (Table S.1, column 1) were rated by experts as having the most promise for international comparisons, meaning that experts scored the measure high (median 7 or higher) on three of the four rating criteria. In many cases, experts came to an agreement on key assumptions or revisions to the measure construct that strengthened its potential. All of these, however, will require additional development work to establish their operational definitions and specifications to ensure that any measure developed is valid and feasible for international comparisons of health system performance. Despite these

xiv concerns, experts felt that overcoming these challenges was achievable and, in many cases, pointed to measures that are currently in use or to work that is underway in developing or validating potential measures that could be leveraged. Ten measure constructs (Table S.1, column 2) were determined by experts to hold promise but will require additional refinements to the measure construct prior to moving toward the development of an operational definition. Experts suggested ways to refine, focus, or split the measure constructs, providing a helpful direction for how the measure construct may be strengthened. Many of the perceived limitations of these measure constructs centered around two major concerns: (1) measure constructs that might be impacted by factors outside of the health system, making them less useful for measuring health system performance, and (2) variability in data availability and quality within the United States and abroad, which could introduce bias or make international comparisons more difficult. As noted earlier, seven measure constructs (Table S.1, column 3) were not discussed by experts in Phase 3, due to their lower initial ratings by experts. For some of the measure constructs, experts were split, with some providing strong support and others calling out what they considered to be critical flaws or challenges with the measure construct that would be difficult to overcome. Other measure constructs were not met with strong opposition, but they also did not have a champion among experts, with ratings squarely in the middle of the range. While these measure constructs hold merit and could provide useful information for strengthening the knowledge base of important areas of inquiry, particularly within the United States, they require significant work before they can be used for international comparisons of health system performance.

xv Table S.1. Expert Reviews of Measure Constructs

Measure Constructs That Hold the Measure Constructs That Received Measure Constructs That Were Not Most Promise Lower or Inconsistent Ratings Discussed by Experts

• Treatment and control of • Self-reported pain • Clinician workforce who can hypertension prescribe medication-assisted treatment or naloxone • Access to and coverage for • Access to primary palliative care • Access to opioid treatment centers telehealth • Quality-adjusted life expectancy • Prices for brand-name and generic • The percentage of patients with a drugs follow-up visit within four weeks of starting an opioid for chronic pain • Insurance coverage for mental • Diffusion of and access to new • Time to regulatory approval for new health, behavioral health, and prescription drugs prescription drugs substance abuse services • Receipt of preference-concordant • Avoidable emergency department • Travel time to provider office end-of-life care use • Care continuity or consistent • The percentage of patients with an • Health care spending in the last provider opioid use disorder who were year of life referred to or prescribed medication-assisted treatment • Access to mental health providers • Estimates of administrative • Spending on mental health complexity and cost (percentage of total health spending) • Data transfer and interoperability • Disadoption of ineffective medical services

• Healthy days at home • Availability of emergency medical services to prevent opioid death

Recommendations Detailed recommendations for what is needed to move each measure construct forward are provided in the body of the report. In addition, a number of cross-cutting recommendations and key decision points emerged from this effort that could help to shape next steps. Pursue measure specification for promising measure constructs. Experts rated eight of the measure constructs as having the most promise for international comparisons. Next steps will require additional development work to establish the operational definitions and specifications of these measure constructs to ensure that any measure developed is valid and feasible for international comparisons of health system performance. In many cases, experts pointed to existing measures that could be leveraged for this purpose. Develop guidelines for assessing “health care system performance.” Some experts felt that if a measure construct could be influenced by factors outside of the health system (e.g., in the case of the construct “healthy days at home”), that construct was less useful for international comparisons of health care system performance given differences in populations, cultural preferences, and social conditions across countries. Other experts noted, however, that there

xvi could be ways to account for these differences in analysis (e.g., using regression analysis) to isolate the effect of health system performance on the outcome of interest. This ambiguity was particularly challenging for measure constructs that were both highly relevant for the health system and influenced by external factors. These measure constructs include quality-adjusted life expectancy, which is influenced by social, economic, and geographic factors, and the approval and diffusion of new drugs, which are shaped by regulatory guidelines and industry processes. Developing clear guidelines to assess the alignment of measure constructs with health system performance will help ensure that such decisions are being applied consistently and help determine which measure constructs that were flagged with this concern may warrant further development. Disentangle and prioritize related constructs of access, coverage, utilization, and outcomes. Several measure constructs focused on issues of access or coverage (e.g., “Access to mental health providers”), but experts were quick to point out that coverage for or access to services does not necessarily equate to appropriate utilization of those services or result in improvements in health outcomes. As a result, in some cases, experts recommended strengthening the measure construct by focusing on utilization or the expected health outcomes. However, experts also noted that coverage of and access to specific types of health care providers, services, and treatments could be important intermediate outcomes that could shed valuable insight into key outcomes of interest. As the measure constructs undergo further development work, it will be beneficial to provide additional specificity around these related constructs to help ensure that what is being measured will reflect the intended health outcome. Invest in developing novel measure constructs. As outlined in Chapter 6, experts provided a number of ideas for measure constructs that are important but were deemed not specific enough to advance to the rating stage. Experts who suggested these concepts often mentioned that measurement would be difficult but still recommended panel consideration because of their importance. One example is the idea of innovation, which was offered by ten experts in Phase 1. Although experts nominated different areas for innovation (e.g., drugs, diagnostics, health information technology), this and other proposed measure constructs may be good candidates for measurement development work by HHS or other federal agencies in the near future. Offer refinements to existing OECD measures. In Phase 1, experts nominated measure concepts for consideration. Many of these were refinements to or expansions of existing OECD measures, with suggestions for additional specification or recommendations to further parse out the data by key subgroups that would facilitate subgroup analyses and more direct, and appropriate, cross-country comparisons (see Chapter 5). Because these measures are already being used by OECD in some form, offering these refinements for OECD consideration may help to strengthen international comparisons of health system performance in the near term.

xvii Limitations All of the experts were based in the United States. While many of the project experts do have expertise in international comparisons of , they may not be in the best position to judge how relevant, useful, and feasible a measure construct is for other countries. There may be benefits to engaging an international audience in the future development of these measure constructs. Experts raised the limitation that this project’s U.S.-centric approach to construct selection might result in identification of measure constructs that are less important or relevant for other countries. For example, the opioid crisis is a more significant concern in the United States and is not necessarily relevant for international benchmarking. Where experts raised this as a concern in their comments or discussion, it was noted.

Conclusion Collectively, experts provided a wealth of information on potential measure constructs that could strengthen international comparisons of health care system performance. Eight measure constructs were identified as having the most promise, although all require additional work to strengthen the measure specification and address the feasibility of data collection in an international setting. Experts felt that many other measure constructs were important and held promise but would require additional investment to develop. In the near term, experts pointed to a number of opportunities to strengthen the existing OECD measures set, providing important refinements to measure specifications and how data can be collected and presented to facilitate more appropriate and accurate international comparisons. These suggestions could be explored with OECD sooner, while the new measure constructs suggested by experts are developed into feasible, reliable, and valid measures suitable for international comparisons.

xviii Acknowledgments

We gratefully acknowledge the support and assistance of several people in writing this report. First, we thank the following experts for their continued involvement and participation in this effort: Scott Atlas (Hoover Institution), Jay Bhattacharya (Stanford University), Helen Burstin (Council of Medical Specialty Societies), David Cutler (Harvard University), Patricia Danzon (University of Pennsylvania), Bianca Frogner (University of Washington), Craig Garthwaite (Northwestern University), Jeremiah (Awori) Hayanga (West Virginia University), Regina Herzlinger (Harvard University), Jonathan Ketcham (Arizona State University), Mary Naylor (University of Pennsylvania), Stephen Parente (University of Minnesota), Avik Roy (Foundation for Research on Equal Opportunity), and Eric Schneider (the Commonwealth Fund). We thank Patrick Romano (University of California, Davis), who graciously agreed to chair and facilitate the June 2020 meeting. We would also like to thank four federal experts for their advice and guidance: Irma Arispe (Centers for Control and Prevention), Jeff Brady (Agency for Health Research and Quality [AHRQ]), Joel Cohen (AHRQ), and Steven Sheingold (HHS). We thank our HHS and Office of the Assistant Secretary for Planning and Evaluation project leads, Mamatha Pancholi, Pamela Owens, Christie Peters, and Rose Chu, for their input and guidance. We also thank several colleagues at RAND for their assistance: Christine Eibner for serving in a senior advisory role on this project; Hamad Al Ibrahim, Erika Bloom, Joan Chang, and Lilian Perez for help with creating the evidence tables; and Karishma Patel for administrative assistance. We are also grateful to Christine Eibner, Paul Koegel, and Rachel Reid (RAND) and Soeren Mattke (University of Southern California) for their thoughtful review of this work.

xix Abbreviations

ACA ACSC ambulatory care–sensitive conditions AOD acute opioid disorder BPI Short-Form Brief Pain Inventory CAHPS Consumer Assessment of Healthcare Providers and Systems CDC Centers for Disease Control and Prevention CHF congestive heart failure CMS Centers for & Medicaid Services COPD chronic obstructive pulmonary disease COVID-19 coronavirus disease 2019 ED emergency department EHR electronic health record EMS emergency medical services FDA U.S. Food and Drug Administration GDP GIS geographic information systems GNP gross national product GP general practitioner HALE healthy life expectancy HDAH healthy days at home HHS U.S. Department of Health and Human Services HIC high-income country HRQoL health-related quality of life HRSA Health Resources and Services Administration ICT information and communications technology

xx IOS Immediate Office of the Secretary IQR interquartile range IT information technology LIC low-income country LMICs low- and middle-income countries MAT medication-assisted treatment MIC middle-income country MSRP manufacturer’s suggested retail price NBER National Bureau of Economic Research NHATS National Health and Aging Trends Study NHEA U.S. National Health Expenditure Accounts NHHSUQ National Health and Health Services Use Questionnaire NRS Numerical Rating Scale NSDUH National Survey on Drug Use and Health N-SSATS National Survey of Substance Abuse Treatment Services OECD Organisation for Economic Co-operation and Development OTP opioid treatment program OUD opioid use disorder PPC primary palliative care QALE quality-adjusted life expectancy QALY quality-adjusted life year QUALICOPC Quality and Costs of in Europe R&D research and development RCT randomized controlled trial SAMHSA Substance Abuse and Mental Health Services Administration SHS serious health-related suffering SUD substance use disorder VBP value-based payment WHO World Health Organization

xxi WHOAIMS World Health Organization Assessment Instrument for Mental Health Systems

xxii 1. Introduction

Project Overview Differences in per capita spending and health outcomes between the United States and other countries have been widely reported. Compared with other Organisation for Economic Co- operation and Development (OECD) member countries, the United States ranks in the bottom third for several health outcomes, such as infant mortality,1 that tend to be overemphasized by stakeholders and used as a marker of health care system performance. However, the driving factors contributing to many of these rankings are commonly attributed to factors outside of the health care system, such as greater inequality and less social protection. Health behaviors, social determinants, structural factors, measurement issues, and data differences likely contribute to international differences in health care spending and outcomes. Identifying a core set of metrics built on comparable data and aligned with health care system priorities can help researchers and policymakers better understand the impact of different structural and policy features on international health spending and outcomes. Given the increasingly important question of what the United States is buying for its health expenditures, and interest in understanding what factors of the health care system contribute to better health outcomes, an examination of the factors contributing to these differences is warranted. To shed light on this issue, in 2020, the Immediate Office of the Secretary (IOS) of the U.S. Department of Health and Human Services (HHS) sought to identify measures that could improve the ability of the United States and other countries to learn from international comparisons of health care system performance. The IOS sought to identify new measures that are important, valid, feasible for cross-country comparisons, and useful for policymakers and are also aligned with HHS priorities. HHS Secretary Alex Azar identified four priorities for HHS: the opioid crisis, health insurance reform, drug pricing, and value-based care. These priorities were developed before the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) virus was identified. During the course of this project, coronavirus disease 2019 (COVID-19) developed into a pandemic and was declared a national emergency by President Donald Trump on March 13, 2020. Slowing the spread and responding to the immediate effects of COVID-19 has been a central focus of HHS. Although the COVID-19 pandemic provided important context as the experts identified potential measures for international comparison, this report does not focus on COVID-19 measurement. To inform the identification of measures for international comparison, the RAND Corporation team worked with a diverse group of 15 experts in quality measurement, clinical care, and health economics to generate and prioritize potential measure constructs that are particularly promising for international comparisons. Experts were selected in partnership with

1 HHS, and we sought to achieve a balance of expertise relevant to this effort. A list of experts and their affiliations is provided in the acknowledgments section of this report. With few exceptions, the measure constructs identified as most promising will require additional development work to establish their operational definitions and specifications to ensure that any measure developed is valid and feasible for international comparisons of health system performance. This report is designed to lay a strong foundation for these future refinements by noting the degree of consensus among experts about the importance, scientific acceptability, perceived feasibility, and usability of measure constructs; summarizing the strengths and limitations of the measure constructs; and providing additional context that may be useful to inform the selection of measure constructs that could ultimately be developed into measures and proposed to OECD for consideration. A secondary purpose of this report is to share information on promising measure constructs that are ripe for additional development work.

Methods We implemented a modified Delphi panel approach based on the RAND-UCLA Delphi method implemented via RAND’s ExpertLens platform, an online tool for expert elicitation. This process occurred in three phases: • Phase 1: Identification of measure constructs that should be considered for inclusion in the expert rating process • Phase 2: Initial assessment of each measure construct by experts against prespecified rating criteria • Phase 3: Virtual convening of experts to discuss the ratings, explore areas of disagreement, and then provide final ratings of each measure construct against the criteria.

Phase 1: Identification of Measure Constructs That Should Be Considered In April 2020, the RAND team asked experts to submit measure constructs for consideration that held promise for international comparisons. To support the submission of measure constructs, RAND researchers prepared a source document with relevant background information and quick reference tables to facilitate the experts’ input to this project. This document included, for example, a summary of HHS priorities and potential measure concepts related to these topics. Given that our goal was to identify measures that could be considered for adoption by OECD, it was important that experts had a strong and complete understanding of what is and is not currently measured by OECD (see Chapter 5 for additional detail on current OECD measures); whether and how current measures map to HHS priorities; and known critiques of OECD measures, particularly with regard to those that are commonly used for international comparisons. The document also included a high-level summary of existing

2 measurement frameworks and health-related domains within these frameworks for use by experts considering current gaps and opportunities for measurement. Collectively, experts submitted 142 measure constructs. To identify those that would move forward to the expert rating process, we conducted a multistep process. First, we identified duplicate or overlapping submissions, resulting in 80 unique measure constructs. We then conducted a review of these measure constructs to identify and exclude sets of measure constructs that, while important, require additional work before they are specific enough for experts to provide ratings (e.g., innovation), reflect refinements to existing OECD measures, or could warrant a separate discussion or expert review panel, such as in the case of public health preparedness and measure constructs related to COVID-19. Although this group of excluded measure constructs was not included in the Phase 2 expert rating process, these constructs are important and provide valuable insights around opportunities to strengthen existing OECD measures (described in more detail in Chapter 5) or emerging areas that might warrant additional consideration to be shaped into a more specified measure construct (described in more detail in Chapter 6). Twenty-five measure constructs were identified for the Phase 2 rating process.

Phase 2: Evaluation of Each Measure Construct Against Prespecified Criteria To support experts in the Phase 2 rating process, we developed evidence tables for each of the measure constructs (see Appendix A). Experts were asked to draw on the findings in the evidence tables and from their own knowledge and expertise to evaluate each measure construct against the following criteria. These criteria were adapted from similar criteria used by the National Quality Forum and in other measure assessment activities: • Importance: The extent to which the measure construct represents an issue with high health or social impact both within the United States and globally, is aligned with HHS priorities, and provides opportunities for countries to make significant gains in health care performance • Scientific acceptability: The extent to which adequate scientific evidence or professional consensus exists to support that the concept measured is related to health care system performance • Feasibility for international comparisons: The extent to which data are likely to be readily available in OECD countries and could be collected in multiple countries without undue burden • Usability: The extent to which policymakers and other potential audiences are using or could use data from this measure construct to inform policy.

Experts provided ratings through RAND’s ExpertLens platform. Experts were asked to provide a numeric rating from 1 to 9 for each criterion, along with a brief written rationale for their rating. Experts were provided with the following guidance: Scores of 1–3 indicate low ratings, scores of 4–6 indicate moderate or unsure ratings, and scores of 7–9 indicate high ratings. Experts completed their ratings between June 8 and June 18, 2020. After the rating

3 period closed, the RAND team summarized the numeric and written assessments for each measure construct. ExpertLens generated the median and interquartile range (IQR) of ratings for each criterion within each measure construct. Although absolute distance to the median is another commonly used measure of dispersion, ExpertLens draws on both level of agreement and the value of the median to determine the group decision (i.e., strong, moderate, or low support of a criterion), which is more readily understandable by participants. These data, coupled with the distribution of responses, were used to identify the measure constructs that would be discussed in the Phase 3 meeting. We sought to limit the number of measure constructs that were discussed to ensure that adequate time was available for discussion and to ensure that discussion was limited to those measures that held the most promise for international comparisons based on Phase 2 ratings. In total, ratings for ten measure constructs were unambiguous, and no further discussion of these was warranted.

Phase 3: Convene, Discuss, and Adjust Ratings On June 29, 2020, the RAND team convened experts for a five-hour videoconference to discuss the measure constructs rated in Phase 2 and to provide updated ratings, if they chose, based on the discussion. In advance of the meeting, experts were sent the results of the Phase 2 ratings through the ExpertLens platform, where they were able to see the distribution of ratings for each measure construct and criteria, along with the median and IQR; their own Phase 2 ratings were also superimposed on the distributions. At the beginning of the meeting, experts were given an opportunity to review the measure constructs that were not slated for discussion based on the criteria noted above and to nominate any for discussion. Two measure constructs were moved to the agenda as a result, and a total of 17 measure constructs were discussed during the meeting (see Table 1.1). The meeting was facilitated by Patrick Romano, an experienced facilitator with expertise in quality measurement and experience with the use and development of OECD measures. For each measure construct, experts first reviewed the distribution of scores and a summary of comments at the lower and higher ends of the rating distribution and were then provided an opportunity to discuss ratings and areas of disagreement. Because many of the measure constructs could be broadly interpreted, in many cases experts agreed on a refinement to the measure construct that helped to clarify or strengthen it, which resulted in increased convergence of expert ratings. After discussion of each measure, experts re-rated the measure construct through ExpertLens. Experts who did not provide Phase 3 ratings to one or more measure constructs confirmed with us that they would like their Phase 2 ratings to stand. Two of our 15 experts were not able to participate in the Phase 2 discussion and did not provide updated ratings. Unless otherwise noted, this report summarizes the results from the Phase 3 ratings. For each measure construct described in Chapters 2–4, we provide a figure that summarizes the final distribution of expert ratings (yellow bars), median rating (blue line), and IQR (gray shaded rectangle) for each of the four

4 domains: importance, scientific acceptability, feasibility for international comparisons, and usability. Summaries of measure constructs are derived from RAND’s analysis of expert commentary during the Phase 3 meeting and comments that experts provided through the ExpertLens platform to justify their numeric ratings. To provide additional context for each measure construct, we included findings from the literature, drawn from the respective evidence table for that measure construct (Appendix A).

Table 1.1. Measure Constructs Included in Expert Ratings

Discussed in Phase 3 Not Discussed in Phase 3 1. Availability of emergency medical services 1. Treatment and control of hypertension to prevent opioid death (consistently high expert ratings) 2. The percentage of patients with an opioid 2. Clinician workforce who can prescribe use disorder who were referred to or medication-assisted treatment or naloxone prescribed medication-assisted treatment 3. Access to and coverage for telehealth 3. Access to opioid treatment centers 4. Insurance coverage for mental health, 4. The percentage of patients with a follow-up behavioral health, and substance abuse visit within four weeks of starting an opioid services for chronic pain 5. Avoidable emergency department use 5. Time to regulatory approval for new prescription drugs 6. Prices for brand-name and generic drugs 6. Travel time to provider office 7. Estimates of administrative complexity and 7. Health care spending in the last year of life cost 8. Quality-adjusted life expectancy 8. Spending on mental health (percentage of total health spending) 9. Diffusion of and access to new prescription drugs 10. Access to primary palliative care 11. Receipt of preference-concordant end-of- life care 12. Healthy days at home 13. Care continuity or consistent provider 14. Access to mental health providers 15. Data transfer and interoperability 16. Disadoption of ineffective medical services 17. Self-reported pain

5 Organization of This Report Chapter 2 provides a summary of the eight measure constructs that received the highest ratings from experts after Phase 3. Chapter 3 provides a summary of the measure constructs that were discussed by experts but received lower ratings after Phase 3, suggesting that more refinement to these measure constructs could be warranted prior to offering them as suitable measures for international comparisons. Chapter 4 presents measure constructs that received lower ratings in Phase 2 and were not discussed by experts. In Chapter 5, we discuss measure constructs suggested by experts that offered important refinements and extensions of existing OECD measures to strengthen international comparisons. In Chapter 6, we discuss the remaining measure constructs that were excluded from expert ratings for other reasons, including emerging ideas that may warrant additional consideration to be shaped into a more specified measure construct. The evidence tables that the RAND team developed to support expert ratings are included in Appendix A.

6 2. Measure Constructs That Hold the Most Promise for International Comparisons

Eight measure constructs were identified that received the highest ratings in the expert elicitation process: • treatment and control of hypertension • access to and coverage for telehealth • quality-adjusted life expectancy • insurance coverage for mental health, behavioral health, and substance abuse services • receipt of preference-concordant end-of-life care • care continuity or consistent provider • access to mental health providers • data transfer and interoperability. For these eight measure constructs, experts rated three out of four criteria (importance, scientific acceptability, feasibility for international comparisons, usability) as high, meaning that the median of the distribution for that criteria was a 7 or higher on a scale of 1 to 9. In this chapter, we show the distribution of expert ratings, summarize key strengths of the measure constructs, and note where disagreement still exists. Although each of these measure constructs holds promise, for each measure we also provide a summary of what experts felt was needed to move this measure construct forward for international comparisons.

Treatment and Control of Hypertension

Description Provided in Evidence Table Hypertension is blood pressure that is higher than normal. In the United States, the threshold for a hypertension diagnosis is defined as systolic blood pressure consistently at or greater than either 130 or 140 mm Hg and diastolic blood pressure consistently at or greater than either 80 or 90 mm Hg.2 The population of individuals tested and treated for hypertension typically includes adults aged 18 and older. • Treatment of hypertension: There are two components of treatment that can be used in or in combination: (1) antihypertensive medications and (2) lifestyle changes (e.g., physical activity and diet).3 • Control of hypertension: Control is achieved when the individual’s blood pressure measures are consistently lower than 140 mm Hg (systolic) and lower than 90 mm Hg (diastolic).4

7 Strengths and Limitations Figure 2.1. Treatment and Control of As shown in Figure 2.1, experts provided Hypertension consistently high ratings for importance, scientific acceptability, feasibility for international Importance comparisons, and usability. Because this measure construct received consistently high scores in Phase 2, it was not discussed at the Phase 3 meeting and was not re-rated by experts. As a result, data in Figure 2.1 reflect Phase 2 expert ratings. In comments provided by experts to justify their ratings, most agreed that this was an Scientific Acceptability important measure, noting that “it is one of the biggest health problems we have” and that it is “one of the key chronic diseases and a risk for many serious conditions that decrease life expectancy.” Data suggest that an estimated 1.13 billion people have hypertension,5 at a global cost of $370 billion annually.6 Experts also pointed to the availability of currently used measures in the Feasibility United States and abroad that assess hypertension treatment and control.7,8 Two experts cautioned, however, against measuring “treatment” of hypertension, noting that “we are too quick to prescribe” and that “assessing only ‘treatment’ is not sufficient.” They went on to note that the “CDC [Centers for Disease Control and Prevention], ACC [American Usability College of Cardiology], AHA [American Heart Association], and others routinely assess ‘control’ as the more meaningful indicator.” With respect to the feasibility for international comparisons, our evidence table reported that there is international variation in diagnostic thresholds,9 guidelines for the initiation of treatment (e.g., NOTES. blue: median; gray: IQR lifestyle changes,10 medications,11 no explicit guidelines12), and the focus on total cardiovascular risk rather than only blood pressure when initiating treatment.13 Related to this latter point, one expert noted that the measure “would be of greater value [if it included] glycemic control and obesity.”

8 What Is Needed to Move This Measure Forward Discrepancies in the threshold for hypertension treatment both within and across high- income nations would need to be resolved.14 A key decision would be whether to collect data on hypertension treatment, control, or both. How the data are collected would also need to be resolved because data describing treatment (e.g., medication utilization, lifestyle changes) are typically self-reported but have potential biases due to differences in the structure of the survey questions15 and cross-cultural differences in responses.16 Hypertension control, however, could be described by administrative data that document those who have been diagnosed with hypertension and their recent blood pressure readings. Among the input sources for the OECD data, diagnosed diseases are typically documented by national disease surveillance systems.17 However, describing control of hypertension would require the integration of advanced health information technology systems with repeated measures of blood pressure.

Access to and Coverage for Telehealth

Description Provided in Evidence Table There is no widely agreed-upon definition of telehealth;18 however, the Health Resources and Services Administration (HRSA) of HHS defines telehealth as “the use of electronic information and telecommunication technologies to support long-distance clinical health care, and professional health-related education, public health, and health administration. Technologies include video conferencing, the internet, store-and-forward imaging, streaming media, and terrestrial and wireless communications.”19 HHS currently describes four modalities of telehealth: (1) live video interaction between a patient and provider, (2) store and forward (electronic transmission of videos and digital images to a provider in a different location), (3) remote patient monitoring (electronic transmission of personal health and medical data, such as blood pressure readings from an individual in one location to a provider in another location), and (4) mobile health (mHealth, which includes smartphone apps intended to promote health and well-being).20

Strengths and Limitations After discussion, experts rated this measure concept high on importance, scientific acceptability, and usability, but they scored it in the moderate range on feasibility for international comparisons (Figure 2.2). Experts noted that telehealth is an important measure construct but one that is in “dynamic evolution” in the current COVID-19 pandemic. One expert noted that the recent expansion of telehealth services “created a lot of enthusiasm on the ground, particularly for rural populations and those who previously had not been able to travel to a provider office.” While experts pointed to the value of telehealth as a measure construct, for it to

9 be successful, experts noted a need to Figure 2.1 Access to and Coverage of Telehealth disentangle the two separate concepts of access Figure 2.2. Access to and Coverage for Telehealth and insurance coverage and recommended that Importance the measure focus on coverage and payment for Importance telehealth. Several concerns were raised with regard to a measure of access to telehealth. First, it is not yet clear what the “right” level of access to telehealth is, given the value of in-person interactions and a lack of data on the longer- term outcomes of telehealth services. Experts ScientificScientific Acceptability Acceptability also cautioned that the lack of a clear definition of telehealth and variability in broadband access could lead to skewed data. While some experts raised the concern that obtaining access to data would require the use of surveys that could have limitations for international comparisons, others pointed to examples where surveys are used successfully for international FeasibilityFeasibility comparisons (e.g., the Commonwealth Fund International Survey). Insurance coverage for telehealth, however, was viewed by experts as “the most important and the place where CMS [the Centers for Medicare & Medicaid Services] has been most engaged” and offering “an important policy lens” where Usability Usability “international comparisons could be helpful.” Experts cautioned that coverage does not necessarily translate to access and use. Our evidence table included findings that reimbursement and regulations vary by state,21 and, during the COVID-19 pandemic, Medicare and Medicaid expanded coverage of telehealth NOTES. blue: median; gray: IQR services and lifted requirements that previously restricted telehealth services,22–26 which may make estimates of coverage for telehealth services somewhat challenging in the near term.

10 What Is Needed to Move This Measure Forward The definition of telehealth (specifically, which types of services count as telehealth) would need to be agreed on first in order to design a measure that can accurately reflect international differences in access to and coverage for telehealth. Experts felt that this measure construct should be refined to focus on coverage and payment for telehealth, specifically the percentage of the population with health care coverage for patient-to-provider telehealth services. Experts also noted that there may be benefits to further bounding the measure to populations where coverage for telehealth may be particularly beneficial, such as senior or rural populations or chronically ill patients.

11 Quality-Adjusted Life Expectancy Figure 2.3. Quality-Adjusted Life Description Provided in Evidence Table Expectancy

Quality-adjusted life expectancy (QALE) is a Importance Importance Figure 2.3 Quality-Adjusted Life Expectancy summary measure of population health that Importance Figure 2.3 Quality-Adjusted Life Expectancy combines information on fatal and nonfatal health outcomes. Data describing (1) health- related quality of life (HRQoL) and (2) life expectancy (by characteristics of interest, such as age, sex, race, and ethnicity) are required to calculate QALE. QALE has been used to Scientific Acceptability monitor changes in population health over time, Scientific Acceptability Acceptability compare population health across countries, investigate health inequalities, and quantify the benefits of health interventions in cost effectiveness analysis.27

Strengths and Limitations After discussion, experts rated this measure Feasibility construct high on importance, scientific FeasibilityFeasibility acceptability, and feasibility, although there was some disagreement (Figure 2.3). Experts varied widely in their perception of the usability of this measure construct. Experts considered QALE an important measure construct that provided an improvement over the more commonly used measure of life UsabilityUsabilityUsability expectancy. As noted in our evidence table, comparing a nation’s life expectancy and its QALE can help stakeholders understand the additional toll that morbidity takes on society. Moreover, comparing QALE for different subgroups within one nation (e.g., men versus women) can lend insight into how different subgroups experience outcomes NOTES. blue: median; gray: IQR disproportionately. Experts noted that the current widespread use of QALE in research and the availability of existing tools to measure it were considered strengths of the measure construct. Of note, the HHS Healthy People 2020 goals include increasing the quality of life and years of

12 healthy life,28 both of which make up QALE. Experts, however, raised concern about its use for international comparisons of health care system performance. They noted that while QALE is a good measure to assess the health of a community, given the numerous factors that influence life expectancy (e.g., race/ethnicity, socioeconomic factors), it is not a good measure of health care system performance. One expert noted, for example, that “it tends to be major economic events that change measures of this type.”

What Is Needed to Move This Measure Forward Experts noted that although it may be possible to isolate the impact of the health care system by controlling for other factors that influence life expectancy, it would “require advanced analysis to make sense of the health care system’s contribution.” Another expert noted that QALE could be adjusted in a manner similar to how adjustments are made for purchasing power in cost and pricing data, but experts also noted that more work would be needed to figure out how best to normalize income, the distribution of income, or socioeconomic factors outside of income that influence life expectancy. It is also worth noting that calculation of QALE requires three sources of data: the probability of death at various ages; data on HRQoL for people in the sample; and a value set (i.e., how individual countries weight the impact of various nonfatal illnesses on health), which is likely to vary across nations due to differences in sociocultural and demographic characteristics.27 Standardization of this value set would be a necessary step in moving this measure forward. OECD does not currently measure QALE, but it does collect and report data on healthy life years at age 65. Although this is a slightly different measure from QALE, the United States currently does not participate in this measure; one expert noted that submitting data on this measure might be worth considering.

Insurance Coverage for Mental Health, Behavioral Health, and Substance Abuse Services

Description Provided in Evidence Table Behavioral health conditions can include mental illnesses, such as anxiety disorders, major depression, schizophrenia, and posttraumatic stress disorder, and substance use disorders (SUDs), such as opioid and alcoholism. Mental health, behavioral health, and substance abuse services can include care in inpatient and outpatient settings, residential treatment centers, day care facilities, and detox centers. Treatments can include pharmaceutical and psychological interventions.29 There are several measures of insurance coverage to consider, including the following:

13 • Effective coverage: “People who need Figure 2.4. Insurance Coverage for Mental health services obtain them in a timely Health, Behavioral Health, and Substance manner and at a level of quality Figure 2.2 Insurance Coverage for Mental Health, Behavioral Health, or Substance Abuse Services Abuse Services necessary to obtain the desired effect 30 and potential health gains.” Importance • Universal health coverage: “Universal Importance health coverage means all people receiving the health services they need . . . of sufficient quality to be effective while at the same time ensuring that the use of these services does not expose the user to financial hardship.”30

Strengths and Limitations ScientificScientific Acceptability Acceptability After discussion, experts rated this measure construct high on importance, scientific acceptability, and usability and in the moderate range for feasibility (Figure 2.4). Experts rated this measure construct as important, citing data included in RAND’s evidence table that almost one in five American FeasibilityFeasibility adults live with a mental illness,31 but only 41 percent of people with mental disorders access any mental health services.32 According to the World Health Organization (WHO), “The cost of mental health problems in developed countries is estimated to be between 3% and 4% of GNP [gross national product]. Approximately UsabilityUsability 14% of the global burden of disease can be attributed to these disorders.”33 Experts raised several challenges and concerns with how this measure is operationalized, however. First, they noted that insurance coverage is not a useful proxy for access; several experts noted anecdotally that they “know of many psychiatrists who will not NOTES. blue: median; gray: IQR take Medicare, Medicaid, or commercial insurance.” Many agreed that access is important to consider because coverage is not helpful if you cannot be seen or it is cost-prohibitive. Second, some experts recommended splitting apart mental, behavioral, and substance abuse services, noting that “there is ambiguity in lumping together three different services”; another noted that

14 the “most ambiguous is behavioral health, which can mean different things for different people.” However, others countered that although splitting apart the measure could be useful, this creates sample-size issues for survey measures, which are likely needed if the measure intends to capture availability of or access to services.

What Is Needed to Move This Measure Forward To improve the international comparability and precision of the measure, a list of mental health, behavioral health, and substance use conditions and treatments would need to be included in any measurement definition. Experts disagree, for example, on which programs constitute behavioral health treatment, such as self-help programs like Alcoholics Anonymous.34 Given the different types of insurance mechanisms across countries (e.g., universal, nationally funded coverage versus more fragmented, private coverage), comparison of coverage might be more difficult and the presence of coverage might not have the same implications for access given different payment structures and cost-sharing requirements (e.g., deductibles, copays). Furthermore, because some U.S. psychiatrists judge public-sector payments as inadequate and only take private-pay patients, a key decision point for this measure construct will be determining whether access to such services should be used in place of, or in combination with, a measure of insurance coverage alone.

Receipt of Preference-Concordant End-of-Life Care

Description Provided in Evidence Table Receipt of preference-concordant end-of-life care refers to the level of agreement between a patient’s desired end-of-life care and the actual end-of-life care received.35 These preferences are supposed to be translated into actionable medical orders that are maintained in the patient’s medical record and designed to accompany the patient wherever he or she resides.36

Strengths and Limitations After discussion, experts rated this measure construct high on importance, scientific acceptability, and usability but scored it in the moderate range for feasibility (Figure 2.5). One expert commented that “it is more powerful than it looks. . . . when patients come in with advance directives . . . it really changes the expectation, comprehension, and entire patient- provider encounter. . . . having a detailed knowledge of what a patient desires before the end helps whatever we do as providers.” Yet several experts struggled with the broad nature of the measure construct, and specifically the notion of “preference-concordant,” noting that this is “very ambiguous and an amalgam of preference of care, legality of what the patient is requesting, and an understanding of [those preferences].” Experts noted that although there is a literature on advanced directives and following them, development of a measure construct

15 “would take work on understanding data Figure 2.5. Receipt of Preference- Figure 2.7 Receipt of Preference-Concordant End of Life Care resources, [the] legal structure for patients to give Concordant End-of-Life Care their preferences, and ways to measure Importance Importance concordance.” Experts also noted more fundamentally that “we need to have advanced directive baseline information before we can measure receipt of it” and that “the issue is that we’re not even eliciting what people want.” In discussion, experts agreed that this measure construct should be refined to focus on Scientific Acceptability documenting goals of care through advanced Scientific Acceptability directives or similar tools. It was through this lens that experts provided Phase 3 ratings.

What Is Needed to Move This Measure Forward Experts recommended focusing on the documentation of patient goals of care. Additional FeasibilityFeasibility work will be needed to flesh out how documentation is defined, as RAND’s evidence table notes that comparisons of different methods of communicating end-of-life preferences are limited by the inconsistent use of valid and reliable measures across studies.37 Specific issues Usability identified that can affect validity include response Usability shift (i.e., when people’s values and choices change over time), a lack of specificity and consistency of documentation, and biases related to chart reviews (e.g., preferences may be “judged invalid” or assessed as concordant when they do not align with care received).35 There are a number of survey measures that assess preference of end- NOTES. blue: median; gray: IQR of-life care among older adults (see the Commonwealth Fund International Health Policy Survey,38 for example), which could be helpful starting points for further operationalization of this measure construct.

16 Care Continuity or Consistent Provider Figure 2.6. Care Continuity or Description Provided in Evidence Table Consistent Provider WHO defines continuity of care as “the degree to which a series of discrete health care Importance events is experienced by people as coherent and interconnected over time and consistent with their health needs and preferences.”39 Continuity of care can include the quality of care over time, which includes the patient’s experience of a continuous caring relationship with an identified health care professional (i.e., a consistent provider), as well as the provider’s delivery of Scientific Acceptability seamless service through integration, coordination, and the sharing of information between different providers.40 Three ways of providing care continuity are (1) personal continuity (via an ongoing patient-provider relationship), (2) information continuity (present care takes into account past information), and (3) management continuity (management of a health Feasibility condition is consistent but also flexible to a patient’s changing needs).41

Strengths and Limitations After discussion, experts rated this measure construct high on importance, scientific acceptability, and usability but moderate for feasibility for international comparisons (Figure Usability 2.6). In discussing this measure construct, experts felt it was particularly important for patients with chronic illnesses like diabetes. Experts also pointed to literature included in RAND’s evidence table that found that continuity of care allows for better support of individuals and a better understanding of their conditions, which in turn increases patient satisfaction, patient- NOTES. blue: median; gray: IQR

17 clinician trust, and quality of communication.42–46 About 20 percent of Americans report having no usual source of health care.47 Experts discussed the various ways this measure construct could be operationalized, noting that it could “refer to coordination by a primary care provider or coordination among members of a team who cares for someone with a chronic disease and its many comorbidities.” Experts generally agreed that it was better to focus this measure on a team conceptualization, with one expert noting that we “need to leave space for innovation in this area. Focusing too much on a single provider might be against where we see the system evolving in general. There are opportunities we haven’t exploited yet that might lead to this type of continuity.” Experts also discussed potential data sources, including health insurance claims; administrative data, such as those aggregated by care collaboration companies like PatientPing; and survey data. With respect to claims data, one expert raised the questions of “which entity is submitting the claim” and how we might ensure that claims data can be used to assess continuity across a team of providers. Experts agreed that survey data may be the most feasible data source for constructing a continuity measure that is comparable across countries but noted that one of the challenges is in understanding “expectations around a measure like this. What do people expect [with respect to care coordination]? This varies across countries and can vary within the U.S. by insurance type, age, and other characteristics.” Experts noted that capturing data for this measure construct requires complementary approaches: “The patient and caregiver’s perspective are crucial to understand if there is continuity.”

What Is Needed to Move This Measure Forward Experts noted that fully capturing continuity of care would require utilizing multiple data sources to get at various dimensions and perspectives of care continuity. How to combine those sources and ensure feasibility for international comparisons will need to be determined. RAND’s evidence table, for example, documented that claims-based measures of care continuity, while valuable, have several limitations, including an inability to capture information about interpersonal continuity among clinicians and patients and coordination activities that might occur outside of visits between clinicians or between clinicians and patients. Also, some continuity of care analyses examine continuity during episodes of care (e.g., congestive heart failure [CHF], chronic obstructive pulmonary disease [COPD]) and could exclude a large proportion of patients and claims data; results might therefore not be generalizable.48 There are several examples of validated scales (e.g., National Health and Health Services Use Questionnaire for patient-reported continuity of care49) and existing measures of continuity of care used to facilitate international comparisons (the Commonwealth Fund International Health Policy Survey50,51) that might be useful for the development of this measure.

18 Access to Mental Health Providers Figure 2.7. Access to Mental Health Providers Description Provided in Evidence Table This construct refers to the availability of Importance mental health providers to meet population behavioral health needs and is one dimension of overall access to mental health care.52 However, which providers are counted as mental health providers can vary.53 The term mental health provider broadly includes psychiatrists, psychologists, licensed clinical Scientific Acceptability social workers, counselors, marriage and family therapists, and mental health providers who treat alcohol and other drug abuse.54 HRSA only includes those with a graduate degree.53

Strengths and Limitations Experts rated this measure construct high Feasibility on importance, scientific acceptability, and feasibility but moderate on usability (Figure 2.7). RAND’s evidence table documented that there are about 5,565 designated mental shortage areas in the United States.55 Provider shortages result in lower access to care, long waits for necessary Usability treatment, and provider burnout.56 Low access to mental health providers can also contribute to unmet mental health needs. In 2019, about 18 percent of United States adults (about 44 million) had a mental illness, but 56 percent of those received no treatment, and 20.6 percent of those who sought treatment reported not 57 being able to receive treatment. NOTES. blue: median; gray: IQR Experts discussed some of the inherent challenges with this measure construct, notably the need to define mental health provider. One expert noted that “there are data in the OECD on primary care providers versus specialty care. The challenge I can see is [that] some primary care physicians are trained in mental health, in

19 addition to psychiatrists.” Another expert noted that “if this measure is framed as a ratio of available providers to the population, it should recognize that a broad workforce can contribute to the mental health workforce.” To this point, experts also discussed whether this measure construct should be one of provider availability or access. “I think access is important, but it tends to be narrow in its scope whenever it’s discussed. If we do talk about access, which is the more critical point, think about the broader set of people who can provide the mental health services we need.”

What Is Needed to Move This Measure Forward To ensure the feasibility of international comparisons, it will be necessary to standardize what types of providers are mental health providers and how to handle the vast amount of mental health care provided by those who are not medical providers. RAND’s evidence table noted, for example, that a substantial amount of mental health care is administered by professionals outside the health sector—e.g., criminal justice, education, and social services.58 More work is needed to determine which measure construct—one of provider counts or ratios versus one of access to mental health—will be most valuable for international comparisons and policy decisions and to then align the inclusion criteria for mental health provider accordingly.

Data Transfer and Interoperability The transfer and interoperability of health data involves the hardware and software that deal with the storage, retrieval, sharing, and use of health care information.59 Appropriately exchanging health information among health care professionals and patients allows the doctors, nurses, pharmacists, and other providers to obtain vital medical information.60 The objectives of health information technology and exchange are to improve the speed, quality, safety, and cost of patient care.60,61

Strengths and Limitations After discussion, experts rated this measure construct high on importance, scientific acceptability, and usability and moderate on feasibility (Figure 2.8). In justifying the higher rating for importance, experts pointed to the potential for health information exchanges to lead to higher-quality care. RAND’s evidence table noted that the transfer and interoperability of health information can reduce medical errors and improve compliance with clinical guidelines62 and reduce overindicated and contraindicated prescribing.63 Health information exchange systems, while not yet widespread, have also been shown to increase timely communication, efficient provider-patient interactions,64 and patient engagement.65

20 Experts discussed numerous efforts that are Figure 2.8. Data Transfer and currently underway to operationalize this Interoperability measure construct, noting that there may be Importance several promising avenues on which to build, Importance including a pilot study conducted by OECD.65 Experts also pointed to the Healthcare Information and Management Systems Society Interoperability & Health Information Exchange Committee, which has proposed eight metric categories as a “starting point for consensus around the measurement for market suppliers, providers and government agencies” and has ScientificScientific Acceptability Acceptability developed a three-part definition.66,67 The Commonwealth Fund International Health Policy Survey of Primary Care Physicians also includes questions on the electronic exchange of information.68 One expert noted that “defining those categories of exchange, using the data to determine how much exchange is occurring, and Feasibility getting from physicians an assessment of Feasibility whether they are reaching their full potential is another complementary way to look at this.” Experts also pointed to a number of issues that should be decided upon as the measure becomes operationalized: the value of measuring electronic data transfers that are mandated in the United States (e.g., e-prescribing), the usability of the data being exchanged for clinical care UsabilityUsability (e.g., some are more or less relevant), and “how broad must the interoperability be to count? In the United States it is within a system, but in other countries it is national or regional. In the United States it’s a much narrower concept.”

What Is Needed to Move This Measure Forward NOTES. blue: median; gray: IQR Experts noted that the next step is “to identify the most important domains of data transfer and interoperability, and how to measure those in a valid way.” As noted in RAND’s evidence table, the OECD pilot study on this measure construct included measures of (1) the utilization of

21 electronic health records (EHRs); (2) whether laboratory, radiology, and other results are shared with outside organizations; (3) e-prescription utilization; and (4) telehealth capacities.65 Given that the goal of this effort is to encourage OECD adoption of a set of promising measures for international comparison, the United States may wish to engage with OECD to suggest refinements based on findings of its pilot study and other measurement work happening in the United States on this measure construct.

Conclusion These eight measures hold the most promise for international comparisons of health care system performance. Overall, experts scored them high across multiple dimensions of importance, scientific acceptability, feasibility, and usability. Each of them, however, requires additional work to further specify the measure, strengthen feasibility for international comparisons, or continue to build the use case for understanding health care system performance. Despite these concerns, experts felt that overcoming these challenges was achievable and, in many cases, pointed to work underway that is developing or validating potential measures that could be leveraged.

22 3. Measure Constructs That Received Lower or Inconsistent Ratings After Expert Discussion

Of the 25 measure constructs discussed, ten received lower or inconsistent ratings from experts. In most cases, experts felt that these measure constructs were important but identified a number of challenges and limitations with respect to scientific acceptability, feasibility, and usability that must be addressed if these measure constructs are to move forward. These measure constructs are • self-reported pain • access to primary palliative care • prices for brand-name and generic drugs • diffusion of and access to new prescription drugs • avoidable emergency department use • the percentage of patients with an opioid use disorder who were referred to or prescribed medication-assisted treatment • estimates of administrative complexity and cost • disadoption of ineffective medical services • healthy days at home • availability of emergency medical services to prevent opioid death.

23 Self-Reported Pain Figure 3.1. Self-Reported Pain

Description Provided in Evidence Table Importance

Pain is physical suffering or discomfort caused Importance by illness or injury. Because pain is subjective, the existence and intensity of pain is often measured by patient self-reports.69 Elements of self-report could include relevant pain; physical, psychological, emotional, and social domains of functioning; and patient-reported outcomes and 70 defined goals. Pain assessment can also occur Scientific Acceptability through physical examination or behavioral Scientific Acceptability observation when self-report is not possible.

Strengths and Limitations Self-reported pain was briefly discussed by experts in Phase 3 both alone and in combination with other measures, such as access to primary palliative care. After discussion, experts rated it Feasibility higher on importance and usability, but the scores Feasibility for scientific acceptability were widely distributed, resulting in median scores in the moderate range (Figure 3.1). Experts felt that this is an important measure construct because it is a function of appropriate medical care that relates to two HHS top priorities: the opioid crisis and value-based care. As one expert succinctly stated, “Few health problems are more important than pain.” Experts UsabilityUsability widely disagreed on the scientific acceptability and feasibility of this measure, with some pointing to existing measures that are “reasonably well validated, despite subjectivity” that could be used for international comparisons, while others made the point that this measure construct is “very subjective [and] highly dependent on personal, international, and cultural differences.” NOTES. blue: median; gray: IQR.

24 What Is Needed to Move This Measure Forward Experts were split in their interpretation of this measure construct and what it would need to move forward. A few felt that it had potential as is, given existing validated measures, while others felt that it should not move forward at all, given limitations. A few experts, however, recommended a potential approach to strengthening the measure construct that involves pairing it with questions “about pain management or tools” to help understand how well those are working or how well they work in relation to one another (e.g., chronic use of opioids versus other non-narcotic medications). Similarly, another expert noted that this measure construct would be “most useful as an outcome if linked to treatment modalities and their use across countries.” However, more work would be needed to identify the set of pain management approaches that would be paired with self-reported pain to make this a viable and useful measure for international comparisons.

Access to Primary Palliative Care

Description Provided in Evidence Table Primary palliative care (PPC) is all of the palliative care competencies expected of the primary care physician, including but not limited to assessing a patient’s physical and nonphysical symptoms, assisting the patient and his or her family with establishing appropriate goals of care, communicating the patient’s illness and its trajectory, and affirming preference- concordant end-of-life care.71 In the United States, palliative care is provided within and outside programs.72 Primary care focuses on continuity of care and seeing the whole person, which is why the majority of palliative care is administered in that setting. Providing PPC requires the following: involving an interdisciplinary team of providers to meet patient and family needs; creating systems for routine, reliable assessments of symptoms and care needs; creating pathways to triage patients who screen positive for symptoms or distress; and committing to continuing education and skills training for staff.73

Strengths and Limitations After discussion, experts rated access to PPC higher on importance and usability but in the moderate range for scientific acceptability and feasibility (Figure 3.2). According to RAND’s evidence table, WHO estimates that more than 20 million people require palliative care worldwide; most are adults over 60 years of age (69 percent), and 6 percent are children.74 Other researchers have estimated that 45 percent of all people who died in 2016 worldwide experienced serious health-related suffering (SHS) requiring palliative care (25.5 million deaths).75 This percentage is estimated to increase to 47 percent by the year 2060, accounting for more than 48 million deaths.75

25 Experts felt that this measure construct was Figure 3.2. Access to Primary Palliative important, but several struggled with how to Care operationalize it. “The biggest problem with this measure is that [it] is so vague that I don’t know Importance Importance what we are actually measuring.” Experts Figure 2.6 Access to Primary Palliative Care discussed that a measure of pain and its treatment would be an important component of this measure. “I agree that . . . linking to self-reported pain is an important way to understand what is going on.” But experts also discussed the importance of the patient experience and Scientific Acceptability perception of options to manage symptoms. Scientific Acceptability Experts cautioned about placing too much emphasis on pain management because they “don’t want a situation where countries rush to prescribe opioids to get a higher score.” One expert “read this measure construct as a decision [about where to seek care] and resources to care for patients outside of the ” and cautioned that “community-based care may not be FeasibilityFeasibility understood in the same way in every country.” Experts agreed that a family of measures would be necessary to adequately capture this measure construct. “I like this measure, but I think looking at it as a family of measures would be useful. There may be some opposition to an overarching measure. If we can do it in a culturally sensitive Usability way to recognize different norms on how to do Usability this, I think the effort is worthwhile, especially as populations age around the world.”

What Is Needed to Move This Measure Forward This measure construct is multidimensional, and a necessary next step is to operationalize the NOTES. blue: median; gray: IQR relevant domains. Experts noted that pain is a sentinel component of this measure but that it should also include measures of the patient experience. One expert noted that the Consumer Assessment of Healthcare Providers and Systems (CAHPS) hospice survey might have some relevant, validated questions that could be

26 leveraged. Work is also needed to ensure that the setting for PPC is well defined to facilitate Figure 3.3. Prices for Brand-Name and international comparisons. Generic Drugs Importance

Prices for Brand-Name and Generic Importance Drugs

Description Provided in Evidence Table Pharmaceuticals have enabled a multitude of improvements in health outcomes for patients. One in every five health care dollars is spent on 76 pharmaceuticals in OECD countries. While Scientific Acceptability overall spending has not changed in recent years, Scientific Acceptability it has become increasingly skewed toward expensive specialty medicines.77 Measuring drug pricing at the international level could lead nations to make decisions that impact prices, making them available more broadly and/or to specific subpopulations of patients. Brand-name and generic prescription drug pricing is dependent on quantity of services, mix Feasibility of compounds, prices, and other factors. Feasibility International comparisons are best done with sales of single-molecule products.78

Strengths and Limitations After discussion, experts felt that the measure of drug prices was important, particularly given findings summarized in RAND’s evidence table that annual expenditures on pharmaceuticals UsabilityUsability exceed half a trillion dollars in the United States and account for 17 percent of national spending on health care.79 Americans have reported skipping prescriptions because of cost, and this phenomenon is more common for those who have lower income and more chronic conditions.80 Drug prices are also one of HHS’s top priorities. Experts also rated this construct NOTES. blue: median; gray: IQR

27 higher on feasibility, although the distribution for scientific acceptability and usability was wider, resulting in median ratings in the moderate range (Figure 3.3). Experts pointed to a number of issues that make capturing pricing difficult, including cost- sharing and bargaining power that large insurers or benefit managers have that could affect drug prices. These challenges caused some experts to question how this measure is linked to health care system performance. Experts also discussed the pros and cons of various prices, including the manufacturer’s suggested retail price (MSRP), list price, post-rebate price, negotiated price (for many OECD countries), and net price. Although several experts agreed that the post-rebate price would be useful conceptually, they also were quick to note that this was unrealistic given the lack of data. One expert further noted that the post-rebate price “isn’t reflective of the net price, because rebates flow to payers, not consumers.” One expert proposed using the list price, or MSRP, because it can be collected. Another proposal was made to utilize the list price because it “is the least worst option [and] the most informative.” However, other experts questioned the value of “studying a price that we know nobody is paying and using it as a metric to assess the quality of the health care system. It is more dangerous to put out a price you know is false than not have information on pricing at all.”

What Is Needed to Move This Measure Forward This measure construct would benefit from more in-depth study and discussion of health economists and experts in drug pricing to identify the optimal approach for operationalizing this measure for international comparisons. OECD published a report on prescription drug pricing in 2008; however, this could be updated to include all participating OECD countries and more- recent drug prices.81 Experts did not reach an agreement on how best to measure pricing for drugs, and RAND’s evidence table indicates that comparing prices within and between countries is complicated by differences in product availability and formulations between countries, the proprietary nature of the rebates, different manufacturer charges for different payers, inclusion of different market sectors (retail versus inpatient versus outpatient), variability in definition of price, use of data describing price versus spending, distribution costs, value-added tax rates, and subpopulations of patients included in the evaluation (if inclusion varies based on insurance coverage).1,80 Standardization of these issues will be necessary.

Diffusion of and Access to New Prescription Drugs

Description Provided in Evidence Table Pharmaceutical innovations have led to reductions in morbidity and mortality due to conditions such as infectious diseases, cardiovascular diseases, and cancer. However, barriers to widespread diffusion of and access to new medications exist. For example, some health care systems could be slower to adopt new medications despite good evidence of benefits because of

28 poor communication about such benefits or Figure 3.4. Diffusion of and Access to New because of policies such as price regulation. In Prescription Drugs the literature, the following definitions of diffusion of new drugs have been identified: • the share of daily doses and of Importance expenditures in a therapeutic class that is captured by new medicines82 • the percentage of the population that has access to new products, by drug or class, reported by years since first approval (or use) anywhere in the world.83 Scientific Acceptability

Strengths and Limitations After discussion, experts rated the diffusion of and access to new prescription drugs higher on importance, but ratings were varied for scientific acceptability, feasibility, and usability (Figure 3.4). Experts offered a Feasibility number of caveats and a recommendation to split this measure construct into two or more distinct measures. Several experts noted that the emphasis of this measure should be on “new prescription drugs that have the maximum public health impact.” They noted that there are a lot of medications coming to market with modest incremental benefits: Usability “Simply measuring the total number of medications approved in a country says nothing about their scientific or public health importance.” Experts also discussed whether this measure would be further strengthened by assessing what share of people who need the medication are getting it, and one noted that it is not the approval of a drug or where it was NOTES. blue: median; gray: IQR developed that is important but “what is there” to ensure that patients get access to the drug. At least one expert advocated for a measure construct that was more focused on the development of drugs created in

29 “novel ways like gene therapy or other techniques to spur more competition in what is a vast market.”

What Is Needed to Move This Measure Forward Experts recommended splitting this measure construct into several distinct measures: 1. a measure of access that captures whether the people who need a new medication can access it 2. a measure that captures diffusion or delivery of a new drug to the populations who need the drug 3. a measure that captures innovation in the marketplace and the timing of bringing new drugs to market. RAND’s evidence table also cited a challenge for international comparisons that should be addressed, which is that access to novel but low-value medications is not necessarily an indicator of good health system performance, particularly if those drugs are expensive. Some countries, such as the United Kingdom, conduct a cost-benefit analysis and might not allow certain drugs to be covered if their effectiveness is deemed low.84 This lack of access to lower-value drugs runs counter to the policy of many countries and could count against the United Kingdom in assessing health care system performance, which might bias international comparisons.

Avoidable Emergency Department Use

Description Provided in Evidence Table Avoidable (or “preventable”) emergency department (ED) visits are those in which people use hospital EDs for nonurgent care and for conditions that could have been treated in a primary care setting.85 These are discharged ED visits not requiring any diagnostic or services, procedures, or medications.86 ED visits for ambulatory care–sensitive conditions (ACSCs) are considered avoidable.87 Avoidable ED visits can be experienced by all populations, regardless of sociodemographic or health insurance factors.87

Strengths and Limitations Experts noted that avoidable ED use is an important measure construct in the United States (Figure 3.5) because “we view [ED visits] as a high-cost visit” and because it “reflects underlying primary care capacity.” Data included in RAND’s evidence table suggest that in the United States, ED visits account for 12.5 percent of national health expenditures ($328.1 billion U.S. dollars in 2010). Furthermore, avoidable ED visits accounted for $64.4 billion or 2.4 percent of national health expenditures.88

30 However, experts provided lower and more- diverse ratings for scientific acceptability, Figure 3.5. Avoidable Emergency feasibility, and usability. Experts raised a Department Use number of concerns with using this measure to Importance make international comparisons. First, “different Importance health care systems around the world have different policies for what gets treated where. What might be a failure in the U.S. might not be a failure in other countries and vice versa.” One expert also noted that ED visits “are contingent upon the availability of alternative resources.” In areas where there are few alternatives for care in Scientific Acceptability Scientific Acceptability both the United States and in other countries, what we consider to be medically avoidable may actually be necessary to ensure receipt of high- quality care. Experts also cautioned that this measure is commonly analyzed after the incident and diagnosis, which can be problematic. “We have to be careful about visits that are ex-post deemed FeasibilityFeasibility to be avoidable as opposed to those [considered avoidable] ex-ante, or what a reasonable individual would think [did not need to be treated in a hospital].” RAND’s evidence table similarly noted that there is wide variability in the data sources used across studies to define avoidable ED visits (e.g., retrospective diagnoses, hospital admissions, triage scores, UsabilityUsability patient self-reported data), and validity of these measures is not always reported.86

What Is Needed to Move This Measure Forward Experts felt that the success of this measure would require clearer definitions and NOTES. blue: median; gray: IQR measurement specifications around the term avoidable. Analyses of avoidable hospitalizations commonly use claims analyses, but alternative data sources are likely necessary to more accurately reflect avoidable visits when the diagnosis is

31 not yet known. Additional measure specifications could require the exclusion of Figure 3.6. The Percentage of Patients with an Opioid Use Disorder Who Were Referred to or populations (e.g., in rural areas) for whom the Prescribed Medication-Assisted Treatment ED is the only source of after-hours medical care. Importance The Percentage of Patients with an Opioid Use Disorder Who Were Referred to or Prescribed Medication-Assisted Treatment

Description Provided in Evidence Table Scientific Acceptability Medication-assisted treatment (MAT) is the most effective medical treatment for opioid use disorder (OUD).89 Despite the prescribing options available, estimates suggest that only 20–40 percent of people with OUD receive MAT.90 The referral treatment process consists of assisting a patient with accessing MAT, selecting treatment facilities, and helping to Feasibility navigate any barriers, such as treatment cost or lack of transportation, that could hinder accessing treatment in a specialty setting.91 Measuring the number of people who were or were not able to access MAT requires measuring the scope of the problem, treatment providers available, and education of those Usability providers.

Strengths and Limitations Experts rated this measure construct as higher on importance, with wider distributions for scientific acceptability, feasibility, and usability (Figure 3.6). This measure construct aligns with a top HHS priority of addressing NOTES. blue: median; gray: IQR the opioid crisis, and RAND’s evidence table notes that the misuse of and addiction to opioids is a major public health crisis in the United States, causing over 1.6 million years of life lost annually.92 While experts considered this

32 measure construct to be important, they expressed a number of concerns about the readiness of this measure construct for international comparisons. First, experts noted that receiving a prescription for MAT does not necessarily translate to access. “You may be referred to MAT but may not be able to get it. You can wait months after a referral [to access treatment].” Experts also pointed out that there are good data available on the number of people who receive MAT, but the denominator is more difficult to capture. Experts questioned whether data were available on how many people have an OUD and whether that number is available internationally. One expert noted that “other countries are taking a different approach [to treating OUD], such as safe injection sites,” which may make this measure less comparable across countries. Although experts agreed that a lack of international data should not preclude pursuing this measure construct, they also noted that collecting this information is likely to require survey data. While RAND’s evidence table notes that many European countries93 and other OECD countries94 regularly field surveys like the National Survey on Drug Use and Health (NSDUH) that attempt to describe licit and illicit drug use in their populations, one expert noted that “as a rule, quality measures based on potentially criminal activity tend to be difficult to implement. And if the legal environment is different across countries, it may introduce new sources of bias.”

What Is Needed to Move This Measure Forward For this measure construct to move forward, significant challenges with respect to the quality and comparability of data need to be addressed. Given the challenges identified with respect to referral versus receipt, experts agreed and re-rated this measure construct with the assumption that it would be a measure of receipt of MAT. However, even with that refinement, there still could be challenges with international comparisons; RAND’s evidence table noted that there are important differences in how receipt of MAT might be documented across countries because some have national prescription registries while others collect separate data describing reimbursement and prescription. Other countries have good prescription data for specific subpopulations (e.g., those covered by certain insurance programs) but lack data for other subpopulations.95 Challenges identifying the number of people with an OUD necessary to standardize the measure also remain and would need to be addressed.

Estimates of Administrative Complexity and Cost

Description Provided in Evidence Table In the clinical setting, administration refers to the nonclinical activities that regulate or control the behavior of individuals in a health care organization, enabling them to implement policy decisions and achieve their goals.96 Administrative tasks must be carried out at all levels of the health care system to ensure high-quality health care. While more resources invested in

33 administration can be productive, especially high Figure 3.7. Estimates of Administrative administrative complexity and cost might be a Complexity and Cost sign of wasteful spending that could be curtailed without worsening patient health outcomes.97 • Administrative complexity is the Importance complicated workflows and fragmented financing procedures that can waste clinicians’ time and interfere with their caring for patients.98 Estimates can include, but are not limited to, time spent preparing paperwork (e.g., processing and billing of claims) and contacting payers.99 • Administrative costs are the costs to carry Scientific Acceptability out administrative services that help ensure against illness and deliver medical care.100 Estimates can include, but are not limited to, transaction-related costs, benefits management, selling and marketing, and regulatory and compliance costs.100

Strengths and Limitations Feasibility Although the median score for importance of administrative complexity and cost was in the high range, several experts rated its importance as very low (Figure 3.7). Similarly, several experts provided low ratings for scientific acceptability, feasibility, and usability, although the median scores were in the moderate range. RAND’s evidence table provided recent Usability estimates of the percentage of health spending dedicated to administration in the United States, which ranged from 8.3 to 25.3 percent,101,102 depending on how costs were calculated and what was included. Experts noted that figuring out how to compare this in a meaningful way across countries is challenging because each country’s health care system is set up differently. NOTES. blue: median; gray: IQR Health economist members of our panel noted that “the cost accounting to accurately capture administrative complexity is exceedingly difficult,” in part because “the basis for accounting and cost accounting systems differ among countries and between governments and private

34 institutions.” Experts also discussed whether labor force surveys and the number of people in administrative positions could be used as a proxy for administrative complexity. While some found this a feasible option, others noted that it was more important to assess whether the “people produced useful output” as opposed to using the number of staff alone. Even though this is a challenging measure construct to develop from an economic standpoint, experts argued that perceived difficulty should not be the reason not to pursue development. “We know that we are not doing a strictly apples to apples measure, but starting to collect the data will . . . shed better light and improve comparability. It’s a big enough topic and controversial enough that it is important.”

What Is Needed to Move This Measure Forward Given the inherent challenges with this measure construct, developing a measure that is feasible and valid for international comparisons will likely require significant development. It will be important to develop a clear definition of administrative complexity and costs that can be universally applied across countries and that addresses some of the challenges with different accounting and health financing systems. As starting points, in RAND’s evidence table, we note that the system of health accounts described by OECD provides an international framework for the definition, demarcation, and categorization of health expenditures. Under this system, transactions are classified with regard to who pays (financing), who provides (provision), and what the purpose is (function). In the United States, administrative costs have previously been subdivided into costs attributable to private insurers (e.g., claims processing, profits), the government (e.g., eligibility determination, revenue collection), providers (e.g., billing, collections, collection and reporting of quality data), and employers (e.g., choosing plans, designing benefits). However, a more fundamental problem is that specific accounting approaches differ between private and public insurers and between countries. One of our experts noted that although a measure of precise costs could be quite challenging for the above- mentioned reasons, a survey approach to capture some of this information might be a feasible alternative.

Disadoption of Ineffective Medical Services

Description Provided in Evidence Table This measure construct, depending on its precise specification, could describe the rate at which the health care system identifies ineffective treatments and reduces their availability or utilization in the health care system. A disproven treatment is a treatment that has fallen out of favor due to evidence overwhelmingly demonstrating that it is more harmful than beneficial. In the literature, this is often referred to as a medical reversal. Medical reversals occur when new

35 evidence (better designed, controlled, or Figure 3.8. Disadoption of Ineffective powered than predecessors) contradicts the Medical Services current standard of care.103

Importance Strengths and Limitations Experts rated this measure concept higher on importance, but ratings were more spread out for scientific acceptability, feasibility, and usability (Figure 3.8). Experts voiced concern over the use of the term ineffective in this measure construct, noting that it is hard to define “services that do more harm than good.” Scientific Acceptability One expert noted that this measure could be more palatable and actionable if the definition were flipped to specify “very low or no benefit” based on published evidence. Experts noted that , an initiative of the ABIM Foundation that seeks to advance a national dialogue on avoiding unnecessary medical tests, treatments, and procedures, has a Feasibility series of reports that are “trying to find consensus around low-value services. Some may be inappropriate, some questionable, but the idea is that through claims you can identify situations where the service is likely to be of low value.”104 Another expert liked the idea of this measure and pointed out that, although it is Usability difficult to grade the evidence of medical interventions, infrastructure to do so is in place. One expert pointed to the RAND appropriateness criteria developed in the 1980s, although this person noted that those determinations are made on an individual basis and that “this [measure construct] is very challenging to implement if it is defined based NOTES. blue: median; gray: IQR on the implications for individuals.” Another expert agreed that a lot of debate will be around individual-level decisionmaking but noted that a national-level measure may alleviate some of these concerns. “I like the framing of countries persuading physicians to avoid problematic treatments.”

36 What Is Needed to Move the Measure Forward Experts cautioned that there will be opposition to a measure of this type from stakeholders who currently benefit from the continued implementation of low-value or ineffective medical services (e.g., providers, drug manufacturers), regardless of how it is operationalized. Although a change in the framing could be useful for increasing acceptance, experts asked themselves whether “the benefits are worth the costs in terms of the blowback [we may get].” Several experts pointed to a potential solution to reduce the contentiousness of this measure that involved identifying a limited set of low-value (or no-value) services that were not controversial and that the majority of physicians would agree should not be utilized: “If we select a group of [services] or stand up a group like the U.S. Preventive Services Task Force to identify them, this would address a lot and improve health care systems.” Although in some cases different groups might read or interpret data differently, it could be possible to restrict the procedures included in this measure to those with wide agreement. Ensuring clear delineation between the related concepts of negative clinical benefit and poor value for the money spent will be important in the operationalization of this measure moving forward.

Healthy Days at Home

Description Provided in Evidence Table Healthy days at home (HDAH) is a population-based measure that attempts to quantify how well health care organizations keep people alive, healthy, and not utilizing health care services.105,106 This measure is one of a select few population-based measures of the health care system that attempts to quantify health, as opposed to the lack thereof.106 The measure is calculated by subtracting the total number of days out of the year that the individual was not alive or was utilizing acute or post-acute health care services from 365 days and then calculating the mean number of HDAH for the population of interest.106

Strengths and Limitations After discussion, experts remained divided in their perceptions of the importance, scientific acceptability, feasibility, and usability of this measure construct, resulting in median scores in the moderate range for all domains (Figure 3.9). This may have been due, in part, to experts interpreting this measure differently and lack of consensus around whether it was a useful measure of the health care system specifically. Some commented that they “do not see how the health care system has a strong connection to this [measure construct] compared to the public health system, SES [socioeconomic] characteristics, etc.” Another noted that to connect this

37 measure construct to the health care system “is Figure 3.9. Healthy Days at Home a long stretch.” Others, however, noted that Importance the “idea behind the measure is to indicate Importance whether the health care system is effective at keeping patients at home, where they generally want to be.” Another expert commented that this measure construct can reflect “a reduction of unnecessary hospital days, a worthy goal that can be achieved. . . . It is an improvement on measures like Scientific Acceptability readmissions or counting hospital days.” Scientific Acceptability Experts also noted that a measure like this could also help to inform our understanding of transitions to home-based care and assess, to some extent, “how hospital versus community-based care stacks up.” Experts noted, however, that with this measure one would want to stratify patients according to Feasibility the risks they are facing, which is difficult Feasibility even within the United States and particularly challenging for international comparisons.

What Is Needed to Move This Measure Forward A lot of the discussion of this measure centered around whether it was one that UsabilityUsability reflected health care system performance. Given that the objective of this project was to identify measures to strengthen international comparisons of health care system performance, this is a critical decision point that could shape next steps. One expert questioned whether this measure could be offered to OECD as part of a broader set of NOTES. blue: median; gray: IQR measures rather than ones specific to the health care system, although there was concern that it would be misinterpreted by the user as a measure of health care system performance. Experts noted, however, that there are a number of measures that capture similar ideas that might be useful to draw on if this measure construct

38 moves forward, including one recently developed by Burke et al. in conjunction with Figure 3.10. Availability of Emergency Medical Services to Prevent Opioid Death the Medicare Payment Advisory Commission.106 Importance Availability of Emergency Medical Services to Prevent Opioid Death

Description Provided in Evidence Table Emergency medical services (EMS) are a potential mechanism for provision of naloxone, an opioid antagonist that reverses the effects of Scientific Acceptability opioid overdose. Naloxone is increasingly being used by police officers, emergency medical technicians, and nonemergency first responders to reverse opioid overdoses.107 EMS include out-of-hospital EMS practitioners, such as emergency medical technicians and paramedics (i.e., first responders); initial out-of-hospital treatment; Feasibility and transport by air or by ground to a hospital.108

Strengths and Limitations Although some experts rated this measure construct high for importance and scientific acceptability, overall, this measure construct received low to moderate scores for Usability importance, scientific acceptability, feasibility, and usability (Figure 3.10). Experts noted that, while they liked this measure construct in theory, they questioned its added value and its utility for international comparisons. One expert commented that a more useful measure construct would capture the availability of naloxone to prevent opioid death across several NOTES. blue: median; gray: IQR settings: “This is an important concept, but . . . why are we focusing on the EMS response?” Another noted that it was hard to interpret the measure without knowing more about the

39 simultaneous need for such medical services across countries or availability of EMS services. Building on the discussion of international comparisons, one expert questioned whether this was a measure we wanted to propose, noting that “it’s a critically important issue in the U.S., but is [this] a similar issue around the world that would give us a peek into health care systems that we could learn from?” Even within the United States, one expert commented that this information might not be readily available: “The one data source I’m aware of is a proprietary source.” One expert felt that “measuring opioid consumption and naloxone consumption in other countries is probably as far as you will get.”

What Is Needed to Move This Measure Forward Of the measures that were discussed by experts in the Phase 2 rating process, this measure construct received the lowest ratings. Should the decision be made to move this measure forward, it will be important to take into account that emergency services are structured differently in OECD countries. For example, in some countries emergency physicians who have the ability to administer naloxone are sent out to emergencies. RAND’s evidence table also discussed potential ways to operationalize this measure construct. They include • the percentage of opioid overdoses that were reversed with naloxone administered by EMS • the percentage of EMS personnel who are trained to administer and are equipped with naloxone • the percentage of people who could be reached by EMS trained to administer and equipped with naloxone within a specified amount of time • the volume of ED admissions for opioid overdose with transport to the ED via EMS.

Conclusion The ten measures included in this chapter hold promise but require significant work before they are ready to be implemented for the purpose of comparing health care system performance across countries. Experts suggested ways to refine, focus, or split the measure constructs, providing a helpful direction for how they could be strengthened. Many of the perceived limitations of these measure constructs centered around three major concerns: (1) Measure constructs could be impacted by factors outside of the health care system, (2) data both within the United States and abroad might not be available, and (3) cultural or organizational differences across countries that shape where and how care is delivered could pose a barrier to meaningful comparison. If these measure constructs are to move forward, these and other measure-specific challenges will need to be overcome.

40 4. Measure Constructs That Were Not Discussed by Experts

The following measure constructs were rated by experts in Phase 2 but did not score highly enough to be discussed at the Phase 3 teleconference. Experts were given a chance to move any of these measure constructs to the Phase 3 agenda, but they felt that other measure constructs held more promise overall and did not request that these constructs be discussed. The results presented in this chapter, therefore, summarize the Phase 2 ratings and provide additional context for some of the perceived limitations offered by experts through comments provided as justifications for their ratings in the ExpertLens platform. Given that experts were not as supportive of these measure constructs, we do not include a discussion of what is needed to move each measure construct forward. Measure constructs include • clinician workforce who can prescribe medication-assisted treatment or naloxone • access to opioid treatment centers • the percentage of patients with a follow-up visit within four weeks of starting an opioid for chronic pain • time to regulatory approval for new prescription drugs • travel time to provider office • health care spending in the last year of life • spending on mental health (percentage of total health spending).

Clinician Workforce Who Can Prescribe Medication-Assisted Treatment or Naloxone

Description Provided in Evidence Table MAT is the most effective medical treatment for OUD and other SUDs, including alcohol.89 Three medications have been approved by the U.S. Food and Drug Administration (FDA) to treat OUD: methadone, buprenorphine, and naltrexone. Additionally, the FDA has approved naloxone, an injectable or intranasal drug used to prevent opioid overdose.109 Historically, the primary treatment for OUD was methadone, which was only administered by accredited opioid treatment programs (OTPs).110 However, there have been and remain barriers to methadone treatment, including locations of OTPs, provider shortages, and treatment waitlists.111

Strengths and Limitations In Phase 2, experts provided a wide distribution of responses for importance, scientific acceptability, feasibility, and usability of this measure construct, resulting in median ratings in the moderate range for all domains (Figure 4.1). Experts noted that this measure aligns with the

41 HHS priority to address the opioid crisis in the United States, and data included in RAND’s Figure 4.1. Clinician Workforce Who Can Prescribe Medication-Assisted Treatment or evidence table suggest that only 20–40 percent Naloxone 90 of people with OUD receive MAT, with much Importance of this treatment gap attributed to the workforce, Importance Importance specifically due to (1) insufficient prescriber training, (2) lack of institutional support, (3) poor care coordination, (4) provider stigma, (5) inadequate reimbursement, and (6) burdensome regulatory procedures.112 Despite the importance of this measure in the United States, several experts questioned whether this was an Scientific Acceptability appropriate measure for international Scientific Acceptability Scientific Acceptability comparisons or health care system performance in countries where OUD may be less prevalent. As one expert noted, “The appropriate policy for the U.S. on this issue depends on the need in the U.S. and the cost-effectiveness of this [clinician workforce who can prescribe MAT] versus other approaches. International comparisons are not useful to this decisionmaking.” Another Feasibility Feasibility Feasibility commented, “Given major differences in health professional licensure and credentialing across countries, [this measure construct] may be meaningless.” Experts also noted that counts of prescribers who have the ability to prescribe do not necessarily equate to access to MAT, which experts considered the more important measure construct, or the ability to meet the demand. One UsabilityUsability expert commented, for example, that it was Usability unclear whether “higher rates actually lead to better substance use disorder outcomes.”

Access to Opioid Treatment Centers

Description Provided in Evidence Table Access to treatment facilities (for SUDs, NOTES. blue: median; gray: IQR specifically OUD) is defined as the ability to

42 offer same-day or walk-in appointments in the Figure 4.2. Access to Opioid Treatment outpatient setting and the ability to optimize Centers resources, refer patients, and support them if the necessary level of care is not immediately Importance available.113

Strengths and Limitations Experts rated this measure construct high on importance given its alignment with the HHS priority to address the opioid crisis (Figure 4.2). RAND’s evidence table also noted that increasing access to medications for OUD treatment is widely Scientific Acceptability acknowledged to be a key strategy for addressing the opioid epidemic114–116 and that outpatient treatment facilities are particularly important for the treatment of SUDs, since only 13 percent of individuals who receive treatment do so in a private physician’s office.117 Despite higher ratings for importance, expert ratings for scientific Feasibility acceptability, feasibility, and usability were more varied. Experts noted that this measure construct is “key to treating addiction,” but some experts cautioned that “physical access does not assure patients will use these facilities, due to information and financial barriers.” One expert noted that a “more valid measure may be the percent of patients Usability receiving this treatment.” Experts felt that this measure construct would benefit from increased specificity on what constitutes a treatment center. One commented, “It would be important to carefully define these centers and to capture information on capacity of the facility.” Other experts offered cautions around NOTES. blue: median; gray: IQR potential data sources, noting, “If data are based on subjective opinions about availability, then it . . . would be misleading. If it is data from objective, scientifically sound evidence sources, then it will be useful.” Some experts also questioned the value of this measure construct for international comparisons: “[It is] not clear how this would be implemented across countries with different regulatory systems and different

43 infrastructures for substance use disorders.” Despite Figure 4.3. The Percentage of Patients with a these challenges, one expert commented that “if a Follow-Up Visit Within Four Weeks of Starting meaningful measure could be developed, it could be an Opioid for Chronic Pain a useful comparison across countries, much like we compare number of hospital beds across countries.” Importance

The Percentage of Patients with a Follow-Up Visit Within Four Weeks of Starting an Opioid for Chronic Pain

Description Provided in Evidence Table Scientific Acceptability Chronic pain is typically defined as pain that lasts more than three to six months and is present on most days or every day. In 2016, the CDC released its guidelines for prescribing opioids for chronic pain in the United States to encourage careful and selective use of opioid therapy for pain management.118 The CDC advised that “clinicians should evaluate benefits and harms within 1 to 4 Feasibility weeks of starting opioid therapy for chronic pain or of dose escalation.”118 The CDC also developed quality improvement measures to incentivize providers to follow the new guidelines, including an assessment of the recommendation for follow-up within four weeks of starting opioid therapy for chronic pain in order to evaluate the benefits and Usability harms of continued opioid therapy.119

Strengths and Limitations Experts had several concerns about this measure construct overall, which resulted in lower ratings (Figure 4.3). While experts acknowledged that addressing the opioid crisis is a top HHS priority, they noted that the evidence base for the timing of NOTES. blue: median; gray: IQR. this particular visit was not very strong and that this measure “could be met without much impact on patient outcomes.” One expert noted that this measure “feels incomplete, as it does not tell you whether the patient continued with the opioid or not,” and others were skeptical about the usefulness of this measure if “follow-up visits

44 become ‘tick the box’ exercises, especially if Figure 4.4. Time to Regulatory Approval telehealth visits count.” Experts noted that for New Prescription Drugs although this may be a useful measure “to see how compliant our clinicians are in providing Importance appropriate patient follow-up . . . it is not clear that this recommendation is the same across all countries.” RAND’s evidence table raised additional considerations about data access for this measure construct, mainly that EHRs can differ in their ability to capture opioid prescriptions,119 and countries with EHRs that do not capture all of the available opioid Scientific Acceptability medications could have biased results. If survey data are used to collect these data, a minimum standard for a follow-up visit (e.g., duration, content) should be established.

Time to Regulatory Approval for New Prescription Drugs Feasibility Description Provided in Evidence Table When new prescription medications are discovered, it can take different amounts of time for the same biologic agent to be approved for sale in different nations. An international measure of time to regulatory approval could encourage nations or regulatory bodies with slower approval processes to consider Usability streamlining them, particularly for medications that have demonstrable benefits, such as improved health outcomes or cost-effectiveness.

Strengths and Limitations Experts rated this measure construct higher on feasibility for international comparisons, NOTES. blue: median; gray: IQR with more disagreement among experts on the importance, scientific acceptability, and usability of this measure construct; several experts rated it very high, and others rated it very low (Figure 4.4). In terms of importance, experts giving high

45 ratings explained that rapid approval was especially important for cancer patients and also during a pandemic. For example, one expert commented, “Obviously very important for cancer, where time is of the essence . . . and cancer drugs make up most new drugs.” Those giving importance a low rating responded that “faster is not always better” and pointed out that “countries may have differing priorities related to their economic situation, capacity to spend on new therapies, views of safety, epidemiology of disease, and alternative treatments.” Experts on both ends of the rating spectrum recommended more investigation to clarify how increasing the pace of regulatory approval would alter benefits and risks. For example, one expert commented, “The validity of a ‘timing’ measure should be supported by evidence on the marginal difference in benefits and risk, which will clearly differ among newly introduced drugs and is likely to evolve over time as more data become available.” There was relative consensus among experts that data collection would be feasible. In fact, one expert commented that the Foundation for Research on Equal Opportunity already collects similar data, which are incorporated into its World Index of Healthcare Innovation.120 However, multiple experts expressed concern that market characteristics would affect the usability of the measure construct, noting that “this [concept] reflects both corporate strategy and regulatory practices,” which would make results hard to interpret. Others were concerned that health care systems would have little ability to influence regulatory approval times: “Not sure how health care systems can change this per se. [It] seems like a reflection of our regulatory process via the FDA.”

Travel Time to Provider Office

Description Provided in Evidence Table The burden of travel from a patient’s residence to his or her can be an important measure of access to preventive and treatment services. Travel time can be estimated directly (e.g., using geographic information systems [GIS], online routing websites, or self-report measures), but when data are unavailable, travel distance is often used as a proxy measure of travel time. However, although time and distance are highly correlated,121 they can differ depending on several factors (travel mode, time of day, travel speed, etc.).122

Strengths and Limitations In Phase 2, experts rated this measure construct in the moderate range across all domains (Figure 4.5). Experts commented that a measure construct quantifying travel time could play an important role in identifying access problems, particularly for underserved patients. However, one expert responded that it was unclear “how this aligns with HHS priorities.” Four different experts mentioned telehealth in relation to this concept. The overall implication of these

46 comments was that the importance of optimizing Figure 4.5. Travel Time to Provider Office travel time is decreasing with the current Importance Importance expansion of telehealth. Importance Another common theme among experts was that travel time could be used as part of a set of measures characterizing barriers to access of care. For example, one expert wrote, “Travel time can be useful locally when included in a larger suite of measures of access.” Multiple experts reported that it would be necessary to clarify Scientific Acceptability Scientific Acceptability aspects of measurement methodology before they Scientific Acceptability could comment on dimensions of this concept, such as scientific acceptability. For example, “Low travel time to providers is important in some settings and less important in others. [On the one hand,] short time to the emergency room during a heart attack is really important. By contrast, travel time to an oncologist for an initial Feasibility Feasibility cancer workup is much less important.” Another Feasibility expert commented, “There are limitations to how we calculate distance and time traveled. The available tools to do this calculation have improved over time. A key issue is agreeing upon to what provider we are calculating a patient’s travel.” Similarly, there was concern that international comparability would be challenging given differences in transportation infrastructure, Usability Usability population density, and availability of telehealth. However, some experts were more optimistic that the measure could be acceptable, meaningful, and useful: “Data are more readily available than in the past. If technical challenges can be addressed, measures based on this concept can add useful information to other measures of access.”

NOTES. blue: median; gray: IQR

47 Health Care Spending in the Last Figure 4.6. Health Care Spending in the Year of Life Last Year of Life

Description Provided in Evidence Table Importance Health care spending in the last year of life is thought to be an indicator of wasteful spending on care for terminally ill patients with poor prognoses. After a patient’s death, the amount spent on that patient’s care can be calculated retrospectively. If the same calculation is performed for all patients who died in a one-year period, the total amount spent can be averaged Scientific Acceptability over the number of persons who died.

Strengths and Limitations Experts were split on all dimensions of this measure construct, with some scoring it very high and others scoring it very low (Figure 4.6). Several experts commented that the measure construct was well aligned with the HHS priority Feasibility to advance value-based care: “Reducing unnecessary spending at the end of life would improve the value of care delivered.” However, a common concern was that peer-reviewed literature has questioned the validity of using health care spending at the end of life as a measure of health care system performance. Usability Reasoning against the measure construct centered on the idea that death is difficult to predict prospectively, which means that much high-intensity spending is for care of patients who ultimately survive—sometimes for years after a period of high spending. Multiple experts cited literature opposing the measure 123,124 construct, and one expert recommended NOTES. blue: median; gray: IQR that an improved end-of-life spending measure would “somehow need to account for the uncertainty of [prospectively] predicting whether it will be the last year of life.”

48 A criticism shared by several experts was Figure 4.7. Spending on Mental Health that international differences would be driven (Percentage of Total Health Spending) by cultural variation among OECD nations rather than health care system performance. One expert commented, “Every person has a Importance different value placed on care in end stages of life. It is simply wrong to put this together and then extrapolate to some sort of meaningful policy difference.” An additional criticism was that nations with high spending might experience consequential political pressure to decrease costs that would lead to harmful Scientific Acceptability rationing of care. In terms of feasibility, some experts highlighted the simplicity of the measure construct, saying that it is “easy to define and measure (in theory).” Others cautioned that data collection in the United States might be limited to Medicare beneficiaries, thereby compromising international comparability. Feasibility

Spending on Mental Health (Percentage of Total Health Spending)

Description Provided in Evidence Table

National health spending describes both Usability individual needs and population health as a whole. Health spending includes the consumption of health goods and services and includes all types of financing arrangements.1 Percentage of total health spending is the ratio of health spending allocated to mental health services compared with total national health spending.125 NOTES. blue: median; gray: IQR

49 Strengths and Limitations Experts were divided on all dimensions of this measure construct (Figure 4.7). Overall, the highest median rating was for importance. Experts giving high ratings for this dimension explained that mental health had historically been underprioritized: “[Mental health] is an important concept, especially in the U.S. due to longstanding differences in parity.” Experts giving low importance ratings commented that the directionality of the concept was unclear and that it was not clear whether we should be aiming for a high or a low percentage. One expert noted, “This measure punishes countries that have cost-efficient mental health systems.” Another expert felt that “absolute spending per capita is more important,” since the percentage of mental health spending is affected by the amount of total health spending in the country. Multiple experts commented that a measure encouraging nations to increase spending might not lead to improved outcomes: “Not sure spending (inputs) is as important as outcomes (outputs).” One expert expressed concern that prioritizing mental health spending was “politically charged due to debate about efficacy of intervention.” A common criticism of the measure construct was that definitions of mental health might vary among nations, leading to challenges with measurement and international comparability: “Organization, payment, workforce, and pricing differences are among several challenges.” One expert was optimistic that measurement could be harmonized because “we have had similar discussions around defining primary care spending.” Suggestions for strengthening the measure construct included (1) using existing “specifications from the Substance Abuse and Mental Health Services Administration (SAMHSA) or OECD tools” to facilitate common definitions across nations and (2) reporting stratified results by income, race, and ethnicity to ensure validity.

Conclusion The seven measure constructs included in this chapter scored the lowest, overall, in Phase 2 ratings. For some of the measure constructs, experts were split, with some providing strong support and others calling out what they considered to be critical flaws or challenges with the measure construct that would be difficult to overcome. Other measure constructs were not met with such strong opposition, but they also did not have a strong champion among experts. While the measure constructs included in this chapter hold merit and could provide useful information for strengthening the knowledge base, they require significant work before they can be used for international comparisons of health care system performance.

50 5. Recommended Modifications to Existing OECD Measures

Some of the measure constructs provided by experts in Phase 1 were closely related to currently reported OECD measures. In many cases, the expert suggestions indicate potential refinements or extensions to the existing OECD measures. In this chapter, we first provide a brief overview of OECD Health Statistics, then summarize suggestions for refining or extending those measures collected during Phase 1 of our expert elicitation process.

OECD Health Statistics The OECD Health Statistics database includes the latest comparable data for the OECD indicators across the 36 OECD member countries, as well as candidate and partner countries.17 These indicators reflect differences across countries in • health status—e.g., life expectancy, main causes of mortality, disease incidence • risk factors for health—e.g., smoking, alcohol, obesity, opioid use • access to care—e.g., the extent to which people can access needed services, population coverage • quality and outcomes of care—e.g., , clinical effectiveness, prescribing practices • health expenditure and financing—e.g., how much countries spend per person, prices paid • health workforce—e.g., supply and remuneration of doctors and nurses • health care activities—e.g., use and supply of hospital services, medical technologies • pharmaceutical sector—e.g., pharmaceutical spending, research and development (R&D), use of generics • aging and long-term care—e.g., demand for long term care, quality of dementia care • patient-reported outcomes and experiences—e.g., preliminary results from limited countries in three areas: elective hip and , breast cancer care, and mental health. Experts provided suggestions for expanding and enhancing OECD measures in four of these areas: quality and outcomes of care (focusing on health outcomes for common diseases), health expenditure, health workforce, and access to care (focusing on waiting times). Experts also suggested allocation of social spending by age group and ways that equity could be incorporated into OECD measurement across these measurement topics.

Health Outcomes for Common Diseases Health outcomes for the most prevalent and burdensome diseases, such as cancer, ischemic heart disease, stroke, and diabetes, are an important dimension of health care system

51 performance in OECD countries. OECD Health Statistics currently includes a variety of outcome measures for these diseases, including mortality rates, cancer incidence, five-year survival rates for selected types of cancer, breast cancer stage distribution, and 30-day mortality following hospitalization for acute myocardial infarction. Given the importance of these diseases in contributing to death and disability in OECD countries, continuing to expand upon these measures may be warranted. For cancer, reporting stage distribution and survival rates for additional types of cancer could be considered. A number of outcome measures, including such intermediate outcomes as blood glucose control, are routinely measured and reported in the United States and other countries and would expand the possibilities of international comparisons.

Health Expenditure OECD reports a variety of measures of health expenditure, including expenditure by type of service and by source of financing. Health expenditure is reported in currency units (local and adjusted for purchasing power or exchange rates), per capita, and as a percentage of gross domestic product (GDP). One participating expert suggested exploring denominators other than GDP. GDP is used as a proxy for income and is a strong predictor of national health spending. However, GDP is a measure of production and can systematically vary from measures of income or consumption. Alternatively, international comparisons could focus on health expenditure as a share of consumption as measured by existing measures of consumption (such as actual individual income) or measures of income (such as household net adjusted disposable income). The latter measure is reported as part of the OECD Better Life Index.126 Another suggestion to improve international comparisons of health expenditure is to stratify by household income. This type of measure provides a measure of the burden of health care costs among population groups and would allow for international comparisons of the degree of redistribution of costs among groups. For example, Carman et al. reported that United States households in the lowest income quintile pay an average of 34 percent of income toward health care, compared with 16 percent of income among households in the highest income quintile.127 Another suggestion was to increase transparency in accounting methods that can affect international comparisons of health expenditure and take additional steps to increase comparability where possible. Experts noted that accounting differences among countries, and between private- and public-sector organizations within countries, can profoundly affect the measurement of health expenditure. Specific areas of difference that were called out include the chart of accounts (an accounting term for the list of the revenues, expenses, assets, and liabilities that activities and sites included); measurement of amortized items, such as pensions, retiree health care costs, contingent liabilities, and depreciation expenses; use of accrual or encumbrance accounting; alignment with Generally Accepted Accounting Principles; and the

52 extent of debt financing, among others. OECD publishes health accounting guidance in the publication A System of Health Accounts, and countries submit details on their accounting methodology in a “note on data sources and comparability” that is linked from the country’s health expenditure data entry in OECD Health Statistics.17

Health Workforce OECD currently reports on the number of health care workers in each country by various job categories, such as doctors, nurses, dentists, and pharmacists, among others. However, with limited exceptions (e.g., hospital employment, long-term care workers), the currently reported measures do not allow for analysis of employment by setting of care. Additional data on workers employed by setting would allow for greater understanding of how resources are distributed within health care systems and productivity. A further type of stratification of employment statistics would be between clinical and nonclinical staff working in each setting. This would enable more-accurate estimates of the labor component of administration of health care. OECD currently reports a measure of “total health and social employment.” One expert recommended breaking out the reporting of health care worker employment and social work employment because in the United States social work is mostly not funded through the health care system. Another suggestion for health workforce statistics is to expand the reporting of remuneration of health care providers. OECD currently reports on remuneration of doctors and nurses, but data are missing for many countries. An increased focus on data completeness and expansion to different types of health professions would enable more-detailed analyses of the sources of differences in health expenditure among countries and over time.

Waiting Times OECD Health Statistics currently includes waiting times for elective surgery and specialist appointments. In addition, a May 2020 OECD report provided more detail on waiting times in OECD countries. As noted in that report, waiting times are a persistent challenge in many countries and “are a reflection of the functioning of the health care system as a whole and provide an opportunity for policy makers to trigger changes to improve the appropriateness, responsiveness and efficiency in health service delivery.”128 The OECD data on waiting times for elective surgery and specialist appointments currently do not include data for the United States. Developing a data source that would allow for U.S. submissions of waiting time data would permit comparisons with other countries. In addition, OECD should consider expansion of the types of waiting times included in OECD Health Statistics. The OECD report on waiting times noted that OECD countries increasingly measure waiting times for primary care, cancer care, and mental health services.

53 Diagnostic screening is another important type of service for which waiting times comparisons could be useful to policymakers.

Allocation of Social Spending by Age Group OECD reports total social spending, which comprises cash benefits, direct in-kind provision of goods and services, and tax breaks with social purposes (to be considered “social,” the spending must involve either compulsory participation or redistribution across households). One expert recommended that the OECD report social spending in categories of benefits targeted to different age groups, such as programs for older people (e.g., pensions, home help) and family benefits (e.g., early childhood education, parental leave).

Equity In all phases of this project, experts raised equity as an important dimension of the measure constructs proposed, rated, and discussed. Through the lens of measurement, equity can be operationalized through ensuring that data are available on race and ethnicity, gender, income, and other characteristics, such as residing in a rural or urban community. Encouraging countries to begin collecting demographic data on their populations that could be linked to existing measures could create a more nuanced understanding of the OECD measures within countries and help to elucidate important disparities and gaps in performance by country that might be masked when such subgroup analyses are not conducted. As such, experts noted that a stronger focus on equity and disparities is needed not only in the current OECD measures set but should also be considered in refinements to the measure constructs identified in this project.

Other Expert Recommendations Experts included a number of measure construct nominations that are currently reported by OECD. Unlike the measure constructs discussed in the previous section, the experts did not provide recommendations for substantial changes to OECD methodology for these measure constructs. Although experts were not explicitly asked to identify existing OECD measures that they believe are more useful for international comparisons than others, the nominations might provide some insight as to which OECD measures could be highlighted in future comparisons. These nominations include • opioid-related or drug-related death • out-of-pocket expenses • private health insurance coverage • skipping or being unable to access prescribed medication due to cost, formularies • availability of generics and biosimilar measures as share of unit volume and share of sales

54 • total health employees per 1,000 capita • health care provider compensation and earnings • percentage of potential years of life lost, separated by cause • quality of outcomes of top mortality diseases, key chronic diseases • average length of stay in • self-reported health • total doctor visits per capita • utilization of • ambulatory care–sensitive admissions • acute care beds per 1,000 capita • health care consumption, price, and utilization indexes • obesity, calorie consumption • alcohol use • smoking • patient satisfaction.

Critiques of OECD Measures The background research provided to experts in Phase 1 included a number of critiques of OECD measures that were identified in the literature. Although OECD has worked to strengthen international comparison of quality metrics by improving the definition and availability of quality indicators and supporting information infrastructure to produce more-reliable indicators in an increasing number of countries, critiques of OECD measures for international comparisons remain. International comparisons using existing OECD measures, as well as efforts to develop new measures, should consider these critiques, which include • inclusion of measures that are heavily influenced by nonclinical factors, such as life expectancy (e.g., impacted by accidents, homicides)129 • use of survey data, which can vary significantly by country in terms of completeness and quality if not standardized15 • challenges with harmonizing internationally recognized units of measurement, such as for spending: different currencies, fluctuating exchange rates, and different accounting methods15 • differences in gestational age and/or birthweight cutoffs for reporting live births129–131 • differences in coding practices, particularly due to variation in the number of diagnoses coded, the procedure classification system in use, and the presence or absence of diagnosis timing flags, which can impact the accuracy of indicators and potentially introduce bias132 • differences in level of detail captured with respect to time of clinical events, which preclude accurate comparisons of outcomes within a specified time period (e.g., 48 hours).132

55 6. Measure Constructs Requiring Development

Experts recommended dozens of measure constructs that required further development before they could be discussed and rated. In the sections that follow, we present groups of measure constructs as well as our recommendations for future directions in development.

Important Measure Constructs Requiring Significant Development The ten measure constructs in this category are important but were deemed not specific enough to advance to the rating stage. Experts who suggested these concepts often mentioned that measurement would be difficult but still recommended panel consideration because of importance. Thus, these measure constructs could be good candidates for measurement development work by HHS or other federal agencies in the near future. In Table 6.1, we list the measure constructs, the number of experts who suggested each concept, and our recommendations about future steps that can be taken to develop and strengthen each concept.

Table 6.1. Measure Constructs Requiring Significant Development

Number of Experts Who Suggested This Measure Measure Construct Construct Recommendations for Future Development Innovation around basic 10 Determine which aspect(s) of innovation should be science, drugs, prioritized (e.g., pace, impact, accessibility, equity, value, diagnostics, medical progress in important sectors). devices, health information technology, Determine how international measurement would be feasible and health care delivery and meaningful given that OECD member countries might specialize in specific sectors. Regulations pertaining 1 Envision how an ideal regulatory environment would operate to generic and trade so that pharmaceutical R&D would be productive while also drug variants ensuring that patients have access to essential medications. Family caregiving 1 Identify and characterize models of home care used in OECD nations.

Compare family caregiving with professional home care services to determine how costs to the family, costs to society, and health outcomes differ.

56 Number of Experts Who Suggested This Measure Measure Construct Construct Recommendations for Future Development Determine whether OECD nations consider family caregiving to be within the purview of the health care system or whether it is an external social service. Overall survival for 1 Determine how to select impactful innovations that are various cancers after relevant to cancer care across OECD nations. standards of care change because of new Determine how to identify target time periods during which innovations changes in survival could be detected. Fraud 1 Determine which types of fraud are relevant and important across OECD (i.e., health care provider overcharging, patient sharing of identities to defraud insurance companies, patient claims for services they have not received).133

Determine whether detection of fraud is feasible across OECD nations and whether measurement could be comparable. Choice 1 Determine what type of choice should be prioritized (e.g., insurance product, insurance company, provider, health system). Safety and quality of 1 Identify important aspects of behavioral health that would be behavioral health relevant and important across OECD nations (e.g., services screening for depression, adherence to medications, safety of prescribing, follow-up care after emergency visits, institutionally acquired infections). Launch and diffusion of 1 Determine how to select candidate technologies for new technology assessment (e.g., high-impact technology, technology with high volume of sales, “orphan” status).

Determine how to measure launch (e.g., time between patent and regulatory approval, time between patent and availability for purchase).

Conceptualize ideal diffusion (e.g., availability to high-need patients; availability in all geographic areas). Actual costs of medical 1 Envision a strategy for measuring cost of care that would be care comparable across OECD nations. For example, administer surveys to derive cost estimates for key clinical conditions or clinical episodes (myocardial infarction, appendicitis, ED visit for asthma). Determine whose costs should be captured (e.g., patient, system as a whole). Quality of long-term 1 Identify and prioritize measures of the quality of long-term care care (e.g., avoidance of infections, licensed staffing hours per resident day, percentage of residents reporting moderate to severe pain).134

57 Measure Constructs Related to Health System Preparedness, the Public Health System, and/or the COVID-19 Pandemic Nine experts suggested measure constructs were related to health system preparedness for a disaster, pandemic, or similar threat. Four of these concepts referred specifically to COVID-19. Because the objective of this project was to identify measure constructs of health system performance, and the public health system can be considered to be separate, these were not discussed in the expert panel meetings. However, these public health measures were numerous and important enough that they should be considered for evaluation in a future evaluation activity.

Table 6.2. Measure Constructs Related to Health System Preparedness, Public Health, or COVID- 19

Number of Experts Who Suggested This Measure Measure Construct Construct Recommendations for Future Development Ability to respond to a 4 Determine which aspects of response should be prioritized pandemic and measured across OECD nations. Specific development options are numerous and include characterizing the federal stockpile, ability to distribute supplies from a federal stockpile, ability to expand the workforce, ability to expand hospital capacity, capability to develop and distribute testing for novel pathogens, and implementation of policies to spare morbidity and mortality. Investment in public 1 Determine which aspects of investment are most important health preparedness across OECD nations (e.g., expenditure, development of national stockpile of critical supplies, numbers and expertise of public health workers). Ability to provide 1 Develop an improved understanding of which barriers to vaccines provision of vaccines are important across OECD nations (e.g., vaccine development, production of large quantities, administration across the nation, administration in vulnerable areas, population vaccine refusal rate). Number of public health 1 Determine how the roles of public health workers vary workers across OECD nations and which types of public health workers are most important to member nations (e.g., physician, nurse, researcher, contact tracer, environmental safety expert, infectious disease expert, injury prevention expert).

Develop an improved understanding of current data sources characterizing the public health workforce domestically and internationally.135

58 Number of Experts Who Suggested This Measure Measure Construct Construct Recommendations for Future Development Number of ventilators, 1 Explore the availability of and develop new data sources intensive care unit beds, domestically and internationally to characterize total supply respiratory therapists, and percentage of availability. and home beds COVID-19 mortality rate 1 Determine how to calculate mortality rate in light of the occurrence of asymptomatic spread of infection, which makes choosing a denominator challenging. For example, mortality rate could be calculated among hospitalized patients or patients on a ventilator with confirmed infection. Alternatively, mortality rate could be calculated at the population level. COVID-19 testing rate 1 Investigate how COVID-19 testing priorities vary among OECD nations (e.g., population-level testing, testing for symptomatic patients, testing for patients with known exposure, testing for health care workers, testing in nursing homes). COVID-19 waiting time 1 Determine how to measure waiting time for testing to reflect for testing and results important policy goals (e.g., waiting time for testing at the population level, for symptomatic patients, for patients with exposure, for health care workers, for patients). Number and proportion 1 Determine whether comparable data could be collected of COVID-19 infected across OECD nations, given that testing strategies and frontline health care capabilities vary. workers

Measure Constructs Not Clearly Related to Health Care System Performance or HHS Priorities Four measure constructs reflected important concepts but were determined not to be directly related to health care system performance or HHS priority areas (the opioid crisis, health insurance reform, drug pricing, and value-based care).

59 Table 6.3. Measure Constructs Not Clearly Related to Health Care System Performance or HHS Priorities

Number of Experts Who Suggested This Measure Measure Construct Construct Recommendations for Future Development Gun violence 3 Determine how best to characterize the impact of gun violence (e.g., population-level mortality rates, years of lost life). Access to licensed and 1 Home health workers play a variety of roles, including unlicensed home health providing health services and other types of support. workers Determine how the roles of home health workers vary across OECD nations and whether health outcomes are better when home health care is provided by licensed workers.

Develop an improved understanding of current data sources characterizing the home health workforce domestically and internationally. Age-adjusted dementia 1 This measure was excluded because it assesses prevalence disease prevalence, which is not likely to be a reflection of health care system performance unless there are cures or known prevention strategies. Future concept development could seek to characterize health outcomes for patients diagnosed with dementia (e.g., ability to perform activities of daily living). Air pollution 1 Determine how to combine data on air quality with data on population density.

Determine whether to use ambient particulate matter concentrations alone or whether to report additional air quality data.136

Measure Constructs for Which Experts and/or Federal Advisers Raised Questions About Directionality Two measure constructs were suggested but not discussed due to concerns by other experts or federal advisers about the directionality of the measure (i.e., it is not clear which direction is better). In Table 6.4, we list these measure constructs, the number of experts who suggested each concept, and the rationale for exclusion due to directionality, as well as recommendations for future development of a similar concept.

60 Table 6.4. Measure Constructs with Questions About Directionality

Number of Experts Who Suggested This Measure Rationale for Exclusion and Recommendations for Measure Construct Construct Future Development People who went without 1 This measure was excluded because people might forego care during the last year care for a year by choice, which means that this measure construct might not accurately reflect health care system performance. Future concept development could seek to identify patients who require follow-up but fail to adhere (e.g., patients with prescriptions for antihypertensives who fail to fill prescriptions for a year). Deaths at home versus 1 This measure was excluded because this concept would be deaths at a hospital driven by cultural or personal values rather than health care system performance, so it is possible that people in one nation would consider death in hospital to be preferred over death at home. Future concept development could focus on assessment of concordance of end-of-life beliefs with setting of death.

61 7. Recommendations and Conclusion

We identified a number of promising additions and improvements to measures for international health care system comparisons. In addition to recommendations provided above about steps needed to move each measure construct forward, a number of cross-cutting recommendations and key decision points emerged from this effort that could help to shape next steps. Pursue measure specification for promising measure constructs. Experts rated eight of the measure constructs as having the most promise for international comparisons. Next steps will require additional development work to establish the operational definitions and specifications of these measure constructs to ensure that any measure developed is valid and feasible for international comparisons of health system performance. In many cases, experts pointed to existing measures that could be leveraged for this purpose. Develop guidelines for assessing health care system performance. Some experts felt that if a measure construct could be influenced by factors outside of the health system (e.g., in the case of HDAH), it was less useful for international comparisons of health care system performance given differences in populations, cultural preferences, and social conditions across countries. Other experts noted, however, that there could be ways to account for these differences in analysis (e.g., using regression analysis) to isolate the effect of health system performance on the outcome of interest. This ambiguity was particularly challenging for measure constructs that were both highly relevant for the health system and influenced by external factors. This includes measure constructs, such as QALE, that are influenced by social factors, as well as the approval and diffusion of new drugs, which are shaped by regulatory guidelines and industry processes. Developing clear guidelines to assess the alignment of measure constructs with health system performance will help ensure that such decisions are being applied consistently and help determine which measure constructs that were flagged with this concern might warrant further development. Disentangle and prioritize related constructs of access, coverage, utilization, and outcomes. Several measure constructs focused on issues of access or coverage (e.g., access to mental health providers), but experts were quick to point out that coverage for or access to services does not necessarily equate to appropriate utilization of those services or result in improvements in health outcomes. As a result, in some cases experts recommended strengthening the measure construct by focusing on utilization or the expected health outcomes. However, experts also noted that coverage of and access to specific types of health care providers, services, and treatments could be important intermediate outcomes that can shed valuable insight into key outcomes of interest. As the measure constructs undergo further

62 development work, it will be beneficial to provide additional specificity around these related constructs to help ensure that what is being measured will reflect the intended health outcome. Invest in developing novel measure constructs. As outlined in Chapter 6, experts provided a number of ideas for measure constructs that are important but were deemed not specific enough to advance to the rating stage. Experts who suggested these concepts often mentioned that measurement would be difficult but still recommended panel consideration because of their importance. One example is the idea of innovation, which was offered by ten experts in Phase 1. Although experts nominated different areas for innovation (e.g., drugs, diagnostics, health information technology), this and other proposed measure constructs could be good candidates for measurement development work by HHS or other federal agencies in the near future. Offer refinements to existing OECD measures. In Phase 1, experts nominated measure concepts for consideration. Many of these were refinements to or expansions of existing OECD measures, with suggestions for additional specification or recommendations to further parse out the data by key subgroups that would facilitate subgroup analyses and more direct, and appropriate, cross-country comparisons (see Chapter 5). Because these measures are already being used by OECD in some form, offering these refinements for OECD consideration could help to strengthen international comparisons of health system performance in the near term.

Limitations All experts were based in the United States. Although many of the project experts do have expertise in international comparisons of health care quality, they may not be in the best position to judge how relevant, useful, and feasible a measure construct is for other countries. There could be benefits to engaging an international audience in the future development of these measure constructs. Experts raised the limitation that our U.S.-centric approach to construct selection could result in identification of measure constructs that are less important or relevant for other countries. For example, the opioid crisis is a more significant concern in the United States and is not necessarily relevant for international benchmarking. Where experts raised this as a concern in their comments or discussion, it was noted.

Conclusion Collectively, experts provided a wealth of information on potential measure constructs that would strengthen international comparisons of health care system performance. Eight measure constructs were identified as having the most promise, although all require additional work to strengthen the measure specification and address the feasibility of data collection in an international setting. Experts felt that many other measure constructs were important and held promise but would require additional investment to develop. In the near term, experts pointed to a number of opportunities to strengthen the existing OECD measures set, providing important

63 refinements to measure specifications and how data can be collected and presented to facilitate more appropriate and accurate international comparisons. These suggestions could be explored with OECD while the new measure constructs suggested by experts are developed into feasible, reliable, and valid measures suitable for international comparisons.

64 References

1. OECD. Health at a Glance 2019: OECD Indicators. Paris: OECD Publishing; 2019. 2. Centers for Disease Control and Prevention. High Blood Pressure. 2020. Accessed April 1, 2020. https://www.cdc.gov/bloodpressure/facts.htm 3. Centers for Disease Control and Prevention. Manage High Blood Pressure. 2020. Accessed April 1, 2020. https://www.cdc.gov/bloodpressure/manage.htm 4. U.S. Department of Health and Human Services, Health Resources and Services Administration. Hypertension Control. Undated. 5. World Health Organization. Hypertension. 2019. Accessed March 30, 2020. https://www.who.int/news-room/fact-sheets/detail/hypertension 6. Gaziano TA, Bitton A, Anand S, Weinstein MC. The global cost of nonoptimal blood pressure. J Hypertens. 2009;27(7):1472-1477. 7. National Quality Forum. Adoption of Health Information Technology. Undated. Accessed March 31, 2020. https://www.qualityforum.org/Qps/QpsTool.aspx 8. National Institute for Health and Care Excellence. Standards and Indicators. Undated. Accessed March 31, 2020. https://www.nice.org.uk/Standards-and-Indicators/index 9. NCD Risk Factor Collaboration. Long-term and recent trends in hypertension awareness, treatment, and control in 12 high-income countries: An analysis of 123 nationally representative surveys. Lancet (London, England). 2019;394(10199):639-651. 10. Shimamoto K, Ando K, Fujita T, et al. The Japanese Society of Hypertension Guidelines for the Management of Hypertension (JSH 2014). Hypertens Res. 2014;37(4):253-390. 11. Nerenberg KA, Zarnke KB, Leung AA, et al. Hypertension Canada’s 2018 guidelines for diagnosis, risk assessment, prevention, and treatment of hypertension in adults and children. Can J Cardiol. 2018;34(5):506-525. 12. Gabb GM, Mangoni AA, Anderson CS, et al. Guideline for the diagnosis and management of hypertension in adults—2016. Medical J Aust. 2016;205(2):85-89. 13. New Zealand Ministry of Health. Cardiovascular Disease Risk Assessment and Management for Primary Care. Wellington: Ministry of Health, 2018. 14. Wolf-Maier K, Cooper RS, Kramer H, et al. Hypertension treatment and control in five European countries, Canada, and the United States. Hypertension. 2004;43(1):10-17. 15. Hussey PS, Edelen MO. What are the appropriate methodological standards for international comparisons of health data? Isr J Health Policy Res. 2018;7(1):5. 16. Dolnicar S, Grün B. Cross-cultural differences in survey response patterns. International Marketing Review. 2007;24:127-143. 17. OECD. OECD Health Statistics 2019. 2019. 18. Oliveira Hashiguchi TC. Bringing health care to the patient: An overview of the use of telemedicine in OECD countries. OECD Health Working Papers, No. 116. Paris: OECD Publishing; 2020. 19. U.S. Department of Health and Human Services, Health Resources & Services Administration. Telehealth Programs. 2019. Accessed April 1, 2020. https://www.hrsa.gov/rural-health/telehealth

65 20. U.S. Department of Health and Human Services, Office of Health Policy, Office of the Assistant Secretary for Planning and Evaluation. Report to Congress: E-Health and Telemedicine. 2016. 21. Center for Connected Health Policy. State Telehealth Laws and Reimbursement Policies Report. 2020. 22. U.S. Department of Health and Human Services. Telehealth: Delivering Care Safely During COVID-19. 2020. Accessed April 2, 2020. https://www.hhs.gov/coronavirus/telehealth/index.html 23. Rockwell KL, Gilroy AS. Incorporating telemedicine as part of COVID-19 outbreak response systems. Am J Manag Care. 2020;26(4):147-148. 24. Centers for Medicare and Medicaid Services. Section 1135 Waiver Flexibilities: CMS 1135 Waivers. Undated. Accessed April 1, 2020. https://www.medicaid.gov/ resources-for-states/disaster-response-toolkit/section-1135-waiver-flexibilities/index.html 25. Public Law No: 116-123. The Coronavirus Preparedness and Response Supplemental Appropriations Act. 2020. 26. Public Law No: 116-127. Families First Coronavirus Response Act. 2020. 27. Heijink R, van Baal P, Oppe M, Koolman X, Westert G. Decomposing cross-country differences in quality adjusted life expectancy: The impact of value sets. Popul Health Metr. 2011;9(1):17. 28. U.S. Department of Health and Human Services, Office of Disease Prevention and Health Promotion. About Healthy People. Undated. Accessed April 1, 2020. https://www.healthypeople.gov/2020/About-Healthy-People 29. U.S. Department of Health and Human Services, Substance Abuse and Mental Health Services Administration. Key Substance Use and Mental Health Indicators in the United States: Results from the 2018 National Survey on Drug Use and Health. Rockville, MD: Center for Behavioral Health Statistics and Quality, Substance Abuse and Mental Health Services Administration; 2019. 30. World Health Organization. Tracking Universal Health Coverage: 2017 Global Monitoring Report. 2017. 31. Baumgartner JC, Aboulafia GN, McIntosh A. The ACA at 10: How has it impacted mental health care? To the Point. 2020. Accessed May 20, 2020. https://www.commonwealthfund.org/blog/2020/ aca-10-how-has-it-impacted-mental-health-care 32. Thomas KC, Shartzer A, Kurth NK, Hall JP. Impact of ACA health reforms for people with mental health conditions. Psychiatr Serv. 2018;69(2):231-234. 33. World Health Organization. MhGAP Operations Manual: Mental Health Gap Action Programme (MhGAP). Geneva: Licence: CC BY-NC-SA 3.0 IGO; 2018. 34. United States Government Accountability Office. Research on Health Care Costs of Untreated Conditions Is Limited. Washington, D.C.: U.S. Government Accountability Office; 2019. 35. Johnson SB, Butow PN, Kerridge I, Bell ML, Tattersall MH. How well do current measures assess the impact of advance care planning on concordance between patient preferences for end-of-life care and the care received: A methodological review. J Pain Symptom Manage. 2018;55(2):480-495.

66 36. Hopping-Winn J, Mullin J, March L, Caughey M, Stern M, Jarvie J. The progression of end-of-life wishes and concordance with end-of-life care. J Palliat Med. 2018;21(4):541- 545. 37. Ahluwalia SC, Chen C, Raaen L, et al. A systematic review in support of the National Consensus Project Clinical Practice Guidelines for Quality Palliative Care. J Pain Symptom Manage. 2018;56(6):831-870. 38. 2017 Commonwealth Fund International Health Policy Survey of Older Adults. 2017. Accessed May 21, 2020. https://www.commonwealthfund.org/publications/surveys/2017/nov/ 2017-commonwealth-fund-international-health-policy-survey-older 39. World Health Organization. Continuity and Coordination of Care: A Practice Brief to Support Implementation of the WHO Framework on Integrated People-Centred Health Services. 2018. 40. Gulliford M, Naithani S, Morgan M. What is ‘continuity of care’? J Health Serv Res Policy. 2006;11(4):248-250. 41. Haggerty JL, Reid RJ, Freeman GK, Starfield BH, Adair CE, McKendry R. Continuity of care: A multidisciplinary review. BMJ. 2003;327(7425):1219-1221. 42. Mainous AG, Baker R, Love MM, Gray DP, Gill JM. Continuity of care and trust in one’s physician: Evidence from primary care in the United States and the United Kingdom. Fam Med. 2001;33(1):22-27. 43. Katz DA, McCoy K, Sarrazin MV. Does improved continuity of primary care affect clinician-patient communication in VA? J Gen Intern Med. 2014;29(2):682-688. 44. Wasson JH, Sauvigne AE, Mogielnicki RP, et al. Continuity of outpatient medical care in elderly men: A randomized trial. JAMA. 1984;252(17):2413-2417. 45. Fan VS, Burman M, McDonell MB, Fihn SD. Continuity of care and other determinants of patient satisfaction with primary care. J Gen Intern Med. 2005;20(3):226-233. 46. Reddy A, Pollack CE, Asch DA, Canamucio A, Werner RM. The effect of primary care provider turnover on patient experience of care and ambulatory quality of care. JAMA Intern Med. 2015;175(7):1157-1162. 47. Agency for Healthcare Research and Quality. Usual Source of Care, Percentage of People, United States, 2002-2017, Medical Expenditure Panel Survey. 2017. 48. Pollack CE, Hussey PS, Rudin RS, Fox DS, Lai J, Schneider EC. Measuring care continuity: A comparison of claims-based methods. Medical Care. 2016;54(5):e30. 49. Bentler SE, Morgan RO, Virnig BA, Wolinsky FD. Do claims-based continuity of care measures reflect the patient perspective? Med Care Res Rev: MCRR. 2014;71(2):156- 173. 50. Penm J, MacKinnon NJ, Strakowski SM, Ying J, Doty MM. Minding the gap: Factors associated with primary care coordination of adults in 11 countries. Ann Fam Med. 2017;15(2):113-119. 51. Macinko J, Guanais FC, Mullachery P, Jimenez G. Gaps in primary care and health system performance in six Latin American and Caribbean countries. Health Aff (Millwood). 2016;35(8):1513-1521. 52. Access to Care Rankings 2020. 2020. Accessed May 26, 2020. https://www.mhanational.org/issues/2020/mental-health-america-access-care-data 53. Heisler EJ. The Mental Health Workforce: A Primer. Washington, D.C.: Congressional Research Service; 2018.

67 54. University of Wisconsin Population Health Institute. Mental Health Providers. County Health Rankings & Roadmaps. 2020. Accessed May 21, 2020. https://www.countyhealthrankings.org/explore-health-rankings/ measures-data-sources/county-health-rankings-model/health-factors/clinical-care/ access-to-care/mental-health-providers 55. Designated Health Professional Shortage Area Statistics. Health Resources and Services Administration. 2020. Accessed May 26, 2020. https://data.hrsa.gov/Default/GenerateHPSAQuarterlyReport 56. Mental Health in America—Access to Care Data. Mental Health America. 2020. Accessed May 21, 2020. https://www.mhanational.org/issues/2020/mental-health-america-access-care-data 57. Hellebuyuk M, Halpern M, Nguyen T, Fritzle D. State of Mental Health in America 2019. Mental Health America. 2018. Accessed April 1, 2020. https://mhanational.org/sites/default/files/ 2019%20MH%20in%20America%20Final_0.pdf 58. Kilbourne AM, Keyser D, Pincus HA. Challenges and opportunities in measuring the quality of mental health care. Can J Psychiatry. 2010;55(9):549-557. 59. The Office of the National Coordinator for Health Information Technology. Glossary: Health IT Terms. September 15, 2017. Accessed April 3, 2020. https://www.healthit.gov/topic/health-it-basics/glossary 60. The Office of the National Coordinator for Health Information Technology. What Is HIE? May 1, 2019. Accessed April 3, 2020. https://www.healthit.gov/topic/ health-it-and-health-information-exchange-basics/what-hie 61. National Quality Forum. A Measurement Framework to Assess Nationwide Progress Related to Interoperable Health Information Exchange to Support the National Quality Strategy. Final Report. September 1, 2017. 62. Kruse CS, Beane A. Health information technology continues to show positive effect on medical outcomes: Systematic review. J Med Internet Res. 2018;20(2):e41-e41. 63. Garg AX, Adhikari NK, McDonald H, et al. Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: A systematic review. JAMA. 2005;293(10):1223-1238. 64. Lau F, Kuziemsky C, Price M, Gardner J. A review on systematic reviews of health information system studies. J Am Med Inform Assoc. 2010;17(6):637-645. 65. Zelmer J, Ronchi E, Hyppönen H, et al. International health IT benchmarking: Learning from cross-country comparisons. J Am Med Inform Assoc. 2017;24(2):371-379. 66. Oosterwijk H. Determining the Measures of Success for Interoperability. HIMSS. July 13, 2020. Accessed April 1, 2020. https://www.himss.org/resources/determining-measures-success-interoperability 67. HIMSS Europe. Strategic Interoperability in Germany, Spain & the UK: The Clinical and Business Imperative for Healthcare Organisations. 2014. 68. The Commonwealth Fund. 2019 International Health Policy: Survey of Primary Care Physicians. 2019. 69. Herr K, Coyne PJ, McCaffery M, Manworren R, Merkel S. Pain assessment in the patient unable to self-report: Position statement with clinical practice recommendations. Pain Manag Nurs. 2011;12(4):230-250.

68 70. Interagency Pain Research Coordinating Committee. National Pain Strategy: A Comprehensive Population Health-Level Strategy for Pain. Washington, D.C.: U.S. Department of Health and Human Services; 2016. 71. Ahia CL, Blais CM. Primary palliative care for the general internist: Integrating goals of care discussions into the outpatient setting. Ochsner J. 2014;14(4):704-711. 72. Meier DE. Increased access to palliative care and hospice services: Opportunities to improve value in health care. Milbank Q. 2011;89(3):343-380. 73. Parrish M, Kinderman A, Rabow M. Weaving Palliative Care into Primary Care: A Guide for Community Health Centers. California Healthcare Foundation. 2015. 74. World Health Organization, Worldwide Palliative Care Alliance. Global Atlas of Palliative Care at the End of Life. London: Worldwide Palliative Care Alliance. 2014. 75. Sleeman KE, de Brito M, Etkind S, et al. The escalating global burden of serious health- related suffering: Projections to 2060 by world regions, age groups, and health conditions. Lancet Glob Health. 2019;7(7):e883-e892. 76. Belloni A, Morgan D, Paris V. Pharmaceutical Expenditure and Policies: Past Trends and Future Challenges, OECD Health Working Papers, No. 87. Paris: OECD Publishing; 2016. 77. Paris V, Slawomirski L, Colbert A, Delaunay N, Oderkirk J. New Health Technologies Managing Access, Value and Sustainability. Paris: OECD Publishing; 2017. 78. Danzon PM, Furukawa MF. International prices and availability of pharmaceuticals in 2005. Health Affairs. 2008;27(1):221-233. 79. National Academies of Sciences, Engineering, . Making Medicines Affordable: A National Imperative. National Academies Press; 2018. 80. Sarnak DO, Squires D, Kuzmak G, Bishop S. Paying for prescription drugs around the world. Why is the US an outlier? Issue Brief (Commonwealth Fund). 2017;1-14. 81. OECD. Pharmaceutical Pricing Policies in a Global Market. Paris: OECD Publishing; 2008. 82. Berndt ER, Bhattacharjya A, Mishol DN, Arcelus A, Lasky T. An analysis of the diffusion of new antidepressants: Variety, quality, and marketing efforts. J Ment Health Policy Econ. 2002;5(1):3-19. 83. Expert-provided definition. 84. Bryan S, Williams I, McIver S. Seeing the nice side of cost-effectiveness analysis: A qualitative investigation of the use of CEA in NICE technology appraisals. Health Econ. 2007;16(2):179-193. 85. National Quality Forum. Reducing Emergency Department Overuse CAB. 2010. 86. Hsia RY, Niedzwiecki M. Avoidable emergency department visits: A starting point. Int J Qual Health Care. 2017;29(5):642-645. 87. Johnson PJ, Ghildayal N, Ward A, Westgard B, Boland L, Hokanson J. Disparities in potentially avoidable emergency department (ED) care ED visits for ambulatory care sensitive conditions. Medical Care. 2012;50(12):1020-1028. 88. Galarraga JE, Pines JM. Costs of ED episodes of care in the United States. Am J Emerg Med. 2016;34(3):357-365. 89. World Health Organization. Guidelines for the Psychosocially Assisted Pharmacological Treatment of Opioid Dependence. Geneva; 2009. 90. Lembke A, Chen JH. Use of opioid agonist therapy for Medicare patients in 2013. JAMA Psychiatry. 2016;73(9):990-992.

69 91. National Council for Behavioral Health, Center of Excellence for Integrated Health Solutions. HRSA Center of Excellence for Behavioral Health Technical Assistance. 2020. Accessed April 1, 2020. https://www.thenationalcouncil.org/integrated-health-coe 92. Gomes T, Tadrous M, Mamdani MM, Paterson JM, Juurlink DN. The burden of opioid- related mortality in the United States. JAMA Netw Open. 2018;1(2):e180217. 93. Decorte T, Mortelmans D, Tieberghien J, De Moor S. Drug Use: Overview of General Population Surveys in Europe. Lisbon: EMCDDA; 2009. 94. Begin P, Weekes J, Thomas G. The Canadian Addiction Survey: Substance use and misuse among the Canadian population. Forum on Corrections Research. 2006;18(1):12. 95. OECD. Using Routinely Collected Data to Inform Pharmaceutical Policies: Analytical Report for OECD and EU Countries. Paris: OECD Publishing; 2019. 96. U.S. Congress, Office of Technology Assessment. International Comparisons of Administrative Costs in Health Care, BP-H-135. Washington, D.C.: U.S. Government Printing Office; September 1994. 97. Mueller M, Hagenaars L, Morgan D. Administrative Spending in OECD Health Care Systems: Where Is the Fat and Can It Be Trimmed? In: Tackling Wasteful Spending on Health. OECD Publishing; 2017:229-264. 98. Institute of Medicine. Best Care at Lower Cost: The Path to Continuously Learning Health Care in America. Washington, D.C.: The National Academies Press; 2013. 99. Institute of Medicine Roundtable on Evidence-Based Medicine. The National Academies Collection: Reports funded by National Institutes of Health. In: Yong PL, Saunders RS, Olsen L, eds. The Healthcare Imperative: Lowering Costs and Improving Outcomes: Workshop Series Summary. Washington, D.C.: National Academies Press, 2010. 100. Thorpe KE. Inside the black box of administrative costs. Health Affairs. 1992;11(2):41- 55. 101. Papanicolas I, Woskie LR, Jha AK. Health care spending in the United States and other high-income countries. JAMA. 2018;319(10):1024-1039. 102. Himmelstein DU, Jun M, Busse R, et al. A comparison of hospital administrative costs in eight nations: US costs exceed all others by far. Health Aff (Millwood). 2014;33(9):1586- 1594. 103. Prasad V, Vandross A, Toomey C, et al. A decade of reversal: An analysis of 146 contradicted medical practices. Mayo Clin Proc. 2013;88(8):790-798. 104. ABIM Choosing Wisely. ICER Baseline Reports. 2020. Accessed August 14, 2020. https://www.choosingwisely.org/getting-started/resource-library/icer-baseline-reports 105. Medicare Payment Advisory Commission. Chapter 8: Next steps in measuring quality of care in Medicare. In: Medicare and the Health Care Delivery System: Report to the Congress. 2015. 106. Burke LG, Orav EJ, Zheng J, Jha AK. Healthy days at home: A novel population-based outcome measure. Healthc (Amst). 2020;8(1):100378. 107. U.S. Department of Health and Human Services, Office of the Surgeon General. U.S. Surgeon General’s Advisory on Naloxone and Opioid Overdose. 2018. Accessed April 2, 2020. https://www.hhs.gov/surgeongeneral/priorities/opioids-and-addiction/ naloxone-advisory/index.html 108. National Quality Forum. Regionalized Emergency Medical Care Services: Phase I 2012 Final Report. Washington, D.C., 2012.

70 109. U.S. Department of Health and Human Services, Substance Abuse and Mental Health Services Administration. MAT Medications, Counseling, and Related Conditions. 2020. Accessed April 1, 2020. https://www.samhsa.gov/medication-assisted-treatment/ treatment#medications-used-in-mat 110. American Society of Addiction Medicine. Advancing Access to Addiction Medications: Implications for Opioid Addiction Treatment. 2013. 111. Jones CM, Campopiano M, Baldwin G, McCance-Katz E. National and state treatment need and capacity for opioid agonist medication-assisted treatment. Am J Public Health. 2015;105(8):e55-e63. 112. Haffajee RL, Bohnert ASB, Lagisetty PA. Policy Pathways to address provider workforce barriers to buprenorphine treatment. Am J Prev Med. 2018;54(6 Suppl 3):S230-S242. 113. National Quality Forum. Opioids and Opioid Use Disorder: Quality Measurement Priorities. 2020. 114. Rudd RA, Aleshire N, Zibbell JE, Gladden RM. Increases in drug and opioid overdose deaths—United States, 2000-2014. MMWR Morb Mortal Wkly Rep. 2016;64(50- 51):1378-1382. 115. U.S. Department of Health and Human Services, Office of the Assistant Secretary for Planning and Evaluation. ASPE Issue Brief: Opioid Abuse in the U.S. and HHS Actions to Address Opioid-Drug Related Overdoses and Deaths. Washington, D.C.: U.S. Department of Health and Human Services; 2015. 116. Strang J, Babor T, Caulkins J, Fischer B, Foxcroft D, Humphreys K. Drug policy and the public good: Evidence for effective interventions. Lancet. 2012;379(9810):71-83. 117. Wallack SS, Thomas CP, Martin TC, Chilingerian J, Reif S. Substance abuse treatment organizations as mediators of social policy: Slowing the adoption of a congressionally approved medication. J Behav Health Serv Res. 2010;37(1):64-78. 118. Dowell D, Haegerich TM, Chou R. CDC guideline for prescribing opioids for chronic pain—United States, 2016. MMWR Recomm Rep. 2016;65(1):1-49. 119. Centers for Disease Control and Prevention. Quality Improvement and Care Coordination: Implementing the CDC Guideline for Prescribing Opioids for Chronic Pain. Atlanta, GA: National Center for Injury Prevention and Control, Division of Unintentional Injury Prevention; 2018. 120. Roy A. Introducing the FREOPP World Index of Healthcare Innovation. 2020. Accessed July 20, 2020. https://freopp.org/wihi2020-505b1b60bce6 121. Rietveld P, Zwart B, Van Wee B, van den Hoorn T. On the relationship between travel time and travel distance of commuters. Ann Reg Sci. 1999;33(3):269-287. 122. Miller EJ. Accessibility: Measurement and Application in Transportation Planning. Taylor & Francis; 2018. 123. Philipson T, Becker G, Goldman D, Murphy K. Terminal Care and the Value of Life Near Its End. NBER Working Paper No. 15649. National Bureau of Economic Research, Inc., 2010. 124. Einav L, Finkelstein A, Mullainathan S, Obermeyer Z. Predictive modeling of U.S. health care spending in late life. Science. 2018;360(6396):1462-1465. 125. Vigo DV, Kestel D, Pendakur K, Thornicroft G, Atun R. Disease burden and government spending on mental, neurological, and substance use disorders, and self-harm: Cross-

71 sectional, ecological study of health system response in the Americas. Lancet Public Health. 2019;4(2):e89-e96. 126. OECD Better Life Index. Income. Undated. Accessed April 1, 2020. http://www.oecdbetterlifeindex.org/topics/income 127. Carman KG, Liu J, White C. Accounting for the burden and redistribution of health care costs: Who uses care and who pays for it. Health Serv Res. 2020;55(2):224-231. 128. OECD. Waiting Times for Health Services: Next in Line, OECD Health Policy Studies. Paris: OECD Publishing; 2020. 129. Atlas SW. Setting the Record Straight on US Health Care, Single‐Payer Systems, and Medicare‐for‐All. The Subcommittee on Health of the Committee on Energy and Commerce: Hearing on Proposals to Achieve Universal Health Care Coverage; 2019. 130. Kramer MS, Platt RW, Yang H, Haglund B, Cnattingius S, Bergsjo P. Registration artifacts in international comparisons of infant mortality. Paediatr Perinat Epidemiol. 2002;16(1):16-22. 131. MacDorman MF, Mathews TJ, Mohangoo AD, Zeitlin J. International Comparisons of Infant Mortality and Related Factors: United States and Europe, 2010. Centers for Disease Control and Prevention; 2014. 132. Carinci F, Van Gool K, Mainz J, et al. Towards actionable international comparisons of health system performance: Expert revision of the OECD Framework and Quality Indicators. Int J Qual Health Care. 2015;27(2):137-146. 133. World Health Organization. Prevention not cure in tackling health-care fraud. Bull World Health Org. 2011;89(12):853-928. 134. OECD. Ageing and Long-Term Care. Undated. Accessed April 3, 2020. https://www.oecd.org/els/health-systems/long-term-care.htm 135. World Health Organization. Global Strategy on Human Resources for Health: Workforce 2030. Geneva, Switzerland, 2016. 136. Di Q, Amini H, Shi L, et al. An ensemble-based model of PM(2.5) concentration across the contiguous United States with high spatiotemporal resolution. Environ Int. 2019;130:104909.

72 Appendix A. Evidence Tables

The RAND research team developed the following evidence tables for experts to use and reference during their rating process. Experts were asked to draw on these findings, as well as their own expertise and experience, to provide their ratings. The evidence tables are organized by the order in which they appear in the report.

Measure constructs that hold the most promise for international comparisons are • treatment and control of hypertension • access to and coverage for telehealth • quality-adjusted life expectancy • insurance coverage for mental health, behavioral health, and substance abuse services • receipt of preference-concordant end-of-life care • care continuity or consistent provider • access to mental health providers • data transfer and interoperability.

Measure constructs that received lower or inconsistent ratings after expert discussion are • self-reported pain • access to primary palliative care • prices for brand-name and generic drugs • diffusion of and access to new prescription drugs • avoidable emergency department use • the percentage of patients with an opioid use disorder who were referred to or prescribed medication-assisted treatment • estimates of administrative complexity and cost • disadoption of ineffective medical services • healthy days at home • availability of emergency medical services to prevent opioid death.

Measure constructs that were not discussed by experts are • clinician workforce who can prescribe medication-assisted treatment or naloxone • access to opioid treatment centers • the percentage of patients with a follow-up visit within four weeks of starting an opioid for chronic pain • time to regulatory approval for new prescription drugs • travel time to provider office • health care spending in the last year of life • spending on mental health (percentage of total health spending).

73 Treatment and Control of Hypertension

Table A.1. Treatment and Control of Hypertension

Measure Construct Treatment and Control of Hypertension Description Hypertension, also called high blood pressure, is blood pressure that is higher than normal. The threshold for a hypertension diagnosis is defined as systolic blood pressure consistently at or greater than either 130 or 140 mm Hg and diastolic blood pressure consistently at or greater than either 80 or 90 mm Hg.1 The population of individuals tested and treated for hypertension typically includes adults aged 18 and up. • Treatment of hypertension: There are two components of treatment that can be use in isolation or in combination: (1) antihypertensive medications and (2) lifestyle changes (e.g., physical activity and diet).2 • Control of hypertension: Control is achieved when the individual’s blood pressure measures are consistently less than 140 mm Hg (systolic) and less than 90 mm Hg (diastolic).3 Importance: Health or Population impact: social impact • National prevalence: 108 million U.S. adults, or 45%, have hypertension. Of these, 24% have control of their hypertension.4 Many adults for whom hypertension medication is recommended are untreated.5 • Global prevalence: An estimated 1.13 billion people worldwide have hypertension, most (two-thirds) living in low- and middle-income countries. Of these, fewer than 20% have control of their hypertension.6 Clinical impact: • Consequences: Hypertension increases the risk of heart disease, kidney disease, and stroke.7 Hypertension is the leading preventable risk factor for premature death and disability worldwide.8 Performance gap: • Adherence to prescribed lifestyle changes9 and medications10 is low. • More deaths can be averted through improved treatment and control of hypertension than any other major risk factor.11 Costs: • National: Estimated at $131 billion annually.12 • Global: Estimated at $370 billion annually.13 Importance: Value-based care: Related U.S. The HHS priority to transform the U.S. health care system from one that Department of Health pays for procedures and sickness to one that pays for outcomes and and Human Services health relates to the treatment and control of hypertension because of (1) (HHS) priority topics the involvement of lifestyle changes, which involve counseling and discussion rather than billable procedures, in the treatment and control of hypertension and (2) the need for greater transparency around the price and quality of the range of antihypertensive medications.

Other related priorities: Drug pricing: The HHS priority to lower the price of prescription drugs without discouraging innovation relates to the treatment and control of hypertension because of (1) the number of individuals diagnosed with hypertension and their need for antihypertensive prescription drugs and (2) the important role of antihypertensive medications in the treatment and control of hypertension.

Treatment and Control of Hypertension 74 Measure Construct Treatment and Control of Hypertension Validity Construct validity: • Definitional differences in the diagnosis and treatment of hypertension would need to be resolved first in order to design a measure that can accurately reflect international differences in health care system performance.

Discriminant validity: • Because the diagnosis of hypertension varies as a function of diagnosis thresholds1 and the frequency of patient-provider interactions,14 a measure of hypertension treatment and/or control could reflect health care system characteristics rather than performance. • Variation in treatment guidelines across countries15,16,17 could bias a measure of hypertension treatment and/or control against countries whose treatment guidelines are less aggressive. There are unmodifiable risk factors of hypertension, including age and family history.18 To the extent that countries’ demographic compositions are not accounted for, a measure of hypertension treatment and/or control might reflect international variation in these risk factors rather than health care system performance. Feasibility for Definitions: international • There are discrepancies in the threshold for hypertension diagnosis comparisons both within and across high-income nations (e.g., 140/90 or 130/80).1 • There is international variation in diagnostic thresholds,14 the initiation of treatment (e.g., lifestyle changes15 only, medications16 only, both, or no explicit guidelines),17 and the focus on total cardiovascular risk rather than only blood pressure when initiating treatment.19

Data availability: • Data describing hypertension treatment would need to be regularly updated, nationally representative survey data describing medication utilization and lifestyle changes. Often, these measures would be self- reported, with potential biases due to differences in the structure of the survey questions20 and cross-cultural differences in responses.21 Examples of appropriate surveys include the European Health Interview Survey, the Medical Expenditures Panel Survey, and the Canadian Community Health Survey.22 • Hypertension control could be described by administrative data that document those who have been diagnosed with hypertension and their recent blood pressure readings. Among the input sources for the OECD data, diagnosed diseases are typically documented by national disease surveillance systems.23 However, describing control of hypertension would require the integration of advanced health information technology systems with repeated measures of blood pressure. A comparable set of indicators are those involving cancer diagnoses and survival rates. The OECD source for internationally comparable cancer data is the International Agency for Research on Cancer.23 The cost to collect and unify data describing hypertension control similar to the internationally comparable cancer data would likely be high.

Data comparability: • Health system characteristics also play a role in the diagnosis, treatment, and control of hypertension. Because of variation in health care costs borne by the patient, the frequency of interactions with providers and, thus, the diagnosis, treatment, and control of

Treatment and Control of Hypertension 75 Measure Construct Treatment and Control of Hypertension hypertension might relate to system characteristics rather than performance.14 • International definitional differences would also threaten the comparability of the data. Usability: Current evidence of the use of a measure of hypertension treatment Current evidence of use and/or control includes the following (not exhaustive): • U.S. National Quality Forum: Measures the percentage of patients 18 to 85 years of age who had a diagnosis of hypertension and whose blood pressure was adequately controlled (less than 140/90) during the measurement year.24 • UK National Institute for Health and Care Excellence: Measures (1) the percentage of patients under 80 years old with hypertension in whom the last recorded blood pressure measure was 140/90 or less and (2) the percentage of patients with hypertension aged 16 to 74 years who scored “less than active” on their annual physical assessment.25 Usability: Hypertension treatment and control is not among the current OECD Relationship to measures. currently used OECD measures Closest related measures: • Antihypertensives prescribed per unit population: This measure describes the medication component of the treatment of hypertension. It does not describe the lifestyle change component of treatment, and it does not describe the successful control of hypertension. Because this measure describes part of hypertension treatment, its data would be useful. The data sources for this measure are national administrative databases describing claims or dispensed prescriptions. The United States does not have comparable data.26 • Hypertension hospital admission: This measure is indicative of uncontrolled hypertension. It does not describe hypertension treatment. Because this measure is indicative of the opposite of control, the main potential use of the source data would be complementary. In the United States, the main data source for this measure is the National Hospital Discharge Survey, a stratified, probability-designed survey representing approximately 1% of hospitalizations.27 • Ischemic heart disease mortality: This measure is another indicator of uncontrolled hypertension. It does not describe hypertension treatment. Because this measure is indicative of the opposite of control, the main potential use of the source data would be complementary. The data source for this measure is the World Health Organization Mortality Database describing mortalities and their causes.28

References

1. Centers for Disease Control and Prevention. High Blood Pressure. 2020. Accessed May 21, 2020. https://www.cdc.gov/bloodpressure/facts.htm 2. Centers for Disease Control and Prevention. Manage High Blood Pressure. 2020. Accessed May 21, 2020. https://www.cdc.gov/bloodpressure/manage.htm 3. U.S. Department of Health and Human Services, Health Resources and Services Administration. Hypertension Control. Undated. 4. Centers for Disease Control and Prevention. Facts About Hypertension. 2020. Accessed May 21, 2020. https://www.cdc.gov/bloodpressure/facts.htm 5. Centers for Disease Control and Prevention. Hypertension Cascade: Hypertension Prevalence, Treatment and Control Estimates Among US Adults Aged 18 Years and Older Applying the Criteria from the

Treatment and Control of Hypertension 76 American College of Cardiology and American Heart Association’s 2017 Hypertension Guideline. U.S. Department of Health and Human Services; 2019. 6. World Health Organization. Hypertension. 2019. Accessed May 21, 2020. https://www.who.int/news-room/fact-sheets/detail/hypertension 7. Kearney PM, Whelton M, Reynolds K, Muntner P, Whelton PK, He J. Global burden of hypertension: Analysis of worldwide data. Lancet. 2005;365(9455):217-223. 8. Forouzanfar MH, Alexander L, Anderson HR, et al. Global, regional, and national comparative risk assessment of 79 behavioural, environmental and occupational, and metabolic risks or clusters of risks in 188 countries, 1990–2013: A systematic analysis for the Global Burden of Disease Study 2013. Lancet. 2015;386(10010):2287-2323. 9. Hamer M. Adherence to healthy lifestyle in hypertensive patients: Ample room for improvement. J Hum Hypertens. 2010;24:559-560. 10. Ho PM, Bryson CL, Rumsfeld JS. Medication adherence: Its importance in cardiovascular outcomes. Circulation. 2009;119(23):3028-3035. 11. Farley TA, Dalal MA, Mostashari F, Frieden TR. Deaths preventable in the U.S. by improvements in use of clinical preventive services. Am J Prev Med. 2010;38(6):600-609. 12. Kirkland EB, Heincelman M, Bishu KG, et al. Trends in healthcare expenditures among US adults with hypertension: National estimates, 2003-2014. J Am Heart Assoc. 2018;7(11). 13. Gaziano TA, Bitton A, Anand S, Weinstein MC. The global cost of nonoptimal blood pressure. J Hypertens. 2009;27(7):1472-1477. 14. NCD Risk Factor Collaboration. Long-term and recent trends in hypertension awareness, treatment, and control in 12 high-income countries: An analysis of 123 nationally representative surveys. Lancet (London, England). 2019;394(10199):639-651. 15. Shimamoto K, Ando K, Fujita T, et al. The Japanese Society of Hypertension Guidelines for the Management of Hypertension (JSH 2014). Hypertens Res. 2014;37(4):253-390. 16. Nerenberg KA, Zarnke KB, Leung AA, et al. Hypertension Canada’s 2018 guidelines for diagnosis, risk assessment, prevention, and treatment of hypertension in adults and children. Can J Cardiol. 2018;34(5):506-525. 17. Gabb GM, Mangoni AA, Anderson CS, et al. Guideline for the diagnosis and management of hypertension in adults—2016. Med J Aust. 2016;205(2):85-89. 18. Centers for Disease Control and Prevention. Know Your Risk for High Blood Pressure. 2020. Accessed May 21, 2020. https://www.cdc.gov/bloodpressure/risk_factors.htm 19. New Zealand Ministry of Health. Cardiovascular Disease Risk Assessment and Management for Primary Care. Wellington: Ministry of Health, 2018. 20. Hussey PS, Edelen MO. What are the appropriate methodological standards for international comparisons of health data? Isr J Health Policy Res. 2018;7(1):5. 21. Dolnicar S, Grün B. Cross-cultural differences in survey response patterns. International Marketing Review. 2007;24:127-143. 22. OECD. Health at a Glance 2019: OECD Indicators. Paris: OECD Publishing; 2019. 23. OECD. OECD Health Statistics 2019. 2019. 24. National Quality Forum. Adoption of Health Information Technology. Undated. Accessed May 21, 2020. https://www.qualityforum.org/Qps/QpsTool.aspx 25. National Institute for Health and Care Excellence. Standards and Indicators. Undated. Accessed May 21, 2020. https://www.nice.org.uk/Standards-and-Indicators/index 26. OECD. OECD Health Statistics 2019, Definitions, Sources and Methods. 2019. 27. Centers for Disease Control and Prevention. National Hospital Discharge Survey. 2015. Accessed May 21, 2020. https://www.cdc.gov/nchs/nhds/index.htm 28. World Health Organization. WHO Mortality Database. Undated. Accessed May 21, 2020. https://www.who.int/healthinfo/mortality_data/en

Treatment and Control of Hypertension 77 Access to and Coverage for Telehealth

Table A.2. Access to and Coverage for Telehealth

Measure Construct Access to and Coverage for Telehealth Description Access, defined as “the timely use of personal health services to achieve the best health outcomes,” includes four dimensions: coverage, services, timeliness, and workforce.1,34 Access could be operationalized as the proportion of patients in the population for whom telehealth services are available or the proportion of patients who have used telehealth services. Other relevant data points when considering access include (1) whether the required technology is available in the patient’s geographic location (e.g., broadband internet and/or cellular service), (2) the proportion of patients who have personal access to the required hardware (e.g., a computer or smartphone), (3) the number of or proportion of providers who offer telehealth services, and (4) the proportion of patients who are aware of and know how to contact telehealth providers. Coverage could be defined as the availability and cost of telehealth services within health insurance plans or covered health services.

There is no widely used definition of telemedicine;2 however, the Health Resources and Services Administration (HRSA) of the U.S. Department of Health and Human Services (HHS) defines telehealth as “the use of electronic information and telecommunication technologies to support long-distance clinical health care, patient and professional health-related education, public health, and health administration. Technologies include video conferencing, the internet, store-and-forward imaging, streaming media, and terrestrial and wireless communications.”3

The World Health Organization (WHO) defines telehealth as “[t]he delivery of health care services, where distance is a critical factor, by all health care professionals using information and communication technologies for the exchange of valid information for diagnosis, treatment and prevention of disease and injuries, research and evaluation, and for the continuing education of health care providers, all in the interests of advancing the health of individuals and their communities.”4

HHS currently describes four modalities of telehealth: (1) live video interaction between a patient and provider, (2) store and forward (electronic transmission of videos and digital images to a provider in a different location), (3) remote patient monitoring (electronic transmission of personal health and medical data, such as blood pressure readings, from an individual in one location to a provider in another location), and (4) mobile health (mHealth, which includes smartphone apps intended to promote health and well-being).5

HRSA distinguishes between telehealth and telemedicine thusly: Telehealth “refers to a broader scope of remote health care services than telemedicine. While telemedicine refers specifically to remote clinical services, telehealth can refer to remote non-clinical services, such as provider training, administrative meetings, and continuing , in addition to clinical services” (emphasis in original).6

Access to and Coverage for Telehealth 78 Measure Construct Access to and Coverage for Telehealth Importance: Health or • Population impact: social impact o Estimates of the proportion of the U.S. population with access to and/or coverage for telehealth, as well as the prevalence of actual use of telehealth services, are widely disparate, primarily because of inconsistencies in the definition of telehealth (e.g., which services are included, such as audio-only telephones; live video; asynchronous written communications, such as patient portals, emails, and text messages; and/or synchronous written communications, such as e- visits); in the definitions of access, coverage, and use; and in which population is studied (e.g., the entire population or a specific population, such as individuals who are covered by a specific type of health insurance). Additionally, reimbursement and regulations vary by state.7 Use of telehealth is increasing, but it varies by type of insurance coverage, age, health status, income, and rural location.8–11 o In 2016, it was estimated that 61% of U.S. health care institutions and 40–50% of U.S. were using some form of telehealth.5 o Estimates of global access and use are also widely disparate for the same reasons (inconsistent definitions of telehealth, access, and use). More than half of the 70 countries participating in the WHO survey indicated that their country had a specific national telehealth policy or a reference to telehealth in their national eHealth policy.4 The Organisation for Economic Co-operation and Development (OECD) reported that telehealth was available and used in the majority of OECD countries but few countries currently collect specific data on volume or rates of use, and telehealth services were a small proportion of total health care services provided. For example, “teleconsultations” were estimated to account for only 0.1–0.2% of face-to-face consultations in a number of countries, including Canada, Australia, Portugal, Argentina, and the United States.2 • Meaningful clinical impact: There is evidence that telehealth can be an effective way for patients to access health care providers for primary care, specialists, and mental health care.12–16 Telehealth has the potential to increase access to health care to people who reported being unable to make it to the doctor’s office due to barriers to access, such as waiting times, distance, and transportation (estimated to be between 11–65% of people across OECD countries).2 Patients report high satisfaction with telehealth.2

During the COVID-19 pandemic, Medicare and Medicaid expanded coverage of telehealth services and lifted requirements that previously restricted telehealth services.17–21 The increased use of telehealth has the potential to prevent overcrowding and exposure while still allowing those who need medical care to consult with their health care providers.22 Telehealth also has the potential to aid with mental health concerns and isolation during the COVID-19 pandemic.23 • Performance gap: There are many barriers to the use of telemedicine in OECD countries, including lack of funding and lack of clear reimbursement mechanisms, payment schemes that discourage telemedicine, lack of legislation pertaining to telemedicine, inadequate information and communications technology (ICT) infrastructure, issues with connectivity, access to broadband, coverage in rural areas, challenges with onboarding health care staff, and privacy and data security.2

Access to and Coverage for Telehealth 79 Measure Construct Access to and Coverage for Telehealth • Costs: OECD conducted expert interviews and a literature review and found that there was some agreement that telemedicine services can deliver more cost-effective health care and possibly provide cost savings, but the data are not sufficient to generalize2 and require constant updates to keep up with the changes in available telehealth services and technologies.24 Telehealth revenue was $9.6 billion in 20135 and was estimated to increase to $30 billion by 2020.25 Global: The global telemedicine market was valued at $45 billion in 2019 and expected to grow to $175 billion by 2026.35 Importance: Health insurance reform: Related U.S. Insurance coverage of telehealth has the potential to improve access to Department of Health health care services. Telehealth coverage is not currently consistently and Human Services included in health insurance plans, and, given evidence that telehealth is (HHS) priority topics cost-effective, increasing telehealth coverage could increase access to health care and reduce overall health care costs.

Other related priorities: Value-based care: Use of telehealth services falls under the HHS priority area of “maximizing the promise of health IT [information technology].” The HHS priority to transform our health care system from one that pays for procedures and sickness to one that pays for outcomes and health relates to access to/coverage for telehealth because of the potential for telehealth to increase access to and use of preventive health care services that can be delivered via telehealth more easily (versus procedures which cannot be done via telehealth). As a result, it could reduce the number of procedures that are necessary and reduce delays in seeking care. Validity • Construct validity: The definition of telehealth (specifically, which types of services count as telehealth) would need to be agreed on first in order to design a measure that can accurately reflect international differences in access to and coverage for telehealth. • Internal validity: There is evidence to suggest that telehealth services are effective and provide the same quality of care as in-person services.12–16 • Discriminant validity: Although insurance coverage of telehealth is generally straightforward, because access to telehealth requires access to high-speed internet and digital literacy, measures assessing access may be confounded by these other factors.2 Feasibility for • Definitions: international o There is not a common or agreed-upon definition for telehealth,2 comparisons which encompasses a variety of services and modalities. Meaningful measures would likely need to define specific types of telehealth (e.g., teleradiology, telepathology, teledermatology, remote patient monitoring, telepsychiatry) or a specific service (interacting with a health care provider through a video call, using email to communicate with a provider, etc.), as well as account for differences in coverage of health services in general (e.g., universal, nationally funded coverage versus more-fragmented, private coverage) to accurately compare between countries. • Data availability: o Data on insurance coverage of various telehealth services in the United States are available7 and could be used to estimate the overall

Access to and Coverage for Telehealth 80 Measure Construct Access to and Coverage for Telehealth coverage in the United States. However, access more broadly would likely require survey data to capture reach and feasibility. o Similarly, on a global level, high-level coverage data exist;4 however, information about access is more limited. o If telehealth visits could be captured via electronic health records, administrative data could be used.26 However, survey data would be more likely to yield the information of interest. • Subgroup analysis and equity: Data could be stratified by type of insurance coverage, age, health status, income, and rural location; these subgroup analyses would facilitate a comparison of how well telehealth visits are improving access to health care for individuals who already have problems with access and could face challenges with accessing telehealth services as well. Usability: • There is no currently accepted measure for access to or coverage for Current evidence of use telehealth. However, other relevant data are available, such as total revenue generated by telehealth, the number of telemedicine visits per year in specific populations (e.g., Medicaid recipients), coverage for telehealth by different types of health insurance plans (public and private), and patient-reported surveys about use of various types of telehealth services. • Most data collection pertaining to telehealth is focused on the effectiveness and cost-effectiveness of telehealth; there is less information about access to and coverage of telehealth services. • This measurement concept does not appear to be widely used globally or nationally; however, there is discussion in the literature for a need to better understand and measure the structure, processes, and outcomes of telehealth.27 The National Quality Forum has developed several measurement concepts to inform future studies of various aspects of telehealth, including the effect on access to health care; the cost and financial impact on the patient, care team, health system or payer, and society; the experience of the patient, the care team, and the community; and effectiveness (system, clinical, operational, and technical).28 Usability: • Access to and coverage for telehealth do not exist in the OECD Health Relationship to at a Glance series or OECD Health Statistics; however, there is interest currently used OECD in better understanding aspects of digital health, including telehealth.29,2 measures • Additionally, OECD captures other related measures: o household access to ICT at home (computer access, internet access, broadband internet access); ICT and internet use (use of a computer, use of the internet, internet activities [email, social networking, reading, telephone or video calling, buying and selling goods, finding information about goods and services, seeking health care information, online coursework, looking for a job, banking, etc.]); online interaction with government agencies (interacting with health services via public authorities’ websites); and ICT skills (use of email with attached files, posting of messages, transferring files, etc.). These would be helpful in gauging barriers to access to telehealth.30 o Population coverage for a core set of services (% of population): Given that telehealth may often be included in overall coverage, this measure may provide insight into data collection for coverage of telehealth.31 o Needs-adjusted probability of visiting a doctor (% of population aged 15+): This measure could be positively correlated with use of telehealth.32

Access to and Coverage for Telehealth 81 Measure Construct Access to and Coverage for Telehealth o Geographic distribution of doctors: Countries within which there are greater disparities in physician density across localities suggest a greater potential need for and benefit of increasing telehealth services.33

References

1. U.S. Department of Health and Human Services, Agency for Healthcare Research and Quality. Chartbook on Access to Health Care. Rockville, MD. 2018. 2. Oliveira Hashiguchi TC. Bringing Health Care to the Patient: An Overview of the Use of Telemedicine in OECD Countries, OECD Health Working Papers, No. 116. Paris: OECD Publishing; 2020. 3. U.S. Department of Health and Human Services, Health Resources & Services Administration. Telehealth Programs. 2019. Accessed April 3, 2020. https://www.hrsa.gov/rural-health/telehealth 4. World Health Organization. Global Diffusion of eHealth: Making Universal Health Coverage Achievable: Report of the Third Global Survey on eHealth. 2017. 5. U.S. Department of Health and Human Services, Office of Health Policy, Office of the Assistant Secretary for Planning and Evaluation. Report to Congress: E-Health and Telemedicine. 2016. 6. The Office of the National Coordinator for Health Information Technology. What Is Telehealth? How Is Telehealth Different from Telemedicine? 2019. Accessed April 3, 2020. https://www.healthit.gov/faq/what-telehealth-how-telehealth-different-telemedicine 7. Center for Connected Health Policy. State Telehealth Laws and Reimbursement Policies Report. 2020. 8. Mehrotra A, Jena AB, Busch AB, Souza J, Uscher-Pines L, Landon BE. Utilization of telemedicine among rural Medicare beneficiaries. JAMA. 2016;315(18):2015-2016. 9. Douglas MD, Xu J, Heggs A, Wrenn G, Mack DH, Rust G. Assessing telemedicine utilization by using Medicaid claims data. Psychiatr Serv. 2017;68(2):173-178. 10. Harvey JB, Valenta S, Simpson K, Lyles M, McElligott J. Utilization of outpatient telehealth services in parity and nonparity states 2010-2015. Telemed J E Health. 2019;25(2):132-136. 11. Park J, Erikson C, Han X, Iyer P. Are state telehealth policies associated with the use of telehealth services among underserved populations? Health Aff (Millwood). 2018;37(12):2060-2068. 12. Wootton R. Twenty years of telemedicine in chronic disease management—an evidence synthesis. J Telemed Telecare. 2012;18(4):211-220. 13. Ashwood JS, Mehrotra A, Cowling D, Uscher-Pines L. Direct-to-consumer telehealth may increase access to care but does not decrease spending. Health Aff (Millwood). 2017;36(3):485-491. 14. Mehrotra A, Huskamp HA, Souza J, et al. Rapid growth in mental health telemedicine use among rural Medicare beneficiaries, wide variation across states. Health Aff (Millwood). 2017;36(5):909-917. 15. Uscher-Pines L, Mehrotra A. Analysis of teladoc use seems to indicate expanded access to care for patients without prior connection to a provider. Health Aff (Millwood). 2014;33(2):258-264. 16. Uscher-Pines L, Malsberger R, Burgette L, Mulcahy A, Mehrotra A. Effect of teledermatology on access to dermatology care among Medicaid enrollees. JAMA Dermatol. 2016;152(8):905-912. 17. U.S. Department of Health and Human Services. Telehealth: Delivering Care Safely During COVID-19. 2020. Accessed April 3, 2020. https://www.hhs.gov/coronavirus/telehealth/index.html 18. Rockwell KL, Gilroy AS. Incorporating telemedicine as part of COVID-19 outbreak response systems. Am J Manag Care. 2020;26(4):147-148. 19. Centers for Medicare and Medicaid Services. Section 1135 Waiver Flexibilities: CMS 1135 Waivers. Undated. Accessed April 3, 2020. https://www.medicaid.gov/resources-for-states/disaster-response-toolkit/ section-1135-waiver-flexibilities/index.html 20. Public Law No: 116-123. The Coronavirus Preparedness and Response Supplemental Appropriations Act. 2020. 21. Public Law No: 116-127. Families First Coronavirus Response Act. 2020. 22. LaRosa J. The benefits of telehealth during a pandemic—and beyond, To the Point (blog). Commonwealth Fund; 2020. 23. Lewis C, Shah T, Jacobson G, McIntosh A, Abrams MK. How the COVID- 19 pandemic could increase social isolation, and how providers and policymakers can keep us connected, To the Point (blog). Commonwealth Fund; 2020.

Access to and Coverage for Telehealth 82 24. OECD. New Health Technologies: Managing Access, Value and Sustainability. Paris: OECD Publishing; 2017. 25. Marcoux RM, Vogenberg FR. Telehealth: Applications from a legal and regulatory perspective. P T. 2016;41(9):567-570. 26. Yeramosu D, Kwok F, Kahn JM, Ray KN. Validation of use of billing codes for identifying telemedicine encounters in administrative data. BMC Health Serv Res. 2019;19(1):928. 27. Dinesen B, Nonnecke B, Lindeman D, et al. Personalized telehealth in the future: A global research agenda. J Med Internet Res. 2016;18(3):e53. 28. National Quality Forum. Creating a Framework to Support Measure Development for Telehealth. Washington, D.C.: National Quality Forum; 2017. 29. OECD. Health in the 21st Century: Putting Data to Work for Stronger Health Systems. Paris: OECD Health Policy Studies, OECD Publishing; 2019. 30. OECD. ICT access and usage by households and individuals. OECD Telecommunications and Internet Statistics (database). 2020. 31. OECD. Population coverage for health care. Health at a Glance 2019: OECD Indicators. Paris: OECD Publishing; 2019. 32. OECD. Use of primary care services. Health at a Glance 2019: OECD Indicators. Paris: OECD Publishing; 2019. 33. OECD. Geographic distribution of doctors. Health at a Glance 2017: OECD Indicators. Paris: OECD Publishing; 2017. 34. Institute of Medicine. Access to Health Care in America. Washington, DC: The National Academies Press; 1993. 35. Mikulic M. Global Telemedicine Market Size 2019 vs 2026. Statista. May 12, 2020. Accessed November 18, 2020. https://www.statista.com/statistics/671374/global-telemedicine-market-size/

Access to and Coverage for Telehealth 83 Quality-Adjusted Life Expectancy

Table A.3. Quality-Adjusted Life Expectancy

Measure Construct Quality-Adjusted Life Expectancy Description Quality-adjusted life expectancy (QALE) is a summary measure of population health that combines information on fatal and nonfatal health outcomes. Data describing (1) health-related quality of life (HRQoL) and (2) life expectancy (by characteristics of interest, such as age, sex, race, and ethnicity) are required to calculate QALE. QALE has been used to monitor changes in population health over time, compare population health across countries, investigate health inequalities, and quantify the benefits of health interventions in cost-effectiveness analysis.1 Importance: Health or Population impact: social impact National: In 2008, the QALE of a U.S. adult at age 18 years was 52.3 years.2

Global: • Life expectancy has increased in all Organisation for Economic Co- operation and Development (OECD) countries over the last few decades, though gains have recently slowed. Meanwhile, the rates of chronic conditions, such as obesity and diabetes, have been rising, and these conditions can lead to nonfatal adverse health outcomes such as functional disabilities.3 • A 15-country analysis showed that the QALE at age 20 ranged from 33 years (males in Armenia) to 61 years (females in Japan).1 The United States performed worse than other Western high-income countries in the data set, which the authors conjectured could be due to disparities in access to care, unhealthy diets, or other behavioral factors. However, these estimates were calculated using the UK value set, and estimates changed when different countries’ value sets were applied.

Meaningful clinical impact: Individuals with particular health conditions can lose quality-adjusted life years (QALYs).4 Evidence of differential QALE loss across subgroups can identify groups most affected by specific health conditions and thus those who are in need of targeted clinical interventions.4 HRQoL alone has also been used in clinical research and practice and is deemed important to inform decisions about treatments.5

Performance gap: QALE can be an important indicator of health systems’ performance because it can assess population health; when linked to health outcomes, it can help identify the drivers of changes in QALE over time, which is important for informed policymaking.6,7

Costs: • Cost per QALE gained or lost is used in cost-effectiveness evaluations of health interventions (e.g., cancer screening).8,9 In the United States, improvements in key risk factors (smoking, motor vehicle accidents, and alcohol) from 1960 to 2010 were attributed to QALE gains of 1.82 years in adults at age 25, valued at $65,428 per person over the course of a person’s adult life.10,11

Quality-Adjusted Life Expectancy 84 Measure Construct Quality-Adjusted Life Expectancy • The costs to society due to low performance in QALE are potentially great. For example, the loss of an average of 28 years of quality (and thus productive) years of life for the average Armenian person relative to the average Japanese person has significant economic implications. A quality-adjusted life year (QALY) is thought to be worth somewhere between $50,000 and $150,000.12 Thus, if we assume the worth of a QALY to be $100,000, Armenia is losing $8.4 trillion per year due to the difference in QALE relative to Japan (28 QALYs per person in Armenia multiplied by $100,000 per QALY per year multiplied by 3 million Armenians).13 Importance: Value-based care Related U.S. The HHS Healthy People 2020 goals include increasing the quality of life Department of Health and years of healthy life,14 both of which make up QALE. Given that and Human Services value-based care focuses on patient values, which include increased life (HHS) priority topics expectancy and improved HRQoL,15 assessing QALE is highly relevant to this HHS priority. Measuring HRQoL on a large scale could lead stakeholders to better understand cost-effectiveness of interventions, thus informing coverage decisions that can improve the value of care.

Other related priorities Opioid crisis: Certain regions in the United States likely have worse QALEs due to disproportionate burdens of opioid leading to disability and/or death. Opioid crisis hotspots might be identifiable due to subgroup analyses of QALEs at the regional levels or by demographic characteristics. Validity Construct validity: QALE, as a summary measure of population health for fatal and nonfatal health outcomes, is a measure that offers more insight into health than classic life expectancy. Comparing a nation’s life expectancy versus its QALE can help stakeholders understand the additional toll that morbidity takes on society. Moreover, comparing QALE for different subgroups within one nation (e.g., men versus women) can lend insight into how different subgroups experience outcomes disproportionately.

Convergent validity: Although no single global or national QALE measure exists, researchers have used a combination of data sources on quality of life and life expectancy. One of the most common measures of HRQoL is assessed by the EQ-5D population survey, which is used around the world; this measure has been standardized and validated.16 For example, the convergent validities of the EQ-5D 3-item (0.88–0.99) and 5-item (0.90–0.99) HRQoL scales are high and about equal.16 However, response bias in the measurement of self-reported data such as HRQoL could affect the validity of QALE.1

Internal validity: As with life expectancy, QALE is dependent on social determinants of health, in addition to medical determinants. For example, violent crime could lead QALE to drop in countries with high crime rates.

Discriminant validity: For some purposes, such as cost-effectiveness analysis, measures of HRQoL must be based on utilities or preferences for health states that meet the conditions of welfare economics, which assumes that individuals seek to maximize utilities (preferences for particular outcomes) and that overall societal welfare is some function of these individual utilities.17 Additionally, HRQoL is subjective, and

Quality-Adjusted Life Expectancy 85 Measure Construct Quality-Adjusted Life Expectancy responses may be systematically different across and within countries because of cultural differences.3,18 Feasibility for Definitions: QALE is categorized as a summary measure of population international health: a measure that combines information on fatal and nonfatal health comparisons outcomes. Calculation of QALE requires two sources of data: probability of death at various ages and data on HRQoL for people in the sample, as well as a value set, which is likely to vary across nations due to differences in sociocultural and demographic characteristics.1

QALY is the unit of measurement of QALE.

Healthy life expectancy (HALE) is a similar measure to QALE, but it is dependent on a population’s rankings of preferences for different health conditions (health utility index) rather than HRQoL scores. In samples of patients with multiple comorbidities, calculating HALE is challenging because the large number of combinations of comorbidities makes scoring the health utility index challenging.19

Data availability: National: The United States does not routinely calculate or report QALE.20 However, QALE is often estimated by combining HRQoL data from the Behavioral Risk Factor Surveillance System 21 and life table estimates from the National Center for Health Statistics national mortality files.2,22 Yet, to estimate QALE at various levels (e.g., national, state, local), expanded measurement of “preference weights” is needed—i.e., the data required to scale health outcomes into health-state utilities. Currently, only a handful of weights exist for the U.S. population, and this affects QALE estimates.20

Other HRQoL measures are assessed in the National Health and Nutrition Examination Survey and the Medicare Health Outcome Survey. There is also a 14-item version called the Centers for Disease Control and Prevention HRQOL-14, though this is not routinely administered in national surveys.23

Global In terms of HRQoL data, the EQ-5D questionnaire is the most common globally. Population norm values using the EQ-5D have been established in many European countries, as well as the United States, Canada, the United Kingdom, China, Japan, Korea, Argentina, New Zealand, Thailand, and Zimbabwe.24 Life expectancy tables are available in most countries and are maintained by Eurostat and the World Health Organization.25,26 A report from Korea explains the step-by-step process taken to calculate QALE using data from Statistics Korea (probability of death at 5-year intervals by gender, year, educational status, and region from 1970 to 2014) and HRQoL data from the Korea National Health and Nutrition Examination Survey.27

Data comparability: Data on life expectancy have been used to compare health outcomes internationally for decades. Although they are limited in the setting of rapidly changing age-specific death rates (e.g., in time of war or epidemics), they are relatively comparable across nations. Data on

Quality-Adjusted Life Expectancy 86 Measure Construct Quality-Adjusted Life Expectancy HRQoL could be less comparable for several reasons: self-ratings of quality of life can be systematically different across and within countries because of sociocultural differences and other characteristics, such as age distribution. For QALE in particular, the choice of value sets for quality of life scores may influence overall performance on QALE, which “may seriously affect cross country comparisons of health expectancy.”1,18,28

Subgroup analysis and equity: • Calculating QALEs for different subgroups has been used in multiple contexts to evaluate for disparities in health expectancy, including by age, sex, race/ethnicity, socioeconomic status, and geographic region.1,2,7,29–31 • In the United States, geographic variations in QALE among adults have been observed, with some of the lowest estimates found in Southern states (e.g., Mississippi, Alabama, Kentucky, Oklahoma).2 • In the United States, QALE is higher among White women (54.1 years in 2008), followed by White men (51.1), Black women (50.5), and Black men (46.1).2 • An international study of 15 countries showed that QALE was generally higher in females than in males.1 Usability: QALE measures are used as a routine health measure for tracking Current evidence of use population health, estimating lifetime health losses for people with a particular health condition compared with those without the condition and to compare the burden of disease for target populations, monitoring trends, and measuring health disparities.20

National: There is minimal evidence of QALE use within the United States outside of the academic studies reported above; however, components such as life expectancy and HRQoL are routinely collected by the federal government.

Global: There is no evidence of routine reporting of QALE internationally. However, the World Health Organization (WHO) reports data on HALE (derived from all-cause years lost due to disability in the Global Burden of Disease study from 2016) and generates estimates at the regional and global levels.32,33 QALE has been used to assess inequities in health in several countries.31,34 Usability: QALE is not currently represented among OECD measures. However, Relationship to OECD does routinely collect and report two related measures: life currently used OECD expectancy and self-rated health. measures • Life expectancy: Life expectancy, which refers to years of life at birth, is one of two necessary components for calculating QALE. Collecting life table data (life expectancy across all ages) would be a necessary step toward calculating QALE at the national level. • Self-rated health: Nations report survey-based measures of self-rated health. HRQoL is more detailed but is conceptually similar to self-rated health. A related measure collected by WHO and applied in analyses involving OECD countries is HALE at birth, which is defined as the average number of years that a person can expect to live in full health by taking

Quality-Adjusted Life Expectancy 87 Measure Construct Quality-Adjusted Life Expectancy into account years lived in less than full health due to disease and/or injury.35 HALE (previously termed disability-free life expectancy by WHO) is closely related to QALE, but it is not weighted for health-state preferences.20,36

References

1. Heijink R, van Baal P, Oppe M, Koolman X, Westert G. Decomposing cross-country differences in quality adjusted life expectancy: The impact of value sets. Population Health Metrics. 2011;9(1):17. 2. Jia H, Zack MM, Thompson WW. State quality-adjusted life expectancy for U.S. adults from 1993 to 2008. Qual Life Res. 2011;20(6):853-863. 3. OECD. Health at a Glance 2019: OECD Indicators. Paris: OECD Publishing; 2019. 4. Jia H, Zack MM, Thompson WW. The effects of diabetes, hypertension, asthma, heart disease, and stroke on quality-adjusted life expectancy. Value in Health. 2013;16(1):140-147. 5. Guyatt GH, Ferrans CE, Halyard MY, et al. Exploration of the value of health-related quality-of-life information from clinical research and into clinical practice. Mayo Proceedings. 2007;82(10):1229- 1239. 6. Meltzer DO, Chung JW. The population value of quality indicator reporting: A framework for prioritizing health care performance measures. Health Affairs. 2014;33(1):132-139. 7. Stewart ST, Cutler DM, Rosen AB. US trends in quality-adjusted life expectancy from 1987 to 2008: Combining national surveys to more broadly track the health of the nation. American Journal of Public Health. 2013;103(11):e78-e87. 8. Ratushnyak S, Hoogendoorn M, van Baal PHM. Cost-effectiveness of cancer screening: Health and costs in life years gained. Am J Prev Med. 2019;57(6):792-799. 9. McRae IS, Butler JRG, Sibthorpe BM, et al. A cost effectiveness study of integrated care in health services delivery: A diabetes program in Australia. BMC Health Services Research. 2008;8(1):205. 10. Stewart ST, Cutler DM. The Contribution of Behavior Change and Public Health to Improved U.S. Population Health, NBER Working Papers 20631. National Bureau of Economic Research, Inc.; 2014. 11. Kaplan R, Spittel M, David D, eds. Population Health: Behavioral and Social Science Insights, AHRQ Publication No. 15-0002. Rockville, MD: Agency for Healthcare Research and Quality and Office of Behavioral and Social Sciences Research, National Institutes of Health; 2015. 12. Neumann PJ, Cohen JT, Weinstein MC. Updating cost-effectiveness—the curious resilience of the $50,000-per-QALY threshold. N Engl J Med. 2014;371(9):796-797. 13. Worldometer. Armenia Population. 2020. Accessed May 21, 2020. https://www.worldometers.info/world-population/armenia-population 14. U.S. Department of Health and Human Services, Office of Disease Prevention and Health Promotion. About Healthy People. Undated. Accessed May 21, 2020. https://www.healthypeople.gov/2020/About-Healthy-People 15. Bae J-M. Value-based medicine: Concepts and application. Epidemiol Health. 2015;37:e2015014- e2015014. 16. Janssen MF, Birnie E, Haagsma JA, Bonsel GJ. Comparing the standard EQ-5D three-level system with a five-level version. Value Health. 2008;11(2):275-284. 17. Institute of Medicine (US) Committee on Summary Measures of Population Health, Field MJ, Gold MR, eds. Summarizing Population Health: Directions for the Development and Application of Population Metrics. Washington, D.C.: National Academies Press; 1998. 18. Heijink R, Reitmeir P, Leidl R. International comparison of experience-based health state values at the population level. Health Qual Life Outcomes. 2017;15(1):138. 19. van Baal PH, Hoeymans N, Hoogenveen RT, de Wit GA, Westert GP. Disability weights for comorbidity and their influence on health-adjusted life expectancy. Popul Health Metr. 2006;4:1. 20. Brown DS, Jia H, Zack MM, Thompson WW, Haddix AC, Kaplan RM. Using health-related quality of life and quality-adjusted life expectancy for effective public health surveillance and prevention. Expert Rev Pharmacoecon Outcomes Res. 2013;13(4):425-427. 21. Centers for Disease Control and Prevention. Measuring Healthy Days: Population Assessment of Health- Related Quality of Life. Atlanta, GA; 2000.

Quality-Adjusted Life Expectancy 88 22. Centers for Disease Control and Prevention. Compressed Mortality File: Underlying Cause-of-Death. 2020. Accessed May 21, 2020. https://wonder.cdc.gov/mortSQL.html 23. Centers for Disease Control and Prevention. CDC HRQOL–14 “Healthy Days Measure.” 2018. Accessed May 21, 2020. https://www.cdc.gov/hrqol/hrqol14_measure.htm 24. EuroQol Group. Population Norms. 2019. Accessed May 21, 2020. https://euroqol.org/eq-5d-instruments/population-norms 25. Eurostat. Life Expectancy at Birth by Sex. 2020. Accessed May 21, 2020. https://ec.europa.eu/eurostat/databrowser/view/tps00205/default/table?lang=en 26. World Health Organization. Global Health Observatory (GHO) Data: Life Tables. 2020. Accessed May 21, 2020. https://www.who.int/gho/mortality_burden_disease/life_tables/life_tables/en 27. Jo MW, Seo W, Lim SY, Ock M. The trends in health life expectancy in Korea according to age, gender, education level, and subregion: Using quality-adjusted life expectancy method. J Korean Med Sci. 2019;34(Suppl 1):e88. 28. Rencz F, Gulácsi L, Drummond M, et al. EQ-5D in Central and Eastern Europe: 2000-2015. Qual Life Res. 2016;25(11):2693-2710. 29. Lim D, Bahk J, Ock M, et al. Income-related inequality in quality-adjusted life expectancy in Korea at the national and district levels. Health Qual Life Outcomes. 2020;18(1):45. 30. Love-Koh J, Asaria M, Cookson R, Griffin S. The social distribution of health: Estimating quality-adjusted life expectancy in England. Value Health. 2015;18(5):655-662. 31. Gheorghe M, Wubulihasimu P, Peters F, Nusselder W, Van Baal PH. Health inequalities in the Netherlands: Trends in quality-adjusted life expectancy (QALE) by educational level. Eur J Public Health. 2016;26(5):794-799. 32. World Health Organization. The Global Health Observatory: Healthy Life Expectancy (HALE) at Birth. 2020. Accessed May 21, 2020. https://www.who.int/data/gho/indicator-metadata-registry/imr-details/66 33. World Health Organization. WHO Methods and Data Sources for Life Tables 1990-2016. Geneva: Department of Information, Evidence, and Research, World Health Organization; 2018. 34. Collins B. Using a survey to estimate health expectancy and quality-adjusted life expectancy to assess inequalities in health and quality of life. Value Health. 2013;16(4):599-603. 35. Park M-B, Nam EW, Kim C-B, Lee HJ, Lee K-S, Koh S-B. Favorable and unfavorable health conditions within OECD countries: An exploratory study. SAGE Open Med. 2018;6. 36. World Health Organization. Health Status Statistics: Mortality. 2020. Accessed May 21, 2020. https://www.who.int/healthinfo/statistics/indhale/en

Quality-Adjusted Life Expectancy 89 Insurance Coverage for Mental Health, Behavioral Health, and Substance Abuse Services

Table A.4. Insurance Coverage for Mental Health, Behavioral Health, and Substance Abuse Services

Insurance Coverage for Mental Health, Behavioral Health, and Measure Construct Substance Abuse Services Description The 2008 Mental Health Parity and Addiction Equity Act required large group health plans to place benefits for mental health problems on equal footing with physical illness. The Affordable Care Act required small- group health plans and individual plans sold on exchanges to cover mental health services at the same level as medical services. However, patient advocates complain that health plans are more restrictive with reimbursement for mental health.1

Behavioral health conditions can include mental illnesses, such as anxiety disorders, major depression, schizophrenia, and posttraumatic stress disorder, and substance use disorders (SUDs), such as opioid addiction and alcoholism. People with behavioral health needs may benefit from a range of treatments, from outpatient counseling to prescription drugs or inpatient care.2 Mental health, behavioral health, and substance abuse services can include care in inpatient and outpatient settings, residential treatment centers, day care facilities, detox centers, etc. Treatments can include pharmaceutical and psychological interventions.3 • Medicaid plays a key role in financing behavioral health care. In 2015, Medicaid covered 21% of adults with mental illness, 26% of adults with serious mental illness, and 17% of adults with SUDs.4 • There are several measures of insurance coverage to consider: o Effective coverage: “People who need health services obtain them in a timely manner and at a level of quality necessary to obtain the desired effect and potential health gains.”5 o Universal health coverage: “Universal health coverage means all people receiving the health services they need, including health initiatives designed to promote better health (such as anti-tobacco policies), prevent illness (such as vaccinations), and to provide treatment, rehabilitation, and palliative care (such as end-of-life care) of sufficient quality to be effective while at the same time ensuring that the use of these services does not expose the user to financial hardship.”5 Importance: Health or Population impact: social impact • National incidence: Almost one in five American adults lives with a mental illness.6 Only 41% of people with mental disorders access any mental health services.7 • Global incidence: Mental, behavioral, and substance use disorders are prevalent throughout the world, with 970 million people experiencing a mental disorder and 175 million experiencing an SUD in 2017.8 • Approximately 14% of the global burden of disease can be attributed to these disorders; however, most people do not have access to the treatment they need, including 75% of those in several low-income countries.9

Insurance Coverage for Mental Health, Behavioral Health, and Substance Abuse Services 90 Insurance Coverage for Mental Health, Behavioral Health, and Measure Construct Substance Abuse Services Clinical impact: • Living in a Medicaid expansion state is associated with greater decline in cost-related access problems, especially for young adults.7,10,11 Insurance coverage gains improve mental health and substance use treatment rates;7,12 however, there are racial and ethnic disparities in the increases in access attributable to insurance.13 • More than 70,000 Americans died of overdoses in 2017, yet only 1% of total health care dollars went to treatment for SUDs.14

Performance gap: • There is no generally accepted estimate of the health care costs associated with untreated behavioral health conditions.15 Data on untreated mental health conditions and associated health costs come from multiple sources and are difficult to link. Not knowing how many people are suffering from a specific behavioral health condition limits the ability to measure coverage rates.15 • Nearly three-quarters of 169 World Health Organization (WHO) member states reported that care and treatment of persons with severe mental health disorders were included in their national health insurance or reimbursement schemes; 27% indicated that this care was not included, and 19% indicated that these conditions were explicitly excluded from the plans.16

Costs: • National: Annual U.S. mental health spending is more than $200 billion.17 Insufficient coverage of mental health and addiction treatments is forcing people to go out of network and incur higher out-of-pocket costs.18 • Global: According to WHO, “The cost of mental health problems in developed countries is estimated to be between 3% and 4% of GNP [gross national product]. However, mental disorders cost national economies several billion dollars, both in terms of expenditures incurred and loss of productivity. The average annual costs, including medical, pharmaceutical and disability costs, for employees with depression may be 4.2 times higher than those incurred by a typical beneficiary. However, the cost of treatment is often completely offset by a reduction in the number of days of absenteeism and productivity lost while at work.”19 Importance: Health insurance reform: Related U.S. The HHS priority to improve the availability and affordability of health Department of Health insurance seeks to help all Americans access health care that meets and Human Services individual needs and budgets.20 Mental and behavioral health services (HHS) priority topics are considered essential health benefits.21 Expanding Medicaid access may reduce opioid-related hospitalizations owing to better management of SUDs in outpatient settings.22

Other related priorities: Opioid crisis: Expanding Medicaid may reduce opioid-related hospitalizations owing to management of opioid use disorder in outpatient settings.22 Validity Construct validity: Individual patient measures and census-level data have shown the face validity of this measure.23 To improve comparability and precision of the measure, a list of mental health, behavioral health,

Insurance Coverage for Mental Health, Behavioral Health, and Substance Abuse Services 91 Insurance Coverage for Mental Health, Behavioral Health, and Measure Construct Substance Abuse Services and substance use conditions and treatments would need to be included in any measurement definition.

Internal validity: There is evidence that those with insurance are more likely to receive care for mental health disorders through the medical system than those without.24 Insurance coverage gains improve mental health and substance use treatment rates.7,12

Discriminant validity: Health insurance coverage is not a perfect indicator of access to services. Countries with similar rates of insurance coverage for mental or behavioral health and SUDs but differences in cost-sharing could also have very different access to mental health treatment. Measures should account for differences in coverage of health services in general (e.g., universal, nationally funded coverage versus more-fragmented, private coverage). Furthermore, access to services does not imply that the services are of high quality.25

Feasibility for Definitions: international • There is no commonly used or standard definition of insurance comparisons coverage of mental health, behavioral health, or substance abuse measures, but there are international comparisons of insurance coverage overall and for other conditions, which could be leveraged to create a metric for this measurement concept. • Given the different types of insurance mechanisms across countries (e.g., universal, nationally funded coverage versus more-fragmented, private coverage), comparison of coverage could be more difficult, and the presence of coverage might not have the same implications for access given different payment structures and cost-sharing requirements (e.g., deductibles, copays).

Data availability: • Behavioral health conditions often go undiagnosed or untreated, which limits the ability to measure unmet need for insurance coverage.26 • Review of payer claims data identifies which mental and behavioral conditions are or are not covered by insurance.

Data comparability: • Experts disagree which programs constitute behavioral health treatment, such as self-help programs like Alcoholics Anonymous.15 • The United States currently captures data insurance via several sources: the National Survey of Drug Use and Health (Substance Abuse and Mental Health Services Administration [SAMHSA]),3 the Current Population Survey (Census Bureau), the Medical Expenditure Panel Survey (Agency for Healthcare Research and Quality), the National Health Interview Study (National Center for Health Statistics/Centers for Disease Control and Prevention), and the Survey of Income and Program Participation (Census Bureau).27 • WHO has collected data on coverage of mental health services by country via survey; however, these are high-level data and do not account for differences within countries with fragmented health care payment systems.16

Insurance Coverage for Mental Health, Behavioral Health, and Substance Abuse Services 92 Insurance Coverage for Mental Health, Behavioral Health, and Measure Construct Substance Abuse Services Subgroup analysis and equity: Given the racial and ethnic disparities in insurance coverage and mental health treatment,28 this measure should be stratified to assess whether these disparities continue to exist. Usability: Several countries currently provide insurance coverage for mental and Current evidence of use behavioral health services. Evidence includes the following (not exhaustive):

• National: Financial burden of mental health conditions is recorded in the Medical Expenditure Panel Survey.29 • Access to behavioral health services for insured and noninsured populations is recorded annually in the SAMHSA Behavioral Health Barometer.30 • International: WHO collects data on coverage of mental health services by country via survey.16 • Australia uses national hospital data, community mental health data, and outcomes measures to measure publicly funded coverage. There are limited data on utilization or coverage of private psychiatry.31 • England’s Improving Access to Psychological Therapies initiative supports 1.1 million people accessing psychological support annually, with the plan to increase to 1.9 million by 2024. Because England has a national health care system, primary and specialist mental health care is paid for by the state.31 • In Japan, patients who need psychiatric services can apply for a municipal system where for outpatient and inpatient care are 10%, with a monthly threshold based on income. Statistics are reported in the 630 Survey, the Patient Survey, and the National Database of Medical Fee Statements.31 Usability: Insurance coverage for mental health is not among the current OECD Relationship to measures. currently used Organisation for Closest related measures: Economic Co-operation • OECD collects data from the European Health Interview Survey on self- and Development reported disability and substance abuse.32 (OECD) measures • OECD reports on personal costs of mental ill health on a country level but has not updated its data since 2018.33 • In the 2019 report Health at a Glance, there are two measures related to mental health: suicide rates and responses to the question “Does your health keep you from working full-time or limit your ability to do housework or other daily activities?” which are stratified by responses to the following question from the Commonwealth Fund 2016 International Health Policy Survey of Adults: “Have you ever been told by a doctor that you have depression, anxiety, or other mental health problems?”34

References

1. Dangor G. ‘Mental Health Parity’ Is Still an Elusive Goal in U.S. Insurance Coverage. Shots: Health News from NPR. 2019. Accessed April 2, 2020. https://www.npr.org/sections/health-shots/2019/06/07/ 730404539/mental-health-parity-is-still-an-elusive-goal-in-u-s-insurance-coverage

Insurance Coverage for Mental Health, Behavioral Health, and Substance Abuse Services 93 2. Zur J, Musumeci M, Garfield R. Medicaid’s Role in Financing Behavioral Health Services for Low-Income Individuals. 2017. Accessed April 1, 2020. https://www.kff.org/medicaid/issue-brief/ medicaids-role-in-financing-behavioral-health-services-for-low-income-individuals 3. U.S. Department of Health and Human Services, Substance Abuse and Mental Health Services Administration. Key Substance Use and Mental Health Indicators in the United States: Results from the 2018 National Survey on Drug Use and Health, Rockville, MD: Center for Behavioral Health Statistics and Quality, Substance Abuse and Mental Health Services Administration; 2019. 4. Center for Behavioral Health Statistics and Quality. 2015 National Survey on Drug Use and Health: Detailed Tables. 2016. 5. World Health Organization. Tracking Universal Health Coverage: 2017 Global Monitoring Report. 2017. 6. Baumgartner JC, Aboulafia GN, McIntosh A. The ACA at 10: How has it impacted mental health care? To the Point. 2020. Accessed May 20, 2020. https://www.commonwealthfund.org/blog/2020/aca-10-how-has-it-impacted-mental-health-care 7. Thomas KC, Shartzer A, Kurth NK, Hall JP. Impact of ACA health reforms for people with mental health conditions. Psychiatr Serv. 2018;69(2):231-234. 8. James SL, Abate D, Abate KH, et al. Global, regional, and national incidence, prevalence, and years lived with disability for 354 diseases and injuries for 195 countries and territories, 1990-2017: A systematic analysis for the Global Burden of Disease Study 2017. Lancet. 2018;392(10159):1789-1858. 9. World Health Organization. mhGAP Operations Manual: Mental Health Gap Action Programme (mhGAP). Geneva: Licence: CC BY-NC-SA 3.0 IGO; 2018. 10. Fry CE, Sommers BD. Effect of Medicaid expansion on health insurance coverage and access to care among adults with depression. Psychiatr Serv. 2018;69(11):1146-1152. 11. Howell BA, Wang EA, Winkelman TN. Mental health treatment among individuals involved in the criminal justice system after implementation of the Affordable Care Act. Psychiatr Serv. 2019;70(9):765- 771. 12. Garfield RL, Zuvekas SH, Lave JR, Donohue JM. The impact of national on adults with severe mental disorders. Am J Psychiatry. 2011;168(5):486-494. 13. Creedon TB, Cook BL. Access to mental health care increased but not for substance use, while disparities remain. Health Aff (Millwood). 2016;35(6):1017-1021. 14. Melek S, Davenport S, Gray TJ. Addiction and Mental Health vs. Physical Health: Widening Disparities in Network Use and Provider Reimbursement. Milliman; November 19, 2019. 15. United States Government Accountability Office. Research on Health Care Costs of Untreated Conditions Is Limited. Washington, D.C.; 2019. 16. World Health Organization. Mental Health Atlas 2017. Geneva: Licence: CC BY-NC-SA 3.0 IGO; 2018. 17. Roehrig C. Mental disorders top the list of the most costly conditions in the United States: $201 billion. Health Affairs. 2016;35(6):1130-1135. 18. Kennedy PJ. Mental Health and A ddiction Care Are Poorly Covered by Insurance Networks. STAT. 2019. Accessed May 20, 2020. https://www.statnews.com/2019/12/10/ mental-health-addiction-care-poorly-covered-by-insurance-networks 19. World Health Organization. Investing in Mental Health. 2003. 20. U.S. Department of Health and Human Services. Secretary Priorities: Health Insurance Reform. 2018. Accessed May 20, 2020. https://www.hhs.gov/about/leadership/secretary/priorities/index.html#health-insurance-reform 21. Healthcare.gov. Mental Health & Substance Abuse Coverage. Undated. Accessed May 20, 2020. https://www.healthcare.gov/coverage/mental-health-substance-abuse-coverage 22. Wen H, Soni A, Hollingsworth A, et al. Association between Medicaid expansion and rates of opioid- related hospital use. JAMA Intern Med. 2020. 23. Afshar M, Joyce C, Dligach D, et al. Subtypes in patients with opioid misuse: A prognostic enrichment strategy using electronic health record data in hospitalized patients. PloS One. 2019;14(7). 24. Wang PS, Lane M, Olfson M, Pincus HA, Wells KB, Kessler RC. Twelve-month use of mental health services in the United States: Results from the National Comorbidity Survey replication. Arch Gen Psychiatry. 2005;62(6):629-640. 25. Tikkanen R, Fields K, Williams RD, II, Abrams MK. Mental Health Conditions and Substance Use: Comparing U.S. Needs and Treatment Capacity with Those in Other High-Income Countries. Commonwealth Fund. 2020. Accessed May 21, 2020.

Insurance Coverage for Mental Health, Behavioral Health, and Substance Abuse Services 94 https://www.commonwealthfund.org/publications/issue-briefs/2020/may/ mental-health-conditions-substance-use-comparing-us-other-countries 26. Kessler RC, Berglund PA, Bruce ML, et al. The prevalence and correlates of untreated serious mental illness. Health Serv Res. 2001;36(6 Pt 1):987. 27. U.S. Department of Health and Human Services, Assistant Secretary for Planning and Evaluation. Health Insurance Data. Undated. Accessed May 21, 2020. https://aspe.hhs.gov/health-insurance-data 28. Novak P, Williams-Parry KF, Chen J. Racial and ethnic disparities among the remaining uninsured young adults with behavioral health disorders after the ACA expansion of dependent coverage. J Racial Ethn Health Disparities. 2017;4(4):607-614. 29. Xu WY, Retchin SM, Seiber EE, Li Y. Income-based disparities in financial burdens of medical spending under the Affordable Care Act in families with individuals having chronic conditions. Inquiry. 2019;56. 30. U.S. Department of Health and Human Services, Substance Abuse and Mental Health Services Administration. Behavioral Health Barometer: United States, Volume 5: Indicators as Measured Through the 2017 National Survey on Drug Use and Health and the National Survey of Substance Abuse Treatment Services. HHS Publication No. SMA–19–Baro-17-US. Rockville, MD: Substance Abuse and Mental Health Services Administration; 2019. 31. Watkins S, Morris Z. International Mental Health Comparisons 2019: Child and Adolescent, Adult, and Older Adult Services. National Health Service; October 31, 2019. 32. OECD, European Union. Health at a Glance: Europe 2018: State of Health in the EU Cycle. Paris/European Union, Brussels: OECD Publishing; 2018. 33. OECD. Mental Health and Work. Undated. Accessed May 21, 2020. https://www.oecd.org/employment/mental-health-and-work.htm 34. OECD. Health at a Glance 2019: OECD Indicators. Paris: OECD Publishing; 2019.

Insurance Coverage for Mental Health, Behavioral Health, and Substance Abuse Services 95 Receipt of Preference-Concordant End-of-Life Care

Table A.5. Receipt of Preference-Concordant End-of-Life Care

Measure Construct Receipt of Preference-Concordant End-of-Life Care Description Receipt of preference-concordant end-of-life care refers to the level of agreement between a patient’s desired end-of-life care and the actual end-of-life care received.1 These preferences are supposed to be translated into actionable medical orders that are designed to accompany the patient wherever he or she resides and in the patient’s medical record.2

Definitions for the various components of this construct are as follows: • End-of-life care is the support and medical care (e.g., palliative care) given to people who are near the end of life; this care can include palliative care, hospice care, and social support from family or religious communities.3 There is no standard definition for the end-of-life period, but it is usually the period preceding an individual’s natural death from a process that is unlikely to be arrested by medical care; some insurance plans operationalize this period based on specific criteria for life expectancy (e.g., 6 months or less).4 • Preference for end-of-life care is the care the patient desires and can be assessed by various methods such as questionnaire, postmortem chart review (e.g., do-not-resuscitate forms, advance directives, other standardized legal forms), medical charts, and in-person interviews with the patient or the patient’s designated proxy.1 This can also include preferences for site of care.3 Dying patients’ preferences for life- sustaining treatment are often unidentified due to physical deterioration and cognitive impairment; thus, proxies are often used to make decisions about end-of-life care on their behalf.5 • Receipt of end-of-life care is the actual care provided and is usually confirmed using postmortem chart review.1 • Concordance represents the level of agreement between the preferred and received end-of-life care. Some studies also assess agreement between nonpreferred care and the care that was received.1 When a patient’s preferences are not known, surrogate decisions (e.g., from a doctor or other decisionmaker) and medical orders have been used to determine concordance. Importance: Health or Population impact: social impact National: • Among a national sample of bereaved family members and friends of deceased older adults (65 years or older), about 87.4% reported that the end-of-life care received was consistent with decedents’ preferences (when weighted, this represents about 4.1 million decedents whose desired and received end-of-life care aligned).6 When end-of-life care was inconsistent with the decedent’s preferences, informants were more likely to report poor quality of care in the last month of life (e.g., unmet needs for pain management, decisions were made without enough input from the decedent or family, the patient was not always treated with respect). Global: • In Singapore, among adults who completed advance care plans as part of a national program, concordance for preferred care was high (98%

Receipt of Preference-Concordant End-of-Life Care 96 Measure Construct Receipt of Preference-Concordant End-of-Life Care desired and received comfort measures) but low for place of care (65% desired and received care at home).1 • Among the types of care used at the end of life, palliative care has received increasing attention worldwide.7 The goal of palliative care at the end of life is to relieve suffering of patients and their families by placing attention to physical, psychosocial, and spiritual symptoms as death approaches. It should be noted, though, that palliative care can be implemented at any stage of disease and is not limited to the end of life. Per a 2014 World Health Organization (WHO) report, globally, an estimated 19 million adults each year need palliative care at the end of life, with the majority being older adults (69%). Low- and middle-income countries (LMICs) have the highest prevalence of adults in need of palliative care at the end of life (70% in middle-income countries [MICs] plus 8% in low-income countries [LICs]) compared with high-income countries (HICs; 22%), but HICs have the highest rate (475 adults per 100,000).8 Among children globally, about 1.2 million per year need palliative care at the end of life, with the vast majority living in LMICs (62.9% in MICs plus 35% in LICs) as opposed to HICs (2.1%). LICs have the highest rate: 129 children per 100,000.8

Clinical impact: • Lack of concordance between a patient’s preferred and received end- of-life care could contribute to receipt of unnecessary care, potentially reducing a patient’s quality of life in the end-of-life period.9 • Furthermore, patients who do not receive concordant care can suffer from depression and their families could endure additional psychological burden—e.g., decisional conflict, anxiety, depression, and posttraumatic stress disorder—before and after the patient’s death.5 • Among older adults who received end-of-life care that was not consistent with their preferences, a higher proportion died in a hospital (30.3%) compared with their own home (27.9%) or a nursing home (22.9%),6 which could reflect trends of increasing intensive care unit use in the last 30 days of life and hospital readmissions in the last 90 days of life among Medicare beneficiaries.10 • Discussing expectations for a patient’s remaining length of life is associated with higher hospice enrollment.11

Performance gap: • Changes in concordance have been not studied longitudinally, potentially distorting the extent of concordance.5 • Automating assessment of concordant end-of-life care, with a chart review to verify findings, could be a valuable screening tool to identify potential overtreatment and undertreatment.12

Costs: National: • management and intensive interventions during the last three years of life are tied to high aggregate medical spending, even though such interventions do not always align with patient preferences.13 • Among Medicare beneficiaries, receiving end-of-life care that is not consistent with a patient’s preferences is associated with higher health care costs.14 About one-fourth of all Medicare spending goes to end-of-

Receipt of Preference-Concordant End-of-Life Care 97 Measure Construct Receipt of Preference-Concordant End-of-Life Care life care among beneficiaries, and increasing costs in recent years are attributed to the high cost of treating chronic diseases.9

Global: • The cost of providing care that is not consistent with patient preferences has not been estimated on a global scale. However, estimates for end-of-life care are available from multiple countries. For example, a nine-country study showed that medical spending per capita in the last 12 months of life is high, ranging from about $20,000 in Taiwan to $80,000 in the United States.15 However, medical care at the end of life (last 12 months) accounted for only 8 to 11% of overall medical spending in most countries. • A national Canadian study showed that the mean health care cost in the last year of life among children (aged 1 month–19 years) was $78,332 (Canadian dollars), with the majority incurred in acute care settings (67%).16 • Use of advance planning directives programs in the United States and Canada, in which facilitators assist patients in documenting their preferences for end-of-life care, have been shown to reduce costs of care from $1,031 to $64,827 U.S. dollars per patient, depending on study period and cost measurement.17 Importance: Value-based care: Related U.S. • Gaps in quality of care are linked to pain and symptom management, Department of Health communication, and care planning. Interventions to develop structured and Human Services discussions about goals of care can improve patient and family priority topics satisfaction.18 Value-based care incentives promote an environment that relies on keeping patients comfortable and at home when possible.19 • Ensuring that end-of-life care decisions are concordant with patient preferences reflects shared decisionmaking, which is a key component of value-based care.20,21 Validity Overall, there is limited reliability and validity of measures used to determine concordance of preferred and received end-of-life care. Comparisons of different methods of communicating end-of-life preferences are limited by the inconsistent use of valid and reliable measures across studies.22 Specific issues identified that can affect validity include response shift (i.e., when people’s values and choices change over time), a lack of specificity and consistency of documentation, and biases related to chart reviews.1

Convergent, predictive, and face validity: An example measure with available psychometric properties is the DES- 10 scale, which assesses patient engagement in decisionmaking for cancer care. It has been found to have convergent and predictive validity as well as good face validity.23 Feasibility for Definitions: international Although there is general consensus that this construct refers to the level comparisons of agreement between a patient’s preferred and received end-of-life care, there is currently no standard definition or measure for this construct.1

Data availability: National: • The National Health and Aging Trends Study (NHATS)—a prospective nationally representative survey of Medicare beneficiaries aged 65 and

Receipt of Preference-Concordant End-of-Life Care 98 Measure Construct Receipt of Preference-Concordant End-of-Life Care older—collects data from participants and, after death, from informants knowledgeable about the participants’ experiences in the month before death. To determine concordance between preferred versus received end-of-life care, informants are asked whether any decisions were made about treatments in the last month of the participant’s life that the participant would not have wanted (a “yes” would indicate discordance).24 • The Physician Orders for Life-Sustaining Treatment (POLST) form is becoming increasingly standardized to assess patient preferences for care, with almost all 50 states implementing the program.2 Global: • The Commonwealth Fund International Health Policy Survey assesses preference for end-of-life care among older adults (i.e., patients discuss their care wishes with their doctor or family or have a written plan in place).25 These data need to be linked with other data sources on receipt of care to determine concordance with preferences. • As countries move to incorporate advance care directives in which patients can document their preferences for care, these documents can be valuable for assessing concordance between preferred and received end-of-life care.26,27

Data comparability: • The lack of theoretical and conceptual clarity regarding concordance limits data comparability.1 • There are also various methods to assess end-of-life care preferences and care received, which makes comparing results across studies difficult.1

Subgroup analysis and equity: • Among U.S. older adults, fewer non-Latino Black patients (10.4%) reported that end-of-life care received was inconsistent with the patient’s preferences, compared with non-Latino White patients (13.7%), although this difference is not statistically significant.28 • Black patients tend to receive more life-prolonging end-of-life care than White patients. Black patients do not experience the same benefits of end-of-life discussions, and their directives are not followed as frequently, even when directives are in place.29,30 Usability: Current evidence of the use of measures for receipt of preference- Current evidence of use concordant end-of-life care (not exhaustive):

National: • The NHATS provides a single measure of concordance of a patient’s preferred and received end-of-life care; however, the measure is based on reports from informants who knew the patient’s experiences in the month before death. It is unclear how accurate the informant’s knowledge of preferred care was to the patient’s actual preferences.24 • Historical chart reviews found approximately 99% concordance between care preferences and care received.12 In cases that were not concordant, the designated decisionmaker was not immediately available, and a clinician made his or her own determination on how best to proceed.2 • The National Quality Forum encourages the documentation of treatment preferences and advanced care plans, recommending measuring the “[p]ercentage of patients aged 65 years and older who

Receipt of Preference-Concordant End-of-Life Care 99 Measure Construct Receipt of Preference-Concordant End-of-Life Care have an advance care plan or surrogate decision maker documented in the medical record or documentation in the medical record that an advance care plan was discussed, but the patient did not wish or was not able to name a surrogate decision maker or provide an advance care plan.”31,32 • The Home Health Care Consumer Assessment of Healthcare Providers and Systems (CAHPS) Survey uses a multi-item scale with several measures for elements of and quality of communication between home health provider and patient.33 • The hospice PEACE project measures the “[p]ercentage of seriously ill patients receiving specialty palliative care in an acute hospital setting for more than one day or patients enrolled in hospice for more than seven days with chart documentation of preferences for life-sustaining treatments.”18,34 • The Family Evaluation of Hospice Care is an after-death survey administered to bereaved caregivers of individuals who died while in hospice.35 An indicator on end-of-life patient and family preferences could be added to this instrument. Global: • The Commonwealth Fund International Health Policy Survey assesses preference for end-of-life care among older adults (i.e., patients discuss their care wishes with their doctor or family or have a written plan in place).25 Usability: Receipt of preference-concordant end-of-life care is not among the Relationship to current OECD measures. However, OECD’s conceptual framework points currently used to “coping with end-of-life” as a key feature of health care needs related Organisation for to continuous and integrated health management.36 Economic Co-operation and Development Closest related measures: (OECD) measures • OECD measures the number of people in long-term care but not their preferences on types or location of care.37

References

1. Johnson SB, Butow PN, Kerridge I, Bell ML, Tattersall MH. How well do current measures assess the impact of advance care planning on concordance between patient preferences for end-of-life care and the care received: A methodological review. J Pain Symptom Manage. 2018;55(2):480-495. 2. Hopping-Winn J, Mullin J, March L, Caughey M, Stern M, Jarvie J. The progression of end-of-life wishes and concordance with end-of-life care. J Palliat Med. 2018;21(4):541-545. 3. Razmaria AA. End-of-life care. JAMA. 2016;316(1):115-115. 4. Lamont EB. A demographic and prognostic approach to defining the end of life. J Palliat Med. 2005;8(Suppl 1):S-12-S-21. 5. Wen F-H, Chou W-C, Chen J-S, Chang W-C, Hsieh C-H, Tang ST. Evolution and predictors of patient- caregiver concordance on states of life-sustaining treatment preferences over terminally ill cancer patients’ last six months of life. J Palliat Med. 2019;22(1):25-33. 6. Khandelwal N, Curtis JR, Freedman VA, et al. How often is end-of-life care in the United States inconsistent with patients’ goals of care? J Palliat Med. 2017;20(12):1400-1404. 7. Rome RB, Luminais HH, Bourgeois DA, Blais CM. The role of palliative care at the end of life. Ochsner J. 2011;11(4):348-352. 8. Connor SR, Bermedo MCS. Global Atlas of Palliative Care at the End of Life. Worldwide Palliative Care Alliance; 2014. 9. Goodman DC, Esty AR, Fisher ES, Chang C-H. Trends and Variation in End-of-Life Care for Medicare Beneficiaries with Severe Chronic Illness: A Report of the Dartmouth Atlas Project. Dartmouth Institute for Health Policy and Clinical Practice. April 2011.

Receipt of Preference-Concordant End-of-Life Care 100 10. Teno JM, Gozalo PL, Bynum JPW, et al. Change in end-of-life care for Medicare beneficiaries: Site of death, place of care, and health care transitions in 2000, 2005, and 2009. JAMA. 2013;309(5):470-477. 11. Gramling R, Ingersoll LT, Anderson W, et al. End-of-life preferences, length-of-life conversations, and hospice enrollment in palliative care: A direct observation cohort study among people with advanced cancer. J Palliat Med. 2019;22(2):152-156. 12. Turley M, Wang S, Meng D, Garrido T, Kanter MH. The feasibility of automating assessment of concordance between advance care preferences and care received near the end of life. Jt Comm J Qual Patient Saf. 2019;45(2):123-130. 13. Jha AK. End-of-life care, not end-of-life spending. JAMA. 2018;320(7):631-632. 14. Teno JM, Fisher ES, Hamel MB, Coppola K, Dawson NV. Medical care inconsistent with patients’ treatment goals: Association with 1‐year Medicare resource use and survival. J Am Geriatr Soc. 2002;50(3):496-500. 15. French EB, McCauley J, Aragon M, et al. End-of-life medical spending in last twelve months of life is lower than previously reported. Health Affairs. 2017;36(7):1211-1217. 16. Widger K, Seow H, Rapoport A, Chalifoux M, Tanuseputro P. Children’s end-of-life health care use and cost. Pediatrics. 2017;139(4):e20162956. 17. Klingler C, in der Schmitten J, Marckmann G. Does facilitated advance care planning reduce the costs of care near the end of life? Systematic review and ethical considerations. Palliat Med. 2016;30(5):423-433. 18. Dy SM, Kiley KB, Ast K, et al. Measuring what matters: Top-ranked quality indicators for hospice and palliative care from the American Academy of Hospice and Palliative Medicine and Hospice and Palliative Nurses Association. J Pain Symptom Manage. 2015;49(4):773-781. 19. DeVore S. The humanity in end-of-life care. Health Affairs Blog. Bethesda, MD: Health Affairs; 2017. 20. Kay Frank R. Shared decision making and its role in end of life care. Brit J Nurs. 2009;18(10):612-618. 21. Spatz ES, Elwyn G, Moulton BW, Volk RJ, Frosch DL. Shared decision making as part of value based care: New U.S. policies challenge our readiness. Z Evid Fortbild Qual Gesundhwes. 2017;123-124:104- 108. 22. Ahluwalia SC, Chen C, Raaen L, et al. A systematic review in support of the National Consensus Project Clinical Practice Guidelines for Quality Palliative Care. J Pain Symptom Manage. 2018;56(6):831-870. 23. Hoerger M, Chapman BP, Mohile SG, Duberstein PR. Development and psychometric evaluation of the Decisional Engagement Scale (DES-10): A patient-reported psychosocial survey for quality cancer care. Psychol Assess. 2016;28(9):1087-1100. 24. NHATS. Undated. Accessed May 21, 2020. https://www.nhats.org 25. Commonwealth Fund. 2017 Commonwealth Fund International Health Policy Survey of Older Adults. 2017. Accessed May 21, 2020. https://www.commonwealthfund.org/publications/surveys/2017/nov/ 2017-commonwealth-fund-international-health-policy-survey-older 26. Tan WS, Bajpai R, Low CK, Ho AHY, Car J. Using routinely collected data to ascertain concordance with advance care planning preferences. J Pain Symptom Manage. 2018;56(5):659-666. e652. 27. Carr D, Luth EA. Advance care planning: Contemporary issues and future directions. Innov Aging. 2017;1(1). 28. Sharma RK, Freedman VA, Mor V, Kasper JD, Gozalo P, Teno JM. Association of racial differences with end-of-life care quality in the United States. JAMA Intern Med. 2017;177(12):1858-1860. 29. Mack JW, Paulk E, Viswanath K, Prigerson HG. Black-white disparities in the effects of communication on medical care received near death. JAMA Intern Med. 2010;170(17):1533-1540. 30. Gramling R, Fiscella K, Xing G, et al. Determinants of patient-oncologist prognostic discordance in advanced cancer. JAMA Oncol. 2016;2(11):1421-1426. 31. Sanders JJ, Curtis JR, Tulsky JA. Achieving goal-concordant care: A conceptual model and approach to measuring serious illness communication and its impact. J Palliat Med. 2018;21(S2):S-17-S-27. 32. National Quality Forum. Performance Measurement Coordination Strategy for Hospice and Palliative Care. 2012. 33. Home Health Care CAHPS Survey. Undated. Accessed May 22, 2020. https://homehealthcahps.org 34. PEACE Hospice and Palliative Care Quality Measures. UNC Palliative Care Program. 2020. Accessed May 22, 2020. https://www.med.unc.edu/pcare/resources/PEACE-Quality-Measures 35. Holland JM, Keene JR, Kirkendall A, Luna N. Family evaluation of hospice care: Examining direct and indirect associations with overall satisfaction and caregiver confidence. Palliat Support Care. 2015;13(4):901-908.

Receipt of Preference-Concordant End-of-Life Care 101 36. Arah OA, Westert GP, Hurst J, Klazinga NS. A conceptual framework for the OECD Health Care Quality Indicators Project. Int J Qual Health Care. 2006;18 Suppl 1:5-13. 37. Long-Term Care Resources and Utilisation. OECD Health Statistics. 2016. Accessed May 22, 2020. https://www.oecd-ilibrary.org/content/data/data-00543-en

Receipt of Preference-Concordant End-of-Life Care 102 Care Continuity or Consistent Provider

Table A.6. Care Continuity or Consistent Provider

Measure Construct Care Continuity or Consistent Provider Description The World Health Organization defines continuity of care as “the degree to which a series of discrete health care events is experienced by people as coherent and interconnected over time and consistent with their health needs and preferences.”1

The American Academy of Family Physicians defines continuity of care as “the process by which the patient and his/her physician-led care team are cooperatively involved in ongoing health care management toward the goal of high-quality, cost-effective medical care.”2

The emphasis on continuity of care can vary across health care domains. In primary care, the emphasis is on having a consistent single provider for each patient. For mental health care, the emphasis is on a team of providers delivering care through a coordinated plan, which can extend beyond health to social services.3

Continuity of care can include the quality of care over time, which includes the patient’s experience of a continuous caring relationship with an identified health care professional (i.e., a consistent provider) as well as the providers’ delivery of seamless service through integration, coordination, and the sharing of information between different providers.4

Three ways of providing care continuity are (1) personal continuity (via an ongoing patient-provider relationship), (2) information continuity (present care takes into account past information), and (3) management continuity (management of a health condition is consistent but also flexible to a patient’s changing needs).3 Importance: Health or Population impact: social impact National: • In 2012, about 15% of Americans reported having no usual source of health care. From 1996 to 2012, the percentage of people reporting a provider as their usual source of care declined (about 35% reported this in 2012), while the percentage reporting a facility as their usual source of care increased (about 40% reported this in 2012).5 Global: • Across 11 high-income countries, there is a high prevalence of patient- reported continuity of care in the primary care setting. Around 80% reported that their regular doctor often or always knows their medical history, spends enough time with them, involves them as much as they want, and explains things well.6 • In a three-country study, general practitioners (GPs) in England and Wales reported lower scores on their ability to provide informational and management continuity of care than their counterparts in the Netherlands and the United States. However, they reported similar (high) scores for personal continuity of care.7 • Across six Latin American countries, continuity of care in the primary care setting was poor, about half of users reported not having a regular doctor, and a third reported that their doctor did not know their medical history.8 The prevalence of reporting “not having a regular doctor” was

Care Continuity or Consistent Provider 103 Measure Construct Care Continuity or Consistent Provider particularly high in Brazil, Colombia, and El Salvador (each over 60%). The prevalence of “PC [primary care] doctor not knowing medical history” was highest in Brazil (57%).

Meaningful clinical impact: • Continuity of care allows for better support of individuals and a better understanding of their conditions, which increases patient satisfaction, patient-clinician trust, and quality of communication.9–13 • A review of 18 studies found several studies reporting positive associations of continuity of care with decreased health utilization (e.g., hospitalization and emergency department [ED] visits) and increased patient satisfaction.14 • Among Medicare beneficiaries (aged 65 years and older), patient- reported continuity of care is associated with lower ED use, preventable hospitalization, and mortality.15 • Among U.S. infants and children (up to three years of age), lower continuity of care (e.g., lower index score for having a usual provider of care) was related to more ambulatory care–sensitive hospitalizations, more ambulatory sick visits, and lower odds of lead screening, with stronger associations found in children with chronic conditions.16 • High levels of continuity of care are associated with fewer admissions to hospitals for conditions requiring ambulatory care, fewer ED visits, and lower probability of poor primary care coordination.1,17,18 • Continuity of care with a primary care provider, as assessed by several indexes, is related to decreased number and costs of ED visits but higher costs of medical consultation visits among adults (aged 19 and older).19 • A review of 22 studies from nine countries showed that most studies (82%) reported reductions in mortality (all-cause or disease-specific) with increased continuity of care from generalist or specialist providers.20 • A review of 18 studies found several studies reporting a positive association between continuity of care and improved social functioning, but there were mixed findings for other mental health outcomes (e.g., hospitalization, symptom severity, service satisfaction).21

Performance gap: • A European study involving five countries with different health care systems showed that, overall, countries with national health systems are more effective at providing care continuity than countries with regulated-market systems.22 • Among 11 high-income countries (including the United States), measures of high continuity of care are related to better primary care coordination.6

Costs: • Increased care continuity has been associated with lower costs.14,23 • Among Medicare beneficiaries with chronic conditions, for every 0.1- unit increase in the continuity of care index, episode costs of care were 4.7% lower for congestive heart failure (CHF), 6.3% lower for chronic obstructive pulmonary disease (COPD), and 5.1% lower for .24

Care Continuity or Consistent Provider 104 Measure Construct Care Continuity or Consistent Provider • An economic modeling study showed that a 10% increase in continuity of care is related to about $19,905 in savings per 2,000 pediatric patients from reduced charges associated with less frequent ED use.25 Importance: Value-based care: Related U.S. Care continuity is a part of care coordination and a measure of quality of Department of Health care. Higher provider continuity of care is related to a 14% reduction in and Human Services health care costs and fewer hospitalizations. The value associated with priority topics this cost reduction is $1,000 per beneficiary per year. Therefore, continuity of care measures could be useful for assessing provider quality and resource use under value-based payment systems like Medicare’s Quality Payment Program.26 Validity Construct validity: • Claims-based measures of care continuity have several limitations, including an inability to capture information such as interpersonal continuity between clinicians and patients and coordination activities that can occur outside of visits between clinicians or between clinicians and patients. Also, some continuity of care analyses examine continuity during episodes of care (e.g., CHF, COPD) and could exclude a large proportion of patients and claims data; results might therefore not be generalizable.27 • The National Health and Health Services Use Questionnaire (NHHSUQ) patient-reported continuity of care scale has been validated against insurance claims–based continuity. For example, the patient- reported continuity of care scale was significantly associated with claims-based longitudinal (duration of provider-patient relationship) continuity.28 However, this scale was significantly associated with lower mortality in older adults, while claims-based continuity of care measures were not.15 Patient-reported and claims-based measures might capture distinct dimensions of care continuity. That is, claims data capture care provided over time, but the patient-reported responses might better reflect the quality of the patient-provider relationship.

Internal validity: There is evidence that continuity of care is strongly associated with improved health care outcomes and cost savings.14 Feasibility for Definitions: There are several definitions and measures of care international continuity; however, this measure does not appear to be collected at a comparisons national or international level.

Data availability: National: • In 2004, the NHHSUQ had a 13-item scale that assessed continuity of care from a primary care provider among Medicare beneficiaries aged 65 years and older.28,29 Specifically, the questionnaire captures the length of care from a usual provider and personal continuity of care (e.g., provider’s competence, behaviors, and people skills). Global: • Many countries use the Usual Provider Continuity index to assess continuity of care.20,30 It describes the proportion of visits to the patient’s regular physician out of all visits to any provider. However, this measure does not take into account the total number, frequency, or sequence of visits.

Care Continuity or Consistent Provider 105 Measure Construct Care Continuity or Consistent Provider • The Commonwealth Fund International Health Policy Survey collects care continuity data from primary care patients from 11 high-income countries (e.g., personal and information continuity).6,31 • An adapted version of the Commonwealth Fund International Health Policy Survey collects self-reported continuity of care measures in the primary care setting among nationally representative samples of adults in six Latin American countries (Brazil, Colombia, El Salvador, Jamaica, Mexico, and Panama).8

Data comparability: • Across studies, researchers have used different continuity of care measures (e.g., indexes, surveys of patients or providers, and insurance claims data) and time frames to define continuity (e.g., from a single weekend to several years), making comparisons difficult.20,21 • Several measures of care continuity have been shown to be highly correlated; studies using different measures might still be comparable.27

Subgroup analysis and equity: • Among GPs in the United States, younger GPs have more-positive attitudes toward continuity of care than older GPs, but attitudes do not differ by sex, full- or part-time status, or practice list size. However, in England and Wales, female GPs have more-positive attitudes toward continuity of care than male GPs.7 • Among adults with chronic diseases, racial/ethnic minorities (non-Latino Black, Latino, and Asian patients) are less likely to have a usual source of care than non-Latino White patients. Black patients and Latino patients are also more likely than non-Latino White patients to report a facility rather than a person or a person at the facility as their usual source of care. Non-Latino Black patients are less likely than White patients to report that their usual provider listens to them.32 • The benefits of continuity of care are especially pronounced among older populations and those with chronic care conditions.1 Usability: National: Current evidence of use • The NHHSUQ has a 13-item scale that assesses continuity of care from a primary care provider among Medicare beneficiaries.29 • Self-reported usual source of care (none, provider, or facility) is also assessed in the nationally representative Medical Expenditure Panel Survey.5 Global: The Commonwealth Fund International Health Policy Survey collects care continuity data in 11 high-income countries and six Latin American countries.6,8 Usability: This measure is not currently included in the measures studied by the Relationship to Organisation for Economic Co-operation and Development (OECD); currently used OECD however, a recent policy brief on primary care discussed the importance measures of studying continuity of care.33

OECD Health at a Glance does collect information on patient experiences of ambulatory care, including34 • doctor spending enough time with patient during consultation • doctor providing easy-to-understand explanations • doctor involving patient in decisions about care and treatment.

Care Continuity or Consistent Provider 106 References

1. World Health Organization. Continuity and Coordination of Care: A Practice Brief to Support Implementation of the WHO Framework on Integrated People-Centred Health Services. 2018. 2. American Academy of Family Physicians. Continuity of Care, Definition of. 2019. Accessed May 26, 2020. https://www.aafp.org/about/policies/all/definition-care.html 3. Haggerty JL, Reid RJ, Freeman GK, Starfield BH, Adair CE, McKendry R. Continuity of care: A multidisciplinary review. BMJ. 2003;327(7425):1219-1221. 4. Gulliford M, Naithani S, Morgan M. What is ‘continuity of care’? J Health Serv Res Policy. 2006;11(4):248-250. 5. Jetty A, Green L, Bazemore AW, Petterson SM. Fewer Americans report a personal physician as their usual source of health care. Am Fam Physician. 2015;92(12):1053. 6. Penm J, MacKinnon NJ, Strakowski SM, Ying J, Doty MM. Minding the gap: Factors associated with primary care coordination of adults in 11 countries. Ann Fam Med. 2017;15(2):113-119. 7. Stokes T, Tarrant C, Mainous AG, III, Schers H, Freeman G, Baker R. Continuity of care: Is the personal doctor still important? A survey of general practitioners and family physicians in England and Wales, the United States, and the Netherlands. Ann Fam Med. 2005;3(4):353-359. 8. Macinko J, Guanais FC, Mullachery P, Jimenez G. Gaps in primary care and health system performance in six Latin American and Caribbean countries. Health Aff (Millwood). 2016;35(8):1513-1521. 9. Mainous AG, III, Baker R, Love MM, Gray DP, Gill JM. Continuity of care and trust in one’s physician: Evidence from primary care in the United States and the United Kingdom. Fam Med. 2001;33(1):22-27. 10. Katz DA, McCoy K, Sarrazin MV. Does improved continuity of primary care affect clinician-patient communication in VA? J Gen Intern Med. 2014;29(2):682-688. 11. Wasson JH, Sauvigne AE, Mogielnicki RP, et al. Continuity of outpatient medical care in elderly men: A randomized trial. JAMA. 1984;252(17):2413-2417. 12. Fan VS, Burman M, McDonell MB, Fihn SD. Continuity of care and other determinants of patient satisfaction with primary care. J Gen Intern Med. 2005;20(3):226-233. 13. Reddy A, Pollack CE, Asch DA, Canamucio A, Werner RM. The effect of primary care provider turnover on patient experience of care and ambulatory quality of care. JAMA Intern Med. 2015;175(7):1157-1162. 14. Van Walraven C, Oake N, Jennings A, Forster AJ. The association between continuity of care and outcomes: A systematic and critical review. J Eval Clin Pract. 2010;16(5):947-956. 15. Bentler SE, Morgan RO, Virnig BA, Wolinsky FD. The association of longitudinal and interpersonal continuity of care with emergency department use, hospitalization, and mortality among Medicare beneficiaries. PLoS One. 2014;9(12):e115088. 16. Enlow E, Passarella M, Lorch SA. Continuity of care in infancy and early childhood health outcomes. Pediatrics. 2017;140(1):e20170339. 17. Barker I, Steventon A, Deeny SR. Association between continuity of care in general practice and hospital admissions for ambulatory care sensitive conditions: Cross sectional study of routinely collected, person level data. BMJ. 2017;356:j84. 18. Christakis DA. Does continuity of care matter? Yes: Consistent contact with a physician improves outcomes. West J Med. 2001;175(1):4. 19. Dreiher J, Comaneshter DS, Rosenbluth Y, Battat E, Bitterman H, Cohen AD. The association between continuity of care in the community and health outcomes: A population-based study. Isr J Health Policy Res. 2012;1(1):21. 20. Gray DJP, Sidaway-Lee K, White E, Thorne A, Evans PH. Continuity of care with doctors—a matter of life and death? A systematic review of continuity of care and mortality. BMJ Open. 2018;8(6):e021161. 21. Puntis S, Rugkåsa J, Forrest A, Mitchell A, Burns T. Associations between continuity of care and patient outcomes in mental health care: A systematic review. Psychiatr Serv. 2014;66(4):354-363. 22. Nicaise P, Giacco D, Soltmann B, et al. Healthcare system performance in continuity of care for patients with severe mental illness: A comparison of five European countries. Health Policy. 2020;124(1):25-36. 23. Jung B, Cho KH, Lee DH, Kim S. The effects of continuity of care on hospital utilization in patients with knee osteoarthritis: Analysis of nationwide insurance data. BMC Health Serv Res. 2018;18(1):152. 24. Hussey PS, Schneider EC, Rudin RS, Fox DS, Lai J, Pollack CE. Continuity and the costs of care for chronic disease. JAMA Intern Med. 2014;174(5):742-748.

Care Continuity or Consistent Provider 107 25. McBurney PG, Simpson KN, Darden PM. Potential cost savings of decreased emergency department visits through increased continuity in a pediatric medical home. Ambul Pediatr. 2004;4(3):204-208. 26. Bazemore A, Petterson S, Peterson LE, Bruno R, Chung Y, Phillips RL, Jr. Higher primary care physician continuity is associated with lower costs and hospitalizations. Ann Fam Med. 2018;16(6):492-497. 27. Pollack CE, Hussey PS, Rudin RS, Fox DS, Lai J, Schneider EC. Measuring care continuity: A comparison of claims-based methods. Med Care. 2016;54(5):e30. 28. Bentler SE, Morgan RO, Virnig BA, Wolinsky FD. Do claims-based continuity of care measures reflect the patient perspective? Med Care Res Rev. 2014;71(2):156-173. 29. Bentler SE, Morgan RO, Virnig BA, Wolinsky FD. Evaluation of a patient-reported continuity of care model for older adults. Qual Life Res. 2014;23(1):185-193. 30. Dalhousie University. Continuity of Care—Usual Provider Continuity (UPC) Index. Undated. Accessed April 1, 2020. http://dictionary.hdns.dal.ca/concept-dictionary/continuity-care-usual-provider-continuity-upc-index 31. The Commonwealth Fund. 2019 Commonwealth Fund International Health Policy Survey of Primary Care Physicians. 2019. Accessed April 1, 2020. https://www.commonwealthfund.org/series/international-health-policy-surveys 32. Shi L, Chen CC, Nie X, Zhu J, Hu R. Racial and socioeconomic disparities in access to primary care among people with chronic conditions. J Am Board Fam Med. 2014;27(2):189-198. 33. Berchet C. Realising the Full Potential of . Paris: OECD Publishing; 2019. 34. OECD. Health at a Glance 2019: OECD Indicators. Paris: OECD Publishing; 2019.

Care Continuity or Consistent Provider 108 Access to Mental Health Providers

Table A.7. Access to Mental Health Providers

Measure Construct Access to Mental Health Providers Description This construct refers to the availability of mental health providers to meet population behavioral health needs and is one dimension of overall access to mental health care.1 However, which providers are counted as mental health providers can vary.2

Access is a complex construct that generally encompasses a patient’s ability to enter a health care system (usually one that is covered by insurance), identify a health care service that is geographically accessible, and find a provider whom the patient trusts and can communicate with.3

Mental health provider broadly includes psychiatrists, psychologists, licensed clinical social workers, counselors, marriage and family therapists, and mental health providers who treat alcohol and other drug abuse.4 The Health Resources and Services Administration (HRSA) only includes those with a graduate degree.2 Importance: Health or Population impact: social impact National: • There are about 5,565 designated mental health professional shortage areas in the United States (i.e., areas that have at least 30,000 persons to 1 provider).5 • More than half of counties in the United States have no psychiatrists. The majority of providers are in the northeastern states and some counties on the West Coast.6 • From 2003 to 2013, the median number of psychiatrists dropped by 10%, which may explain why patients report poor access to mental health care.7 • Access can be limited by geography or cost.8 Demand for providers has increased because of new treatment options, expanded diagnostic categories, Medicaid expansion, and reduced stigma for psychiatric conditions.7 Global: • The global median of mental health workers is about 9 per 100,000 population, ranging from 1.6 per 100,000 in low-income countries to 71.7 per 100,000 in high-income countries.9 • Among Organisation for Economic Co-operation and Development (OECD) countries, a significantly higher proportion of people consult general practitioners for mental health problems compared with psychiatrists or psychologists.10 • Distance to providers could aggravate the disparities in utilization between patients with higher or lower socioeconomic position.11

Clinical impact: • Provider shortages result in lower access to care, long waits for necessary treatment, and provider burnout.12 • Low access to mental health providers can contribute to unmet mental health needs. In 2019, about 18% of U.S. adults (about 44 million) had a mental illness, but 56% received no treatment, and 20.6% of those

Access to Mental Health Providers 109 Measure Construct Access to Mental Health Providers who sought treatment reported not being able to receive treatment; in addition, 8.7% of youths (12–17 years of age) (more than 2 million) suffer from severe depression, but only 25% receive some consistent treatment (7–25+ visits in a year).13

Performance gap: • Low access to mental health providers can result in individuals relying on emergency departments (ED), which are poorly equipped to address psychiatric care needs.14,15 ED length of stay is considered a surrogate marker for crowding, and, compared with non-psychiatric patients, psychiatric patients have a longer ED length of stay when they are admitted for observation, transferred to another facility, or discharged.16 • Fewer mental health providers participate in insurance plan networks than primary care providers, which contributes to narrow mental health networks and limits access to mental health care.17 • Following Affordable Care Act implementation, insurance plans sold on the individual marketplace are required to offer coverage for mental health services,18 but treatment rates remain low (only 45% in 2014).19 • Some insurance plans still do not offer mental health coverage. In 2019, 7.8% of U.S. youths had a private insurance plan that did not cover mental or emotional difficulties.20 • Measuring access to mental health providers is complicated because a substantial amount of mental health care is administered by professionals outside the health sector—e.g., criminal justice, education, and social services.21

Costs: National: • Psychiatrists receive lower in-network reimbursement (13–20% lower depending on the severity of the problem) than nonpsychiatrist medical professionals for the same services,22 which may contribute to their lower participation rates in insurance networks23 and higher patient costs for out-of-network services.24 • Absenteeism and lost productivity at work from untreated mental health issues costs the United States $23 billion annually.25 Global: • The total cost of mental health illness for OECD countries is between 3.5% and 4% of GDP.26 • In developing countries, less than 1% of the development assistance for health goes to mental health.27 • It is estimated that mental health disorders will cost the global economy $16 trillion (in U.S. dollars) by 2030, in part due to loss of productivity across the life course.28 Importance: Value-based care: Related U.S. • Value-based payment (VBP) models have been shown to improve Department of Health quality and access to behavioral health care, but many structural and and Human Services policy barriers to VBP adoption remain.29 priority topics • Quality measurement and value-based systems that do not take rurality and travel distance to a provider into account could unfairly penalize clinicians and lead to greater health disparities.30 Validity Construct validity: • Mental health quality measures, such as access to providers, have not been refined and validated. The evidence base for quality measures, including access, needs to be expanded and strengthened.21,31

Access to Mental Health Providers 110 Measure Construct Access to Mental Health Providers • Underreporting by ministries of health has been cited as an issue for accurately assessing access to mental health providers, which can compromise construct validity.9 The Mental Health America indicator for mental health workforce availability uses data from the National Provider Identification data file of the County Health Rankings & Roadmaps data source. But limitations to the data include that the list of providers might not be up to date (some might no longer be practicing or accepting new clients) and that some small providers might not have an identification number. Feasibility for Definitions: In the United States and internationally, access to mental international health providers is often measured as a ratio of available providers to the comparisons population in a specified area.

Data availability: National: • The HRSA collects data to identify designated health professional shortage areas for primary, dental, and mental health care to determine eligibility for government programs.5 • State-level data on mental health workforce availability (ratio of county population to number of mental health providers) are estimated by Mental Health America.13 • Mental health workforce data are available from professional associations and Occupational Employment Statistics.2 • U.S. and international research can be conducted with physician and hospital claims data, physician registries, and census data.11,32,33 Global: • The World Health Organization’s (WHO’s) Mental Health Atlas questionnaire collects data on availability of mental health professionals across countries.9

Data comparability: • WHO’s Mental Health Atlas mental health workforce questions include a broad set of professionals trained in mental health, making it possible to compare across countries which specialties are responsible for mental health care.9 • However, measuring access can be challenging because it is based on the organization of services by country.31

Subgroup analysis: • Despite suffering from lower rates of mental and behavioral health illnesses, low-income and racial and ethnic minority populations are disproportionately affected by treatment gaps.34 • Compared with non-Latino White populations, racial/ethnic minorities (those who are non-Latino Black, Latino, or Asian) have lower access to mental health services, are less likely to receive needed care, and are more likely to receive poor quality of care.34 In 2014, mental health care access improved for racial/ethnic minorities but remained significantly lower compared with that of non-Latino White populations.35 • Rural areas have more designated mental health professional shortage areas (3,238) than nonrural areas (1,865).5 Usability: Several countries collect data on access to mental health providers. Current evidence of use Evidence includes the following (not exhaustive):

Access to Mental Health Providers 111 Measure Construct Access to Mental Health Providers National: • HRSA collects data to identify designated health professional shortage areas for mental health care.36 • States are no longer required to use time and distance standards to ensure provider network adequacy.37 Researchers can measure access to care by combining the Centers for Medicare & Medicaid Services Medicare Provider Utilization and Payment Data with census data.38,39 Global: • The WHO Mental Health Atlas collects data on the availability of a range of mental health professionals per population in member countries.9 These data cannot be used for longitudinal analysis.9 Usability: Access to mental health providers is not among the current OECD Relationship to measures. currently used OECD measures Closest related measures: • For mental health care, OECD measures continuity of care, coordination of care, treatment, and outcomes. Continuity of care could be extrapolated to estimate provider access, but additional data would be necessary.21 • OECD also collects data on type of provider consulted for mental health problems: general practitioner, psychiatrist, and psychologist.40

References

1. Mental Health in America. Access to Care Rankings 2020. 2020. Accessed May 26, 2020. https://www.mhanational.org/issues/2020/mental-health-america-access-care-data 2. Heisler EJ. The Mental Health Workforce: A Primer. Washington, D.C.: Congressional Research Service; 2018. 3. Access to Health Services. Healthy People 2020. Accessed May 26, 2020. https://www.healthypeople.gov/2020/topics-objectives/topic/Access-to-Health-Services 4. University of Wisconsin Population Health Institute. Mental Health Providers. County Health Rankings & Roadmaps. 2020. Accessed May 26, 2020. https://www.countyhealthrankings.org/explore-health-rankings/ measures-data-sources/county-health-rankings-model/health-factors/ clinical-care/access-to-care/mental-health-providers 5. AHRQ. Designated Health Professional Shortage Area Statistics. 2020. Accessed May 26, 2020. https://data.hrsa.gov/Default/GenerateHPSAQuarterlyReport 6. University of Michigan Behavioral Health Workforce Research Center. Estimating the Distribution of the U.S. Psychiatric Subspecialist Workforce. 2018. 7. Bishop TF, Seirup JK, Pincus HA, Ross JS. Population of US practicing psychiatrists declined, 2003–13, which may help explain poor access to mental health care. Health Affairs. 2016;35(7):1271-1277. 8. Andrilla CHA, Patterson DG, Garberson LA, Coulthard C, Larson EH. Geographic variation in the supply of selected behavioral health providers. Am J Prev Med. 2018;54(6):S199-S207. 9. World Health Organization. Mental Health Atlas 2017. Geneva: License: CC BY-NC-SA 3.0 IGO;2018. 10. OECD. OECD 50th Anniversary. Health at a Glance 2011: OECD Indicators. Paris: OECD Publishing; 2011. 11. Packness A, Waldorff FB, Christensen Rd, et al. Impact of socioeconomic position and distance on mental health care utilization: A nationwide Danish follow-up study. Soc Psychiatry Psychiatr Epidemiol. 2017;52(11):1405-1413. 12. Mental Health in America. Access to Care Data. 2020. Accessed May 21, 2020. https://www.mhanational.org/issues/2020/mental-health-america-access-care-data 13. Hellebuyuk M, Halpern M, Nguyen T, Fritzle D. State of Mental Health in America 2019. Mental Health America. 2018. Accessed May 20, 2020. http://www.mentalhealthamerica.net/download-2019-state-mental-health-america-report

Access to Mental Health Providers 112 14. Nordstrom K, Berlin JS, Nash SS, Shah SB, Schmelzer NA, Worley LLM. Boarding of mentally ill patients in emergency departments: American Psychiatric Association resource document. West J Emerg Med. 2019;20(5):690-695. 15. Laderman M, Dasgupta A, Henderson R, Waghray A. Tackling the mental health crisis in emergency departments: Look upstream for solutions. Health Affairs Blog. 2018;26. 16. Zhu JM, Singhal A, Hsia RY. Emergency department length-of-stay for psychiatric visits was significantly longer than for nonpsychiatric visits, 2002–11. Health Affairs. 2016;35(9):1698-1706. 17. Zhu JM, Zhang Y, Polsky D. Networks in ACA marketplaces are narrower for mental health care than for primary care. Health Affairs. 2017;36(9):1624-1631. 18. Healthcare.gov. Mental Health & Substance Abuse Coverage. Undated. Accessed May 20, 2020. https://www.healthcare.gov/coverage/mental-health-substance-abuse-coverage 19. Saloner B, Bandara S, Bachhuber M, Barry CL. Insurance coverage and treatment use under the Affordable Care Act among adults with mental and substance use disorders. Psychiatr Serv. 2017;68(6):542-548. 20. Mental Health America. The State of Mental Health in America. Undated. Accessed May 21, 2020. https://www.mhanational.org/issues/state-mental-health-america 21. Kilbourne AM, Keyser D, Pincus HA. Challenges and opportunities in measuring the quality of mental health care. The Canadian Journal of Psychiatry. 2010;55(9):549-557. 22. Mark TL, Olesiuk W, Ali MM, Sherman LJ, Mutter R, Teich JL. Differential reimbursement of psychiatric services by psychiatrists and other medical providers. Psychiatr Serv. 2018;69(3):281-285. 23. Cummings JR. Rates of psychiatrists’ participation in health insurance networks. JAMA. 2015;313(2):190-191. 24. Xu WY, Song C, Li Y, Retchin SM. Cost-sharing disparities for out-of-network care for adults with behavioral health conditions. JAMA Network Open. 2019;2(11):e1914554-e1914554. 25. Kohn R, Saxena S, Levav I, Saraceno B. The treatment gap in mental health care. Bull World Health Organ. 2004;82:858-866. 26. OECD. Health at a Glance 2019: OECD Indicators. Paris: OECD Publishing; 2019. 27. Gilbert BJ, Patel V, Farmer PE, Lu C. Assessing development assistance for mental health in developing countries: 2007–2013. PLoS Med. 2015;12(6). 28. Bloom DE, Cafiero E, Jané-Llopis E, et al. The Global Economic Burden of Noncommunicable Diseases. Program on the Global Demography of Aging; 2012. 29. Bailey M, Matulius R, Brykman K. Behavioral Health Provider Participation in Medicaid Value-Based Payment Models: An Environmental Scan and Policy Considerations. National Council for Behavioral Health. September 2019. Accessed May 21, 2020. https://www.chcs.org/media/behavioral-health-provider- participation-in-medicaid-value-based-payment-models-an-environmental-scan-and-policy-considerations.pdf 30. Mayer ML, Slifkin RT, Skinner AC. The effects of rural residence and other social vulnerabilities on subjective measures of unmet need. Med Care Res Rev. 2005;62(5):617-628. 31. Kilbourne AM, Beck K, Spaeth-Rublee B, et al. Measuring and improving the quality of mental health care: A global perspective. World Psychiatry. 2018;17(1):30-38. 32. Scoggins JF, Fedorenko CR, Donahue SMA, Buchwald D, Blough DK, Ramsey SD. Is distance to provider a barrier to care for Medicaid patients with breast, colorectal, or lung cancer? J Rural Health. 2012;28(1):54-62. 33. Streja E, Kovesdy CP, Soohoo M, et al. Dialysis provider and outcomes among United States veterans who transition to dialysis. Clin J Am Soc Nephrol. 2018;13(7):1055-1062. 34. McGuire TG, Miranda J. New evidence regarding racial and ethnic disparities in mental health: Policy implications. Health Affairs. 2008;27(2):393-403. 35. Creedon TB, Cook BL. Access to mental health care increased but not for substance use, while disparities remain. Health Aff (Millwood). 2016;35(6):1017-1021. 36. HPSA Find. data.HRSA.gov. Undated. Accessed May 26, 2020. https://data.hrsa.gov/tools/shortage-area/hpsa-find 37. Hinton E, Musumeci M. CMS’s 2018 Proposed Medicaid Managed Care Rule: A Summary of Major Provisions. 2019. Accessed May 21, 2020. https://www.kff.org/report-section/ cmss-2018-proposed-medicaid-managed-care-rule-a-summary-of-major-provisions-issue-brief-9271 38. Lee CS, Su GL, Baughman DM, Wu Y, Lee AY. Disparities in delivery of ophthalmic care; an exploration of public Medicare data. PloS One. 2017;12(8). 39. Verevkina NI, Short PF, Yang T-C, Matthews SA, Camacho F, Anderson R. Analyzing hospital choices of colon cancer patients in four states in Appalachia. J Health Care Poor Underserved. 2019;30(2):587-608. 40. OECD. Making Mental Health Count: The Social and Economic Costs of Neglecting Mental Health Care. Paris: OECD Publishing; 2014.

Access to Mental Health Providers 113 Data Transfer and Interoperability

Table A.8. Data Transfer and Interoperability

Measure Construct Data Transfer and Interoperability Description The transfer and interoperability of health data involves the hardware and software that deal with the storage, retrieval, sharing, and use of health care information.1 Health information technology systems aim to facilitate the transfer and interoperability of health information.2 Appropriately exchanging health information among health care professionals and patients allows the doctors, nurses, pharmacists, and other providers to obtain vital medical information.3 The objectives of health information technology and exchange are to improve the speed, quality, safety, and cost of patient care.3,4 • Health data: The data that are exchanged through health information technology consist of private and secure electronic health records (EHRs), personal health records, and electronic prescribing records.2 • Transfer/interoperability: Transfer of health information can be performed electronically or via manual processes. There are also potentially many different information systems that health care providers or organizations could adopt. The transfer and interoperability of health information refers to the ability of health information to be exchanged between systems and used across systems.5 Importance: Health or Population impact: social impact • Recent systematic reviews of the health effects of health information exchanges that serve to transfer and interoperate health information data demonstrate improvements to physical, psychological, and care continuity outcomes by reducing errors and improving compliance.6

Clinical impact: • Health information exchanges can lead to higher-quality care, greater patient engagement,7 and fewer medical errors.6 • Health information technology is associated with greater utilization of preventive care, such as vaccinations.8 • Health information technology can support personalizing care to improve patient outcomes, and when these data are made available for large, representative patient populations, they can support selection of cohorts for clinical trials.9 • However, poorly designed or overly complex interfaces can pose a challenge to users, impede clinical efficacy, and generate other unintended consequences.10,11

Performance gap: • The transfer and interoperability of health information can improve compliance with clinical guidelines.6 • Health information exchange systems have been shown to improve timely communication and increase efficient provider-patient interactions.12 • Health insurance exchanges reduce overindicated and contraindicated prescribing.13 • “Reflecting ongoing challenges with the interoperability of health IT [information technology], just over half of U.S. physicians reported being able to exchange patient clinical summaries, laboratory and diagnostic test results, and patient medication lists with physicians

Data Transfer and Interoperability 114 Measure Construct Data Transfer and Interoperability outside the practice. . . . In contrast, the vast majority of physicians (72– 93 percent) in the Netherlands, New Zealand, Norway, and Sweden reported having these abilities, although Canadian and German physicians rarely reported having them (12–33 percent).”14

Costs: • National: A national health information exchange system in the United States has been estimated to cost $97 million initially and $41 million annually in maintenance.15 On the other hand, a national health information exchange has been estimated to provide $78 billion in value annually.16 • Global: Systematic reviews of studies across the globe indicate that health information exchange systems lead to total cost savings by reducing the costs of laboratory tests, radiology, consultations, and admissions.17 Importance: Value-based care: Related U.S. The HHS priority to transform our health care system from one that pays Department of Health for procedures and sickness to one that pays for outcomes and health and Human Services relates to data transfer and interoperability because of the gains in (HHS) priority topics efficiency that data transfer and interoperability produces. Promoting interoperability is one way to maximize the promise of health information technology. Validity Construct validity: • The Organisation for Economic Co-operation and Development (OECD) pilot study7 measures (1) the utilization of EHRs; (2) whether laboratory, radiology, or other results are shared with outside organizations; (3) e- prescription utilization; and (4) telehealth capacities.

Internal validity: • Evidence indicates that health information exchanges that serve to transfer and improve the interoperability of health information data can lead to higher-quality care, greater patient engagement,7 fewer medical errors,6 greater utilization of preventive care,8 and other positive effects.13 • However, any measure of data transfer and interoperability describes processes for which there are substitutes. There is somewhat-limited evidence surrounding the benefits of health information exchange,18 and some argue that additional evidence is needed to justify the costs of implementation.19

Discriminant validity: Health system characteristics play an important role in the adoption and utilization of health information technologies to facilitate data transfer and interoperability. For instance, nations like the United Kingdom that have single-payer health care systems might avoid (or have already avoided) many of the complicating barriers to adoption of health information technology.20 International comparisons would reflect the ease or difficulty of implementation of the health information technologies borne of the health system structure. Feasibility for Definitions: international • There are no standardized measures of (1) how seamlessly data can comparisons be transferred between providers and (2) how interoperable a nation’s health information systems are.

Data Transfer and Interoperability 115 Measure Construct Data Transfer and Interoperability • There are several types of interoperability to consider. Technical interoperability ensures basic data exchange capabilities between systems. Syntactic interoperability ensures that the same format and data structures are used across systems. Semantic interoperability ensures that the meaning of medical concepts can be shared across systems. Organizational interoperability enables seamless provision of health care across institutions.21 • There are many domains and subdomains that can be measured as part of this concept, including availability of electronic health information, method of exchange, usability, comprehensibility, quality of data content, care coordination, accessibility, application (computable, human use), and patient and caregiver engagement.4 • Other factors include coverage of EHRs, national systems, patient data access, minimum data sets, use of structured data and clinical terminology standards, and unique IDs for patients and providers in the EHRs.9

Data availability: • Survey data would be required to assess the data transfer and interoperability capacities of a nation’s health care system. • A recent OECD pilot study demonstrates the type of data that could be used to inform international comparisons. Part of the survey would be fielded among health care professionals, and part of the survey would be fielded among chief information officers and administrators. The survey would assess the availability and use of EHRs and health information exchange.7 • The 2019 Commonwealth Fund International Health Policy Survey of Primary Care Physicians was administered to nationally representative samples of practicing primary care doctors in Australia, Canada, France, Germany, the Netherlands, New Zealand, Norway, Sweden, Switzerland, the United Kingdom, and the United States and obtains information about use of health information technology.4

Data comparability: • Data are not currently available. New data would need to be collected, similar to the pilot survey data recently collected by OECD.7 • The example OECD survey data would be comparable by collecting the same information from each respondent. • Countries could have different requirements for electronic capture of clinical data, minimum data set requirements, etc.

Subgroup analysis and equity: • Data are not currently available. New data would need to be collected, similar to the pilot survey data recently collected by OECD.7 • The sampling methodology could be defined in order to facilitate subgroup analyses (e.g., geographic variation). Usability: The current evidence of the use of data transfer and interoperability Current evidence of use focuses on the adoption of EHRs. EHR adoption is one component of health information technology that facilitates data transfer/interoperability. The following current evidence of use is not exhaustive: • The U.S. National Quality Forum measures the adoption of health information technology. The measure describes the percentage of encounters for which an EHR is utilized.22

Data Transfer and Interoperability 116 Measure Construct Data Transfer and Interoperability • Due in part to the structure of their health care systems, the United Kingdom, the Netherlands, Australia, and New Zealand had near- universal adoption of EHRs by 2009.23 More recently, survey evidence indicates that all but two of the OECD countries reported use of EHRs by at least half of primary care physicians; many had rates above 75%.7 Usability: Data transfer and interoperability is not among the current OECD Relationship to measures. However, OECD has piloted a survey to assess the adoption currently used OECD and utilization of health information technology in its member nations.7 measures Closest related measures: • CT/MRI units and exams: These measures describe the availability and utilization of medical technologies. U.S. data for this method come from a survey of hospitals and other medical facilities.24

References

1. The Office of the National Coordinator for Health Information Technology. Glossary: Health IT Terms. September 15, 2017. Accessed March 30, 2020. https://www.healthit.gov/topic/health-it-basics/glossary 2. The Office of the National Coordinator for Health Information Technology. Health IT: Advancing America’s Health Care. Undated. 3. The Office of the National Coordinator for Health Information Technology. What Is HIE? May 1, 2019. Accessed March 30, 2020. https://www.healthit.gov/topic/health-it-and-health-information-exchange-basics/what-hie 4. National Quality Forum. A Measurement Framework to Assess Nationwide Progress Related to Interoperable Health Information Exchange to Support the National Quality Strategy. Final Report. September 1, 2017. 5. Fridsma D. Interoperability vs health information exchange: setting the record straight. January 9, 2013. Accessed March 30, 2020. https://www.healthit.gov/buzz-blog/meaningful-use/ interoperability-health-information-exchange-setting-record-straight 6. Kruse CS, Beane A. Health information technology continues to show positive effect on medical outcomes: Systematic review. J Med Internet Res. 2018;20(2):e41. 7. Zelmer J, Ronchi E, Hyppönen H, et al. International health IT benchmarking: Learning from cross-country comparisons. J Am Med Inform Assoc. 2017;24(2):371-379. 8. Dexter PR, Perkins SM, Maharry KS, Jones K, McDonald CJ. Inpatient computer-based standing orders vs physician reminders to increase influenza and pneumococcal vaccination rates: A randomized trial. JAMA. 2004;292(19):2366-2371. 9. Oderkirk J. Readiness of Electronic Health Record Systems to Contribute to National Health Information and Research. Paris: OECD Publishing; 2017. 10. Horsky J, Kaufman DR, Patel VL. The cognitive complexity of a provider order entry interface. AMIA Annu Symp Proc. 2003:294-298. 11. Campbell EM, Sittig DF, Ash JS, Guappone KP, Dykstra RH. Types of unintended consequences related to computerized provider order entry. J Am Med Inform Assoc. 2006;13(5):547-556. 12. Lau F, Kuziemsky C, Price M, Gardner J. A review on systematic reviews of health information system studies. J Am Med Inform Assoc. 2010;17(6):637-645. 13. Garg AX, Adhikari NKJ, McDonald H, et al. Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: A systematic review. JAMA. 2005;293(10):1223-1238. 14. Doty MM, Tikkanen R, Shah A, Schneider EC. Primary care physicians’ role in coordinating medical and health-related social needs in eleven countries. Health Aff (Millwood). 2020;39(1):115-123. 15. Pan E, Cusack CM, Hook JM, Middleton B. Cost of interconnecting health information exchanges to form a national network. AMIA Annu Symp Proc. 2007;583-587. 16. J, Pan E, Johnston D, Adler-Milstein J, Bates DW, Middleton B. The value of health care information exchange and interoperability. Health Aff (Millwood). 2005;Suppl Web Exclusives:W5-10- W5-18.

Data Transfer and Interoperability 117 17. Sadoughi F, Nasiri S, Ahmadi H. The impact of health information exchange on healthcare quality and cost-effectiveness: A systematic literature review. Comput Methods Programs Biomed. 2018;161:209-232. 18. Hersh W, Totten A, Eden K, et al. Health information exchange. Evid Rep Technol Assess (Full Rep). 2015(220):1-465. 19. Reis ZSN, Maia TA, Marcolino MS, Becerra-Posada F, Novillo-Ortiz D, Ribeiro ALP. Is there evidence of cost benefits of electronic medical records, standards, or interoperability in hospital information systems? Overview of systematic reviews. JMIR Med Inform. 2017;5(3):e26. 20. Payne TH, Detmer DE, Wyatt JC, Buchan IE. National-scale clinical information exchange in the United Kingdom: Lessons for the United States. J Am Med Inform Assoc. 2011;18(1):91-98. 21. Lehne M, Sass J, Essenwanger A, Schepers J, Thun S. Why digital medicine depends on interoperability. NPJ Digit Med. 2019;2(1):79. 22. National Quality Forum. Adoption of Health Information Technology. Undated. Accessed March 30, 2020. https://www.qualityforum.org/Qps/QpsTool.aspx 23. Jha AK, Doolan D, Grandt D, Scott T, Bates DW. The use of health information technology in seven nations. Int J Med Inform. 2008;77(12):848-854. 24. OECD. OECD Health Statistics 2019, Definitions, Sources and Methods. 2019.

Data Transfer and Interoperability 118 Self-Reported Pain

Table A.9. Self-Reported Pain

Measure Construct Self-Reported Pain Description Pain is physical suffering or discomfort caused by illness or injury. Because pain is subjective, the existence and intensity of pain is often measured by patient self-reports.1 Elements of self-report could include relevant pain and physical, psychological, emotional, and social domains of functioning, as well as patient-reported outcomes and defined goals.2 Pain assessment can also occur through physical examination or behavioral observation where self-report is not possible. Importance: Health or Population impact: social impact • Adults. In 2016, 50 million adults (20.4%) reported chronic pain, defined as pain on most days or every day in the past 6 months, and 19.6 million (8%) reported high-impact chronic pain, defined as chronic pain limiting life or work activities on most days or every day in the past 6 months.5 • Youth. There is no general self-reported pain assessment of the national youth population, but parent-reported data from 2012 suggest that 15.4 million youth (26.6%) had a pain condition (dental, abdominal, headache, other muscle or bone, etc.) in the last 12 months.6 • Global incidence: Globally, approximately 20% of adults report chronic pain (that lasts at least 3 months).7,8 In low- and middle-income countries (LMICs), the prevalence of self-reported chronic pain is 33% among adults in the general population, 56% in the general elderly population, and 35% in workers.9 A lower prevalence of reporting any pain has been found in Asian countries—e.g., China (6.2%) and Japan (4.4%).8 • In LMICs, there is insufficient access to pain management solutions. In Organisation for Economic Co-operation and Development (OECD) countries, analgesic opioid availability has grown by almost 60% since the 2000s.10

Clinical impact: • Although pain is associated with a negative impact on health and related to poor quality of life, patients often underreport pain because they consider it a normal part of the aging process.11 Consequently, pain is often underassessed and undertreated.12 Chronic pain is associated with reduced physical performance (e.g., physical activity and daily activities), lower quality of life, and poorer sleep.13 Persistent prescriptions of opioids to treat chronic pain have been linked to abuse and addiction.14

Performance gap: • Empirical studies and review articles provide evidence that self-reported pain is the optimal means to evaluate pain among adults without cognitive impairment.15 Patient self-reported pain has been used in the clinical setting to track progress (e.g., controlling pain), evaluate treatment, and change the course of care.16,17 • Uneven pain management can be viewed as an equity issue. Existing self-report scales should scrutinize system-level factors that engender disparities.23

Self-Reported Pain 119 Measure Construct Self-Reported Pain Costs: • National: The annual economic costs of pain can be divided into the incremental costs of treating pain and indirect costs due to lower economic activity associated with lost wages. The total loss in the United States annually ranges from $560 billion to $635 billion.18 Importance: Opioid crisis: Related U.S. Prescribing opioid doses based solely on pain intensity is problematic due Department of Health to the subjectivity of pain intensity. There is no research linking a specific and Human Services dose to pain relief. This subjectivity can lead to misuse and abuse of priority topics opioid analgesics.19 In 2017, 17.4% of the U.S. population received one or more opioid prescriptions, with the average person receiving 3.4 prescriptions.20 The prescribing rate increased annually by 3% from 2006 to 2010 but decreased thereafter, reaching a rate of 58.5 prescriptions per 100 persons in 2017. In 2016, 11.5 million Americans reported misusing prescription opioids in the past year.21 Validity Construct validity: • Many pain measures for adults have been validated in different cultures and languages (e.g., the McGill Pain Questionnaire and the Brief Pain Inventory [BPI]).27,28 For example, the BPI has satisfactory to good construct validity and criterion validity.29 To date, no single measure of pain for youth has been found to be appropriate for use with all types of pain or across the developmental age span.30

Internal validity: • Psychometric studies have found self-reported pain measures to be internally consistent.31 Feasibility for Definitions: international • Self-reported pain is a patient-reported outcome. comparisons • Measures of self-reported pain are available for different populations (e.g., age- or disease-specific). Self-reported pain assessments are mainly appropriate for populations who can communicate their pain verbally, in writing, or by other means (e.g., finger span or blinking of their eyes to yes/no questions). Alternative tools (e.g., behavioral observation) may be more appropriate for noncommunicative populations, such as elderly people with advanced dementia, infants and preverbal toddlers, and intubated or unconscious patients.3,4 • In two reviews of multicountry studies of chronic pain,24,9 there was great heterogeneity in pain measures used across studies. For example, although the International Association for the Study of Pain defines chronic pain as pain that lasts or recurs for longer than 3 months, some studies include intensity in the definition; others add complexity to the definition by stating that pain should be present for the whole day over a specific period (e.g., the preceding week or month).24 • There are other chronic pain measures that identify pain as occurring any time during the last 6 months, which results in a significantly higher prevalence than studies using the definition of recurring pain that lasts 3 months.24

Data availability: • The U.S. National Health Interview Survey assesses pain in the adult population and pain-related conditions among youth.5,6 Although there is currently no global measure of pain, the National Health and Wellness Survey measures self-reported pain among adults in emerging and developed countries.8

Self-Reported Pain 120 Measure Construct Self-Reported Pain • Because self-reported pain is a complex and multidimensional experience, a single measure (e.g., intensity) could be insufficient to inform treatment.

Data comparability: • Several self-reported pain scales have been validated in multiple languages and can be compared and aggregated in multicountry studies.25

Subgroup analysis and equity: • In the United States, chronic pain is higher in older adults.5 Furthermore, age-adjusted prevalence of chronic pain and high-impact chronic pain is higher in women, previously employed adults, adults living in or near poverty, and rural residents but lower in adults with at least a bachelor’s degree compared with all other education levels. Other countries also report higher pain in women and older adults.8 Usability: Several scales for self-reported pain are currently in use. Evidence Current evidence of use includes the following (not exhaustive): • The U.S. National Health Interview Survey assesses frequency of (chronic) pain in the past 6 months and “bothersomeness” of pain among adults aged 18 years and older.5 • The Numerical Rating Scale (NRS) is one of the most widely used scales to assess self-reported pain in children and is considered the gold standard. It is an 11-, 21-, or 101-point scale in which the end points are the extremes of “no pain” and “pain as bad as it can be.”33 It emphasizes pain intensity and can be presented verbally or visually.34 Because it can be administered verbally, it can be used in telephone interviews.35 • The Iowa Pain (IPT) is a modified verbal numeric rating scale from 0–12 consisting of seven pain descriptors describing different levels of pain intensity plus response options between scores.26 It can be used with older adults, including those with cognitive impairment. Initially used in research, it can also be used in clinical settings; however, its 13-point scale does not align with other metrics commonly used in health care facilities.36 • The Verbal Rating Scale (VRS) uses a series of adjectives to denote pain intensities. The most commonly used words are “no pain,” “mild pain,” “moderate pain,” and “severe or intense pain.” For ease of recording, each term can be assigned a number.33 • The Visual Analogue Scale (VAS) is presented as a 10-cm line anchored by verbal pain descriptors, such as “no pain” and “worst pain imaginable.” It must be administered on paper or electronically. Users should orient it vertically or horizontally, depending on the language read by the audience.33 • The Short-Form BPI was originally conceived to measure pain in cancer patients. It is also referred to as the 11-point NRS. It asks patients whether they are experiencing pain, its location, and its intensity.37 The BPI has been validated in 15 languages and fulfills many of the U.S. Food and Drug Administration recommendations for pain as a patient- reported outcome endpoint.38

Global: • The annual National Health and Wellness Survey assesses general pain among patients in the last 12 months; data are collected in Brazil,

Self-Reported Pain 121 Measure Construct Self-Reported Pain China, France, Germany, Italy, Japan, Russia, Spain, the United Kingdom, and the United States.8,39 Usability: Self-reported pain is not among the current OECD measures. Relationship to currently used OECD Closest related measures: measures • OECD is planning to implement the first international Patient-Reported Indicators Survey (PaRIS) of Patients with Chronic Conditions,40 which will include Patient-Reported Outcome Measures (PROMS) such as pain, quality of life, physical functioning, and psychological well-being. Implementation of the survey in all participating countries will take place from 2021 to 2023. • The World Health Organization collects data on self-reported pain in the context of other diseases, such as cancer.41

References

1. Herr K, Coyne PJ, McCaffery M, Manworren R, Merkel S. Pain assessment in the patient unable to self- report: Position statement with clinical practice recommendations. Pain Manag Nurs. 2011;12(4):230-250. 2. Interagency Pain Research Coordinating Committee. National Pain Strategy: A Comprehensive Population Health-Level Strategy for Pain. Washington, D.C.: U.S. Department of Health and Human Services; 2016. 3. Pasero C, McCaffery M. No self-report means no pain-intensity rating. Am J Nurs. 2005;105(10):50-53. 4. Merkel S. Pain Assessment in infants and young children: The finger span scale: The finger span scale provides an estimate of pain intensity in young children. Am J Nurs. 2002;102(11):55-56. 5. Dahlhamer J, Lucas J, Zelaya C, et al. Prevalence of chronic pain and high-impact chronic pain among adults—United States, 2016. MMWR Morb Mortal Wkly Rep. 2018;67(36):1001-1006. 6. Groenewald CB, Beals-Erickson SE, Ralston-Wilson J, Rabbitts JA, Palermo TM. Complementary and alternative medicine use by children with pain in the United States. Acad Pediatr. 2017;17(7):785-793. 7. International Association for the Study of Pain. Unrelieved Pain Is a Major Healthcare Problem. 2012. 8. Goren A, Mould-Quevedo J, daCosta DiBonaventura M. Prevalence of pain reporting and associated health outcomes across emerging markets and developed countries. Pain Med. 2014;15(11):1880-1891. 9. Jackson T, Thomas S, Stabile V, Han X, Shotwell M, McQueen K. Prevalence of chronic pain in low- income and middle-income countries: A systematic review and meta-analysis. Lancet. 2015;385 Suppl 2:S10. 10. OECD. Health at a Glance 2019: OECD Indicators. Paris: OECD Publishing; 2019. 11. Kang Y, Demiris G. Self‐report pain assessment tools for cognitively intact older adults: Integrative review. Int J Older People Nurs. 2018;13(2):e12170. 12. Booker SS, Herr K. The state-of-“cultural validity” of self-report pain assessment tools in diverse older adults. Pain Med. 2015;16(2):232-239. 13. Dueñas M, Ojeda B, Salazar A, Mico JA, Failde I. A review of chronic pain impact on patients, their social environment and the health care system. J Pain Res. 2016;9:457-467. 14. Mojtabai R. National trends in long‐term use of prescription opioids. Pharmacoepidemiol Drug Saf. 2018;27(5):526-534. 15. Safikhani S, Gries KS, Trudeau JJ, et al. Response scale selection in adult pain measures: Results from a literature review. J Patient Rep Outcomes. 2018;2(1):40. 16. Adam R, Burton CD, Bond CM, de Bruin M, Murchie P. Can patient-reported measurements of pain be used to improve cancer pain management? A systematic review and meta-analysis. BMJ Support Palliat Care. 2017;7(4):0. 17. Holmes MM, Lewith G, Newell D, Field J, Bishop FL. The impact of patient-reported outcome measures in clinical practice for pain: A systematic review. Qual Life Res. 2017;26(2):245-257. 18. Simon LS. Relieving pain in America: A blueprint for transforming prevention, care, education, and research. J Pain Palliat Care Pharmacother. 2012;26(2):197-198. 19. Pasero C, Quinlan-Colwell A, Rae D, Broglio K, Drew D. American Society for Pain Management Nursing position statement: Prescribing and administering opioid doses based solely on pain intensity. Pain Manag Nurs. 2016;17(3):170-180.

Self-Reported Pain 122 20. Centers for Disease Control and Prevention. 2018 Annual Surveillance Report of Drug-Related Risks and Outcomes—United States. Surveillance Special Report. U.S. Department of Health and Human Services; 2018. 21. OECD. Addressing Problematic Opioid Use in OECD Countries. Paris: OECD Publishing; 2019. 22. U.S. Department of Health and Human Services. Secretary Priorities: Health Insurance Reform. 2018. Accessed April 1, 2020. https://www.hhs.gov/about/leadership/secretary/priorities/index.html#health-insurance-reform 23. Meghani SH, Polomano RC, Tait RC, Vallerand AH, Anderson KO, Gallagher RM. Advancing a national agenda to eliminate disparities in pain care: Directions for health policy, education, practice, and research. Pain Med. 2012;13(1):5-28. 24. Sá KN, Moreira L, Baptista AF, et al. Prevalence of chronic pain in developing countries: Systematic review and meta-analysis. Pain Rep. 2019;4(6):e779. 25. Feng Y, Herdman M, van Nooten F, et al. An exploration of differences between Japan and two European countries in the self-reporting and valuation of pain and discomfort on the EQ-5D. Qual Life Res. 2017;26(8):2067-2078. 26. Herr K, Spratt KF, Garand L, Li L. Evaluation of the Iowa Pain Thermometer and other selected pain intensity scales in younger and older adult cohorts using controlled clinical pain: A preliminary study. Pain Med. 2007;8(7):585-600. 27. Ferreira KA, Teixeira MJ, Mendonza TR, Cleeland CS. Validation of brief pain inventory to Brazilian patients with pain. Support Care Cancer. 2011;19(4):505-511. 28. Furler L. Validity and reliability of the pain questionnaire “Brief Pain Inventory.” A literature research. Pflege Z. 2013;66(9):546-550. 29. Stanhope J. Brief pain inventory review. Occup Med (Lond). 2016;66(6):496-497. 30. Stinson JN, Kavanagh T, Yamada J, Gill N, Stevens B. Systematic review of the psychometric properties, interpretability and feasibility of self-report pain intensity measures for use in clinical trials in children and adolescents. Pain. 2006;125(1-2):143-157. 31. Melotti R, Ruscheweyh R, Pramstaller PP, Hicks AA, Pattaro C. Structural consistency of the pain sensitivity questionnaire in the Cooperative Health Research In South Tyrol (CHRIS) population-based study. J Pain. 2018;19(12):1424-1434. 32. DeWaters T, Faut-Callahan M, McCann JJ, et al. Comparison of self-reported pain and the PAINAD Scale in hospitalized cognitively impaired and intact older adults after hip fracture surgery. Orthop Nurs. 2008;27(1):21-28. 33. Williamson A, Hoggart B. Pain: A review of three commonly used pain rating scales. J Clin Nurs. 2005;14(7):798-804. 34. Castarlenas E, Jensen MP, von Baeyer CL, Miró J. Psychometric properties of the numerical rating scale to a ssess self-reported pain intensity in children and adolescents. Clin J Pain. 2017;33(4):376-383. 35. Haefeli M, Elfering A. Pain assessment. Eur Spine J. 2006;15(1):S17-S24. 36. Ware LJ, Herr KA, Booker SS, et al. Psychometric evaluation of the revised Iowa Pain Thermometer (IPT- R) in a sample of diverse cognitively intact and impaired older adults: A pilot study. Pain Manag Nurs. 2015;16(4):475-482. 37. The University of Texas MD Anderson Cancer Center. The Brief Pain Inventory. Undated. Accessed May 20, 2020. https://www.mdanderson.org/research/departments-labs-institutes/departments-divisions/ symptom-research/symptom-assessment-tools/brief-pain-inventory.html 38. Atkinson TM, Mendoza TR, Sit L, et al. The Brief Pain Inventory and its “pain at its worst in the last 24 hours” item: Clinical trial endpoint considerations. Pain Med. 2010;11(3):337-346. 39. Kantar. National Health and Wellness Survey (NHWS). 2020. 40. OECD. Putting People at the Centre of Health Care: PaRIS Survey of Patients with Chronic Conditions. 2019. 41. Carlson CL. Effectiveness of the World Health Organization Cancer Pain Relief Guidelines: An integrative review. J Pain Res. 2016;9:515-534.

Self-Reported Pain 123 Access to Primary Palliative Care

Table A.10. Access to Primary Palliative Care

Measure Construct Access to Primary Palliative Care Description Primary palliative care (PPC) is all of the palliative care competencies expected of the primary care physician, including but not limited to assessing a patient’s physical and nonphysical symptoms, assisting patients and their families to establish appropriate goals of care, communicating the patient’s illness and its trajectory, and affirming preference-concordant end-of-life care.1 Primary care focuses on seeing the whole person and continuity of care, which is why the majority of palliative care is administered in that setting. In the United States, palliative care is provided within and outside hospice programs.2

Providing PPC requires the following: involving an interdisciplinary team of providers to meet patient and family needs; creating systems for routine, reliable assessments of symptoms and care needs; creating pathways to triage patients who screen positive for symptoms or distress; and committing to continuing education and skills training for staff.3

The National Quality Forum developed a framework to assess performance and outcomes of palliative care at three levels: the patient/family-centered care level; the organizational/programmatic level; and the system level.4 Access to PPC could be operationalized in several ways. • Provider surveys could assess whether health care providers have received training and continuing education on best practices for palliative care. • Patient surveys could assess whether providers are following palliative care best practices and whether patients are experiencing serious health-related suffering (SHS). • Use of morphine has been used as a crude measure of access to palliative care5 and could be accessed via administrative data. • Insurance coverage of palliative care would provide insight into one aspect of access to palliative care. • Surveys of national policies, clinical care guidelines, and training programs pertaining to palliative care could provide high-level insight. Importance: Health or Population impact: social impact • Unlike the Medicare hospice benefit, which can only be provided to people diagnosed with a terminal illness, palliative care can be delivered to a larger population living with chronic or advanced illnesses.6 • The World Health Organization (WHO) estimates that more than 20 million people require palliative care worldwide; most are adults over 60 years of age (69%) and 6% are children.7 Other researchers have estimated that 45% of all people who died in 2016 worldwide experienced SHS requiring palliative care (25.5 million deaths).8 This percentage is estimated to increase to 47% by the year 2060, accounting for more than 48 million deaths.8

Access to Primary Palliative Care 124 Measure Construct Access to Primary Palliative Care Clinical impact: • Palliative care can meaningfully improve quality of life, boost mood, lower symptom intensity, and decrease emotional distress. Some studies have demonstrated possible prolongation of life.5,6,9 • Many primary care providers might offer palliative care but not recognize or classify actions such as prescribing and titrating opioids for pain relief, maximizing quality of life, and symptom management as palliative care.10

Performance gap: • Demand for palliative care specialists exceeds supply, particularly in the outpatient supply.11 • PPC interventions often overlook the alignment of culturally based preferences with treatment.12 • An estimated 25.5 million (45%) of the 56.2 million deaths recorded worldwide experienced SHS in 2015. More than 80% of these people who died with SHS were from developing regions, and the vast majority lack access to palliative care and pain relief. Nearly 2.5 million children die with SHS every year; the vast majority (98%) of these children are from developing regions; additionally, at least 93% of child deaths associated with SHS in low-income countries are avoidable.13 • 91% of morphine consumed worldwide in 2013 was consumed in high- income countries, which have only 19% of the world’s population; this further illustrates the gap between wealthy and poor countries in access to palliative care.14

Costs: • Providing palliative care can lead to more-equitable resource utilization, reversing the trend of hospitalization and use of the intensive care unit at the end of life.6,13,15 Importance: Value-based care: Related U.S. • The HHS priority to transform our health care system from one that Department of Health pays for procedures and sickness to one that pays for outcomes also and Human Services prioritizes quality of care. Gaps in quality of care are linked to pain and (HHS) priority topics symptom management, communication, and care planning. Interventions to develop structured goals of care discussions can improve patient and family satisfaction.16 Value-based care incentives promote an environment that relies on keeping patients comfortable and, when possible, at home.17

Other related priorities: Opioid crisis: The HHS priority to counter the crisis of opioid abuse, misuse, and overdose in the United States emphasizes the safe prescription and disposal of opioid pharmaceuticals.18 Palliative care specialists must strike a balance between patients who require pain management and potential harmful outcomes for patients who could require constant treatment for many years.19 Validity Construct validity: • Measures of attitudes toward PPC have shown strong content validity.20 • Depending on the measure selected, all aspects of palliative care might not be captured; for example, morphine consumption accounts only for care of physical symptoms and leaves out care of psychosocial and spiritual concerns. Insurance coverage of palliative care does not fully address access.

Access to Primary Palliative Care 125 Measure Construct Access to Primary Palliative Care Internal validity: • There is scientific evidence that palliative care improves patient symptoms; relieves physical, psychological, and spiritual suffering; and improves quality of life and patient and family satisfaction.5

Discriminant validity: The International Classification of Diseases, Ninth Revision, code for PPC is v66.7. A study of veterans diagnosed with heart failure found that it was coded accurately 96% of the time.21 Feasibility for Definitions: international • Currently, there is no commonly used definition for this measure. comparisons • The Palliative Care Registry measures inpatient palliative care rates by dividing service utilization by the inpatient population.22 A similar measure has not yet been developed for the outpatient population.

Data availability: • National: No national data set measuring access to PPC exists. Chart reviews and surveys of the bereaved can be used to measure access, but validated universal measures are needed. • International: WHO includes global access to palliative care in its package of essential services for universal health coverage.13 It used a Delphi study and WHO mortality and population estimates to estimate the need for palliative care.7 • The Demographic and Health Surveys measure the provision of and guidelines for palliative care for people living with HIV/AIDS in countries around the world.23 • The UK Help the database includes the number of providers currently providing specialist palliative care, but this measure does not capture access to PPC.24

Data comparability: • In the United States, palliative care and hospice care are distinguished by the former being based on need with no prognostic restriction and the latter based on a prognosis of living less than six months. In other countries, the terms are largely synonymous.2 • The mechanisms of PPC need further study to identify the necessary components and core functions of effective care.12

Subgroup analysis and equity: • The lack of PPC for Black and Hispanic patients is partially offset by the increase in referrals to specialty palliative care. Nevertheless, the lack of PPC might lead to delayed access to any palliative care, poorer outcomes, and increased disparities in end-of-life care.25 Usability: Current evidence of the use of a measure of access to PPC (not Current evidence of use exhaustive): • Historical chart reviews found high degrees of unmet need for PPC. One review found that 37% of patients had no evidence of any palliative care.25 • Estimating prognosis is challenging with complex patients and is key to prescribing palliative care. Online resources, such as www.eprognosis.org, could guide primary care estimates.26

Access to Primary Palliative Care 126 Measure Construct Access to Primary Palliative Care • The National Home and Hospice Care Survey studies palliative care as a process measure but does not differentiate between primary and specialized levels of care.27 Global: • WHO affirmed that providing palliative care to patients and families is core to the role and identity of primary care clinicians.28 • The Palliative Outcome Scale can be used to measure an unmet need for PPC in clinical trials and longitudinal studies. It has been translated into 12 languages and tested and validated in many countries and cultural contexts.29 Usability: Access to PPC is not among the current OECD measures. Relationship to currently used Closest related measures: Organisation for • OECD measures the number of people in long-term care but not their Economic Co-operation preferences on types or location of care.30 It has also expressed and Development interest and need for further study of palliative care provision.31 (OECD) measures • WHO has recommended a measure of suffering-adjusted life years to augment existing measures of the burden of ill health.32

References

1. Ahia CL, Blais CM. Primary palliative care for the general internist: Integrating goals of care discussions into the outpatient setting. Ochsner J. 2014;14(4):704-711. 2. Meier DE. Increased access to palliative care and hospice services: Opportunities to improve value in health care. Milbank Q. 2011;89(3):343-380. 3. Parrish M, Kinderman A, Rabow M. Weaving Palliative Care into Primary Care: A Guide for Community Health Centers. California Healthcare Foundation. 2015. 4. National Quality Forum. A National Framework and Preferred Practices for Palliative and Hospice Care Quality. Washington, D.C.: National Quality Forum; 2006. 5. Krakauer EL, Kwete X, Verguet S, et al. Palliative care and pain control. In: Jamison DT, Gelband H, Horton S, et al., eds. Disease Control Priorities: Improving Health and Reducing Poverty. Washington, D.C.: The International Bank for Reconstruction and Development/The World Bank; 2017. 6. Hughes MT, Smith TJ. The growth of palliative care in the United States. Annu Rev Public Health. 2014;35:459-475. 7. World Health Organization, Worldwide Palliative Care Alliance. Global Atlas of Palliative Care at the End of Life. London: Worldwide Palliative Care Alliance. 2014. 8. Sleeman KE, de Brito M, Etkind S, et al. The escalating global burden of serious health-related suffering: Projections to 2060 by world regions, age groups, and health conditions. Lancet Glob Health. 2019;7(7):e883-e892. 9. Swami M, Case AA. Effective palliative care: What is involved? Oncology. 2018;32(4). 10. Buss MK, Rock LK, McCarthy EP. Understanding Palliative Care and Hospice: A Review for Primary Care Providers. Paper presented at Proceedings. 2017. 11. Parikh R, Lepp A, Phillips R. A more cohesive home: Integrating primary and palliative care for seriously ill patients. Health Affairs Blog. 2015. Accessed May 26, 2020. https://www.healthaffairs.org/do/10.1377/hblog20150803.049733/full/ 12. Ernecoff NC, Check D, Bannon M, et al. Comparing specialty and primary palliative care interventions: Analysis of a systematic review. J Palliat Med. 2020;23(3):389-396. 13. Knaul FM, Farmer PE, Krakauer EL, et al. Alleviating the access abyss in palliative care and pain relief— an imperative of universal health coverage: Commission report. Lancet. 2018;391(10128):1391-1454. 14. International Narcotics Control Board Pain and Policy Studies Group at the University of Wisconsin. 2017. Accessed May 22, 2020. https://www.incb.org 15. Chalkidou K, Marquez P, Dhillon PK, et al. Evidence-informed frameworks for cost-effective cancer care and prevention in low, middle, and high-income countries. Lancet Oncol. 2014;15(3):e119-131.

Access to Primary Palliative Care 127 16. Dy SM, Kiley KB, Ast K, et al. Measuring what matters: Top-ranked quality indicators for hospice and palliative care from the American Academy of Hospice and Palliative Medicine and Hospice and Palliative Nurses Association. J Pain Symptom Manage. 2015;49(4):773-781. 17. DeVore S. The humanity in end-of-life care. Health Affairs Blog. Bethesda, MD: Health Affairs; 2017. 18. U.S. Department of Health and Human Services. Strategy to Combat Opioid Abuse, Misuse, and Overdose: A Framework Based on the Five Point Strategy. 2018. 19. Gaertner J, Boehlke C, Simone CB, II, Hui D. Early palliative care and the opioid crisis: Ten pragmatic steps towards a more rational use of opioids. Ann Palliat Med. 2019. 20. Hui D, Cerana MA, Park M, Hess K, Bruera E. Impact of oncologists’ attitudes toward end-of-life care on patients’ access to palliative care. Oncologist. 2016;21(9):1149-1155. 21. Feder S, Tate J, Womack J, Redeker N, Akgün K. Validation of the diagnostic code for palliative care in patients hospitalized with heart failure within the Department of Veterans Affairs (S752). J Pain Symptom Manage. 2017;53:438-439. 22. Gruhler H, Krutka A, Luetke-Stahlman H, Gardner E. Determining palliative care penetration rates in the acute care setting. J Pain Symptom Manage. 2018;55(2):226-235. 23. Demographic and Health Survey. Measure DHS: Appendix B: Questionnaire: HIV/AIDS SPA Survey. Undated. 24. Hospice UK. Find a Hospice. Undated. Accessed May 22, 2020. https://www.hospiceuk.org/about-hospice-care/find-a-hospice 25. Chuang E, Hope AA, Allyn K, Szalkiewicz E, Gary B, Gong MN. Gaps in provision of primary and specialty palliative care in the acute care setting by race and ethnicity. J Pain Symptom Manage. 2017;54(5):645-653.e1. 26. McClymont KM, Lee SJ, Schonberg MA, Widera E, Miao Y, Smith AK. Usefulness and impact of online prognostic calculators. J Am Geriatr Soc. 2014;62(12):2444-2445. 27. Dwyer LL, Harris-Kojetin LD, Branden L, Shimizu IM. Redesign and operation of the National Home and Hospice Care Survey, 2007. Vital Health Stat 1. 2010;(53):1-192. 28. World Health Organization, United Nations International Children’s Fund. Declaration of Astana. Global Conference on Primary Health Care. Astana, Kazakhstan, 2018. 29. Harding R, Selman L, Agupio G, et al. Validation of a core outcome measure for palliative care in Africa: The APCA African Palliative Outcome Scale. Health Qual Life Outcomes. 2010;8(1):10. 30. OECD. Long-Term Care Resources and Utilisation. OECD Health Statistics; 2016. Accessed May 22, 2020. https://www.oecd-ilibrary.org/content/data/data-00543-en 31. OECD. Recommendations to OECD Ministers of Health from the High-Level Reflection Group on the Future of Health Statistics. 2017. 32. World Health Organization. Integrating Palliative Care and Symptom Relief into Paediatrics: A WHO Guide for Health-Care Planners, Implementers and Managers. 2018.

Access to Primary Palliative Care 128 Prices for Brand-Name and Generic Drugs

Table A.11. Prices for Brand-Name and Generic Drugs

Measure Construct Prices for Brand-Name and Generic Drugs Description Pharmaceuticals have enabled a multitude of improvements in health outcomes for patients. One in every five health care dollars is spent on pharmaceuticals in Organisation for Economic Co-ordination and Development (OECD) countries.1 Although overall spending has not changed in recent years, it has become increasingly skewed toward expensive specialty medicines.2 Measuring drug pricing at the international level could lead nations to make decisions that impact prices, making them available more broadly or to specific subpopulations of patients. • Brand-name and generic prescription drug pricing is dependent on quantity of services, mix of compounds, prices, and other factors. International comparisons are best done with sales of single-molecule products.3 Importance: Health or Population impact: social impact • National: In the United States, annual expenditures on pharmaceuticals exceed half a trillion dollars and account for 17% of national spending on health care.4 Americans have reported skipping prescriptions due to cost, and this phenomenon is more common for those who have lower income and more chronic conditions.5 Recent reports have described dramatic increases in prices for common medications, such as epinephrine and insulin, as well as high prices for new medications, such as biologic agents that treat cancer.4 In a 2017 poll, 61% of Americans deemed lowering the cost of prescription medications to be a top health care priority.6 • Global: In 2017, retail pharmaceuticals accounted for nearly one-fifth of all health care expenditure in OECD nations. Funding from governments or compulsory schemes (including Affordable Care Act– mandated insurance programs in the United States) covered 58% of spending on retail pharmaceuticals. Most of the remainder is financed from household out-of-pocket payments,7 which makes pricing an important factor in affordability and access. Compared with other high- income countries, the United States spends the most per capita on prescription drugs.5

Clinical impact: • Patients rationing medications due to high prices (or out-of-pocket cost) may experience worse outcomes. For example, approximately 7.4 million Americans need insulin,8 and 25% of patients with diabetes ration insulin because of high cost.9,10 Recent reports have highlighted specific cases in which patients rationed insulin because of high prices and then died of diabetic ketoacidosis (uncontrolled diabetes).11

Performance gap: • The World Health Organization (WHO) has recognized the importance of keeping pharmaceuticals accessible in all nations, including through the use of external reference pricing to identify nations with extraordinarily high prices.12

Prices for Brand-Name and Generic Drugs 129 Measure Construct Prices for Brand-Name and Generic Drugs • Prescription drug prices were higher in the United States than in nine other high-income countries considered in a Commonwealth Fund report from 2017.5

Costs: • National: Generics account for 89% of prescriptions but only 26% of total drug costs in the United States.13 • Global: Overall drug spending is estimated to increase 2–5% annually, exceeding $1 trillion by 2024.14 • High pharmaceutical prices may have equally high opportunity costs. With such a large portion of public and private spending dedicated to spending on pharmaceuticals, spending on other areas important to health, education, or national security could be decreased.15 • The long-term costs of morbidity due to skipping doses of key medications have been demonstrated to exceed the costs of providing medications for patients with certain chronic illnesses.16 Importance: Drug pricing: Related U.S. • The HHS priority to lower the price of prescription drugs without Department of Health discouraging innovation relates to the control of prices relative to and Human Services national budgets and research and development (R&D) priorities. (HHS) priority topics Other related priorities: Value-based care: If drug prices decrease, this may facilitate better adherence to medications, thus improving outcomes for patients and producing a better ratio of quality to cost. Validity Construct validity: • Differences in how drug prices are measured can affect validity. For example, prices are up to 190% higher in the United States per capita, but as a share of total national expenditures, the United States is closer to the median.5,17

Internal validity: • Prior research has demonstrated that more than 50% of the decline in health insurance coverage was attributable to increases in health insurance premiums,18 and currently 14% of the growth in health insurance premiums is due to growth in drug prices.19

Discriminant validity: • A simple comparison of prices can overlook price differences in the types of drugs prescribed, the impact of using older products, and the impact of distribution costs.3 Measures of drug pricing might be more useful for comparing international trends over time rather than to produce rankings of countries in a single year, given the challenging comparability issues described above. • Price variation between countries is not always considered a negative finding. Differences in pricing are considered an appropriate policy to allow companies to earn profits in high-income countries while still being able to conduct R&D and distribute products in lower-income markets.2 • Orphan drugs often target severe diseases and unmet medical needs for small populations, resulting in high prices. The high pressure on decisionmakers to fund them may exempt them from economic evaluation.2 Orphan drugs have been found to be more clinically

Prices for Brand-Name and Generic Drugs 130 Measure Construct Prices for Brand-Name and Generic Drugs effective than other FDA-approved treatments but less cost-effective. Each country uses a different method to assess cost-effectiveness.20 Feasibility for Definitions: international Price is defined as the amount asked by a distributor for a product, while comparisons cost is the expense incurred to a patient, provider, or payer.21–23 Because of a complex web of payment arrangements, some of which are not transparent, high prices can, but do not always, lead to high prices for payers or onerous out-of-pocket costs for patients.4 Ex-factory prices are prices at which manufacturers sell their products to wholesalers. In the United States, ex-factory prices correspond to the wholesaler acquisition cost.24 IQVIA cites a proprietary derived estimate of price called net-price spending, which is the amount received by pharmaceutical manufacturers after accounting for rebates, off-invoice discounts, and other price concessions made to distributors, health plans, and intermediaries.25 Rebates are defined as payments from manufacturers to health plans in exchange for favorable formulary placement.

Coupons are defined as discounts to consumers that cover some or all of the consumer’s share of the retail price.26 The United States distinguishes retail sales (directly to patients) from institutional sales (to hospitals, clinicians, nursing homes, infusion centers, home health agencies, and ). WHO distinguishes pricing, reimbursement, distribution, and availability of generics as separate but interrelated issues of importance to pharmaceutical policy.27

Data availability: • National: Medi-Span tracks wholesaler acquisition cost, which has recently been used as a proxy for price in a study comparing drug prices internationally (though prices were then adjusted downward by 17.8% to estimate the influence of rebates on price).24 Data describing net-price spending in the United States are also available from IQVIA (see definition above).25 • International: Data are available through reference pricing authorities.30,31 Additionally, some OECD nations report data on pharmaceutical sales either as manufacturers’ prices or as expenditures at retail prices.1

Data comparability: • Comparing prices within and between countries is complicated by differences in product availability and formulations between countries, the proprietary nature of the rebates that manufacturers charge different payers, inclusion of different market sectors (retail versus inpatient versus outpatient), variability in definition of price, use of data describing price versus spending, distribution costs, value-added tax rates, and subpopulations of patients included in the evaluation (if inclusion varies based on insurance coverage).5,7 Actual prices paid by payers for expensive therapies are generally not known due to managed entry agreements that disconnect list prices from prices paid.2 A recent study found price variations between 28% and 388% for each drug surveyed.32 • In the United States, rebates on branded drugs have been demonstrated to reduce price from as little as 16% (private insurance)

Prices for Brand-Name and Generic Drugs 131 Measure Construct Prices for Brand-Name and Generic Drugs to as much as 61% (Medicaid). Limited availability of post-rebate prices in the United States thus limits interpretability of measures of pricing domestically and also internationally.26 • For international comparisons of generics and biosimilars, many countries only include data for the community pharmaceutical market or the reimbursed pharmaceutical market.7

Subgroup analysis and equity: • Future analyses could evaluate prices for subgroups of patients (stratified by age, comorbidities, insurance status, or socioeconomic status).33 Usability: Current evidence of the use of drug pricing measures includes the Current evidence of use following (not exhaustive):

National: The Centers for Medicare & Medicaid Services collects manufacturer-reported data of average sales price on a quarterly basis. These data inform the reimbursement of medications administered in physician offices and hospital outpatient departments under Medicare Part B.34

Global: • In an academic study, a British research team used the Intercontinental Medical Statistics MIDAS database to examine variation in drug prices among selected OECD countries.35,36 Usability: Drug pricing is not represented among the current OECD measures. 37 Relationship to currently used OECD Closest related measures: measures • Pharmaceutical spending: This measure describes expenditure on prescription and over-the-counter medications. It is measured as a share of total health spending in U.S. dollars per capita and as a share of gross domestic product. In the United States, the main data source for this measure is the National Health Interview Survey, a continuously updated survey of the noninstitutionalized civilian population.37,38 Although expenditure is a function of both price and utilization, simply dividing by utilization would not yield a valid measure of drug pricing. Instead, a measure of drug pricing would need to measure prices by analyzing sales of single-molecule products. 3,7

References

1. Belloni A, Morgan D, Paris V. Pharmaceutical Expenditure and Policies: Past Trends and Future Challenges, OECD Health Working Papers, No. 87. Paris: OECD Publishing; 2016. 2. Paris V, Slawomirski L, Colbert A, Delaunay N, Oderkirk J. New Health Technologies Managing Access, Value and Sustainability. Paris: OECD Publishing; 2017. 3. Danzon PM, Furukawa MF. International prices and availability of pharmaceuticals in 2005. Health Affairs. 2008;27(1):221-233. 4. National Academies of Sciences, Engineering, and Medicine. Making Medicines Affordable: A National Imperative. National Academies Press; 2018. 5. Sarnak DO, Squires D, Kuzmak G, Bishop S. Paying for prescription drugs around the world. Why is the U.S. an outlier? Issue Brief (Commonw Fund). 2017;1-14. 6. Kirzinger A, Wu B, Brodie M. Kaiser Health tracking poll: Health care priorities for 2017. Polling the Henry J Kaiser Family Foundation, January. 2017. 7. OECD. Health at a Glance 2019: OECD Indicators. Paris: OECD Publishing; 2019.

Prices for Brand-Name and Generic Drugs 132 8. Cefalu W, Dawes D, Gavlak G. Insulin access and affordability working group: Conclusions and recommendations [published correction in Diabetes Care. 2018; 41(8):1831]. Diabetes Care. 2018;41(6):1299-1311. 9. Herkert D, Vijayakumar P, Luo J, et al. Cost-related insulin underuse among patients with diabetes. JAMA Intern Med. 2019;179(1):112-114. 10. Rajkumar SV. The high cost of insulin in the United States: An urgent call to action. Paper presented at Mayo Clinic Proceedings; 2020. 11. Rosenthal E. When high prices mean needless death. JAMA Intern Med. 2019;179(1):114-115. 12. World Health Organization. WHO Guideline on Country Pharmaceutical Pricing Policies. 2015. 13. Association for Accessible Medicines. Generic Drug Access & Savings in the U.S. Washington, D.C., 2017. 14. The IQVIA Institute. Global Medicine Spending and Usage Trends: Outlook to 2024. March 5, 2020. 15. Dionne F, Mitton C. Health care trade-offs: A necessary reality for every health system. Health Affairs Blog. 2018. Accessed April 2, 2020. https://www.healthaffairs.org/do/10.1377/hblog20180316.120106/full 16. Iuga AO, McGuire MJ. Adherence and health care costs. Risk Manag Healthc Policy. 2014;7:35-44. 17. Kanavos PG, Vandoros S. Determinants of branded prescription medicine prices in OECD countries. Health Econ Policy Law. 2011;6(3):337-367. 18. Chernew M, Cutler DM, Keenan PS. Increasing health insurance costs and the decline in insurance coverage. Health Serv Res. 2005;40(4):1021-1039. 19. Pearson CF, Carpenter E, Sloan C. Outpatient Services Are the Largest Driver of 2017 Premium Increases. Avalere; 2016. 20. Chambers JD, Silver MC, Berklein FC, Cohen JT, Neumann PJ. Orphan drugs offer larger health gains but less favorable cost-effectiveness than non-orphan drugs. J General Intern Med. 2020. 21. Arora V, Moriates C, Shah N. The challenge of understanding health care costs and charges. AMA J Ethics. 2015;17(11):1046-1052. 22. Moriates C, Arora V, Shah N. Understanding Value-Based Healthcare. New York: McGraw-Hill; 2015. 23. Dubois RW. Rx drug costs: List prices versus net prices and the importance of staying within the data. Health Affairs Blog. 2019. Accessed April 2, 2020. https://www.healthaffairs.org/do/10.1377/hblog20190312.446522/full 24. Kang S-Y, DiStefano MJ, Socal MP, Anderson GF. Using external reference pricing in Medicare Part D to reduce drug price differentials with other countries. Health Affairs. 2019;38(5):804-811. 25. IQVIA Institute for Human Data Science. Medicine Use and Spending in the U.S.: A Review of 2017 and Outlook to 2022. 2017. 26. Roehrig C. Rebates, coupons, PBMs, and the cost of the prescription drug benefit. Health Affairs Blog. 2018. 27. Pharmaceutical Pricing and Reimbursement Information. Pharmaceutical Policy Analysis. Undated. Accessed April 29, 2020. https://ppri.goeg.at/pharmaceutical_policy_analysis 28. Office of the Assistant Secretary for Planning and Evaluation. Observations on Trends in Prescription Drug Spending. 2016. 29. Centers for Medicare and Medicaid Services. National Health Expenditure Accounts: Methodology Paper, 2018: Definitions, Sources, and Methods. 2018. 30. Patented Medicine Prices Review Board. Recognized Sources for Foreign Price Verification and Formulas: 2018. 2018. Accessed April 30, 2020. http://www.pmprb-cepmb.gc.ca/view.asp?ccid=1356&lang=en 31. MIMS. 2018. Accessed April 30, 2020. https://www.mims.co.uk 32. Vogler S, Paris V, Panteli D. Ensuring access to medicines: H ow to redesign pricing, reimbursement and procurement? Policy Brief No. 30. European Observatory on Health Systems and Policies, Copenhagen (Denmark). 2018. 33. Paez KA, Zhao L, Hwang W. Rising out-of-pocket spending for chronic conditions: A ten-year trend. Health Aff (Millwood). 2009;28(1):15-25. 34. U.S. Department of Health and Human Services, Office of the Inspector General. Average Sales Prices: Manufacturer Reporting and CMS Oversight. 2010. 35. Kanavos P, Ferrario A, Vandoros S, Anderson GF. Higher US branded drug prices and spending compared to other countries may stem partly from quick uptake of new drugs. Health Affairs. 2013;32(4):753-761. 36. Taylor RS, Drummond MF, Salkeld G, Sullivan SD. Inclusion of cost effectiveness in licensing requirements of new drugs: The fourth hurdle. BMJ. 2004;329(7472):972-975.

Prices for Brand-Name and Generic Drugs 133 37. OECD. OECD Health Statistics 2019, Definitions, Sources and Methods. 2019. 38. OECD. Pharmaceutical Spending, in Health Resources 2019. Paris: OECD Publishing; 2019.

Prices for Brand-Name and Generic Drugs 134 Diffusion of and Access to New Prescription Drugs

Table A.12. Diffusion of and Access to New Prescription Drugs

Measure Construct Diffusion of and Access to New Prescription Drugs Description Pharmaceutical innovations have led to reductions in morbidity and mortality caused by such conditions as infectious diseases, cardiovascular diseases, and cancer. However, barriers to widespread diffusion of and access to new medications exist. For example, some health systems may be slower to adopt new medications despite good evidence of benefit because of poor communication about such benefits or because of policies such as price regulation.

In the literature, the following definitions of diffusion of new drugs have been identified: 1. the share of daily doses and of expenditures in a therapeutic class that is captured by new medicines1 2. the percentage of the population that has access to new products, by drug or class, reported by years since first approval (and or use) anywhere in the world.2 Importance: Health or • Population impact: social impact o National: Many conditions are amenable to therapy with pharmaceuticals, including infectious diseases, cardiovascular diseases, and cancers. In the United States, roughly 20% of poll respondents reported that they had been unable to fill a prescription due to cost; a third of these individuals reported a serious health condition. One-third reported that prescription drug costs were a financial burden.3 In the United States in 2020, certain emerging pharmaceuticals are expensive, which has led to restriction in access for certain patients who could benefit (e.g., direct antivirals for hepatitis C).4 Compared with other Organisation for Economic Co- operation and Development (OECD) nations, market launches and adoption by providers could occur more rapidly in the United States.5 o Global: Multiple studies have demonstrated that approvals of new medications are slower in other nations than the United States.6,7 For example, lovastatin became available in Egypt 12 years after it gained FDA approval. According to a National Bureau of Economic Research (NBER) report, “long launch lags are common and nearly 40 percent of all new drugs are only launched in ten or fewer countries.”5

• Clinical impact: In the United States, age-adjusted heart disease mortality fell by more than 50% from 1950 to 1996, and then by another 22% from 1990 to 2013.8 Much of this improvement might be due to innovations in pharmaceuticals that became accessible to patients across the nation.9 Similar advances for other conditions could be made more rapidly. However, rapid adoption of new medications could prove costly or harmful if they have not undergone thorough testing of efficacy, safety, and cost-effectiveness prior to adoption. Questions have also been raised around the approval and diffusion of new medicines that might not be value-enhancing beyond what is currently available, as in the case of “me-too” drugs.10–12

Diffusion of and Access to New Prescription Drugs 135 Measure Construct Diffusion of and Access to New Prescription Drugs • Performance gap: Diffusion of and access to new drugs varies greatly from nation to nation.13,14 The public health benefits of a new drug depend on how quickly drugs are launched in markets and how widely they are adopted within a country once they are launched. Lower- income countries are less likely to have access to new medications because their markets are less profitable. This is an issue in the European Union in particular, because each country has its own policies regulating approval.5,15 Variation within countries after approval depends on multiple factors as well, including insurance coverage for subpopulations, physicians’ scientific attitudes and prescribing patterns, communication among prescribers, and marketing.16

• Costs: The financial cost to society could be large if new medications experience diffusion and adoption more widely, since these medications tend to be costly. However, populations denied essential medications could experience poor outcomes leading to long-term disability, which is also costly.17 Importance: Value-based care Related U.S. Access to cost-effective new drugs can improve health care value. Department of Health and Human Services Other related priorities: priority topics Drug pricing: Accelerating diffusion of or improving access to new drugs can be costly for new brand-name medications. Alternatively, regulating price for expensive medications could lead to more-rapid diffusion and equitable access to medications. Validity Construct validity: Multiple measures of diffusion of and access to new drugs exist, and it is challenging to comment on their validity without concrete examples. However, if nations do not agree on definitions of innovation, diffusion, and access, these measures could present threats to construct validity. In particular, definitions of innovation vary among nations. For example, there is some evidence that lower-value drugs are more likely to diffuse in the United States compared with other nations.18,19 Depending on which measure definition is used, this measure might be assessing aspects related to access, such as insurance coverage or cost, rather than drug diffusion.

Internal validity: Diffusion and access to new therapies might only be a valid measure of health system performance if it is measured for medications that are innovative and/or cost-effective.

Discriminant validity: International comparisons can be challenging due to difficulty accounting for differences in socioeconomic status and patient preferences for treatment options. Two factors influence whether a company will launch a new drug in a given country: demand, or the size of the potential market; and the nature of competition, impacted by a country’s policies on market regulation and intellectual property rights.20 Feasibility for Definitions: international According to OECD, a medicine is characterized as innovative if it (1) comparisons meets a previously unmet or inadequately met substantive health need or (2) offers enhanced effectiveness (e.g., greater efficacy, reduced toxicity, or both) or another incremental benefit (e.g., a substantive improvement in patient convenience) relative to existing therapeutic alternatives.

Diffusion of and Access to New Prescription Drugs 136 Measure Construct Diffusion of and Access to New Prescription Drugs However, there is an important distinction between innovative drugs and new drugs, which might not be innovative.

Diffusion is commonly defined as “the process by which an innovation is communicated through certain channels over time among members of a particular social system.”21

Access to medications is defined by the United Nations Development Group as “having drugs continuously available and affordable at public or private health facilities or drug outlets.”22,23

Data availability: • National: Sources of data could include commercial insurance databases and Medicare Part D data. • International: Multiple reports cite the MIDAS data set produced by IMS Health as a source of commercial market research data describing product launches in multiple therapeutic classes, including quarterly unit sales and revenues at the medication package level.5,18

Data comparability: • Measures comparing use of medications internationally generally use the World Health Organization’s (WHO’s) Anatomical Therapeutic Chemical classification system to identify active ingredients. This covers all classes, but not all countries. • Identifying drug launches over time can be challenging because brand names are often referenced rather than active ingredients, which makes one-to-one comparison difficult. • There may be a question of how to define what is considered new or innovative. The United Kingdom’s NICE system, for example, does a cost-benefit analysis and might not allow certain drugs to be covered if their benefit is deemed low.24 This lack of access to lower-value drugs could count against the United Kingdom in assessing health system performance, for example.

Subgroup analysis and equity: • There is subgroup analysis, as demonstrated in the NBER report: differences in access to a drug of interest by subpopulation (e.g., patients at least 65 years old) in hazard analysis. This could be used for other subpopulations as well. Usability: • National: Emphasis has largely been on mathematical modeling to Current evidence of use describe the diffusion and access to new prescription drugs.13,25

• International: Europe uses the Patients W.A.I.T. indicator to measure access to innovative therapies. This indicator shows the rate of availability (the number of medicines available to patients in each European country) and the average time between marketing authorization and patient access (number of days elapsed from the date of European Union marketing to the day of completion of post- marketing authorization administrative processes).26 WHO recently measured access to direct antiviral therapies for hepatitis C by surveying producers of these medications about pricing (price per 28- day supply), licensing, and regulatory status. WHO also used pharmaceutical sales data to estimate the number of people who received direct-acting antivirals.27

Diffusion of and Access to New Prescription Drugs 137 Measure Construct Diffusion of and Access to New Prescription Drugs Usability: Diffusion of and/or access to new prescription drugs is represented Relationship to among current OECD measures: currently used OECD • Biosimilar market share in treatment days for anti–tumor necrosis factor measures alphas and erythropoietin versus accessible market, 2017 (or nearest year), in European countries: Based on this measure, a nation’s access to innovative medications would be thought of as superior if there was greater availability of biosimilars (biochemically similar products that are more affordable than comparable reference medications).28 • Annual approvals of new medicines per billion U.S. dollars of pharmaceutical business expenditure on research and development (R&D) in the United States, inflation-adjusted: This measure analyzes the ratio of number of new approvals of medications per unit of expenditure on drug R&D. In other words, this is a measure of return on investment in development and approval of drugs.29

References

1. Berndt ER, Bhattacharjya A, Mishol DN, Arcelus A, Lasky T. An analysis of the diffusion of new antidepressants: Variety, quality, and marketing efforts. J Ment Health Policy Econ. 2002;5(1):3-19. 2. Expert-provided definition. 3. Gallup. The U.S. Healthcare Cost Crisis. 2019. Accessed May 21, 2020. https://news.gallup.com/poll/248123/westhealth-gallup-us-healthcare-cost-crisis-report.aspx 4. Canary LA, Klevens RM, Holmberg SD. Limited access to new hepatitis C virus treatment under state Medicaid programs. Ann Intern Med. 2015;163(3):226-228. 5. Cockburn IM, Lanjouw JO, Schankerman M. Patents and the Global Diffusion of New Drugs, Working Paper 20492. 2014. 6. Samuel N, Verma S. Cross-comparison of cancer drug approvals at three international regulatory agencies. Curr Oncol. 2016;23(5):e454-e460. 7. Roberts SA, Allen JD, Sigal EV. Despite criticism of the FDA review process, new cancer drugs reach patients sooner in the United States than in Europe. Health Aff (Millwood). 2011;30(7):1375-1381. 8. Mensah GA, Wei GS, Sorlie PD, et al. Decline in cardiovascular mortality: Possible causes and implications. Circ Res. 2017;120(2):366-380. 9. Cutler D, McClellan M, Newhouse J. The Costs and Benefits of Intensive Treatment for Cardiovascular Disease, NBER Working Papers 6514. National Bureau of Economic Research, Inc.; 1998. 10. Gagne JJ, Choudhry NK. How many “me-too" drugs is too many? JAMA. 2011;305(7):711-712. 11. Garattini S. Are me-too drugs justified? J Nephrol. 1997;10(6):283-294. 12. Hollis A. Me-Too Drugs: Is There a Problem? World Health Organization; 2004. 13. Cockburn IM, Lanjouw JO, Schankerman M. Patents and the global diffusion of new drugs. Am Econ Rev. 2016;106(1):136-164. 14. Berndt ER, Danzon PM, Kruse GB. Dynamic competition in pharmaceuticals: Cross-national evidence from new drug diffusion. MDE Manage Decis Econ. 2007;28(4‐5):231-250. 15. World Health Organization. European Observatory Policy Brief Series: European Observatory on Health Systems and Policies, 2013. Accessed May 21, 2020. https://www.ncbi.nlm.nih.gov/books/NBK464588 16. Lublóy Á. Factors affecting the uptake of new medicines: A systematic literature review. BMC Health Serv Res. 2014;14:469. 17. OECD. Pharmaceutical Innovation and Access to Medicines. Paris: OECD Health Policy Studies; 2018. 18. Kyle M, Williams H. Is American health care uniquely inefficient? Evidence from prescription drugs. Am Econ Rev. 2017;107(5):486-490. 19. Chandra A, Skinner J. Technology growth and expenditure growth in health care. J Econ Lit. 2012;50(3):645-680. 20. Kyle MK. Pharmaceutical price controls and entry strategies. Rev Econ Stat. 2007;89(1):88-99. 21. Rogers EM. Diffusion of Innovations, 5th Edition. New York: Free Press; 2003. 22. United Nations Development Group. Indicators for Monitoring the Millennium Development Goals. New York; 2003.

Diffusion of and Access to New Prescription Drugs 138 23. World Health Organization. Access to Affordable Essential Medicines. Undated. 24. Bryan S, Williams I, McIver S. Seeing the NICE side of cost-effectiveness analysis: A qualitative investigation of the use of CEA in NICE technology appraisals. Health Econ. 2007;16(2):179-193. 25. Peres R, Muller E, Mahajan V. Innovation diffusion and new product growth models: A critical review and research directions. International Journal of Research in Marketing. 2010;27(2):91-106. 26. European Federation of Pharmaceutical Industries and Associations. EFPIA Patient W.A.I.T. Indicator 2018 Survey. 2019. 27. World Health Organization. Global Report on Access to Hepatitis C Treatment—Focus on Overcoming Barriers. 2016. 28. OECD. Pharmaceutical Market, OECD Health Statistics (database). 2020. Accessed May 21, 2020. https://www.oecd-ilibrary.org/content/data/data-00545-en 29. OECD. Health at a Glance 2019: OECD Indicators. Paris: OECD Publishing; 2019.

Diffusion of and Access to New Prescription Drugs 139 Avoidable Emergency Department Use

Table A.13. Avoidable Emergency Department Use

Measure Construct Avoidable Emergency Department Use Description Avoidable (or preventable) emergency department (ED) visits are those in which people use hospital EDs for nonurgent care and for conditions that could have been treated in a primary care setting.1 These are discharged ED visits not requiring any diagnostic or screening services, procedures, or medications.2 ED visits for ambulatory care–sensitive conditions (ACSCs) are considered avoidable.3

Avoidable ED visits can be experienced by all populations, regardless of sociodemographic or health insurance factors.3 Importance: Health or Population impact: social impact National: • Nationally, about 139 million people (across all age groups) visited the ED in 2017, and 3.9% of these visits were classified as nonurgent (i.e., the patient could be seen in 2–24 hours).4 However, urgency and preventability are not necessarily synonymous. Using the above definition, from 2005 to 2011, about 3.3% of ED visits among adults (those 18–64 years of age) nationally were classified as avoidable, with most cases related to mental health and dental conditions.2 • Youth. About 13% of ED visits in 2010 among the national pediatric population (0–19 years of age) were deemed avoidable.5 • Older adults. Nationally, approximately 36% of avoidable ED visits (those that were related to an ACSC) between 2007 and 2009 occurred among adults aged 65 or older.3 Global: • Adults. There is currently no global study of avoidable ED visits. However, the prevalence of ED visits from 2011 to 2013 was 29.4% among adult patients (18 years or older) in the EU Seventh Framework project Quality and Costs in Primary Care (includes 31 European countries, Australia, New Zealand, and Canada); of these visits, it is unclear how many were avoidable.6 Some estimates are available for individual countries. For example, a national analysis from Taiwan suggests that 20% of ED visits are emergent but preventable by primary care.7 • Youth or older adults. Currently, global estimates of avoidable ED visits in youth or older adults are not available.

Meaningful clinical impact: • Avoidable ED visits could contribute to unnecessary testing and treatment and weaker patient–primary care provider relationships.8 • Reducing unnecessary admissions is important because of their cost to commissioners, service providers, and patients and their families.9

Performance gap: • Avoidable ED visits can indicate poor care management or inadequate access to care.10

Costs: In the United States, ED visits account for 12.5% of national health expenditures ($328.1 billion U.S. dollars in 2010). Furthermore,

Avoidable Emergency Department Use 140 Measure Construct Avoidable Emergency Department Use avoidable ED visits accounted for $64.4 billion, or 2.4% of national health expenditures.11 In the pediatric population (0–19 years), the cost of avoidable ED visits due to ACSCs was $3 billion in 2010.5 Importance: Health insurance reform: Related U.S. • Policies or strategies to reduce avoidable ED visits could help reduce Department of Health health care costs12 and, therefore, have important relevance to the HHS and Human Services priority to reform health insurance. Evidence from the Affordable Care (HHS) priority topics Act (ACA) shows that extending eligibility for health insurance to young adults (aged 19–25 years) resulted in significant decreases in ED visits in this age group.13 However, one in ten ED visits are still made by uninsured populations in the United States, suggesting the need for additional reforms.14 Furthermore, with the ACA, a growing prevalence of high-deductible health plans has been observed in both the group and individual markets, and this can have important implications for ED use.15 For example, high-deductible health plans incur higher costs for an ED visit for an individual compared with traditional health plans and, as a result, may contribute to reduced ED visits.16 However, an unintended consequence of such plans is that the high costs may pose a barrier to using the ED for a true emergency. • Since the Deficit Reduction Act of 2005, states may impose mandatory cost-sharing for nonurgent ED visits for Medicaid patients. Most recently, Indiana set copayments for nonemergency care delivered in the ED as part of its Medicaid expansion waiver in 2015. Health plans, too, have emphasized the importance of avoiding the ED to reduce costs.2 Validity There is wide variability in the data sources used across studies to define avoidable ED visits (e.g., retrospective diagnoses, hospital admissions, triage scores, patient self-reported data), and validity of these measures is not always reported.2

Predictive validity: One widely used algorithm for classifying avoidable ED visits developed by researchers at New York University (known as the NYU-ED algorithm) based on diagnosis data has demonstrated acceptable predictive validity in the United States.17 Specifically, the algorithm was able to differentiate between individual ED visits that were and were not likely to result in hospitalization or death. However, a limitation of this algorithm is that it depends on diagnosis codes and physician coding patterns, which can change over time, thereby altering the validity of the algorithm. Feasibility for Definitions: There is currently no internationally agreed-upon definition international of avoidable ED visits. Important differences across health care policies comparisons and systems could make it difficult to develop a standard measure that can work on a global scale.

Data availability: National: In the United States, the National Hospital Ambulatory Medical Care Survey obtains nationally representative data on all ED visits with information on level of urgency (but not on whether they were avoidable or preventable).18

Avoidable Emergency Department Use 141 Measure Construct Avoidable Emergency Department Use Global: • The multicountry Quality and Costs of Primary Care in Europe (QUALICOPC) survey collects ED visit data from hospitals, but it does not distinguish between avoidable and true emergency visits.6 • A related variable is OECD’s avoidable hospital admissions indicator, defined as the number of hospital admissions with a primary diagnosis of asthma, chronic obstructive pulmonary disease (COPD), or congestive heart failure (CHF) among people aged 15 years and over. These conditions can be effectively treated in the primary care setting.19 However, this indicator focuses on a limited set of avoidable admissions and is not specific to the ED.

Data comparability: As demonstrated by the QUALICOPC data, ED visit data can be pooled across countries, but to distinguish avoidable visits from those that are not avoidable will require adding information about the patient’s reason for the visit (e.g., self-report health condition or symptoms or using hospital International Classification of Diseases codes). Furthermore, the QUALICOPC is primarily focused on higher- income countries; thus, the feasibility of obtaining ED data from low- and middle-income countries is unknown.

Subgroup analysis and equity: In the United States, avoidable ED visits due to ACSCs among adults are higher among those who are non-Latino Black and those who are Latino than among those who are non-Latino White, higher among Medicare recipients than among those with private insurance, higher among older adults (50–64 and 65 or older) than among younger adults (18–29 years), and higher among women.3 Data from the multicountry QUALICOPC survey suggest that women and older adults are less likely to visit the ED, while those with less education are more likely to visit it, but this is not specific to avoidable visits.6 Usability: National: Current evidence of use No national study specifically collects avoidable ED visits. However, general ED visit information is obtained by the National Hospital Ambulatory Medical Care Survey18 and the Agency for Healthcare Research and Quality Healthcare Cost and Utilization Project.20 These data sources may need to be linked to other data (e.g., medical records) to distinguish avoidable ED visits.

Global: No global study collects avoidable ED visits. However, general ED visit data are obtained by the QUALICOPC survey,21 and avoidable hospitalization data are collected by the Organisation for Economic Co- operation and Development (OECD).19 Usability: A measure for avoidable ED visits is not among the current OECD Relationship to measures. currently used OECD measures Closest related measures: • The avoidable hospital admissions indicator measures the number of hospital admissions with a primary diagnosis of asthma, COPD, or CHF among people aged 15 years and over per 100,000 population. Rates are age-sex standardized to the 2010 OECD population aged 15 and over. Admissions resulting from a transfer from another hospital and where the patient dies during admission are excluded from the calculation, as these are considered unlikely to be avoidable.19

Avoidable Emergency Department Use 142 References

1. National Quality Forum. Reducing Emergency Department Overuse CAB. 2010. 2. Hsia RY, Niedzwiecki M. Avoidable emergency department visits: A starting point. Int J Qual Health Care. 2017;29(5):642-645. 3. Johnson PJ, Ghildayal N, Ward A, Westgard B, Boland L, Hokanson J. Disparities in potentially avoidable emergency department (ED) care ED visits for ambulatory care sensitive conditions. Med Care. 2012;50(12):1020-1028. 4. Centers for Disease Control and Prevention. National Hospital Ambulatory Medical Care Survey: 2017 Emergency Department Summary Tables. 2017. 5. Jaeger MW, Ambadwar PB, King AJ, Onukwube JI, Robbins JM. Emergency care of children with ambulatory care sensitive conditions in the United States. J Emerg Med. 2015;49(5):729-739. 6. van den Berg MJ, van Loenen T, Westert GP. Accessible and continuous primary care may help reduce rates of emergency department use. an international survey in 34 countries. Fam Pract. 2015;33(1):42-50. 7. Tsai JC-H, Chen W-Y, Liang Y-W. Nonemergent emergency department visits under the national health insurance in Taiwan. Health Policy. 2011;100(2-3):189-195. 8. Uscher-Pines L, Pines J, Kellermann A, Gillen E, Mehrotra A. Emergency department visits for nonurgent conditions: Systematic literature review. Am J Manag Care. 2013;19(1):47-59. 9. O’Cathain A, Knowles E, Maheswaran R, et al. A system-wide approach to explaining variation in potentially avoidable emergency admissions: National ecological study. BMJ Quality & Safety. 2014;23(1):47-55. 10. Dowd B, Karmarker M, Swenson T, et al. Emergency department utilization as a measure of physician performance. Am J Med Qual. 2013;29(2):135-143. 11. Galarraga JE, Pines JM. Costs of ED episodes of care in the United States. Am J Emerg Med. 2016;34(3):357-365. 12. Enard KR, Ganelin DM. Reducing preventable emergency department utilization and costs by using community health workers as patient navigators. J Healthc Manag. 2013;58(6):412-428. 13. Hernandez-Boussard T, Burns CS, Wang NE, Baker LC, Goldstein BA. The Affordable Care Act reduces emergency department use by young adults: Evidence from three states. Health Affairs (Project Hope). 2014;33(9):1648-1654. 14. Singer AJ, Thode HC, Jr., Pines JM. US emergency department visits and hospital discharges among uninsured patients before and after implementation of the Affordable Care Act. JAMA Netw Open. 2019;2(4):e192662. 15. Dolan R. High-deductible health plans. Health Affairs Health Policy Brief. 2016. 16. Wharam JF, Landon BE, Galbraith AA, Kleinman KP, Soumerai SB, Ross-Degnan D. Emergency department use and subsequent hospitalizations among members of a high-deductible health plan. JAMA. 2007;297(10):1093-1102. 17. Ballard DW, Price M, Fung V, et al. Validation of an algorithm for categorizing the severity of hospital emergency department visits. Med Care. 2010;48(1):58-63. 18. Centers for Disease Control and Prevention. Ambulatory Health Care Data. 2020. Accessed May 18, 2020. https://www.cdc.gov/nchs/ahcd/index.htm 19. OECD. Health at a Glance 2019: OECD Indicators. Paris: OECD Publishing; 2019. 20. U.S. Department of Health and Human Services, Agency for Healthcare Research and Quality. Healthcare Cost and Utilization Project (HCUP). 2020. Accessed May 18, 2020. https://www.ahrq.gov/data/hcup/index.html 21. European Commission. Quality and Costs of Primary Care in Europe: Final Report Summary— QUALICOPC (Quality and Costs of Primary Care in Europe). 2015. Accessed May 18, 2020. https://cordis.europa.eu/project/id/242141/reporting

Avoidable Emergency Department Use 143 The Percentage of Patients with an Opioid Use Disorder Who Were Referred to or Prescribed Medication-Assisted Treatment

Table A.14. The Percentage of Patients with an Opioid Use Disorder Who Were Referred to or Prescribed Medication-Assisted Treatment

The Percentage of Patients with an Opioid Use Disorder Who Were Measure Construct Referred to or Prescribed Medication-Assisted Treatment Description Medication-assisted treatment (MAT) is the most effective medical treatment for opioid use disorder (OUD).1 Despite the prescribing options available, estimates suggest that only 20–40% of people with OUD receive MAT.2 The referral treatment process consists of assisting a patient with accessing MAT; selecting treatment facilities; and helping navigate any barriers, such as treatment cost or lack of transportation, that could hinder accessing treatment in a specialty setting.3 Measuring the number of people who were or were not able to access MAT requires measuring the scope of the problem, treatment providers available, and education of those providers.

• Sometimes referred to as “opioid abuse or dependence” or “opioid addiction,” OUD is a problematic pattern of opioid use that causes significant impairment or distress.4 • MAT is the use of medications, in combination with counseling and behavioral therapies, to provide a “whole-patient” approach to the treatment of substance use disorders (SUDs). MAT is primarily used to treat addiction to opioids, but it is also used for alcohol dependence.5 Historically, the primary treatment for OUD was methadone, which was only administered by accredited opioid treatment programs.6 Since the Drug Addiction Treatment Act of 2000, buprenorphine can be prescribed in any location by qualified physicians who have applied for and received a Substance Abuse and Mental Health Services Administration waiver.7 Importance: Health or Population impact: social impact • National: The misuse of and addiction to opioids is a major public health crisis in the United States, causing over 1.6 million years of life lost annually—more than the burden attributable to homicides, hypertension, HIV/AIDS, and pneumonia.8 As of 2018, 42.3% of opioid treatment centers offered MAT.9 • Global: Although the opioid epidemic is most pronounced in the United States, more and more countries are seeing growing numbers of OUDs and overdose-related deaths.10 The United Nations 2017 report on drug abuse stated that more than 200 million people, or 4.2% of the world population, were addicted to illegal drugs.11

Clinical impact: • Consequences: Being diagnosed with an OUD increases the risk of early death by a factor of 20.12 MAT is the most effective treatment for OUD.1 Outpatient treatment facilities are particularly important for the treatment of SUDs; only 13% of individuals who receive treatment do so in a private physician’s office.13

Performance gap: • In 2018, 2 million people in the United States had an OUD.14 However, the capacity to treat OUD remains at less than 50% of the total number The Percentage of Patients with an Opioid Use Disorder Who Were Referred to or Prescribed Medication-Assisted Treatment 144 The Percentage of Patients with an Opioid Use Disorder Who Were Measure Construct Referred to or Prescribed Medication-Assisted Treatment of people diagnosed with OUD.15 The National Institute on Drug Abuse estimates that one-third of patients with opioid dependence at treatment programs receive MAT.16 • Rural populations are particularly underserved—60% of small, nonmetropolitan county residents live in an opioid treatment shortage area.17 • Only 28% of opioid overdose survivors are referred to MAT, despite evidence of its effectiveness.18

Costs: • National: In the United States, recent estimates suggest that the costs of the opioid epidemic exceed $500 billion or 2.8% of GDP. • Global: Because the global opioid epidemic is in its nascent stage, the global costs have not yet been realized or projected. But there is evidence that drug companies are applying tactics used in the United States in order to increase opioid sales in Asia and Europe.19 Importance: Opioid crisis: Related U.S. • HHS is committed to ending the crisis of opioid addiction and overdose Department of Health in the United States. One point of HHS’s 5-point strategy to combat the and Human Services opioid crisis is “better addiction prevention, treatment, and recovery (HHS) priority topics services.” The clinician workforce is critical to providing better treatment and recovery services.

Other related priorities: • Health insurance reform: The HHS priority to improve the availability and affordability of health insurance seeks to help all Americans access health care that meets individual needs and budgets.20 HHS has a vision of “a system [of] affordable, personalized care.”21 In states that expanded access to Medicaid, MAT prescriptions have increased, driven by office-based buprenorphine.22,23 • Value-based care: Integrating MAT into general medical practices could increase access, helping to transform our health care system from one that pays for procedures and sickness to one that pays for outcomes and health, but low reimbursement levels disincentivize providers from offering it.24 Validity Construct validity: • Because MAT is the most effective medical treatment for OUD,1 the percentage of patients with an OUD who were referred to or prescribed MAT is an important determinant of health.

Internal validity: • The rate at which a health care system prescribes the more proven, effective treatment for a disorder, including OUD, is a critical component of the quality of health care available to the consumer.

Discriminant validity: • Greater prevalence of diagnosed OUD and other SUDs may reflect diagnostic differences rather than actual use and abuse of substances. • Additionally, greater prevalence of OUD and other SUDs may reflect elements of the public health system (e.g., laws) rather than the health care system.

The Percentage of Patients with an Opioid Use Disorder Who Were Referred to or Prescribed Medication-Assisted Treatment 145 The Percentage of Patients with an Opioid Use Disorder Who Were Measure Construct Referred to or Prescribed Medication-Assisted Treatment Feasibility for Definitions: international • The World Health Organization’s official recommendation for the comparisons treatment of OUD is “the use of a range of treatment options for opioid dependence which include psychosocial support, opioid maintenance treatments such as methadone and buprenorphine, supported detoxification and treatment with opioid antagonists such as naltrexone.”25 • Each country has different regulations on who can prescribe MAT. For example, in Canada and Europe, buprenorphine and methadone can be prescribed by a pharmacist, but in the United States the majority of prescriptions are by specialist physicians. • There may be international differences in the definition of OUD that could influence the needs and capacities of different countries.

Data availability: • National: o The National Survey on Drug Use and Health (NSDUH) documents illicit drug use, including OUD, and describes the use of MAT.26 o Administrative data (including claims data from Medicare, Medicaid, state all-payer databases, and IQVIA) contain diagnostic codes that would indicate OUD and describe prescription claims (for methadone, buprenorphine, and naltrexone). • Global: o MAT is available in 80 countries around the world.27 Many European countries28 and other OECD countries29 regularly field surveys like the NSDUH that attempt to describe licit and illicit drug use in their populations. o At least 25 countries routinely collect administrative data on diagnoses and prescribed and dispensed medications.30

Data comparability: • Differences in how certain data are collected across countries may threaten comparability. For instance, some countries have national prescription registries, while others collect separate data describing reimbursement and prescription. Other countries have good prescription data for specific subpopulations (e.g., those covered by certain insurance programs) but lack data for other subpopulations.30 • Governmental and public health system characteristics may play a role in the prevalence of OUD of each country. For instance, in some countries where drugs have been decriminalized (e.g., Portugal), overdoses and infections have been reduced.31 International definitional differences (which would arise if there were not commonly agreed-upon standards for OUD diagnoses) would also threaten the comparability of the data.

Usability: Current National: evidence of use • The National Quality Forum measures the initiation and engagement of alcohol and other drug abuse or dependence treatment. This is not limited to OUD or to MAT but would include OUD as a type of drug abuse and MAT as a treatment. • The Joint Commission uses the percentage of those with acute opioid disorder (AOD) diagnosis who receive or refuse a MAT or referral at a hospital, which is comparable to the National Quality Forum’s AOD

The Percentage of Patients with an Opioid Use Disorder Who Were Referred to or Prescribed Medication-Assisted Treatment 146 The Percentage of Patients with an Opioid Use Disorder Who Were Measure Construct Referred to or Prescribed Medication-Assisted Treatment treatment provided or offered at discharge from inpatient hospitalization.32 • The National Survey of Substance Abuse Treatment Services collects data on gross measures of organizational structure, such as the percentage of referrals, but does not measure a program’s ability to prescribe medications. Nor is implementation measured, which may lead to inflated inferences about how therapies are used.33

Global: • The Canadian Institute for Health Information measures the hospital stays for harm caused by substance use. However, this measure does not involve the workforce size or capacity.34 • The Australian Institute of Health and Welfare tracks referral to treatment by treatment source, such as family, law enforcement, or a health professional. It also tracks the different types of treatments to which patients are referred, such as whether MAT is combined with counseling.35 Usability: The percentage of patients with an OUD who were referred to or Relationship to prescribed MAT is not among the current OECD measures. currently used OECD measures Closest related measures: • Opioid use: These measures describe the availability of analgesic opioids and the rate of opioid-related deaths. Therefore, these measures describe the population (or a portion thereof) that could be prescribed MAT.36 • Safe primary care prescribing: OECD tracks the volume of opioids prescribed and the proportion of chronic opioid users. Again, these measures describe the population (or a portion thereof) that could be prescribed MAT.36 • Opioid-related deaths: The European Monitoring Centre for Drugs and Drug Addiction collects these data and shares them with OECD.37

References

1. World Health Organization. Guidelines for the Psychosocially Assisted Pharmacological Treatment of Opioid Dependence. Geneva: World Health Organization; 2009. 2. Lembke A, Chen JH. Use of opioid agonist therapy for Medicare patients in 2013. JAMA Psychiatry. 2016;73(9):990-992. 3. National Council for Behavioral Health, Center of Excellence for Integrated Health Solutions. HRSA Center of Excellence for Behavioral Health Technical Assistance. 2020. Accessed April 1, 2020. https://www.thenationalcouncil.org/integrated-health-coe 4. Centers for Disease Control and Prevention. Prevent Opioid Use Disorder. 2017. Accessed April 3, 2020. https://www.cdc.gov/drugoverdose/prevention/opioid-use-disorder.html 5. U.S. Department of Health and Human Services, Substance Abuse and Mental Health Services Administration. MAT Medications, Counseling, and Related Conditions. 2020. Accessed April 2, 2020. https://www.samhsa.gov/medication-assisted-treatment/treatment#medications-used-in-mat 6. American Society of Addiction Medicine. Advancing Access to Addiction Medications: Implications for Opioid Addiction Treatment. 2013. 7. Public Law No: 106–310. Children’s Health Act of 2000. 2000. 8. Gomes T, Tadrous M, Mamdani MM, Paterson JM, Juurlink DN. The burden of opioid-related mortality in the United States. JAMA Netw Open. 2018;1(2):e180217. 9. U.S. Department of Health and Human Services, Substance Abuse and Mental Health Services Administration. National Survey of Substance Abuse Treatment Services (N-SSATS): 2018. Data on The Percentage of Patients with an Opioid Use Disorder Who Were Referred to or Prescribed Medication-Assisted Treatment 147 Substance Abuse Treatment Facilities. Rockville, MD: Substance Abuse and Mental Health Services Administration; 2019. 10. Vashishtha D, Mittal ML, Werb D. The North American opioid epidemic: Current challenges and a call for treatment as prevention. Harm Reduct J. 2017;14(1):7. 11. Merz F. United Nations Office on Drugs and Crime: World Drug Report 2017. SIRIUS-Zeitschrift für Strategische Analysen; 2018. 12. Degenhardt L, Larney S, Kimber J, et al. The impact of opioid substitution therapy on mortality post- release from prison: Retrospective data linkage study. Addiction. 2014;109(8):1306-1317. 13. Wallack SS, Thomas CP, Martin TC, Chilingerian J, Reif S. Substance abuse treatment organizations as mediators of social policy: Slowing the adoption of a congressionally approved medication. J Behav Health Serv Res. 2010;37(1):64-78. 14. U.S. Department of Health and Human Services, Substance Abuse and Mental Health Services Administration. Key Substance Use and Mental Health Indicators in the United States: Results from the 2018 National Survey on Drug Use and Health. Rockville, MD: Center for Behavioral Health Statistics and Quality, Substance Abuse and Mental Health Services Administration; 2019. 15. Jones CM, Campopiano M, Baldwin G, McCance-Katz E. National and state treatment need and capacity for opioid agonist medication-assisted treatment. Am J Public Health. 2015;105(8):e55-e63. 16. National Institute on Drug Abuse. Effective Treatments for Opioid Addiction. 2016. Accessed April 2, 2020. https://www.drugabuse.gov/publications/effective-treatments-opioid-addiction/ effective-treatments-opioid-addiction 17. Dick AW, Pacula RL, Gordon AJ, et al. Growth in buprenorphine waivers for physicians increased potential access to opioid agonist treatment, 2002-11. Health Aff (Millwood). 2015;34(6):1028-1034. 18. Larochelle MR, Bernson D, Land T, et al. Medication for opioid use disorder after nonfatal opioid overdose and association with mortality: A cohort study. Annals of Internal Medicine. 2018;169(3):137-145. 19. Humphreys K, Caulkins JP, Felbab-Brown V. Opioids of the masses: Stopping an American epidemic from going global. Foreign Affairs. 2018;97:118. 20. U.S. Department of Health and Human Services. Secretary Priorities: Health Insurance Reform. 2018. Accessed April 3, 2020. https://www.hhs.gov/about/leadership/secretary/priorities/index.html#health-insurance-reform 21. U.S. Department of Health and Human Services. Remarks on the Trump Administration Healthcare Vision. 2019. Accessed April 1, 2020. https://www.hhs.gov/about/leadership/secretary/speeches/2019-speeches/ remarks-on-the-trump-administration-healthcare-vision.html 22. Barnes AJ, Cunningham PJ, Saxe-Walker L, et al. Hospital use declines after implementation of Virginia Medicaid’s addiction and recovery treatment services. Health Aff (Millwood). 2020;39(2):238-246. 23. Maclean JC, Saloner B. The Effect of Public Insurance Expansions on Substance Use Disorder Treatment: Evidence from the Affordable Care Act. Cambridge, MA: National Bureau of Economic Research; 2017. 24. National Academies of Sciences, Engineering, and Medicine. Medication-Assisted Treatment for Opioid Use Disorder. 2018. 25. World Health Organization. Information S heet on Opioid Overdose. 2018. Accessed March 31, 2020. https://www.who.int/substance_abuse/information-sheet/en 26. U.S. Department of Health and Human Services, Substance Abuse and Mental Health Services Administration, Center for Behavioral Health Statistics and Quality. National Survey on Drug Use and Health, 2003-2012 (ICPSR 34933-v1). Ann Arbor, MI: Inter-University Consortium for Political and Social Research; 2013. 27. Harm Reduction International. The Global State of Harm Reduction 2014. 2014. Accessed April 2, 2020. https://www.hri.global/contents/1524 28. Decorte T, Mortelmans D, Tieberghien J, De Moor S. Drug Use: Overview of General Population Surveys in Europe. Lisbon: EMCDDA; 2009. 29. Begin P, Weekes J, Thomas G. The Canadian Addiction Survey: substance use and misuse among the Canadian population. InForum on Corrections Research. 2006;18(1):12. 30. OECD. Using Routinely Collected Data to Inform Pharmaceutical Policies: Analytical Report for OECD and EU Countries. Paris: OECD Publishing; 2019. 31. Greenwald G. Drug Decriminalization in Portugal: Lessons for Creating Fair and Successful Drug Policies. Cato Institute Whitepaper Series; 2009. 32. Williams AR, Nunes EV, Bisaga A, et al. Developing an opioid use disorder treatment cascade: A review of quality measures. J Subst Abuse Treat. 2018;91:57-68. The Percentage of Patients with an Opioid Use Disorder Who Were Referred to or Prescribed Medication-Assisted Treatment 148 33. Knudsen HK, Abraham AJ, Roman PM. Adoption and implementation of medications in addiction treatment programs. J Addict Med. 2011;5(1):21-27. 34. Canadian Institute for Health Information. Hospital Stays for Harm Caused by Substance Use. Undated. Accessed April 2, 2020. http://indicatorlibrary.cihi.ca/pages/viewpage.action?pageId=15565197 35. Australian Institute of Health and Welfare. Alcohol and Other Drug Treatment Services in Australia 2017– 18, Drug Treatment Series No. 33. Cat. No. HSE 230. 2019. 36. OECD. Health at a Glance 2019: OECD Indicators. Paris: OECD Publishing; 2019. 37. OECD. Addressing Problematic Opioid Use in OECD Countries. Paris: OECD Publishing; 2019.

The Percentage of Patients with an Opioid Use Disorder Who Were Referred to or Prescribed Medication-Assisted Treatment 149 Estimates of Administrative Complexity and Cost

Table A.15. Estimates of Administrative Complexity and Cost

Measure Construct Estimates of Administrative Complexity and Cost Description In the clinical setting, administration refers to the nonclinical activities that regulate or control the behavior of individuals in a health care organization, enabling them to implement policy decisions and achieve their goals.1 Administrative tasks must be carried out at all levels of the health care system to ensure high-quality health care. Although more resources invested in administration can be productive, especially high administrative complexity and cost can be a sign of wasteful spending that could be curtailed without worsening patient health outcomes.2 Specifically, administrative complexity is the complicated workflows and fragmented financing procedures that can waste clinicians’ time and interfere with their caring for patients.3 Estimates can include, but are not limited to, time spent preparing paperwork (e.g., processing and billing of claims) and contacting payers.4

Administrative costs are the costs to carry out administrative services that help ensure against illness and deliver medical care.5 Estimates can include, but are not limited to, transaction-related costs, benefits management, selling and marketing, and regulatory/compliance costs.5 Importance: Health or Population impact: social impact • National: In 2018, the United States spent 17.7% of the gross domestic product on health care. This amount of spending is higher than that of any other nation. Recent estimates of the percentage of health spending dedicated to administration in the United States range from 8.3 to 25.3%, which is higher than administrative spending in other Organisation for Economic Co-operation and Development (OECD) nations.6,7 (Note that the wide range is due to different definitions of administration.) Furthermore, high administrative complexity can have negative impacts on the nation’s health professionals who are involved in administration. For example, physicians who spend more time on complex administrative duties (e.g., prior authorizations, clinical documentation, and medication reconciliation) report lower levels of career satisfaction and higher levels of burnout and are more likely to consider cutting back on seeing patients in the future.8 • Global: Rising health care costs have proved to be problematic for many nations for a myriad of reasons, including the advancement of expensive innovations in care.9 However, high administrative costs could lead to unnecessary health-related expenditures in some countries more than others. Reducing wasteful spending on administrative spending could allow nations to divert resources toward other more-productive activities in health care and other domains. A recent study using OECD data found that governance and financing- related administrative spending at the macro level has remained stable over the last decade at slightly more than 3% of total health spending. In the sample, Iceland had the lowest administrative spending (1.3% of total health spending) and the United States had the highest (8.3%). Nations having multiple payers tended to have higher administrative spending than those with single payers.10

Estimates of Administrative Complexity and Cost 150 Measure Construct Estimates of Administrative Complexity and Cost Meaningful clinical impact: Administrative complexity can result in frequent interruptions in the work of physicians and their staff, which are likely to interfere with patient care.11 There is some evidence from the United States that health care organizations spending more resources on administration deliver lower-quality care.12 Some stakeholders perceive money spent on administration to be money wasted because it may be less likely to produce direct benefits to patients compared with spending on health care delivery itself.2

Performance gap: Recent comparisons have demonstrated that administrative spending in the United States is double that of Canada.13 A 2019 article by Shrank et al. estimated current levels of waste in the U.S. health care system in six previously developed domains, including spending on administration complexity.14,15 Countries with multipayer systems tend to exhibit higher administrative costs than countries with a single payer, and private insurers’ administrative costs are generally higher than those of public schemes. In many OECD nations, key areas where waste can be reduced include making better use of information and communications technology between payer and provider, simplifying administrative procedures, and finding the right size of administrative bodies.2

The performance of a health care system is also measured by its efficiency, among other domains, and efficiency includes estimates of administrative complexity and costs. Across five performance health care system dimensions, the United States scores lowest in efficiency.16 More time spent on administrative tasks could reflect lower efficiency. An analysis of 11 high-income countries found a high administrative burden in the United States, with 54% of U.S. physicians reporting time spent on administrative issues related to insurance or claims as a major problem, compared with the mean of 41% across all 11 countries.6

Costs: • National: In the United States, administrative costs account for 8–25% of health care spending, which is higher than in other high-income countries (1–3%).6,7 An analysis comparing administrative costs in the United States with those in Canada in 2010 found that the United States generated $15 billion to $32 billion in excess costs per year.4 A physician-level study of administrative waste found that the costs of billing and insurance-related expenses varied from $20 for a primary care visit to $215 for an inpatient surgical procedure.15,17 The estimated total annual cost of waste from administrative complexity in the United States is $265.6 billion (2019 U.S. dollars).15 • Global: Among OECD countries, health system administrative costs represent on average 3% of health spending, with higher spending among multipayer systems with free choice of insurer (as in the case of the United States) than among those with automatic affiliation or single-payer systems (whether the payer is a social health insurance fund or a government entity).18 System-specific investigations have uncovered administrative waste in other countries, including Australia (AUD 106 million was regained by removing duplication of administrative services) and Germany (EUR 4.3 billion of administrative costs were related to documentation and reporting).2

Estimates of Administrative Complexity and Cost 151 Measure Construct Estimates of Administrative Complexity and Cost Importance: Value-based care: Related U.S. Estimating administrative complexity and costs aligns with the HHS Department of Health priority to deliver value-based care because reducing administrative and Human Services burden in health care can empower health professionals to spend more (HHS) priority topics time caring for patients while reducing overall health care costs.19,20 Furthermore, paying for value rather than volume may encourage health care organizations and payers to decrease spending on inefficient administration. Validity Construct validity: Measures of administrative spending and/or waste have been used to identify low-hanging fruit where cuts can be made to save resources without sacrificing quality of care. However, one threat to construct validity is that nations may vary substantially in how they classify different types of spending. Analyzing one nation’s administrative spending trend over time could be more meaningful than comparing absolute numbers across nations.21 Furthermore, administrative complexity has been measured by collecting physician-reported time spent on administrative tasks,6,8,11 but such questions have not been validated. How administrative tasks interfere with patient care has been measured by a 16-item validated instrument, the Maslach Burnout Inventory—General Survey.8

Internal validity: There is some evidence from the United States that health care organizations spending more resources on administration deliver lower-quality care.12 However, floor and ceiling effects likely characterize administrative spending, since some administrative spending is necessary to coordinate high-quality care, but too much spending is likely to be wasteful.

Discriminant validity: If an organization, health system, or nation categorizes “backroom” support personnel as administrative waste, cutting such personnel could lead to lower physician productivity and thus higher costs of providing care to patients.22 Feasibility for Definitions: Per OECD, administrative costs refer to the costs associated international with the governance and administration of the health system and the comparisons collection and pooling of financial resources by different health financing schemes.18 Estimates of administrative complexity in the United States and internationally are often based on physician-reported time spent on various administrative tasks (i.e., perceived burden).4,6,8

In the United States, administrative costs have previously been subdivided into costs attributable to private insurers (e.g., claims processing, profits), the government (e.g., eligibility determination, revenue collection), providers (e.g., billing, collections, collection and reporting of quality data), and employers (e.g., choosing plans, designing benefits).

The administrative loss ratio has been defined as a health insurance plan’s total administrative costs divided by its total premium revenues.12 The medical loss ratio is the proportion of insurance premium revenues spent on clinical services and quality improvement. A higher medical loss ratio means that the insurer is spending less money on overhead.23 The System of Health Accounts described by OECD provides an international framework for the definition, demarcation, and categorization

Estimates of Administrative Complexity and Cost 152 Measure Construct Estimates of Administrative Complexity and Cost of health expenditure. Under this system, transactions are classified around who pays (financing), who provides (provision), and what the purpose is (function). For non-OECD nations, the World Health Organization coordinates a reporting system that compiles health care expenditures as National Health Accounts.24,25

Data availability: • National: A recent study used data from the U.S. National Health Expenditure Accounts (NHEA) to estimate costs of administering government programs and health insurance. The study included an estimate of administrative costs at the physician level (which are not accounted for in NHEA) by using physician effort dedicated to interaction with payers.13,26 • Global: Himmelstein et al. performed an international comparison of eight nations using publicly available data to estimate administrative costs using prespecified categories of cost.7 Another study used OECD System of Health Accounts data to estimate macro-level financing- related expenditures in health care (but did not estimate administrative expenditure by health care providers).10 Furthermore, the Commonwealth Fund International Health Policy Survey’s Physician Supplement collects prevalence of administrative efficiency (e.g., complexity) as measured by physician-reported time spent on administrative issues (e.g., insurance claims, reporting clinical or quality data, and paperwork or disputes related to medical bills).27

Data comparability: Estimates of administrative costs vary even within the United States. Much of this variation is due to different definitions of administration (e.g., whether insurer profits and spending on population health are administrative costs).6,13 The debate around administrative costs of Medicare, for example, is an example of such challenges.28,29 Moreover, approaches in the estimation and valuation of administrative spending vary across countries, which may affect comparability of data. For example, (1) lack of data for certain types of administration (e.g., physician practice overhead) might lead to underestimation of administrative spending; (2) spending on preventive services, such as vaccination, could be misclassified as administrative spending in some nations; (3) differences in depreciation methods could lead to variance in administrative spending estimates across nations; and (4) differences in accounting for profits and brokerage fees of private health insurance could lead to biases in estimates of administrative spending.2 A scoping review of administrative costs in health care published by a German author in 2018 determined that heterogeneous reporting of costs might affect comparability across nations.24 International comparisons can also be complicated by differences across countries in how budgets are set, how reimbursement rates with providers are negotiated, differences in types of staff or technology, and differences in prices to carry out the same administrative functions, for example.1 To collect these additional pieces of information would entail enormous expense, time, and logistical difficulties.

Moreover, electronic health record (EHR) systems are being adopted in some countries, such as the United States, which contributes to the administrative complexities and costs;17 however, including EHR administrative costs could make it difficult to compare overall estimates to countries that do not have EHR systems. Furthermore, given that past

Estimates of Administrative Complexity and Cost 153 Measure Construct Estimates of Administrative Complexity and Cost international measures of administrative complexity and costs have been limited to higher-income countries, their feasibility in developing countries is unclear.

Subgroup analysis and equity: • Subgroup analyses have looked at administrative spending by payer type, generally for publicly versus privately funded payers. For example, a study of U.S. billing and insurance-related administrative costs determined that 3.1% of Medicare costs were directed toward administration, compared with 18% for private insurers.30 Usability: The United States and OECD collect data on administrative complexity Current evidence of use and costs to track wasteful spending of health care dollars, a sign of poor health systems management, and thus identify areas for potential savings.15,18 Current evidence of the use of measures of administrative complexity includes the following (not exhaustive):

National: • The percentage of national health expenditures dedicated to administrative spending: based on NHEA data26 • Medical loss ratio: The Affordable Care Act requires health insurers to submit data on the proportion of premium revenues spent on clinical services and quality improvement. A higher medical loss ratio means that the insurer is spending less money on overhead.23 • Dollars spent on reporting of quality measures.31

Global: • The percentage of national health expenditures dedicated to administrative spending: based on NHEA data (using the Medicare hospital costs reporting format).2,7 Usability: Administrative costs are represented among the current OECD Relationship to measures. However, no standard measure to estimate administrative currently used OECD complexity (e.g., burden or time spent on administrative tasks) is currently measures collected by OECD.

Closest related measures: • Government health administration expenditure related to share of total government expenditure financed by social health insurance or other compulsory schemes, 2014 (or nearest year)35 • Health administration expenditure as a share of financing schemes’ total health spending, 2014.32 However, this measure leaves out administrative costs associated with health services providers (e.g., hospitals or practices of physicians).33,34 OECD could consider adopting other example measures of administrative complexity and costs (e.g., medical loss ratio; dollars spent on reporting of quality measures).

References

1. U.S. Congress, Office of Technology Assessment. International Comparisons of Administrative Costs in Health Care, BP-H-135. Washington, D.C.: U.S. Government Printing Office; September 1994. 2. Mueller M, Hagenaars L, Morgan D. Administrative Spending in OECD Health Care Systems: Where Is the Fat and Can It Be Trimmed? OECD Publishing; 2017:229-264.

Estimates of Administrative Complexity and Cost 154 3. Institute of Medicine. Best Care at Lower Cost: The Path to Continuously Learning Health Care in America. Washington, D.C.: The National Academies Press; 2013. 4. Institute of Medicine Roundtable on Evidence-Based Medicine. The National Academies Collection: Reports funded by National Institutes of Health. In: Yong PL, Saunders RS, Olsen L, eds. The Healthcare Imperative: Lowering Costs and Improving Outcomes: Workshop Series Summary. Washington, D.C.: National Academies Press; 2010. 5. Thorpe KE. Inside the black box of administrative costs. Health Affairs. 1992;11(2):41-55. 6. Papanicolas I, Woskie LR, Jha AK. Health care spending in the United States and other high-income countries. JAMA. 2018;319(10):1024-1039. 7. Himmelstein DU, Jun M, Busse R, et al. A comparison of hospital administrative costs in eight nations: US costs exceed all others by far. Health Aff (Millwood). 2014;33(9):1586-1594. 8. Rao SK, Kimball AB, Lehrhoff SR, et al. The impact of administrative burden on academic physicians: Results of a hospital-wide physician survey. Acad Med. 2017;92(2):237-243. 9. Squires D. Explaining High Health Care Spending in the United States: An International Comparison of Supply, Utilization, Prices, and Quality. New York: Commonwealth Fund; 2012. 10. Hagenaars LL, Klazinga NS, Mueller M, Morgan DJ, Jeurissen PPT. How and why do countries differ in their governance and financing-related administrative expenditure in health care? An analysis of OECD countries by health care system typology. Int J Health Plann Manage. 2018;33(1):e263-e278. 11. Morra D, Nicholson S, Levinson W, Gans DN, Hammons T, Casalino LP. US physician practices versus Canadians: Spending nearly four times as much money interacting with payers. Health Affairs. 2011;30(8):1443-1450. 12. Himmelstein DU, Woolhandler S. Taking care of business: HMOs that spend more on administration deliver lower-quality care. Int J Health Serv. 2002;32(4):657-667. 13. Himmelstein DU, Campbell T, Woolhandler S. Health care administrative costs in the United States and Canada, 2017. Ann Intern Med. 2020;172(2):134-142. 14. Berwick DM, Hackbarth AD. Eliminating waste in US health care. JAMA. 2012;307(14):1513-1516. 15. Shrank WH, Rogstad TL, Parekh N. Waste in the US health care system: Estimated costs and potential for savings. JAMA. 2019;322(15):1501-1509. 16. Schoen C, Davis K, How SKH, Schoenbaum SC. U.S. health system performance: A national scorecard. Health Affairs. 2006;25(Supplement 1):W457-W475. 17. Tseng P, Kaplan RS, Richman BD, Shah MA, Schulman KA. Administrative costs associated with physician billing and insurance-related activities at an academic health care system. JAMA. 2018;319(7):691-697. 18. OECD. Tackling Wasteful Spending on Health. Paris: OECD Publishing; 2017. 19. U.S. Department of Health and Human Services. HHS to Deliver Value-Based Transformation in Primary Care. 2019. Accessed April 2, 2020. https://www.hhs.gov/about/news/2019/04/22/hhs-deliver-value-based-transformation-primary-care.html 20. O’Shea J. Patient-centered, value-based health care is incompatible with the current climate of excessive regulation. Health Affairs Blog. 2018. Accessed April 3, 2020. https://www.healthaffairs.org/do/10.1377/hblog20180927.405697/full 21. Aaron HJ. The costs of health care administration in the United States and Canada: Questionable answers to a questionable question. N Engl J Med. 2003;349:801-803. 22. Kaplan RS, Haas DA. How Not to Cut Health Care Costs. Harvard Business Review. 2014. 23. Centers for Medicare and Medicaid Services. The Center for Consumer Information & Insurance Oversight: Medical Loss Ratio. Undated. Accessed April 2, 2020. https://www.cms.gov/CCIIO/ Programs-and-Initiatives/Health-Insurance-Market-Reforms/Medical-Loss-Ratio 24. Larjow E. Administrative costs in health care—A scoping review. Health Policy. 2018;122(11):1240-1248. 25. World Health Organization. Guide to Producing National Health Accounts with Special Applications for Low-Income and Middle-Income Countries. Geneva. 2003. 26. Centers for Medicare and Medicaid Services. National Health Expenditure Data (Historical). 2019. Accessed April 2, 2020. www.cms.gov/research-statistics-data-and-systems/statistics-trends-and-reports/ nationalhealthexpenddata/nationalhealthaccountshistorical.html 27. Mossialos E, Djordjevic A, Osborn R, Sarnak D. International Profiles of Health Care Systems: Australia, Canada, China, Denmark, England, France, Germany, India, Israel, Italy, Japan, the Netherlands, New Zealand, Norway, Singapore, Sweden, Switzerland, Taiwan, and the United States. Commonwealth Fund; 2017.

Estimates of Administrative Complexity and Cost 155 28. Roy A. The myth of Medicare’s ‘low administrative costs.’ Forbes. 2011. 29. Brook R. Medicare-for-All would increase, not save, administrative costs. Forbes. 2017. 30. Jiwani A, Himmelstein D, Woolhandler S, Kahn JG. Billing and insurance-related administrative costs in United States health care: Synthesis of micro-costing evidence. BMC Health Serv Res. 2014;14:556. 31. Casalino LP, Gans D, Weber R, et al. US Physician practices spend more than $15.4 billion annually to report quality measures. Health Aff (Millwood). 2016;35(3):401-406. 32. OECD. Releasing Health Care System Resources—Tackling Ineffective Spending and Waste. 2016. Accessed April 1, 2020. https://read.oecd-ilibrary.org/social-issues-migration-health/ tackling-wasteful-spending-on-health/administration-as-a-share-of-current-health-expenditure-by- financing-scheme-2014-or-nearest-year_9789264266414-graph5-en#page1 33. OECD. A System of Health Accounts 2011. Paris: OECD Publishing; 2017. 34. OECD. Guidelines to Improve Estimates of Expenditure on Health Administration and Health Insurance. Paris: OECD Publishing; 2013. 35. OECD. Tackling Wasteful Spending on Health. Paris: OECD Publishing; 2017:234.

Estimates of Administrative Complexity and Cost 156 Disadoption of Ineffective Medical Services

Table A.16. Disadoption of Ineffective Medical Services

Measure Construct Disadoption of Ineffective Medical Services Description This measure construct, depending on its precise specification, could describe the rate at which the health system identifies ineffective treatments and reduces their availability or utilization in the health system. • Treatment is defined as medical care assigned to a patient to address an illness or injury.1 Treatment includes medications and interventions (e.g., procedures, surgeries, behavioral interventions). • A disproven treatment is a treatment that has fallen out of favor due to evidence overwhelmingly demonstrating that it is more harmful than beneficial. In the literature, this is often referred to as a medical reversal. Medical reversals occur when new evidence (better-designed, -controlled, and/or -powered than predecessors) contradicts the current standard of care.2 Examples of disproven treatments include vitamin E for cardiovascular benefits, beta carotene to prevent cancer, estrogen to prevent Alzheimer’s disease, arthroscopic partial meniscectomy for meniscal tears, stenting for stable heart disease, Provenge to slow the progression of , and gentamicin-collagen sponge for infection prophylaxis in colorectal surgery. • Abandonment could be defined as discontinuing to prescribe or administer. Alternatively, abandonment could be defined as patients no longer receiving the treatment. The process for actually abandoning standard treatments when new evidence contradicts them also involves societal values, cultural tensions, and politics.3 Importance: Health or Population impact: social impact • National: Failure to abandon disproven therapies has not been measured. A similar concept is low-value care, which costs an estimated $75 billion to $100 billion per year in the United States.4 • Global: Review of evidence between 2003 and 2017 identified 2,017 studies of medical practice, 396 of which were medical reversals. 92% of the studies were conducted in high-income countries, and the remaining 8% in mid- or low-income countries.5 Other related estimates involve low-value care, which has been measured in Canada, Australia, Europe, Israel, India, and Korea.6 The World Health Organization estimates that 20–40% of health spending is wasted.7

Clinical impact: • Consequences: Patients can incur harm due to side effects of disproven or ineffective medications they are taking. The continued use of medical practices that do not work wastes resources, jeopardizes patient health, and undermines trust in medicine.2 For example, some women may still take estrogen in an effort to prevent Alzheimer’s disease, but estrogen is known to increase risk of stroke.8

Performance gap: • The American Board of Internal Medicine launched the Choosing Wisely campaign to identify treatments that should not be offered.9 • The UK health system has endeavored to disinvest in more than 800 disproven or low-value treatments in recent years.10

Disadoption of Ineffective Medical Services 157 Measure Construct Disadoption of Ineffective Medical Services Costs: • National/global: It is difficult to quantify the cost of ineffective treatment, but costs for low-value care may provide a proxy. In the United States, the costs for the top five overused clinical activities across three primary care specialties (pediatrics, internal medicine, and family medicine) accounted for $6.76 billion annually. 86% of these costs were due to prescribing brand-name drugs instead of generics.11 Importance: Value-based care: Related U.S. • Low-value medical services are not cost-effective and carry the Department of Health opportunity costs of underutilized but more-effective treatments.12 and Human Services Institutions could provide higher-value care if they stopped priority topics administering costly or harmful therapies soon after they were disproved.

Other indirectly related priorities: Health insurance reform: The continued utilization of disproven treatments is a part of health system waste that curtails the availability and affordability of health insurance.2 Drug pricing: The prices of disproven drugs represent waste and an area in which to improve the cost-effectiveness of the health care system.

Validity Construct validity: • Although there is a common definition for medical reversal, there is disagreement over the wisdom of abandoning these treatments. Medical reversals are based on randomized controlled trials (RCTs), the “gold standard” of evidence; however, RCTs also carry concerns over external validity and generalizability,13 individual patient response not being characterized by the average reported effect,14 and a number of other design issues.15

Discriminant validity: • There could be variation in which treatments are identified as disproven across countries. • The utilization of medical treatments is, in part, a function of the characteristics of the population. Consequently, international comparisons of measures of the utilization of any medical treatment, disproven or not, could be confounded by population characteristics, access to care overall, and subpopulations. Additional threats to validity include nation-to-nation variation in baseline treatment practices and variations in standards of care for different countries. Feasibility for Definitions: international • There is no commonly agreed-upon set of treatments for which the comparisons evidence represents a medical reversal. • There is no commonly agreed-upon definition for the concept of abandonment of disproven treatments. • However, there is international interest in the more-general concept of low-value care, as well as how to measure low-value care (which sometimes includes therapies).6,16

Disadoption of Ineffective Medical Services 158 Measure Construct Disadoption of Ineffective Medical Services Data availability: • Data describing which medical treatments are disproven would need to be generated via regular systematic reviews of the existing literature surrounding treatments. • Data regarding prescription medications and procedures are already collected and reported by many nations. This process could likely be adapted to quantify rates of abandonment of medications and procedures over time. o National: The United States collects data describing use of medications as part of the Medical Expenditure Panel Survey, in state-level databases through the Healthcare Cost and Utilization Project, through private companies like IQVIA, and via Medicare claims. For procedures, the United States collects and submits data via the National Hospital Discharge Survey (inpatient procedures) and the National Survey of Ambulatory Surgery (outpatient procedures).17 o Worldwide: At least 25 countries routinely collect data on prescribed and dispensed medications.18 At least 17 countries provide data on procedures, including coronary angioplasty and stenting, in the inpatient or outpatient setting.19

Data comparability: • Differences in how certain data are collected across countries could threaten comparability. For instance, some countries have national prescription registries, while others collect separate data describing reimbursement and prescription. Other countries have good prescription data for specific subpopulations (i.e., those covered by certain insurance programs) but lack data for other subpopulations.18 Regarding procedures, some nations count the number of main procedures only, so there could be undercounting if patients undergo multiple procedures during the same hospitalization or visit, while in other countries overcounting of procedures could occur because procedures are counted without any restriction.19 • Health system characteristics could play a role in the utilization of disproven treatments. Specifically, if the treatments are costly, there could be incentives to utilize them or to avoid disinvesting in them. An example of this is the drug bevacizumab, which received accelerated U.S. Food and Drug Administration approval for metastatic breast cancer. The cost to each patient was $88,000 per year,20 but the drug was ultimately shown not to improve overall survival.21 • International definitional differences (which would arise if there are not commonly agreed-upon treatments that represent medical reversals or what constitutes an abandonment of the treatment) would also threaten the comparability of the data. Usability: National: Current evidence of use • There are existing measures of low-value care that count the incidence of therapies that are thought to be low yield, including ones promulgated through Choosing Wisely in the United States.16 • Additionally, medical reversal evidence is used by insurers or within health care systems to determine which procedures to cover or allow. For instance, high-dose chemotherapy with autologous bone marrow transplantation for advanced breast cancer was thought to be helpful. Many women with advanced breast cancer demanded that their health insurance plans cover the procedure and sued the companies in court

Disadoption of Ineffective Medical Services 159 Measure Construct Disadoption of Ineffective Medical Services when they did not. Later, a definitive RCT found no benefit, which lead to insurers halting coverage for the procedure.22

Global: • There is no currently accepted measure for abandonment of disproven therapies. However, there are existing measures of low-value care that have been promulgated in the United Kingdom23 and other countries.24 For example, the United Kingdom National Institute for Health and Clinical Excellence identifies low-value activities that could be stopped—for example, because they are not clinically effective (and therefore not cost-effective), have a poor risk-benefit profile, or are not supported by adequate evidence. This work often leads to disinvestment in the disproven treatments.10 Usability: The abandonment of disproven treatments is not among the current Relationship to OECD measures. However, OECD expressed interest in low-value care currently used in a recent publication.28 Organisation for Economic Co-operation Closest related measures: and Development • Caesarean section rates: This measure describes the percentage of (OECD) measures live births that occur via caesarean section. Caesarean sections can be lifesaving and necessary, but the procedure is known to be overutilized in some contexts, and the overutilization is related to financial incentives, liability concerns, and other factors. Consequently, the international comparison of caesarean section rates reflects, in part, the inappropriate utilization of the procedure.25 Because this measure only partly reflects inappropriate use, the national vital statistics data used for this measure would not be relevant in describing the abandonment of low-value treatments.26 • Total volume of antibiotics prescribed: The harms of antibiotics may outweigh the benefits for patients with conditions that are not likely attributable to bacterial infection. OECD tracks the volume of antibiotics so that nations with high prescription rates can consider taking action to achieve lower prescribing rates. • Benzodiazepine prescriptions for older adults: Benzodiazepines can cause falls for older adults, meaning that potential harms tend to outweigh benefits. The OECD measure is designed to influence nations to take action to reduce inappropriate prescribing of potentially harmful therapies.27

References

1. Lexico. Definition of Treatment in English. Undated. Accessed March 30, 2020. https://www.lexico.com/en/definition/treatment 2. Prasad V, Vandross A, Toomey C, et al. A decade of reversal: An analysis of 146 contradicted medical practices. Mayo Clin Proc. 2013;88(8):790-798. 3. Prasad V, Ioannidis JPA. Evidence-based de-implementation for contradicted, unproven, and aspiring healthcare practices. Implement Sci. 2014;9(1):1. 4. OECD. Tackling Wasteful Spending on Health. Paris: OECD Publishing; 2017. 5. Herrera-Perez D, Haslam A, Crain T, et al. A comprehensive review of randomized clinical trials in three medical journals reveals 396 medical reversals. Elife. 2019;8. 6. Brownlee S, Chalkidou K, Doust J, et al. Evidence for overuse of medical services around the world. Lancet. 2017;390(10090):156-168. 7. World Health Organization. WHO Global Health Expenditure Atlas. Geneva; 2014.

Disadoption of Ineffective Medical Services 160 8. Henderson VW, Lobo RA. Hormone therapy and the risk of stroke: Perspectives 10 years after the Women’s Health Initiative trials. Climacteric. 2012;15(3):229-234. 9. Cassel CK, Guest JA. Choosing wisely: Helping physicians and patients make smart decisions about their care. JAMA. 2012;307(17):1801-1802. 10. Garner S, Littlejohns P. Disinvestment from low value clinical interventions: NICEly done? BMJ. 2011;343:d4519. 11. Kale MS, Bishop TF, Federman AD, Keyhani S. “Top 5” lists top $5 billion. Arch Intern Med. 2011;171(20):1856-1858. 12. Korenstein D, Chimonas S, Barrow B, Keyhani S, Troy A, Lipitz-Snyderman A. Development of a conceptual map of negative consequences for patients of overuse of medical tests and treatments. JAMA Intern Med. 2018;178(10):1401-1407. 13. Jüni P, Altman DG, Egger M. Systematic reviews in health care: Assessing the quality of controlled clinical trials. BMJ. 2001;323(7303):42-46. 14. Cheng H. Randomized, controlled trials: Gold or bronze? J Am Med Dir Assoc. 2006;7(9):611-612. 15. Altman DG, Schulz KF, Moher D, et al. The revised CONSORT statement for reporting randomized trials: Explanation and elaboration. Ann Intern Med. 2001;134(8):663-694. 16. ABIM Foundation. Choosing Wisely. 2020. Accessed March 30, 2020. https://www.choosingwisely.org 17. OECD. OECD Health Statistics 2019: Definitions, Sources and Methods, Surgical Procedures (shortlist). 2019. 18. OECD. Using Routinely Collected Data to Inform Pharmaceutical Policies: Analytical Report for OECD and EU Countries. Paris: OECD Publishing; 2019. 19. OECD. Comparing Activities and Performance of the Hospital Sector in Europe: How Many Surgical Procedures Performed as Inpatient and Day Cases? Paris: OECD Publishing; 2012. 20. Selyukh A, Yukhananov A. FDA revokes approval of Avastin for breast cancer. Reuters, 2011. 21. Vitry A, Nguyen T, Entwistle V, Roughead E. Regulatory withdrawal of medicines marketed with uncertain benefits: The Bevacizumab case study. J Pharm Policy Pract. 2015;8:25. 22. Kamerow D. Paying for promising but unproven technologies. BMJ. 2007;335(7627):965. 23. NHS Right Care. The NHS atlas of variation in healthcare: Reducing to increase value and improve quality. Public Health England. 2011. 24. McAlister FA, Lin M, Bakal J, Dean S. Frequency of low-value care in Alberta, Canada: A retrospective cohort study. BMJ Qual Saf. 2018;27(5):340-346. 25. OECD. Health at a Glance 2019: OECD Indicators. Paris: OECD Publishing; 2019. 26. OECD. OECD Health Statistics 2019, Definitions, Sources and Methods. Paris: OECD Publishing; 2019. 27. OECD. Health at a Glance 2019: OECD Indicators, Pharmaceutical Consumption. Paris: OECD Publishing; 2019. 28. Forde I, Nader C. Producing the right health care: Reducing low-value care and adverse events. In: OECD. Tackling Wasteful Spending on Health. Paris: OECD Publishing; 2017:63-114.

Disadoption of Ineffective Medical Services 161

Healthy Days at Home

Table A.17. Healthy Days at Home

Measure Construct Healthy Days at Home Description Healthy days at home (HDAH) is a population-based measure that attempts to quantify how well health care organizations keep people alive, healthy, and not utilizing health care services.1,2 This measure is one of a select few population-based measures of the health care system that attempts to quantify health, as opposed to the lack thereof.2

• The measure is calculated by subtracting the total number of days out of the year that the individual was not alive or was utilizing acute or postacute health care services from 365 days and then calculating the mean number of HDAH for the population of interest.2 • Acute or postacute health care services include inpatient days, observation days, skilled nursing facility days, home health visits, outpatient emergency department visits, inpatient psychiatry days, inpatient rehabilitation days, and days of long-term hospital stays. • Each time the individual utilizes acute or postacute health services counts as 1 day, though some of these services will generally not take the whole day. • Mortality days are counted as the number of days remaining in the calendar year after the date of death. If an individual dies on December 28, mortality days = 3. If an individual is alive for the entire year, mortality days = 0. • Alternative definitions or specifications of the measure consider that home health visits are neither as undesirable nor as costly as the other health services in the measure and reduce the weight of each home health visit.2 • Population: The measure was developed for the full U.S. Medicare population;2 alternative formulations consider subsets of the Medicare population (e.g., those with a cancer diagnosis, those with multiple chronic conditions).3

Importance: Health or Population impact: social impact HDAH is a positive measure, describing the lack of health care service utilization; it is intended to assess overall population health as opposed to health outcomes following an acute event.2 Healthy time at home is an outcome that patients value and reflects a very broad understanding of health and quality of care.2

Clinical impact: • Measures such as HDAH seek to maximize patient experiences and reorient the focus away from procedures and toward the prevention of needs that require a health care response.2,4 • Current measures of health care quality have been criticized for “looking under the streetlight” (i.e., focusing attention on conditions that are easily measured or health care interventions that are considered widely appropriate, to the detriment of other aspects of care that are not measured).5 Additionally, focusing only on acute care events that require hospitalization does not credit health care systems that prevented that hospitalization in the first place.2

Healthy Days at Home 162 Measure Construct Healthy Days at Home • Most individuals at the end of life would prefer to spend their last days at home; however, most do not.6 This measure incorporates more nuance than mortality alone.2

Performance gap: • In a study of a sample of Medicare beneficiaries aged 65 and older, individuals in the worst-performing market had 5.8 fewer adjusted HDAH on average relative to the national mean; those in the best- performing market had 5.0 more HDAH on average relative to the national mean. HDAH is also strongly associated with beneficiary age, gender, and chronic conditions.2

Costs: • Health care spending in the United States is projected to grow 5.5% annually, reaching 19.4% of gross domestic product by 2027.7 Maximizing HDAH would presumably lower costs via reduction in utilization. Importance: Value-based care: Related U.S. The HHS priority to transform our health care system from one that pays Department of Health for procedures and sickness to one that pays for health is reflected in this and Human Services measure. The measure emphasizes efforts to improve health and prevent (HHS) priority topics the utilization of health care services. Validity Construct validity: • The measure is built on the intuitive premise that if consumers have access to care, their lack of utilization of care is indicative of their health.8 The measure was developed for use among a Medicare population, which presumably has access to care. It could be difficult to interpret this measure across countries with different health care payment systems and possible differences in access to care. • The measure is new and therefore has not been extensively studied to show that its variation accurately measures health.2 • One concern with the measure is the level of variation and whether the variation captures health variation across all age groups. For the full population, the utilization of health services will be close to 0, and among that population the measure may not reflect actual health.9

Internal validity: • The appeal of the measure is its simplicity and intuition. However, it is built on the premise of equal and ready access to health care. This implies that if access is not equal or ready, the measure may not accurately reflect the quality of health care. • The measure is new and therefore has not been extensively studied to show that its variation accurately measures the quality of health care.2

Discriminant validity: • Variation in the measure might reflect use of health care services but not HDAH if a population has less access to affordable health care (e.g., an individual who does not seek treatment for a health concern because of costs would appear to be healthy using this measure). • The utilization of health services is, in part, a function of the characteristics of the population. Consequently, international comparisons of the measure could be confounded by population characteristics overall and by subpopulations.

Healthy Days at Home 163 Measure Construct Healthy Days at Home Feasibility for Definitions: international • The measure is new (2020); the original publication provided a precise comparisons definition.2 • Although the measure has been applied to a specific population (Medicare, aged 65+)2 and has been further applied to more-narrow populations,3 it could, in theory, be applied to broader populations. • There are alternative definitions or specifications of the measure that could be explored (e.g., weighting of home health visits).2

Data availability: • The data used in generating the measure are Medicare administrative claims data, the use of which has been shown to be technically feasible.2 Gathering comparable data elements for people under 65 in the United States would likely be more difficult. • Data describing utilization of health services that are used to generate the measure are common to all administrative claims data sources. o National: Medicare, Medicaid, and state-level all-payer claims databases. o Worldwide: As evidenced from hospital admissions data currently employed by the Organisation for Economic Co-operation and Development (OECD), nearly all OECD countries have administrative data describing the utilization of health services;10 however, it is not clear whether all of the elements required to generate comparable measures would be readily available (e.g., date of service, utilization types).

Data comparability: • The specific variables used in constructing the measure are simple, which facilitates its construction and comparability. • Health system characteristics play a role in the utilization of health services. Cost-sharing influences the utilization of health services11 so that utilization might not reflect health. Consequently, the utilization of health services will not be comparable between countries or populations that do and do not require cost-sharing.

Subgroup analysis and equity: • In some countries, data describing health services utilization might not be available (or uniformly available) for the entire population. For instance, some countries have national administrative databases describing health services utilization, while others have data for specific subpopulations (i.e., those covered by certain insurance programs) but lack data for other subpopulations.12 • Additionally, if the cost-sharing requirements for certain subgroups differ, the measure might not be comparable. • This measure could be stratified by the presence of chronic conditions, which could necessitate more health care utilization and fewer HDAH.2 Usability: National: Current evidence of use • The Medicare Payment Advisory Commission commissioned the development of the measure.2 • Similar measures, such as health-related quality of life (HRQoL), have been developed by the Centers for Disease Control and Prevention (CDC) and other organizations and are currently used.13

Healthy Days at Home 164 Measure Construct Healthy Days at Home Global: • This measure has not been used on a global population; however, there have been multiple studies examining similar measures across the globe. For example, a New Zealand study measured days alive and out of the hospital and showed improvement over time.14 • Measures based on the CDC’s HRQoL measure are currently used internationally. For example, the EuroQol EQ-5D measure has been validated and is used across Europe to measure generic health status.15 Usability: HDAH is not among the current OECD measures. In terms of measures Relationship to that positively describe health, self-rated health is the closest. There are currently used OECD many measures describing the prevalence of negative health outcomes measures that, if aggregated and reversed, could be comparable with HDAH. OECD also captures measures related to patient satisfaction with doctors involving that patient in decisions about care, which is tangentially related to HDAH.

Closest related measures: • Self-rated health: Respondents are asked to self-report their health.16 This measure is intuitively similar to HDAH, though HDAH is not self- reported. Consequently, HDAH is likely more objective but might also be less patient centered. • Avoidable hospital admissions: Measures the number of hospital admissions with a primary diagnosis of asthma, chronic obstructive pulmonary disease, and congestive heart failure with the idea that admissions for these diagnoses could be avoidable with better primary care.16 • “Patients reporting having been involved in decisions about care or treatment by their regular doctor” and “Patients reporting having been involved in decisions about care or treatment by any doctor.”10,17

References

1. Medicare Payment Advisory Commission. Chapter 8: Next Steps in Measuring Quality of Care in Medicare. Medicare and the Health Care Delivery System. Report to the Congress. 2015. 2. Burke LG, Orav EJ, Zheng J, Jha AK. Healthy days at home: A novel population-based outcome measure. Healthc (Amst). 2020;8(1):100378. 3. Lam M, Burke LG, Reimold K, Orav EJ, Jha A. Healthy days at home: A population-based quality measure for cancer patients at the end of life? Int J Radiat Oncol Biol Phys. 2018;102(3):S158. 4. Groff AC, Colla CH, Lee TH. Days spent at home—a patient-centered goal and outcome. N Engl J Med. 2016;375(17):1610-1612. 5. Hayford T, Maeda JL. Issues and Challenges in Measuring and Improving the Quality of Health Care. Washington, D.C.: Congressional Budget Office; 2017. 6. Teno JM, Gozalo P, Trivedi AN, et al. Site of death, place of care, and health care transitions among US Medicare beneficiaries, 2000-2015. JAMA. 2018;320(3):264-271. 7. Sisko AM, Keehan SP, Poisal JA, et al. National health expenditure projections, 2018–27: Economic and demographic trends drive spending and enrollment growth. Health Aff (Millwood). 2019;38(3):491-501. 8. Oss ME. Moving to ‘Healthy Days’ as a Measure of Success. 2017. Accessed May 15, 2020. https://www.openminds.com/market-intelligence/executive-briefings/ moving-healthy-days-measure-success 9. Lynn J, Brock J. Time at home as a quality measure. EClinicalMedicine. 2019;11:5-6. 10. OECD. Health at a Glance 2019: OECD Indicators. Paris: OECD Publishing; 2019. 11. Manning WG, Newhouse JP, Duan N, Keeler EB, Leibowitz A, Marquis MS. Health insurance and the demand for medical care: Evidence from a randomized experiment. Am Econ Rev. 1987;77(3):251-277.

Healthy Days at Home 165 12. OECD. Using Routinely Collected Data to Inform Pharmaceutical Policies: Analytical Report for OECD and EU Countries. Paris: OECD Publishing; 2019. 13. Centers for Disease Control and Prevention. Measuring Healthy Days: Population Assessment of Health- Related Quality of Life. Atlanta, GA; 2000. 14. Wasywich CA, Gamble GD, Whalley GA, Doughty RN. Understanding changing patterns of survival and hospitalization for heart failure over two decades in New Zealand: Utility of ‘days alive and out of hospital’ from epidemiological data. Eur J Heart Fail. 2010;12(5):462-468. 15. Brooks R, Rabin R, de Charro F, eds. The Measurement and Valuation of Health Status Using EQ-5D: A European Perspective, Evidence from the EuroQol BIOMED Research Programme. Springer; 2003. 16. OECD. OECD Health Statistics 2019, Definitions, Sources and Methods. Paris: OECD Publishing; 2019. 17. OECD. Health Care Quality Indicators. 2020. Accessed April 3, 2020. https://stats.oecd.org/Index.aspx?QueryId=51879

Healthy Days at Home 166 Availability of Emergency Medical Services to Prevent Opioid Death

Table A.18. Availability of Emergency Medical Services to Prevent Opioid Death

Measure Construct Availability of Emergency Medical Services to Prevent Opioid Death Description Emergency medical services (EMS) are a potential mechanism for provision of naloxone, an opioid antagonist that reverses the effects of opioid overdose. Naloxone is increasingly being used by police officers, emergency medical technicians, and nonemergency first responders to reverse opioid overdoses.1 • EMS: Denotes the pre-hospital component of emergency services and includes out-of-hospital EMS practitioners, such as emergency medical technicians and paramedics (i.e., first responders); initial out-of-hospital treatment; and transport, by air or by ground, to a hospital.2 • The availability of EMS could reduce opioid-related deaths because emergency medical technicians might be able to administer naloxone, which rapidly reverses an opioid overdose; EMS could also be able to coordinate with other treatment services to prevent future overdoses.3 • To measure inpatient emergency department (ED) treatment for opioid overdose, cases are defined as having an International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM) code of one or more discharge codes: 965 (.00, .01, .02, .09), E8580 (.0, .1, .2).4

This measure construct could be operationalized in a number of ways: • the percentage of opioid overdoses that were reversed with naloxone administered by EMS • the percentage of EMS personnel who are trained to administer and are equipped with naloxone • the percentage of people who could be reached by EMS trained to administer and equipped with naloxone within a specified amount of time • the volume of ED admissions for opioid overdose with transport to the ED via EMS. Importance: Health or Population: In 2018, 46,802 Americans died as a result of an opioid social impact overdose, and an estimated 1.7 million people in the United States suffered from substance use disorders related to prescription opioid pain relievers; 526,000 suffered from a heroin use disorder (not mutually exclusive).5 Emergency medical service administration of naloxone can be used as a proxy for estimating opioid overdoses.3 From July 2016 to September 2017, there were 142,557 ED visits for suspected opioid overdose.6

Worldwide, roughly 34 million people used opioids (synthetic narcotic analgesic) and about 19 million used opiates (natural narcotic analgesic) in 2016; roughly 27 million suffered from opioid use disorders (OUDs) in 2016. The majority of people dependent on opioids used illicitly cultivated and manufactured heroin, but an increasing proportion used prescription opioids. Approximately 118,000 people died of OUDs in 2015.7 EMS vary across OECD countries. Decisions on which providers can provide emergency aid, such as naloxone, are determined at a national or subnational level.8

Meaningful clinical impact: The longer the delay between recognition of an overdose and calling emergency services, the greater the risk of

Availability of Emergency Medical Services to Prevent Opioid Death 167 Measure Construct Availability of Emergency Medical Services to Prevent Opioid Death severe damage or death. This problem is exacerbated in areas with poor access to EMS.9 EMS responses for suspected opioid overdose reduce the likelihood that the overdose will be fatal and also increase the likelihood that an opioid user will be referred to treatment.3,10–12 Despite data suggesting that heroin and opioid misuse is stabilizing, ED use continues to increase.6

Performance gap: EDs do not typically have consistent protocols or guidance for what to do after an opioid overdose is resolved.

Costs: The Society of Actuaries estimated that the opioid epidemic cost the United States $179 billion in 2018; $72.6 billion of that cost was attributable to mortality costs (lost lifetime earnings).13 • National: Caring for all opioid overdoses in the ED costs more than $632 million annually.14 • Global: Estimating costs is dependent on whether the measure captures the costs of medication, associated health services, or both.9 Importance: Opioid crisis Related U.S. The opioid crisis is an HHS priority topic, and this measure directly Department of Health addresses the goal of reducing deaths from opioid overdoses, as well as and Human Services improving access to naloxone and increasing referrals to additional (HHS) priority topics treatment programs.

Validity Measurement of the time of response to opioid overdose EMS calls or the availability of EMS could be biased by individuals’ unwillingness to call EMS during an overdose. Examples include an ability to administer naloxone and supervise recovery without EMS support, fear of arrest or incarceration (even in the presence of Good Samaritan laws), distrust of police and the legal system, avoidance of costly EMS interventions, and an unwillingness to draw unwanted attention with an EMS call and response.15 Measures such as the percentage of EMS calls for opioid overdose that do not result in overdose death can vary based on cultural differences by country in the factors described above. Greater attention to quality control of EMS records will enhance the internal validity of these data. Linking data to toxicology results and patient outcomes will further validate the data.3 Feasibility for Definitions: There is no common definition, nor is there a well-defined international measurement, for this concept.16 A measure could be constructed using a comparisons subset of existing data on EMS availability,17 limited to responses for opioid overdoses (e.g., “time of response” data for EMS runs to opioid overdose calls, percentage of EMS runs for opioid overdoses that result in death). However, even within the wider field of prehospital emergency care, there are very few performance metrics that are generalizable or widely used. Although there is interest in measurement of this aspect of the health care system, development of such measures is in the early phases.16

Data availability: The United States lacks strong opioid abuse and overdose surveillance systems. The National Survey of Substance Abuse Treatment Services (N-SSATS) collects data on the location, characteristics, and use of treatment facilities at the state level. It tracks the number and location of facilities that provide emergency medical treatment. In the United States, there have been several national18 and state-based19,20 studies of the distribution of EMS and performance;

Availability of Emergency Medical Services to Prevent Opioid Death 168 Measure Construct Availability of Emergency Medical Services to Prevent Opioid Death however, these metrics are varied and generally are limited to availability of EMS in general rather than specifically for opioid overdoses.

Some countries collect more-robust data from EMS providers and systems; however, others have less-developed data systems.21–26 Additionally, some countries do not have EMS systems in place.27

EMS departments could provide administrative data for this measurement concept, but it is unclear how many are collecting all of the elements that would be needed to fulfill this measurement concept.

Data comparability: Without defined measurements, it is difficult to assess data comparability across countries. Additionally, the organizational structure and functions of EMS vary from country to country, which will also have an impact on data comparability.

Subgroup analysis: There is evidence of disparities in naloxone administration by EMS providers in rural communities.28 Generally, EMS response times and availability vary by urbanicity; stratifying results by rural, urban, and suburban regions would provide additional insights for this topic.29 Usability: This measure is not currently in use on a global or national level.16 Current evidence of use • The Centers for Disease Control and Prevention tracks ED visits for suspected opioid overdoses.30 • The Australian Institute of Health and Welfare tracks the rate of emergency admissions for opioid dependence by age, socioeconomic group, urbanicity, and degree of urgency.31 Usability: OECD currently collects the following data for distantly related concepts, Relationship to but none approach the information that is needed for this concept. These currently used OECD measures would be helpful in establishing the extent of opioid abuse and measures the risk for overdose deaths but not this specific measurement concept. • availability of analgesic opioids • opioid-related deaths; overall volume of opioids prescribed • proportion of population who are chronic opioid users.

References

1. U.S. Department of Health and Human Services, Office of the Surgeon General. U.S. Surgeon General’s Advisory on Naloxone and Opioid Overdose. 2018. Accessed April 1, 2020. https://www.hhs.gov/surgeongeneral/priorities/opioids-and-addiction/naloxone-advisory/index.html 2. National Quality Forum. Regionalized Emergency Medical Care Services: Phase I 2012 Final Report. Washington, D.C.; 2012. 3. Knowlton A, Weir BW, Hazzard F, et al. EMS runs for suspected opioid overdose: Implications for surveillance and prevention. Prehosp Emerg Care. 2013;17(3):317-329. 4. Walley AY, Xuan Z, Hackman HH, et al. Opioid overdose rates and implementation of overdose education and nasal naloxone distribution in Massachusetts: Interrupted time series analysis. BMJ. 2013;346:f174. 5. Wilson N, Kariisa M, Seth P, Smith H, IV, Davis NL. Drug and opioid-involved overdose deaths—United States, 2017–2018. MMWR Morb Mortal Wkly Rep. 2020;69:290–297. 6. Vivolo-Kantor AM, Seth P, Gladden RM, et al. : Trends in emergency department visits for suspected opioid overdoses—United States, July 2016–September 2017. MMWR Morb Mortal Wkly Rep. 2018;67(9):279-285. 7. World Health Organization. Information Sheet on Opioid Overdose. 2018. Accessed April 3, 2020. https://www.who.int/substance_abuse/information-sheet/en

Availability of Emergency Medical Services to Prevent Opioid Death 169 8. OECD. Addressing Problematic Opioid Use in OECD Countries. Paris: OECD Publishing; 2019. 9. Strang J, McDonald R, eds. Preventing Opioid Overdose Deaths with Take-Home Naloxone. Luxembourg: European Monitoring Centre for Drugs and Drug Addiction, 2016. 10. Barnett PG, Masson CL, Sorensen JL, Wong W, Hall S. Linking opioid-dependent hospital patients to drug treatment: Health care use and costs 6 months after randomization. Addiction. 2006;101(12):1797-1804. 11. Fairbairn N, Coffin PO, Walley AY. Naloxone for heroin, prescription opioid, and illicitly made fentanyl overdoses: Challenges and innovations responding to a dynamic epidemic. Int J Drug Policy. 2017;46:172- 179. 12. Faul M, Lurie P, Kinsman JM, Dailey MW, Crabaugh C, Sasser SM. Multiple naloxone administrations among emergency medical service providers is increasing. Prehosp Emerg Care. 2017;21(4):411-419. 13. Davenport S, Weaver A, Caverly M. Economic Impact of Non-Medical Opioid Use in the United States: Annual Estimates and Projections for 2015 Through 2019. Society of Actuaries; 2019. 14. Premier Inc. Opioid Overdoses Costing U.S. Hospitals an Estimated $11 Billion Annually. 2019. Accessed April 2, 2020. https://www.premierinc.com/newsroom/press-releases/ opioid-overdoses-costing-u-s-hospitals-an-estimated-11-billion-annually 15. Koester S, Mueller SR, Raville L, Langegger S, Binswanger IA. Why are some people who have received overdose education and naloxone reticent to call emergency medical services in the event of overdose? Int J Drug Policy. 2017;48:115-124. 16. Howard I, Cameron P, Wallis L, Castren M, Lindstrom V. Quality indicators for evaluating prehospital emergency care: A scoping review. Prehosp Disaster Med. 2018;33(1):43-52. 17. Gale J, Coburn A, Pearson K, Croll Z, Shaler G. Developing program performance measures for rural emergency medical services. Prehosp Emerg Care. 2017;21(2):157-165. 18. Crandall M. Rapid emergency medical services response saves lives of persons injured in motor vehicle crashes. JAMA Surg. 2019;154(4):293-294. 19. Brown JB, Rosengart MR, Peitzman AB, Billiar TR, Sperry JL. Defining geographic emergency medical services coverage in trauma systems. J Trauma Acute Care Surg. 2019;87(1):92-99. 20. He Z, Qin X, Renger R, Souvannasacd E. Using spatial regression methods to evaluate rural emergency medical services (EMS). Am J Emerg Med. 2019;37(9):1633-1642. 21. Rahman NH, Tanaka H, Shin SD, et al. Emergency medical services key performance measurement in Asian cities. Int J Emerg Med. 2015;8(1):12. 22. Pappinen J, Laukkanen-Nevala P, Mäntyselkä P, Kurola J. Development and implementation of a geographical area categorisation method with targeted performance indicators for nationwide EMS in Finland. Scand J Trauma Resusc Emerg Med. 2018;26(1):41. 23. Moafa HN, Kuijk SMJv, Franssen GHLM, Moukhyer ME, Haak HR. What is known about the quality of out- of-hospital emergency medical services in the Arabian Gulf states? A systematic review. PLoS One. 2019;14(12):e0226230. 24. Xia T, Song X, Zhang H, Song X, Kanasugi H, Shibasaki R. Measuring spatio-temporal accessibility to emergency medical services through big GPS data. Health Place. 2019;56:53-62. 25. Bélanger V, Ruiz A, Soriano P. Recent optimization models and trends in location, relocation, and dispatching of emergency medical vehicles. Eur J Oper Res. 2019;272(1):1-23. 26. Husum H, Gilbert M, Wisborg T, Van Heng Y, Murad M. Rural prehospital trauma systems improve trauma outcome in low-income countries: A prospective study from North Iraq and Cambodia. J Trauma. 2003;54(6):1188-1196. 27. Mould-Millman NK, Dixon JM, Sefa N, et al. The state of emergency medical services (EMS) systems in Africa. Prehosp Disaster Med. 2017;32(3):273-283. 28. Faul M, Dailey MW, Sugerman DE, Sasser SM, Levy B, Paulozzi LJ. Disparity in naloxone administration by emergency medical service providers and the burden of drug overdose in US rural communities. Am J Public Health. 2015;105(Suppl 3):e26-e32. 29. Mell HK, Mumma SN, Hiestand B, Carr BG, Holland T, Stopyra J. Emergency medical services response times in rural, suburban, and urban areas. JAMA Surg. 2017;152(10):983-984. 30. Houry DE, Haegerich TM, Vivolo-Kantor A. Opportunities for prevention and intervention of opioid overdose in the emergency department. Ann Emerg Med. 2018;71(6):688-690. 31. Australian Institute of Health and Welfare. Opioid Harm in Australia and Comparisons Between Australia and Canada. Canberra; 2018.

Availability of Emergency Medical Services to Prevent Opioid Death 170 Clinician Workforce Who Can Prescribe Medication-Assisted Treatment or Naloxone

Table A.19. Clinician Workforce Who Can Prescribe Medication-Assisted Treatment or Naloxone

Clinician Workforce Who Can Prescribe Medication Assisted Measure Construct Treatment or Naloxone Description Medication-assisted treatment (MAT) is the most effective medical treatment for opioid use disorder (OUD) and other substance use disorders (SUDs), including alcohol.1 Three medications have been approved by the U.S. Food and Drug Administration (FDA) to treat OUD: methadone, buprenorphine, and naltrexone. Additionally, the FDA has approved naloxone, an injectable drug used to prevent opioid overdose.2 Historically, the primary treatment for OUD was methadone, which was only administered by accredited opioid treatment programs (OTPs).3 However, barriers to methadone treatment remain, including locations of OTPs, provider shortages, and treatment waitlists.4 Naltrexone can be prescribed by any licensed physician, but patients must be abstinent for 7 days prior to treatment.5 Since the Drug Addiction Treatment Act of 2000, buprenorphine can be prescribed in any location by qualified physicians who have applied and received a Substance Abuse and Mental Health Services Administration (SAMHSA) waiver.6

• MAT is the use of medications, in combination with counseling and behavioral therapies, to provide a “whole-patient” approach to the treatment of SUDs. MAT is primarily used in the treatment of addiction to opioids but is also used for alcohol dependence.2 • Sometimes referred to as “opioid abuse or dependence” or “opioid addiction,” OUD is a problematic pattern of opioid use that causes significant impairment or distress.7 • SUDs occur when the recurrent use of alcohol or drugs causes clinically significant impairment, including health problems; disability; and failure to meet major responsibilities at work, school, or home.8

Importance: Health or Population impact: social impact • National: The misuse of and addiction to opioids is a major public health crisis in the United States, causing over 1.6 million years of life lost annually, more than the burden attributable to homicides, hypertension, HIV/AIDS, and pneumonia.9 As of 2018, 42.3% of opioid treatment centers offered MAT.10 Despite the prescribing options available, estimates suggest that only 20–40% of people with OUD receive MAT.11 Much of this treatment gap is attributed to the workforce, specifically (1) insufficient prescriber training, (2) lack of institutional support, (3) poor care coordination, (4) provider stigma, (5) inadequate reimbursement, and (6) burdensome regulatory procedures. Consequently, the size of the clinician workforce who can prescribe MAT is a critical variable in effectively addressing the ongoing opioid crisis.12 • Global: While the opioid epidemic is most pronounced in the United States, more and more countries are seeing growing numbers of OUDs and overdose-related deaths.13 The United Nations 2017 report on drug abuse reports that more than 200 million people, or 4.2% of the world population, are addicted to illegal drugs.14

Clinician Workforce Who Can Prescribe Medication-Assisted Treatment or Naloxone 171 Clinician Workforce Who Can Prescribe Medication Assisted Measure Construct Treatment or Naloxone Clinical impact: • Being diagnosed with an OUD increases the risk of early death by a factor of 20.15 MAT is the most effective treatment for OUD.1

Performance gap: • In 2018, 2 million people in the United States were diagnosed with an OUD.16 However, the capacity to treat OUD remains at less than 50% of the total number of people diagnosed with OUD.4 Only 28% of opioid overdose survivors are linked to MAT despite evidence of its effectiveness.17 • Rural populations are particularly underserved—60% of small, nonmetropolitan county residents live in an opioid treatment shortage area.18

Costs: • National: In the United States, recent estimates suggest that the costs of the opioid epidemic exceed $500 billion or 2.8% of gross domestic product. Wide disparities in Medicaid coverage of MAT across states have implications for access because OUD predominantly affects low- income populations. • Global: Because the global opioid epidemic is in its nascent stage, the global costs have not yet been realized or projected. But there is evidence that drug companies are applying tactics used in the United States to increase opioid sales in Asia and Europe.19 Importance: Opioid crisis: Related U.S. • HHS is committed to ending the crisis of opioid addiction and overdose Department of Health in the United States. One point of HHS’s 5-point strategy to combat the and Human Services opioid crisis is “better addiction prevention, treatment, and recovery (HHS) priority topics services.” The clinician workforce is critical to providing better treatment and recovery services.

Other related priorities: • Value-based care: Integrating MAT into general medical practices could increase access, helping to transform our health care system from one that pays for procedures and sickness to one that pays for outcomes and health, but low reimbursement levels disincentivize providers from offering MAT.20 Validity Construct validity: • The measure is built on the premise that a greater number of authorized MAT prescribers will increase the number that can access, and access quickly, effective treatments for OUD.12 • However, given the effectiveness (or potential effectiveness) of other public health approaches to reduce the prevalence of SUD in the population,21 increasing the number of authorized MAT prescribers might not be a necessary condition for the improvement of health as it relates to OUD.

Internal validity: • The capacity of the health care system to deliver proven, effective treatments is a critical component of the quality of health care as available to the consumer.

Clinician Workforce Who Can Prescribe Medication-Assisted Treatment or Naloxone 172 Clinician Workforce Who Can Prescribe Medication Assisted Measure Construct Treatment or Naloxone Discriminant validity: • Greater MAT prescribing capacity might reflect the greater population need rather than the quality of the health care system. Consequently, the measure could be biased against countries where OUD and other SUDs are less prevalent. Bias in the measure would be prevented by accounting for the prevalence of OUD in the population. • Greater prevalence of diagnosed OUD and other SUDs might reflect diagnostic differences rather than actual use and abuse of substances. • Additionally, greater prevalence of OUD and other SUDs could reflect elements of the public health system (e.g., laws) rather than the health care system. Feasibility for Definitions: international • The World Health Organization’s official recommendation for the comparisons treatment of OUD is “the use of a range of treatment options for opioid dependence which include psychosocial support, opioid maintenance treatments such as methadone and buprenorphine, supported detoxification and treatment with opioid antagonists such as naltrexone.”22 • Each country has different regulations on who can prescribe MAT. For example, in Canada and Europe, buprenorphine and methadone can be prescribed by a pharmacist, but in the United States the majority of prescriptions are by specialist physicians.23 Any international differences in the definition of OUD and in who is authorized to prescribe MAT could influence the needs and capacities of different countries.

Data availability: • National: o Capacity needs could be assessed with regularly updated surveys on drug use, such as the National Survey on Drug Use and Health (NSDUH).24 o The National Survey of Substance Abuse Treatment Services (N- SSATS) is an annual survey conducted by SAMHSA that captures detailed information on all known substance abuse treatment facilities throughout the United States, including OTPs.25 o SAMHSA maintains a database describing all physicians that have received waivers to prescribe buprenorphine.4 • Global: o MAT is available in 80 countries around the world.26 o Many European countries27 and other OECD countries28 regularly field surveys like the NSDUH that attempt to describe licit and illicit drug use in their populations. o In many European and other OECD countries, methadone treatment is available via dedicated facilities (like OTPs) or via primary care providers or others.29 Consequently, in many locations the capacity of authorized prescribers could be assessed with administrative data.

Data comparability: • Governmental and public health system characteristics could play a role in the capacity needs of each country. For instance, in some countries where drugs have been decriminalized (e.g., Portugal), overdoses and infections have been reduced, reducing the needs for physicians authorized to prescribe MAT.21

Clinician Workforce Who Can Prescribe Medication-Assisted Treatment or Naloxone 173 Clinician Workforce Who Can Prescribe Medication Assisted Measure Construct Treatment or Naloxone • Health system characteristics might play a role in the capacity needs of each country. For instance, in many European and other OECD countries, OTPs are not necessary because primary care physicians and others are authorized prescribers.29 • International definitional differences (which would arise if there were not commonly agreed-upon standards for OUD diagnoses) would also threaten the comparability of the data. Usability: National: Current evidence of use • There is no currently accepted measure for the clinician workforce who can prescribe MAT. • The National Quality Forum measures the initiation and engagement of alcohol and other drug abuse or dependence treatment, but this measure does not involve the workforce size or capacity.30 • The Joint Commission uses the percentage of those with an acute opioid disorder (AOD) diagnosis who receive or refuse a MAT or referral at hospital, which is comparable to the National Quality Forum’s AOD treatment provided or offered at discharge from inpatient hospitalization.31 • The National Survey of Substance Abuse Treatment Services collects data on gross measures of organizational structure, such as the percentage of referrals, but does not measure a program’s ability to prescribe medications. Nor is implementation measured, which could lead to inflated inferences about how therapies are used.32 Global: • There is no currently accepted measure for the clinician workforce who can prescribe MAT. • The Canadian Institute for Health Information does measure the hospital stays for harm caused by substance use, but this measure does not capture the workforce size or capacity.33 • The Australian Institute of Health and Welfare tracks referral to treatment by treatment source, such as family, law enforcement, or a health professional. It also tracks the different types of treatment to which patients are referred, such as whether MAT is combined with counseling.34 Usability: A measure of the clinician workforce who can prescribe MAT is not Relationship to among the current OECD measures. currently used OECD measures Closest related measures: • Opioid use: These measures describe the availability of analgesic opioids and the rate of opioid-related deaths. Therefore, these measures describe the population need for a clinician workforce who can prescribe MAT.35 • Opioid-related deaths: The European Monitoring Centre for Drugs and Drug Addiction collects these data and shares them with OECD.36 • Safe primary care prescribing: OECD tracks the volume of opioids prescribed and the proportion of chronic opioid users. Again, these measures describe the population need for a clinician workforce who can prescribe MAT.35

Clinician Workforce Who Can Prescribe Medication-Assisted Treatment or Naloxone 174 References

1. World Health Organization. Guidelines for the Psychosocially Assisted Pharmacological Treatment of Opioid Dependence. Geneva; 2009. 2. U.S. Department of Health and Human Services, Substance Abuse and Mental Health Services Administration. MAT Medications, Counseling, and Related Conditions. 2020. Accessed April 1, 2020. https://www.samhsa.gov/medication-assisted-treatment/treatment#medications-used-in-mat 3. American Society of Addiction Medicine. Advancing Access to Addiction Medications: Implications for Opioid Addiction Treatment. 2013. 4. Jones CM, Campopiano M, Baldwin G, McCance-Katz E. National and state treatment need and capacity for opioid agonist medication-assisted treatment. Am J Public Health. 2015;105(8):e55-e63. 5. Schuckit MA. Treatment of opioid-use disorders. N Engl J Med. 2016;375(4):357-368. 6. Public Law No: 106–310. Children’s Health Act of 2000. 2000. 7. Centers for Disease Control and Prevention. Prevent Opioid Use Disorder. 2017. Accessed April 2, 2020. https://www.cdc.gov/drugoverdose/prevention/opioid-use-disorder.html 8. U.S. Department of Health and Human Services, Substance Abuse and Mental Health Services Administration. Mental Health and Substance Use Disorders. 2020. Accessed April 1, 2020. https://www.samhsa.gov/find-help/disorders 9. Gomes T, Tadrous M, Mamdani MM, Paterson JM, Juurlink DN. The burden of opioid-related mortality in the United States. JAMA Netw Open. 2018;1(2):e180217. 10. U.S. Department of Health and Human Services, Substance Abuse and Mental Health Services Administration. National Survey of Substance Abuse Treatment Services (N-SSATS): 2018. Data on Substance Abuse Treatment Facilities. Rockville, MD: Substance Abuse and Mental Health Services Administration; 2019. 11. Lembke A, Chen JH. Use of opioid agonist therapy for Medicare patients in 2013. JAMA Psychiatry. 2016;73(9):990-992. 12. Haffajee RL, Bohnert ASB, Lagisetty PA. Policy pathways to address provider workforce barriers to buprenorphine treatment. Am J Prev Med. 2018;54(6 Suppl 3):S230-S242. 13. Vashishtha D, Mittal ML, Werb D. The North American opioid epidemic: Current challenges and a call for treatment as prevention. Harm Reduct J. 2017;14(1):7. 14. Merz F. United Nations Office on Drugs and Crime: World Drug Report 2017. SIRIUS-Zeitschrift für Strategische Analysen; 2018. 15. Degenhardt L, Larney S, Kimber J, et al. The impact of opioid substitution therapy on mortality post- release from prison: Retrospective data linkage study. Addiction. 2014;109(8):1306-1317. 16. U.S. Department of Health and Human Services, Substance Abuse and Mental Health Services Administration. Key Substance Use and Mental Health Indicators in the United States: Results from the 2018 National Survey on Drug Use and Health, Rockville, MD: Center for Behavioral Health Statistics and Quality, Substance Abuse and Mental Health Services Administration; 2019. 17. Larochelle MR, Bernson D, Land T, et al. Medication for opioid use disorder after nonfatal opioid overdose and association with mortality: A cohort study. Ann Intern Med. 2018;169(3):137-145. 18. Dick AW, Pacula RL, Gordon AJ, et al. Growth in buprenorphine waivers for physicians increased potential access to opioid agonist treatment, 2002-11. Health Aff (Millwood). 2015;34(6):1028-1034. 19. Humphreys K, Caulkins JP, Felbab-Brown V. Opioids of the masses: Stopping an American epidemic from going global. Foreign Affairs. 2018;97:118. 20. National Academies of Sciences, Engineering, and Medicine. Medication-Assisted Treatment for Opioid Use Disorder. 2018. 21. Greenwald G. Drug Decriminalization in Portugal: Lessons for Creating Fair and Successful Drug Policies. Cato Institute Whitepaper Series; 2009. 22. World Health Organization. Information Sheet on Opioid Overdose. 2018. Accessed April 1, 2020. https://www.who.int/substance_abuse/information-sheet/en 23. DiPaula BA, Menachery E. Physician-pharmacist c ollaborative care model for buprenorphine-maintained opioid-dependent patients. J Am Pharm Assoc. 2015;55(2):187-192. 24. U.S. Department of Health and Human Services, Substance Abuse and Mental Health Services Administration, Center for Behavioral Health Statistics and Quality. National Survey on Drug Use and

Clinician Workforce Who Can Prescribe Medication-Assisted Treatment or Naloxone 175 Health, 2003-2012 (ICPSR 34933-v1). Ann Arbor, MI: Inter-University Consortium for Political and Social Research; 2013. 25. U.S. Department of Health and Human Services, Substance Abuse and Mental Health Services Administration. National Survey of Substance Abuse Treatment Services (N-SSATS): 2007. Data on Substance Abuse Treatment Facilities. InDASIS Series: S-44, DHHS Publication No.(SMA) 08–4348. Rockville, MD; 2008. 26. Harm Reduction International. The Global State of Harm Reduction 2014. 2014. Accessed April 1, 2020. https://www.hri.global/contents/1524 27. Decorte T, Mortelmans D, Tieberghien J, De Moor S. Drug Use: Overview of General Population Surveys in Europe. Lisbon: EMCDDA; 2009. 28. Begin P, Weekes J, Thomas G. The Canadian Addiction Survey: Substance use and misuse among the Canadian population. InForum on Corrections Research. 2006;18(1):12. 29. Torrens M, Fonseca F, Castillo C, Domingo-Salvany A. Methadone maintenance treatment in Spain: The success of a harm reduction approach. Bull World Health Organ. 2013;91(2):136-141. 30. National Quality Forum. Initiation and Engagement of Alcohol and Other Drug Abuse or Dependence Treatment. Undated. 31. Williams AR, Nunes EV, Bisaga A, et al. Developing an opioid use disorder treatment cascade: A review of quality measures. J Subst Abuse Treat. 2018;91:57-68. 32. Knudsen HK, Abraham AJ, Roman PM. Adoption and implementation of medications in addiction treatment programs. J Addict Med. 2011;5(1):21-27. 33. Canadian Institute for Health Information. Hospital Stays for Harm Caused by Substance Use. Undated. Accessed April 3, 2020. http://indicatorlibrary.cihi.ca/pages/viewpage.action?pageId=15565197 34. Australian Institute of Health and Welfare. Alcohol and Other Drug Treatment Services in Australia 2017– 18, Drug Treatment Series No. 33. Cat. No. HSE 230. 2019. 35. OECD. Health at a Glance 2019: OECD Indicators. Paris: OECD Publishing; 2019. 36. OECD. Addressing Problematic Opioid Use in OECD Countries. Paris: OECD Publishing; 2019.

Clinician Workforce Who Can Prescribe Medication-Assisted Treatment or Naloxone 176 Access to Opioid Treatment Centers

Table A.20. Access to Opioid Treatment Centers

Measure Construct Access to Opioid Treatment Centers Description Access to treatment facilities (for substance use disorders [SUDs], specifically opioid use disorders [OUDs]) is defined as the ability to offer same-day or walk-in appointments in the outpatient setting and the ability to optimize resources, refer patients, and support them if the necessary level of care is not immediately available.1 Importance: Health or Population impact: social impact • National incidence: Of the 19.9 million adults who needed treatment for an SUD in 2016 (inclusive of but not limited to opioid use), only 2.1 million (10.8%) received addiction treatment.2 Structural barriers and stigma inhibit access.3 Client outreach varies widely between states, ranging from 47% in Wisconsin to 85% in Montana and Oklahoma.4 • Although approximately 33,000 physicians have obtained the waiver needed to prescribe medications on U.S. Food and Drug Administration–approved (FDA-approved) Schedules II, IV, or B for treating OUDs, fewer than half offer this treatment to patients.5 • Nearly all U.S. states do not have sufficient treatment capacity to provide medication-assisted treatment (MAT) to all patients with an OUD.6

Clinical impact: • Increasing access to medications for OUD treatment is widely acknowledged to be a key strategy for addressing the opioid epidemic.7–9 The use of OUD medications is associated with reductions in opioid use, withdrawal and craving, infectious disease transmission, and treatment dropout.10–15 • Outpatient treatment facilities are particularly important for the treatment of SUDs because only 13% of individuals who receive treatment do so in a private physician’s office.16

Performance gap: • Almost all states and the District of Columbia (96%) had opioid abuse or dependence rates higher than their buprenorphine treatment capacity rates; 19 states had a gap of at least 5 per 1,000 people.6 • A review of national survey data found that less than 20% of persons with OUD have used any SUD service in a given year.17 A separate analysis found that OUD medication treatment capacity only has the potential to cover about 61% of those in need.6

Costs: • National: High out-of-pocket costs and access to a provider are both barriers to accessing treatment.18 Individuals accessing opioid treatment tend to have comorbidities that increase health care utilization and costs. The costs of treatment alone do not account for the higher costs.19 Importance: Opioid crisis: Related U.S. The availability of opioid treatment centers is directly related to this HHS Department of Health priority and contributes to a multifaceted response to addressing the and Human Services opioid crisis. (HHS) priority topics

Access to Opioid Treatment Centers 177 Measure Construct Access to Opioid Treatment Centers Other related priorities: Value-based care: The HHS priority to transform our health care system from one that pays for procedures and sickness to one that pays for outcomes and health relates to access to opioid treatment centers because of the increased access to long-acting MAT and assignment of case managers to addicted patients. These additional steps have lessened the need for emergency medical treatment of opioid overuse.20 Validity Construct validity: • The availability of opioid treatment centers has high construct validity because it captures the presence or absence of treatment facilities. Access to opioid treatment centers is sometimes measured by utilization of services, which leaves room for more interpretation and somewhat lowered construct validity.

Internal validity: • Because access is a component of quality of care, a measure of access to opioid treatment centers would have high internal validity as a measure of care quality. Feasibility for Definitions: international • It is challenging when estimating drug treatment access to isolate drug- comparisons specific data (e.g., treatment for OUD) from broader data sets. Additional modeling could be required if data from international sources are going to be used to estimate drug-specific expenditures.21

Data availability: • National accountancy and reporting systems might record public but not private expenditure data on drug treatment, which can be linked to access. Additional research would need to be done using claims data.21

Data comparability: International definitional differences and approaches to isolating data specific to opioid treatment center access could threaten the comparability of the data. Usability: Current evidence of the use of measures related to accessing opioid Current evidence of use treatment centers includes the following (not exhaustive): • Access to opioid treatment is measured by the National Survey on Drug Use and Health (NSDUH) by the number of people aged 12 or older who needed substance abuse treatment in the past year (inclusive of opioid use) and the number who received any or specialty treatment.22 • There is no currently accepted measure for access to opioid treatment. The NSDUH measures the need for and receipt of specialty substance abuse treatment in the past year but does not specify whether specialty treatment includes MAT. • A validated instrument based on World Health Organization policy guidelines identified barriers to treatment in 11 European countries.23 Usability: Access to opioid treatment is not among the current OECD measures. Relationship to currently used Closest related measures: Organisation for • OECD collects data on opioid access and related deaths but not access Economic Co-operation to treatment. In its reports, OECD urges that MAT should be part of any and Development long-term comprehensive treatment and rehabilitation program. MAT is (OECD) measures available in all OECD countries except Japan and Korea.24

Access to Opioid Treatment Centers 178 References

1. National Quality Forum. Opioids and Opioid Use Disorder: Quality Measurement Priorities. 2020. 2. Park-Lee E, Lipari RN, Hedden SL, Copello EAP, Kroutil LA. Receipt of Services for Substance Use and Mental Health Issues Among Adults: Results from the 2015 National Survey on Drug Use and Health. NSDUH Data Review; 2016. 3. National Academies of Sciences, Engineering, and Medicine. Medication-Assisted Treatment for Opioid Use Disorder. 2018. 4. U.S. Department of Health and Human Services, Substance Abuse and Mental Health Services Administration. National Survey of Substance Abuse Treatment Services (N-SSATS): 2018. Data on Substance Abuse Treatment Facilities. Rockville, MD: Substance Abuse and Mental Health Services Administration; 2019. 5. McCance-Katz EF, George P, Scott NA, Dollase R, Tunkel AR, McDonald J. Access to treatment for opioid use disorders: Medical student preparation. Am J Addict. 2017;26(4):316-318. 6. Jones CM, Campopiano M, Baldwin G, McCance-Katz E. National and state treatment need and capacity for opioid agonist medication-assisted treatment. Am J Public Health. 2015;105(8):e55-e63. 7. Rudd RA, Aleshire N, Zibbell JE, Gladden RM. Increases in drug and opioid overdose deaths—United States, 2000-2014. MMWR Morb Mortal Wkly Rep. 2016;64(50-51):1378-1382. 8. U.S. Department of Health and Human Services, Office of the Assistant Secretary for Planning and Evaluation. ASPE Issue Brief: Opioid Abuse in the U.S. and HHS Actions to Address Opioid-Drug Related Overdoses and Deaths. Washington, D.C.: U.S. Department of Health and Human Services; 2015. 9. Strang J, Babor T, Caulkins J, Fischer B, Foxcroft D, Humphreys K. Drug policy and the public good: Evidence for effective interventions. Lancet. 2012;379(9810):71-83. 10. Amato L, Minozzi S, Davoli M, Vecchi S. Psychosocial combined with agonist maintenance treatments versus agonist maintenance treatments alone for treatment of opioid dependence. Cochrane Database Syst Rev. 2011(10):CD004147. 11. Amato L, Minozzi S, Davoli M, Vecchi S. Psychosocial and pharmacological treatments versus pharmacological treatments for opioid detoxification. Cochrane Database Syst Rev. 2011(9):CD005031. 12. Comer SD, Sullivan MA, Yu E, et al. Injectable, sustained-release naltrexone for the treatment of opioid dependence: A randomized, placebo-controlled trial. Arch Gen Psychiatry. 2006;63(2):210-218. 13. Krupitsky E, Nunes EV, Ling W, Illeperuma A, Gastfriend DR, Silverman BL. Injectable extended-release naltrexone for opioid dependence: A double-blind, placebo-controlled, multicentre randomised trial. Lancet. 2011;377(9776):1506-1513. 14. Fiellin DA, Pantalon MV, Chawarski MC, et al. Counseling plus buprenorphine-naloxone maintenance therapy for opioid dependence. N Engl J Med. 2006;355(4):365-374. 15. Ziedonis DM, Amass L, Steinberg M, et al. Predictors of outcome for short-term medically supervised during a randomized, multicenter trial of buprenorphine-naloxone and clonidine in the NIDA Clinical Trials Network. Drug Alcohol Depend. 2009;99(1- 3):28-36. 16. Wallack SS, Thomas CP, Martin TC, Chilingerian J, Reif S. Substance abuse treatment organizations as mediators of social policy: Slowing the adoption of a congressionally approved medication. J Behav Health Serv Res. 2010;37(1):64-78. 17. Saloner B, Karthikeyan S. Changes in substance abuse treatment use among individuals with opioid use disorders in the United States, 2004-2013. JAMA. 2015;314(14):1515-1517. 18. Mackey K, Veazie S, Anderson J, Bourne D, Peterson K. Evidence Brief: Barriers and Facilitators to Use of Medications for Opioid Use Disorder. Washington, D.C.: U.S. Department of Veterans Affairs; 2019. 19. Association of State and Territorial Health Officials. Vermont Case Study Medication Assisted Treatment Program for Opioid Addiction. Undated. 20. Barrett J, Li M, Spaeth-Rublee B, Pincus H. Value-based payment as part of a broader strategy to address opioid addiction crisis. Health Affairs Blog. 2017. 21. European Monitoring Centre for Drugs and Drug Addiction. Drug Treatment Expenditure: A Methodological Overview, EMCDDA Insights 24. Luxembourg: Publications Office of the European Union; 2017. 22. U.S. Department of Health and Human Services, Substance Abuse and Mental Health Services Administration. Key Substance Use and Mental Health Indicators in the United States: Results from the

Access to Opioid Treatment Centers 179 2018 National Survey on Drug Use and Health, Rockville, MD: Center for Behavioral Health Statistics and Quality, Substance Abuse and Mental Health Services Administration; 2019. 23. Vranken MJM, Lisman JA, Mantel-Teeuwisse AK, et al. Barriers to access to opioid medicines: A review of national legislation and regulations of 11 Central and Eastern European countries. Lancet Oncol. 2016;17(1):e13-e22. 24. OECD. Addressing Problematic Opioid Use in OECD Countries. Paris: OECD Publishing; 2019.

Access to Opioid Treatment Centers 180 The Percentage of Patients with a Follow-Up Visit Within Four Weeks of Starting an Opioid for Chronic Pain

Table A.21. The Percentage of Patients with a Follow-Up Visit Within Four Weeks of Starting an Opioid for Chronic Pain

The Percentage of Patients with a Follow-Up Visit Within Four Measure Construct Weeks of Starting an Opioid for Chronic Pain Description Chronic pain is typically defined as pain that lasts more than 3–6 months and is present on most days or every day. Chronic pain affects a significant proportion of the population in the United States and is associated with poor physical and mental health outcomes and risk of opioid use disorder (OUD), as opioids are frequently prescribed as a primary treatment for chronic pain.1 Increasing rates of opioid prescribing over the past 15 years have contributed significantly to increasing rates of OUD and overdose.2

In 2016, the Centers for Disease Control and Prevention (CDC) released its guidelines for prescribing opioids for chronic pain in the United States in order to encourage careful and selective use of opioid therapy for pain management.1 These guidelines included three groups of recommendations pertaining to how to determine when to prescribe opioids for chronic pain, how to determine dose and duration and when to follow up and discontinue opioids, and how to address the risks and harms of opioid use. In the second group of recommendations, the CDC advised (Recommendation 7) that “clinicians should evaluate benefits and harms within 1 to 4 weeks of starting opioid therapy for chronic pain or of dose escalation.”1 The CDC also developed quality improvement measures to incentivize providers to follow the new guidelines, including an assessment of the recommendation for follow-up within four weeks of starting opioid therapy for chronic pain in order to evaluate the benefits and harms of continued opioid therapy.3

Opioid medication: The CDC annually updates a list of all opioids, with associated National Drug Code, generic name, and product name, which may be used to match with electronic health records (EHRs).3

This measure is limited to patients 18 years and older.3

Numerator: The number of patients with a new opioid prescription (within the previous 45 days) for chronic pain with an in-person follow-up visit with the prescribing clinician within four weeks.3

Denominator: The number of patients in an outpatient panel of patients 18 years of age or older prescribed an opioid for chronic pain who had no opioid prescription in the previous 45 days.3

Exclusions: Exclusion criteria include cancer patients, palliative care, and end-of-life care. Additional exclusion criteria are (1) drugs not typically used in outpatient settings and (2) buprenorphine products indicated for medication-assisted treatment (MAT) to treat OUD.3

The Percentage of Patients with a Follow-Up Visit Within Four Weeks of Starting an Opioid for Chronic Pain 181 The Percentage of Patients with a Follow-Up Visit Within Four Measure Construct Weeks of Starting an Opioid for Chronic Pain Importance: Health or Population impact: social impact National: In the United States, research has shown that 11–40% of the adult population experiences chronic pain,4–6 for which opioids are commonly prescribed long term (3–4% of the adult population receives long-term opioid therapy).1,7

Global: Chronic pain is estimated to impact 20% of adults worldwide,8 and low-back pain is the leading cause of age-standardized years of lifetime disability worldwide.9 Prescriptions for opioids to treat chronic noncancer pain have increased over time,10 which has coincided with an increase in opioid misuse, opioid abuse, and opioid-related deaths.2,11

Meaningful clinical impact: The recommendation for follow-up after starting opioid medications is supported by type 4 evidence: clinical experience and observations, observational studies with important limitations, or randomized clinical trials with several major limitations.1 If the visits are effective, they could result in reductions in adverse events, such as overdose and OUDs, as well as other improved outcomes, such as proper dosing.

Performance gap: The United States and a few other developed countries consume the vast majority of the world’s opioids.12 Within the United States, there is variation in the frequency of opioid prescriptions between states.13 Currently, 15 OECD countries have clinical opioid guidelines in place, most of which are focused on treating patients with chronic pain.2 However, adherence to these guidelines, as well as specific information (such as the recommendation of a follow-up visit within 4 weeks of beginning a new opioid prescription), is not uniformly captured, and thus it is difficult to assess whether a performance gap exists.

Costs: The cost of chronic pain in the United States is estimated at $560 billion per year in direct medical costs, lost productivity, and disability programs.14 The Society of Actuaries estimated that the opioid epidemic cost the United States $179 billion in 2018.15 Importance: Opioid crisis: Related U.S. This measure addresses the HHS priority of addressing the opioid crisis, Department of Health specifically the goal of advancing the practice of pain management by and Human Services encouraging selective and appropriate opioid prescriptions to individuals (HHS) priority topics experiencing chronic pain. Validity Construct validity: EHRs can differ in their ability to capture opioid prescriptions;3 countries with EHRs that do not capture all of the available opioid medications could have biased results. If survey data are being used, a minimum standard for a follow-up visit (e.g., duration, content) should be established.

Internal validity: This measure was determined to have an evidence base rating of 4, indicating that it is based on clinical experience and observations, observational studies with important limitations, or randomized clinical trials with several major limitations.1 There are currently no studies evaluating the effectiveness of monitoring patients at this interval (e.g., within 4 weeks). The recommendation was based on evidence that continuing opioid therapy for more than 3 months significantly increases the risk of developing OUD and that patients who The Percentage of Patients with a Follow-Up Visit Within Four Weeks of Starting an Opioid for Chronic Pain 182 The Percentage of Patients with a Follow-Up Visit Within Four Measure Construct Weeks of Starting an Opioid for Chronic Pain are not experiencing pain relief within 1 month are unlikely to experience pain relief by 6 months. Therefore, following up with patients prior to 3 months and discontinuing opioids if a patient is not experiencing effective pain relief should reduce OUD risk.1

Discriminant validity: This measure does not account for the quality of the follow-up visit, questions asked, or effectiveness in preventing adverse outcomes from use of opioids for chronic pain. The CDC guidelines include recommendations for what questions clinicians should ask patients during the follow-up visit and considerations for determining whether to continue with opioid therapy. These recommendations should be compared with other countries’ follow-up practices to determine what counts as a follow-up visit, as well as availability of EHR and pharmacy record data. Feasibility for Definitions: This measurement definition is derived from CDC guidelines international (detailed above).1 Currently, this measure is only proposed for use in the comparisons United States; other countries are not using this measure. There are no specific data available for international comparisons. However, there are other relevant data on rates of chronic pain and rates of opioid prescription and overdose, and it is possible that this measure could be obtained for other countries from existing data.

Data availability: This measure could be obtained using prescription data from the practice EHR, as well as from patient follow-up visit data from the EHR or the medical chart. The Organisation for Economic Co- operation and Development (OECD) has identified ten countries with EHR systems that could adequately support this type of research and reporting, as well as other countries that are currently developing EHR systems to be used for national measurement of quality in the future.16 Survey data could also be used.

Data comparability: The same OECD report found that there is variation in the EHRs that would complicate comparisons across countries, including lacking or inadequate terminology standards for the same terms, incomplete records or records not kept up to date, variation in quality of providers’ recordkeeping, lack of provider-level quality checks, low rates and low quality of diagnostic and/or procedural coding, incomplete coverage, complex legacy systems, lack of standardization, inability to identify and match patients across providers, and difficulty with transitioning from paper to electronic records resulting in duplication.16 Additionally, there may be differences in the ways that opioid prescriptions are captured in the EHR, with some opioid prescriptions not identified in some systems.1

Subgroup analysis and equity: In the United States, there are significant disparities in the treatment of pain and in rates of opioid prescribing and rates of OUD by race/ethnicity,17,18 gender, and socioeconomic status.5 These disparities must also be evaluated in other countries and must be considered when defining this measure. The ability to conduct subgroup analyses to assess disparities will be limited by the same data quality issues that impact data comparability. Usability: The CDC metric is relatively new; there are no available studies that Current evidence of use report on this measure on a national or global level.

The Percentage of Patients with a Follow-Up Visit Within Four Weeks of Starting an Opioid for Chronic Pain 183 The Percentage of Patients with a Follow-Up Visit Within Four Measure Construct Weeks of Starting an Opioid for Chronic Pain Usability: This measure is new, proposed by the CDC in 2016, and is not among Relationship to the current OECD measures. OECD currently collects the following data currently used OECD related to opioid prescribing practices that are closely related to this measures measurement concept but do not address the same parameters: • availability of analgesic opioids • opioid-related deaths; overall volume of opioids prescribed • proportion of population who are chronic opioid users. Overall volume of opioids prescribed is the closest measure, as it helps to inform the denominator.

References

1. Dowell D, Haegerich TM, Chou R. CDC Guideline for prescribing opioids for chronic pain—United States, 2016. MMWR Recomm Rep. 2016;65(1):1-49. 2. OECD. Addressing Problematic Opioid Use in OECD Countries. Paris: OECD Publishing; 2019. 3. Centers for Disease Control and Prevention. Quality Improvement and Care Coordination: Implementing the CDC Guideline for Prescribing Opioids for Chronic Pain. Atlanta, GA: National Center for Injury Prevention and Control, Division of Unintentional Injury Prevention; 2018. 4. Nahin RL. Estimates of pain prevalence and severity in adults: United States, 2012. J Pain. 2015;16(8):769- 780. 5. Dahlhamer J, Lucas J, Zelaya C, et al. Prevalence of chronic pain and high-impact chronic pain among adults—United States, 2016. MMWR Morb Mortal Wkly Rep. 2018;67(36):1001-1006. 6. Interagency Pain Research Coordinating Committee. National Pain Strategy: A Comprehensive Population Health-Level Strategy for Pain. Washington, D.C.: U.S. Department of Health and Human Services; 2016. 7. Boudreau D, Von Korff M, Rutter CM, et al. Trends in long-term opioid therapy for chronic non-cancer pain. Pharmacoepidemiol Drug Saf. 2009;18(12):1166-1175. 8. Goldberg DS, McGee SJ. Pain as a global public health priority. BMC Public Health. 2011;11:770. 9. Vos T, Abajobir AA, Abate KH, et al. Global, regional, and national incidence, prevalence, and years lived with disability for 328 diseases and injuries for 195 countries, 1990–2016: A systematic analysis for the global burden of disease study 2016. Lancet. 2017;390(10100):1211-1259. 10. Rosner B, Neicun J, Yang JC, Roman-Urrestarazu A. Opioid prescription patterns in Germany and the global opioid epidemic: Systematic review of available evidence. PLoS One. 2019;14(8):e0221153. 11. Häuser W, Petzke F, Radbruch L, Tölle TR. The opioid epidemic and the long-term opioid therapy for chronic noncancer pain revisited: A Transatlantic perspective. Pain Manag. 2016;6(3):249-263. 12. Knaul FM, Farmer PE, Krakauer EL, et al. Alleviating the access abyss in palliative care and pain relief—an imperative of universal health coverage: The Lancet Commission report. Lancet. 2018;391(10128):1391- 1454. 13. Kuehn BM. CDC: Major disparities in opioid prescribing among states: Some states crack down on excess prescribing. JAMA. 2014;312(7):684-686. 14. Institute of Medicine. Relieving Pain in America: A Blueprint for Transforming Prevention, Care, Education, and Research. Washington, D.C.: National Academies Press; 2011. 15. Davenport S, Weaver A, Caverly M. Economic Impact of Non-Medical Opioid Use in the United States: Annual Estimates and Projections for 2015 Through 2019. Society of Actuaries; 2019. 16. Oderkirk J. Readiness of Electronic Health Record Systems to Contribute to National Health Information and Research. Paris: OECD Publishing; 2017. 17. Ezenwa MO, Fleming MF. Racial disparities in pain management in primary care. J Health Dispar Res Pract. 2012;5(3):12-26. 18. Tait RC, Chibnall JT. Racial/ethnic disparities in the assessment and treatment of pain: Psychosocial perspectives. Am Psychol. 2014;69(2):131-141.

The Percentage of Patients with a Follow-Up Visit Within Four Weeks of Starting an Opioid for Chronic Pain 184 Time to Regulatory Approval for New Prescription Drugs

Table A.22. Time to Regulatory Approval for New Prescription Drugs

Measure Construct Time to Regulatory Approval for New Prescription Drugs Description When new prescription medications are discovered, it may take different amounts of time for the same biologic agent to be approved for sale in different nations. An international measure of time to regulatory approval could encourage nations with slower approval processes to consider streamlining them, particularly for medications that have demonstrable benefits, such as improved health outcomes or cost-effectiveness. Importance: Health or Population impact: social impact National: Many conditions are amenable to therapy with pharmaceuticals, including infectious diseases, cardiovascular diseases, and cancers.1 Compared with many other Organisation for Economic Co-operation and Development (OECD) nations, approvals of new prescription medications occur more rapidly in the United States (the time from new drug application to approval is typically 6–10 months for the U.S. Food and Drug Administration [FDA]).2–4 However, some studies suggest that the European Medicines Agency approves medications even faster, leading critics of the United States to argue that approvals should be accelerated.5

Global: Multiple studies have demonstrated that approvals of new medications are slower in nations other than the United States.6,7 For example, lovastatin became available in Egypt 12 years after it gained FDA approval. According to a National Bureau of Economic Research report, “long launch lags are common and nearly 40 percent of all new drugs are only launched in ten or fewer countries,”2 suggesting that patients in some nations could be denied beneficial medications due to regulatory barriers.

Clinical impact: Approval of a new drug for a life-threatening disease can result in significantly decreased mortality rates and improved quality of life for individuals with that disease. In the United States, age-adjusted heart disease mortality fell by more than 50% from 1950 to 1996, and then by another 22% from 1990 to 2013.8 Much of this improvement could be due to innovations in pharmaceuticals that became accessible to patients across the nation.9 Improvements in outcomes for other conditions could be made more rapidly if new prescription drugs were approved rapidly. Alternatively, more-rapid adoption of new medications could prove costly or harmful if new products have not undergone thorough testing of efficacy, safety, and cost-effectiveness.10

Performance gap: Time to regulatory approval for prescription drugs varies greatly from nation to nation. The United States and Europe tend to have faster approval times compared with other OECD nations. Lower- income countries are less likely to approve medications rapidly for various reasons, including that public or private payers might not have the means to pay for expensive new medications, making their markets less profitable.2,11

Time to Regulatory Approval for New Prescription Drugs 185 Measure Construct Time to Regulatory Approval for New Prescription Drugs Costs: The financial cost to society could be large if new medications are approved more rapidly, since these medications tend to be costly. However, populations denied essential medications could experience poor outcomes leading to long-term disability, which are also costly.12 Importance: Value-based care: Related U.S. Bringing new and transformative pharmaceutical products to the market Department of Health faster could lead to improved health outcomes for patients. Alternatively, and Human Services it could hinder the provision of cost-effective care if new pharmaceuticals priority topics are expensive.

Other related priorities: Drug pricing: Accelerating approval of new drugs may be costly due to costs related to accelerating the review process. Additionally, accelerating approval could lead to more demand for new and expensive medications, which could cause the average price of medications to increase. Opioid crisis: Decreasing time to regulatory approval of new prescription medications could aid in addressing the opioid crisis. For example, policy options to reduce abuse of opioids include (1) approving new analgesic medications that are not addictive and (2) increasing availability of new and innovative pharmacologic treatments for opioid addiction. Alternatively, increasing spending on new pharmaceuticals could divert resources away from addressing the opioid crisis. Validity Construct validity: Time to regulatory approval for new prescription medications is a relatively straightforward measurement concept, though differences in approval processes could affect interpretability of international comparisons (see the section on data comparability).

Internal validity: Time to regulatory approval is likely a good measure of the ability of a health system to innovate quickly. The association between good performance on measures of innovation and improved health outcomes is less clear. For example, if most candidate medications are orphan drugs, then outcomes are likely to improve for eligible patients. However, if low-value drugs are rapidly gaining approval, outcomes on health could be minimal or negative.13,14

The time to regulatory approval represents only the final step in a much longer, risk-prone process of drug development that begins with initial discovery and basic research.12 There are many regulatory policies governing the entire pathway from discovery to market that differ widely by country in cost, duration, and complexity.12 The unique contribution of each step of this process, including but not limited to time to regulatory approval, quality of health care, and patient outcomes, needs to be determined.

Discriminant validity: A nation with exceptionally slow approvals of medications would likely benefit from streamlining approval processes. However, a nation with exceptionally rapid approvals might experience poor patient outcomes and high costs if newly approved drugs are expensive and lead to avoidable harms that could have been averted with more rigorous preapproval testing.10

Time to Regulatory Approval for New Prescription Drugs 186 Measure Construct Time to Regulatory Approval for New Prescription Drugs Feasibility for Definitions: international Time from concept to market: The time between initiating product design comparisons and bringing it to the commercial market. Time of regulatory review: The time required for a regulatory agency such as the FDA to review and approve a product.15 Benchmarks for regulatory review could be different if a drug is considered for accelerated approval.16 Launch lag: The time between the product’s first launch date until its launch date in another country.2 First to market: Whether a medication was approved first in one country versus any other. Data availability: • National: The FDA website lists approval dates for new medications.17 • International: Multiple reports cite the MIDAS data set produced by IMS Health as a source of commercial market research data describing product launches in multiple therapeutic classes.2,13 The European Medicine Agency also posts information describing new drugs and approval dates.18,19

Data comparability: • Measures comparing use of medications internationally generally use the World Health Organization’s Anatomical Therapeutic Chemical classification system to identify active ingredients. This covers all classes but not all countries. • Identifying drug launches over time can be challenging because brand names are often referenced rather than active ingredients, which makes one-to-one comparison difficult.2 • Country-specific differences in approval processes can make comparability challenging. For example, some countries prioritize safety monitoring prior to approval, while others approve medications earlier and then perform post-marketing surveillance of safety.15 Usability: • National: The FDA monitors time of regulatory review for all products.20 Current evidence of use • International: Multiple OECD nations track time to regulatory approval, including the European Union, Canada, and Japan.16,21,22 Using publicly available data, academic investigators have compared approval times in the United States with those of other nations. For example, one study published in 2012 collected data on 510 novel drug applications in the United States, Europe, and Canada between 2001 and 2010. The investigators tracked medical length of time for completion of first review, median total review time, and number of drugs first to market in each geographic area.21 Usability: Time to regulatory approval for new prescription drugs is not currently Relationship to represented among current OECD measures; however, OECD has currently used OECD expressed interest in the topic.12 measures The closest available measures include the following: • Annual approvals of new medicines per billion U.S. dollars of pharmaceutical business expenditure on research and development (R&D) in the United States, inflation-adjusted: This measure analyzes the ratio of the number of new approvals of medications per unit of expenditure on drug R&D. In other words, this is a measure of return on

Time to Regulatory Approval for New Prescription Drugs 187 Measure Construct Time to Regulatory Approval for New Prescription Drugs investment in development and approval of drugs.23 However, it does not include time to approval. • Business enterprise expenditure for pharmaceutical R&D and government outlays for health-related R&D.24 • R&D intensity by industry: business enterprise R&D expenditure as a share of gross value added.25 Multiple options exist for future development of OECD measures of time to regulatory approval for new prescription drugs. • Median time to approval for new drugs each year would require data on all approved drugs, including data describing when applications were submitted and approved. • Alternatively, OECD could identify lists of specific drugs that are likely to greatly improve population health outcomes or value and monitor dates they came to market in each member nation (or first-to-market statuses).

References

1. Canary LA, Klevens RM, Holmberg SD. Limited access to new hepatitis C virus treatment under state Medicaid programs. Ann Intern Med. 2015;163(3):226-228. 2. Cockburn IM, Lanjouw JO, Schankerman M. Patents and the Global Diffusion of New Drugs, Working Paper 20492. 2014. 3. Danzon PM, Furukawa MF. International prices and availability of pharmaceuticals in 2005. Health Affairs. 2008;27(1):221-233. 4. U.S. Food and Drug Administration. The FDA’s Drug Review Process: Ensuring Drugs Are Safe and Effective. 2017. Accessed May 21, 2020. https://www.fda.gov/drugs/drug-information-consumers/ fdas-drug-review-process-ensuring-drugs-are-safe-and-effective 5. Wild C, Erdös J, Zechmeister I. Contrasting clinical evidence for market authorisation of cardio-vascular devices in Europe and the USA: A systematic analysis of 10 devices based on Austrian pre-reimbursement assessments. BMC Cardiovasc Disord. 2014;14:154. 6. Samuel N, Verma S. Cross-comparison of cancer drug approvals at three international regulatory agencies. Curr Oncol. 2016;23(5):e454-e460. 7. Roberts SA, Allen JD, Sigal EV. Despite criticism of the FDA review process, new cancer drugs reach patients sooner in the United States than in Europe. Health Aff (Millwood). 2011;30(7):1375-1381. 8. Mensah GA, Wei GS, Sorlie PD, et al. Decline in cardiovascular mortality: Possible causes and implications. Circ Res. 2017;120(2):366-380. 9. Cutler DM, McClellan M, Newhouse JP. The costs and benefits of intensive treatment for cardiovascular disease. In: Jack T., ed. Measuring the Prices of Medical Treatments. Washington D.C.: The Brookings Institution; 1999:34-71. 10. Downing NS, Shah ND, Aminawung JA, et al. Postmarket safety events among novel therapeutics approved by the US Food and Drug Administration between 2001 and 2010. JAMA. 2017;317(18):1854- 1863. 11. World Health Organization. European Observatory Policy Brief Series: European Observatory on Health Systems and Policies. Copenhagen; 2013. 12. OECD. Pharmaceutical Innovation and Access to Medicines. Paris: OECD Health Policy Studies; 2018. 13. Kyle M, Williams H. Is American health care uniquely inefficient? Evidence from prescription drugs. Am Econ Rev. 2017;107(5):486-490. 14. Chandra A, Skinner J. Technology growth and expenditure growth in health care. J Econ Lit. 2012;50(3):645-680. 15. Van Norman GA. Drugs, devices, and the FDA: Part 1: An overview of approval processes for drugs. JACC: Basic Transl Sci. 2016;1(3):170-179. 16. Nagai S. Flexible and expedited regulatory review processes for innovative medicines and regenerative medical products in the US, the EU, and Japan. Int J Mol Sci. 2019;20(15).

Time to Regulatory Approval for New Prescription Drugs 188 17. U.S. Food and Drug Administration. Drugs@FDA: FDA-Approved Drugs. Undated. Accessed May 21, 2020. https://www.accessdata.fda.gov/scripts/cder/daf 18. Zeukeng M-J, Seoane-Vazquez E, Bonnabry P. A comparison of new drugs approved by the FDA, the EMA, and Swissmedic: An assessment of the international harmonization of drugs. Eur J Clin Pharmacol. 2018;74(6):811-818. 19. European Medicines Agency. Human Medicines: Regulatory Information. Undated. Accessed May 21, 2020. https://www.ema.europa.eu/en/human-medicines-regulatory-information 20. Herper M. Gilead CEO: We’re going to make sure that access is not an issue with remdesivir. Stat. 2020. Accessed May 21, 2020. https://www.statnews.com/2020/04/29/ gilead-ceo-were-going-to-make-sure-that-access-is-not-an-issue-with-remdesivir 21. Downing NS, Aminawung JA, Shah ND, Braunstein JB, Krumholz HM, Ross JS. Regulatory review of novel therapeutics—comparison of three regulatory agencies. N Engl J Med. 2012;366(24):2284-2293. 22. Jain AB, Mollet A, Szucs TD. Regulatory watch: Structural and procedural characteristics of international regulatory authorities. Nat Rev Drug Discov. 2017;16(9):594. 23. OECD. Health at a Glance 2019: OECD Indicators. Paris: OECD Publishing; 2019. 24. OECD. Business Enterprise Expenditure for Pharmaceutical R&D (BERD) and Government Outlays for Health-Related R&D (GBARD), 2016 (or Nearest Year). Paris: OECD Publishing; 2019. 25. OECD. R&D Intensity by Industry: Business Enterprise R&D Expenditure as a Share of Gross Valued Added, 2016 (or Nearest Year). Paris: OECD Publishing; 2019.

Time to Regulatory Approval for New Prescription Drugs 189 Travel Time to Provider Office

Table A.23. Travel Time to Provider Office

Measure Construct Travel Time to Provider Office Description The burden of travel from a patient’s residence to his or her health care provider can be an important measure of access to preventive and treatment services. Travel time can be estimated directly (e.g., using geographic information systems [GIS], online routing websites, or self- report measures), but when data are unavailable, travel distance is often used as a proxy measure of travel time. However, although time and distance are highly correlated,1 they can differ depending on several factors (travel mode, time of day, travel speed, etc.).2

Travel time to a provider is sometimes measured under the umbrella term network adequacy. Network adequacy is a health plan’s ability to deliver the benefits promised by giving reasonable access to in-network providers; the maximum travel time or distance to providers should be 30 miles or 30 minutes from the home.3,4 Importance: Health or Population impact: social impact • Adverse outcomes associated with greater distance or travel time may include treatment delays and discontinuity of care.5 • Low-income populations bear a relatively high burden of travel because they often reside in remote areas and/or have limited means of transportation.6 Having to travel greater distances for mental health care or clinical interventions negatively affects utilization in rural and urban areas.7,8 • National prevalence: Studies have found transportation barriers in as little as 3% or as much as 67% of the population sampled, making it difficult to assess the impact on utilization or outcomes.8 Adults report traveling 38 minutes, on average, to their health care provider.9 Travel to a provider can also affect provider selection, such as electing to visit an emergency department (ED) instead of a primary care provider for nonurgent care.10 • Global prevalence: Despite lower user fees in Organisation for Economic Co-operation and Development (OECD) countries, distance to providers may aggravate the disparities in utilization between patients with higher or lower socioeconomic position.11 • Among 21 low- and middle-income countries (LMICs), the majority of respondents reported traveling 10 minutes or less (about 21%) or 11– 20 minutes (about 22%) to get to a ; however, there were variations across countries, with Burkina Faso having the lowest proportion of respondents reporting a health facility within 10 minutes (about 4%) and Jordan having the highest (about 90%).12

Clinical impact: • Living farther away from care has clinical and cost implications.13 • Rural counties report worse Medicare quality measures than urban counties.14 • A review of 108 studies from the global north countries (the United States, Canada, the countries of Western Europe, Australia, New Zealand) found that the majority of studies (77%) identified a “distance decay” association, where shorter travel time to health care services

Travel Time to Provider Office 190 Measure Construct Travel Time to Provider Office was related to better health outcomes among adults (18 years or older; excluding maternity and emergency medical travel); however, six studies showed the reverse (distance bias association), and 19 showed no association.15 • Among 21 LMICs, longer time to travel (i.e., more than 10 minutes) to a health care facility was associated with higher odds of neonatal mortality and lower odds of receipt of antenatal care during pregnancy and in-facility delivery.12

Performance gap: • Transportation barriers like excessive travel time are an important barrier to health care access, especially for those with lower incomes, the underinsured, and the uninsured.8 Closing of rural hospitals limits local access to specialty care and can delay screenings, diagnoses, and treatment, particularly for older populations.16 • Most studies of neighborhood environments and their relationship to health and health equity have been cross-sectional and are limited in establishing causal relationships.17

Costs: • Costs to seek care are usually measured as opportunity costs, or the value of patient time based on the value of foregone activities.18 • A study of U.S. adults found a mean of $42 in opportunity costs per visit (based on travel plus clinic time) to seek ambulatory medical care for oneself, which is higher than the mean out-of-pocket costs of $34 per visit.9 • A multistate study in the United States showed that longer travel times (e.g., more than an hour) for cancer care among older adults (aged 65 years or older) were associated with higher Medicare spending (e.g., $669/month more for those traveling more than 1 hour than those with commutes of 30 minutes or less in the initial phase of care) and higher patient cost responsibility (e.g., $67/month more for those traveling more than 1 hour versus those with commutes of 30 minutes or less in the initial phase of care).13 The higher Medicare spending could be due to higher hospitalization rates. • Health maintenance organization members consume more health care and experience higher disease burden as their distance from primary care providers increases.19 Importance: Value-based care: Related U.S. Quality measurement and value-based systems that do not take rurality Department of Health and travel distance to a provider into account might unfairly penalize and Human Services clinicians and lead to greater health disparities.14 priority topics Other related priorities: Health insurance reform: Travel time is a potential indicator of access to personalized health care that meets individual needs and budgets, a key component of HHS’s priority for health insurance reform.

Opioid crisis: Longer drive times to the nearest opioid treatment program could affect adherence to the federal requirement that individuals must have six visits per week to receive medication.20 Validity Construct validity: Analysis of measures of distance or travel time to a provider shows that these measures have strong construct validity.21,22 A measure of self-

Travel Time to Provider Office 191 Measure Construct Travel Time to Provider Office reported travel times to a hospital showed a moderately strong association with travel times estimated by GIS (r = 0.86).23 Feasibility for Definitions: international • Travel to a provider can be expressed in distance or time. Time is often comparisons more representative in urban areas where public transportation is utilized.24

Data availability: • Researchers in the United States have combined disease registries with the Centers for Medicare & Medicaid Services (CMS) Physician Compare data, which list the name and location of clinicians who have billed Medicare in the past year.24 • The American Time Use Survey collects self-reported time to travel for care among a nationally representative sample of adults (18 years or older).25 This measure is not specific to a particular site of care (e.g., ED or primary provider’s office). • U.S. and international research can be conducted with physician and hospital claims data, physician registries, GIS mapping tools, and census data.11,26,27 • The cross-sectional Demographic & Health Survey, which collects data from nationally representative samples on a range of topics and across multiple countries, has a service availability module that identifies distance to the nearest health facility of interest, the most common transportation mode used by people to go to the facility, and the time it takes to travel to the facility using the most common transportation mode.28 GIS and online routing services (e.g., Google Maps) are also increasingly being used to estimate travel time in various countries.15

Data comparability: • Estimating travel time is complicated by multiple factors, such as transportation mode and availability, environmental conditions, transportation costs, and any other barriers to travel.29 Other studies have used objective measures, such as GIS or online routing websites, but various geospatial methods exist to estimate travel time, and different assumptions are made (e.g., researcher-selected route to the provider), which may make comparisons across studies difficult.15

Subgroup analysis and equity: • In the United States, American Time Use Survey data show that self- reported travel time to access care was higher for those who are non- Hispanic Black and those who are Hispanic (on average, about 45 minutes in each group) compared with those who are non-Latino White (36 minutes); higher for men (40 minutes) than for women (37 minutes); higher for those aged 25–44 years (38 minutes) and 45–64 years (41 minutes) compared with younger adults aged 18–24 years (31 minutes); higher for those who were unemployed or not in the labor force (41 minutes) compared with employed adults (about 35 minutes); and higher when the visit occurred on a weekday during work hours or after hours (38 minutes) compared with a weekend (33 minutes); no differences were found between urban (38 minutes) and rural (40 minutes) residence.30 However, another national survey of adults shows that, taking distance to the nearest hospital and traffic patterns into account, rural residents are estimated to have higher travel times (17

Travel Time to Provider Office 192 Measure Construct Travel Time to Provider Office minutes) than suburban (12 minutes) and urban (10 minutes) residents.31 Usability: Several countries currently assess travel distance or time to health Current evidence of use providers. Evidence includes the following (not exhaustive): • National: Self-report measures (e.g., the American Time Use Survey) and geospatial techniques are being used to estimate travel time to providers, especially to identify disparities among population sociodemographic groups and geographic settings to identify where policies and interventions are needed to improve access to care.15,30,32 • States are no longer required to use time and distance standards to ensure provider network adequacy.33 Researchers can measure access to care by combining the CMS Medicare Provider Utilization and Payment Data with census data.34,35 • International: For countries with national health systems, health registries, mapping software, and census data can be combined to measure distance to health centers and the types of care provided. In the United Kingdom, distance to an ED similarly affected utilization.36 • The Demographic and Health Surveys collect multiple measures of travel burden (including time) to assess health service availability across countries.28 Usability: Travel time to a provider office is not among the current OECD measures. Relationship to currently used OECD Closest related measures: measures • OECD measures the number and concentration of health providers and hospitals but not their geographic distribution or travel distances.37 • OECD collects data on unmet care needs (due to costs, travel distance, or waiting time) as a dimension of health systems performance. In 2013, 3% of the population among the OECD European Union countries reported unmet needs for medical care for those reasons, but there were variations across countries, with a higher prevalence in Latvia, Greece, Poland, and Estonia, and less than 1% prevalence in the Netherlands, Austria, Spain, Luxembourg, and the Czech Republic.38

References

1. Rietveld P, Zwart B, Van Wee B, van den Hoorn T. On the relationship between travel time and travel distance of commuters. Ann Reg Sci. 1999;33(3):269-287. 2. Miller EJ. Accessibility: Measurement and Application in Transportation Planning. Taylor & Francis; 2018. 3. National Association of Insurance Commissioners. Network Adequacy. 2020. Accessed May 20, 2020. https://content.naic.org/cipr_topics/topic_network_adequacy.htm 4. Wishner JB, Marks J. Ensuring Compliance with Network Adequacy Standards: Lessons from Four States. Urban Institute; 2017. 5. Birkmeyer JD, Siewers AE, Marth NJ, Goodman DC. Regionalization of high-risk surgery and implications for patient travel times. JAMA. 2003;290(20):2703-2708. 6. Casey MM, Call KT, Klingner JM. Are rural residents less likely to obtain recommended services? Am J Prev Med. 2001;21(3):182-188. 7. Lê Cook B, Doksum T, Chen C-N, Carle A, Alegría M. The role of provider supply and organization in reducing racial/ethnic disparities in mental health care in the U.S. Soc Sci Med. 2013;84:102-109. 8. Syed ST, Gerber BS, Sharp LK. Traveling towards disease: Transportation barriers to health care access. J Community Health. 2013;38(5):976-993. 9. Ray KN, Chari AV, Engberg J, Bertolet M, Mehrotra A. Opportunity costs of ambulatory medical care in the United States. Am J Manag Care. 2015;21(8):567-574.

Travel Time to Provider Office 193 10. Ludwick A, Fu R, Warden C, Lowe RA. Distances to emergency department and to primary care provider’s office affect emergency department use in children. Acad Emerg Med. 2009;16(5):411-417. 11. Packness A, Waldorff FB, Christensen Rd, et al. Impact of socioeconomic position and distance on mental health care utilization: A nationwide Danish follow-up study. Soc Psychiatry Psychiatr Epidemiol. 2017;52(11):1405-1413. 12. Karra M, Fink G, Canning D. Facility distance and child mortality: A multi-country study of health facility access, service utilization, and child health outcomes. Int J Epidemiol. 2017;46(3):817-826. 13. Rocque GB, Williams CP, Miller HD, et al. Impact of travel time on health care costs and resource use by phase of care for older patients with cancer. J Clin Oncol. 2019;37(22):1935-1945. 14. Mayer ML, Slifkin RT, Skinner AC. The effects of rural residence and other social vulnerabilities on subjective measures of unmet need. Med Care Res Rev. 2005;62(5):617-628. 15. Kelly C, Hulme C, Farragher T, Clarke G. Are differences in travel time or distance to healthcare for adults in global north countries associated with an impact on health outcomes? A systematic review. BMJ Open. 2016;6(11):e013059. 16. Konerding U, Bowen T, Elkhuizen SG, et al. The impact of travel distance, travel time and waiting time on health-related quality of life of diabetes patients: An investigation in six European countries. Diabetes Res Clin Pract. 2017;126:16-24. 17. National Academies of Sciences, Engineering, and Medicine. Communities in Action: Pathways to Health Equity. National Academies Press; 2017. 18. Buchanan JM. Opportunity Cost. The World of Economics: Springer; 1991:520-525. 19. Billi JE, Pai C-W, Spahlinger DA. The effect of distance to primary care physician on health care utilization and disease burden. Health Care Manage Rev. 2007;32(1):22-29. 20. Joudrey PJ, Edelman EJ, Wang EA. Drive times to opioid treatment programs in urban and rural counties in 5 US states. JAMA. 2019;322(13):1310-1312. 21. Geronimus AT, Bound J, Neidert LJ. On the validity of using census geocode characteristics to proxy individual socioeconomic characteristics. J Am Stat Assoc. 1996;91(434):529-537. 22. Mahdavi M. Building the Bridge Between Operations and Outcomes. Dissertation. Rotterdam, the Netherlands: Erasmus University; 2015. 23. Haynes R, Jones AP, Sauerzapf V, Zhao H. Validation of travel times to hospital estimated by GIS. Int J Health Geogr. 2006;5(1):40. 24. Lin CC, Bruinooge SS, Kirkwood MK, et al. Association between geographic access to cancer care, insurance, and receipt of chemotherapy: Geographic distribution of oncologists and travel distance. J Clin Oncol. 2015;33(28):3177-3185. 25. U.S. Bureau of Labor Statistics. American Time Use Survey. 2020. Accessed May 26, 2020. https://www.bls.gov/tus 26. Scoggins JF, Fedorenko CR, Donahue SM, Buchwald D, Blough DK, Ramsey SD. Is distance to provider a barrier to care for Medicaid patients with breast, colorectal, or lung cancer? J Rural Health. 2012;28(1):54- 62. 27. Streja E, Kovesdy CP, Soohoo M, et al. Dialysis provider and outcomes among United States veterans who transition to dialysis. Clin J Am Soc Nephrol. 2018;13(7):1055-1062. 28. Measure DHS. Data. 2020. Accessed May 26, 2020. https://dhsprogram.com/data 29. Humphreys JS, Smith KB. Healthcare accessibility. The International Encyclopedia of Human Geography. 2009;5:71-79. 30. Ray KN, Chari AV, Engberg J, Bertolet M, Mehrotra A. Disparities in time spent seeking medical care in the United States. JAMA Intern Med. 2015;175(12):1983-1986. 31. Lam O, Broderick B, Toor S. How Far Americans Live from the Closest Hospital Differs by Community Type. Washington, D.C.: Pew Research Center; 2018. 32. McLafferty SL. GIS and health care. Annual Review of Public Health. 2003;24(1):25-42. 33. Hinton E, Musumeci M. CMS’s 2018 Proposed Medicaid Managed Care Rule: A Summary of Major Provisions. 2019. Accessed May 21, 2020. https://www.kff.org/report-section/ cmss-2018-proposed-medicaid-managed-care-rule-a-summary-of-major-provisions-issue-brief-9271 34. Lee CS, Su GL, Baughman DM, Wu Y, Lee AY. Disparities in delivery of ophthalmic care; an exploration of public Medicare data. PloS One. 2017;12(8):e0182598. 35. Verevkina NI, Short PF, Yang T-C, Matthews SA, Camacho F, Anderson R. Analyzing hospital choices of colon cancer patients in four states in Appalachia. J Health Care Poor Underserved. 2019;30(2):587-608.

Travel Time to Provider Office 194 36. Rudge GM, Mohammed MA, Fillingham SC, Girling A, Sidhu K, Stevens AJ. The combined influence of distance and neighbourhood deprivation on emergency department attendance in a large English population: A retrospective database study. PloS One. 2013;8(7):e67943. 37. OECD. Health at a Glance 2019: OECD Indicators. Paris: OECD Publishing; 2019. 38. OECD. Unmet Needs for Medical Care and Dental Care, in Health at a Glance 2015: OECD Indicators. Paris: OECD Publishing; 2015.

Travel Time to Provider Office 195 Health Care Spending in the Last Year of Life

Table A.24. Health Care Spending in the Last Year of Life

Measure Construct Health Care Spending in the Last Year of Life Description Health care spending in the last year of life is thought to be an indicator of wasteful spending on care for terminally ill patients with poor prognoses. After a patient’s death, the amount spent on that patient’s care can be calculated retrospectively. If the same calculation is performed for all patients who died in a one-year period, the total amount spent can be averaged over the number of persons who died. Importance: Health or • Population impact: social impact o National: The United States spent 17.1% of its gross domestic product (GDP) on health care in 2017.1 Estimates of expenditures for patients in the last year of life range from 10% of health spending for the general population to as much as 25% of Medicare spending for Medicare beneficiaries in the last year of life.2,3 One estimate of mean per capita medical spending in the last 12 months of life was $80,000 in the United States.3 Maximizing value in the care of high-cost, seriously ill individuals is a major public health challenge domestically, especially as the population ages.4 o Global: Annual health care spending is a major component of national budgets each year, accounting for between 7 and 12% of GDP for most wealthy Organisation for Economic Co-operation and Development (OECD) nations in 2017. Efforts to reduce unnecessary spending are widespread among member nations, including efforts to reduce spending at the end of life by redirecting patients toward palliative care and away from high-cost, low-value services.5,6 • Meaningful clinical impact: Optimizing national performance on a measure of health care spending at the end of life would mean that patients received appropriate care when necessary and did not receive low-value (e.g., futile) services.4 For example, a well-performing nation would likely (1) maximize use of palliative care, which has been demonstrated to improve patient quality of life at the end of life;7 (2) minimize nonbeneficial treatments at the end of life;8,9 and (3) encourage patients to live their last days at home rather than in the acute care setting.10 It is important to note that some critics of end-of- life spending measures report that only 11% of the highest-cost individuals are in the last year of life, while even fewer have predictable prognoses, making spending reductions challenging.11 • Performance gap: An academic study from 2017 found similar performance among nine countries on health care spending at the end of life. Each country with complete data spent between 8 and 11% of total health expenditures on care for patients in the last 12 months of life.3 There is some evidence that high-cost, low-value care could be more prevalent in the United States in the last three months of life.12 However, there is also some evidence that end-of-life care costs are decreasing in the United States.13 • Costs: According to one estimate, the United States spent $200 billion on health care services for patients in their last year of life.11 Any reduction in such spending could be redirected toward potentially higher-value services.

Health Care Spending in the Last Year of Life 196 Measure Construct Health Care Spending in the Last Year of Life Importance: Value-based care: Related U.S. Reducing unnecessary spending at the end of life would improve the Department of Health value of care delivered. and Human Services priority topics Validity Construct validity: The challenge in constructing a valid international measure of health care spending at the end of life would be in calculating decedent-level expenditures. Although OECD has performed international comparisons of health care expenditures for many years, calculating individual expenditures would involve various data sources and methods across countries. This could be challenging for the United States, in particular, since estimates for patients not covered by Medicare would be hard to obtain.1

Internal validity: One threat to internal validity is that cultural differences might account for significant international variation in health care spending in the last year of life.

Discriminant validity: Nations with very high expenditures would likely have room to improve performance. However, concerns have been raised that reducing high levels of spending could be challenging because predicting which severely ill patients will recover and which will not is often infeasible.11,14–16 Feasibility for Definitions: There is no accepted standard measure of health care international spending at the end of life, and academic studies use various time comparisons intervals to calculate end-of-life spending (range of 1 month to 5 years).17–20 Expenditures have been expressed as the percentage of total national health expenditures or the amount spent per decedent.3,21

Data availability: • National: Studies characterizing end-of-life health care spending most often focus on patients covered by Medicare and use fee-for-service claims data to estimate cost.18–20,22 One study used the Medical Expenditure Panel Survey and the National Health Expenditure Survey.11 Another potential data source is the Medicare Current Beneficiary Survey, though this survey may be limited by recall bias and could be subject to systematic biases in times proximate to beneficiary death.23 • Global: Studies of end-of-life spending in Canada and Europe have used insurance claims, estimates of resource use, and administrative databases to estimate spending per decedent.18,24,25

Data comparability: Comparability of hospital spending data across nations might be additionally limited because of different methods of calculating estimates of spending using different data sources (such as claims, resources utilization estimates, and administrative databases). Estimates of nonhospital care are limited because data sources are disparate and more difficult to acquire than those describing inpatient hospitalizations.18 In nations that have multiple payers, there also may be limited ability to capture expenses based on payer-specific availability of data.1

Health Care Spending in the Last Year of Life 197 Measure Construct Health Care Spending in the Last Year of Life Subgroup analysis and equity: • There is some evidence that spending at the end of life varies based on race, with higher spending rates for Black decedents than for White decedents.17,26 Usability: • National: Outside of the academic studies cited above, the United Current evidence of use States does not appear to be routinely using this measure or any similar measure. • International: Outside of the academic studies cited above, other countries do not appear to be routinely using this measure or any similar measure. Usability: Health care spending in the last year of life is not currently represented Relationship to among OECD measures. Relevant measures include the following: currently used OECD • Health expenditure per capita: This measure calculates the amount measures spent on health care per person in a nation. It is simpler to calculate than expenditures per decedent because it does not require individual- level calculations.1 • Current health spending by age under the System of Health Accounts Framework: This measure is only available for three OECD member nations, but it shows spending for specific age groups of patients. Similar methods could be used to stratify expenses for decedents versus nondecedents.27 • Long-term care expenditure by government and compulsory schemes as a share of GDP: Persons receiving long-term care are more likely to expire than persons who are not receiving this care, which makes spending on their care conceptually similar to spending on decedent care.28

References

1. OECD. Health at a Glance 2019: OECD Indicators. Paris: OECD Publishing; 2019. 2. Riley GF, Lubitz JD. Long‐term trends in Medicare payments in the last year of life. Health Serv Res. 2010;45(2):565-576. 3. French EB, McCauley J, Aragon M, et al. End-of-life medical spending in last twelve months of life is lower than previously reported. Health Affairs. 2017;36(7):1211-1217. 4. Institute of Medicine. Dying in America: Improving Quality and Honoring Individual Preferences Near the End of Life. Washington, D.C.: The National Academies Press; 2015. 5. World Health Organization, Worldwide Palliative Care Alliance. Global Atlas of Palliative Care at the End of Life. London: Worldwide Palliative Care Alliance. 2014. 6. Hasselaar J, Payne S. Integrated Palliative Care. Nijmegan: Radboud University Medical Centre. 2016. 7. Kavalieratos D, Corbelli J, Zhang D, et al. Association between palliative care and patient and caregiver outcomes: A systematic review and meta-analysis. JAMA. 2016;316(20):2104-2114. 8. Cardona-Morrell M, Kim J, Turner RM, Anstey M, Mitchell IA, Hillman K. Non-beneficial treatments in hospital at the end of life: A systematic review on extent of the problem. Int J Qual Health Care. 2016;28(4):456-469. 9. Massa I, Balzi W, Altini M, et al. The challenge of sustainability in healthcare systems: Frequency and cost of diagnostic procedures in end-of-life cancer patients. Support Care Cancer. 2018;26(7):2201-2208. 10. Where Death Lives Now. In: Warraich H. Modern Death: How Medicine Changed the End of Life. New York: St. Martin’s Press/MacMillan; 2017. 11. Aldridge MD, Kelley AS. The myth regarding the high cost of end-of-life care. Am J Public Health. 2015;105(12):2411-2415. 12. Yi D, Johnston BM, Ryan K, et al. Drivers of care costs and quality in the last 3 months of life among older people receiving palliative care: A multinational mortality follow-back survey across England, Ireland and the United States. Palliat Med. 2020;34(4):513-523.

Health Care Spending in the Last Year of Life 198 13. Weeks WB, Kirkland KB, Freeh C, Weinstein JN. Proportion of decedents’ expenditures among recent reductions in Medicare expenditures. JAMA Intern Med. 2018;178(5):717-719. 14. Emanuel EJ, Emanuel LL. The economics of dying—the illusion of cost savings at the end of life. N Engl J Med. 1994;330(8):540-544. 15. Jha AK. End-of-life care, not end-of-life spending. JAMA. 2018;320(7):631-632. 16. Einav L, Finkelstein A, Mullainathan S, Obermeyer Z. Predictive modeling of U.S. health care spending in late life. Science. 2018;360(6396):1462-1465. 17. Cubanski J., Neuman T., Griffin S., Damico A. Medicare Spending at the End of Life: A Snapshot of Beneficiaries Who Died in 2014 and the Cost of Their Care. 2016. Accessed May 22, 2020. https://www.kff.org/medicare/issue-brief/medicare-spending-at-the-end-of-life 18. Bekelman JE, Halpern SD, Blankart CR, et al. Comparison of site of death, health care utilization, and hospital expenditures for patients dying with cancer in 7 developed countries. JAMA. 2016;315(3):272-283. 19. Unroe KT, Greiner MA, Hernandez AF, et al. Resource use in the last 6 months of life among Medicare beneficiaries with heart failure, 2000–2007. Arch Intern Med. 2011;171(3):196-203. 20. Kelley AS, McGarry K, Gorges R, Skinner JS. The burden of health care costs for patients with dementia in the last 5 years of life. Ann Intern Med. 2015;163(10):729-736. 21. Duncan I, Ahmed T, Dove H, Maxwell TL. Medicare cost at end of life. Am J Hosp Palliat Care. 2019;36(8):705-710. 22. Kelley AS, Covinsky KE, Gorges RJ, et al. Identifying older adults with serious illness: A critical step toward improving the value of health care. Health Serv Res. 2017;52(1):113-131. 23. Hoover DR, Crystal S, Kumar R, Sambamoorthi U, Cantor JC. Medical expenditures during the last year of life: Findings from the 1992–1996 Medicare Current Beneficiary Survey. Health Serv Res. 2002;37(6):1625-1642. 24. Fassbender K, Fainsinger RL, Carson M, Finegan BA. Cost trajectories at the end of life: The Canadian experience. J Pain Symptom Manage. 2009;38(1):75-80. 25. Polder JJ, Barendregt JJ, van Oers H. Health care costs in the last year of life—the Dutch experience. Soc Sci Med. 2006;63(7):1720-1731. 26. Shugarman LR, Decker SL, Bercovitz A. Demographic and social characteristics and spending at the end of life. J Pain Symptom Manage. 2009;38(1):15-26. 27. OECD. A System of Health Accounts 2011. Paris: OECD Publishing; 2017. 28. OECD. Ageing and Long-Term Care. Undated. Accessed May 22, 2020. https://www.oecd.org/els/health-systems/long-term-care.htm

Health Care Spending in the Last Year of Life 199 Spending on Mental Health (Percentage of Total Health Spending)

Table A.25. Spending on Mental Health (Percentage of Total Health Spending)

Measure Construct Spending on Mental Health (Percentage of Total Health Spending) Description The World Health Organization (WHO) defines mental health as “a state of well-being in which every individual realizes his or her own potential, can cope with the normal stresses of life, can work productively and is able to make a contribution to her or his community.”1 Mental health problems refer to a set of medical conditions that affect a person’s thinking, feeling, mood, ability to relate to others, and daily functioning.2

National health spending describes both individual needs and population health as a whole. Health spending includes the consumption of health goods and services and includes all types of financing arrangements.3

Percentage of total health spending is the ratio of health spending allocated to mental health services compared with total national health spending.4

Importance: Health or Population impact: social impact National: • Mental health is an indispensable component of health,2 and mental disorders represent one of the most significant and increasing burdens to global public health.5 In the United States, an estimated 50% of the population will be diagnosed with a mental disorder during their lifetime.6 Mental health disorders have the highest prevalence and disability burden among all noncommunicable diseases.4 Furthermore, mental health spending tends to be low and inefficiently allocated, with the least-effective interventions receiving the largest funding share.4 • Nearly one in five U.S. adults lives with a mental illness (46.6 million in 2017).7 More than 10 million adults in the United States have unmet need for mental health treatment.8 The United States had the highest rate of death from mental health disorders and substance use disorders (SUDs) among comparable countries (France, Germany, Sweden, Canada, Austria, Switzerland, the United Kingdom, Belgium, Netherlands, Japan) in the 2015 Global Burden of Disease Study.9 In 2016, mental health spending accounted for $180.7 billion out of an estimated $3.1 trillion of total health care spending, or 6%.10 Spending on mental health is expected to total $280.5 billion in 2020.11 Other studies estimate that mental health spending accounts for 7% of total health care spending and has increased by 62% since 2006.12 However, as a percentage of total health spending, spending on mental health is expected to account for 6.5% in 2020, down from 7.4% in 2009.11

Global: • Mental illness represents nearly 10% of the global burden of disease (measured in disability-adjusted life-years lost), up from 6.6% in 1991.13 Mental health disorders and SUDs affected more than 1 billion people globally in 2016.14 Globally, the allocations for mental health care are disproportionately low relative to the burden.13 WHO estimated that in 2015, mental health spending accounted for less than 2% of the global median health expenditure. The global median mental health

Spending on Mental Health (Percentage of Total Health Spending) 200 Measure Construct Spending on Mental Health (Percentage of Total Health Spending) expenditure per capita was $2.50 out of a total global median per capita health expenditure of $141.15 The increased international focus on mental health is expected to increase the resources devoted to mental health.5 By 2030, the economic burden of poor mental health is projected to cost the global economy $16 trillion.13

Clinical impact: • Consequences: Disproportionately low spending on mental health translates to limited access to care.13 Currently, as many as 80% of those with a common mental disorder and up to 50% of those with a severe mental disorder do not seek or receive treatment.16

Performance gap: • In 2008, the Mental Health Parity and Addiction Equity Act required that health insurance plans include the same level of benefits for medical care and for mental health and substance use care. Although spending on and utilization of mental health services in employer-sponsored group health plans increased after the passage of this law,17 other data suggest that there was no significant effect overall when all types of plans were considered, and there are still significant disparities between physical and mental health care and unmet need for mental health care.18 • The 2011 Grand Challenges in Global Mental Health initiative, led by the U.S. National Institute of Mental Health, prioritized implementation research questions to reduce the treatment gap for mental health disorders.19 • The 2017 Global Alliance for Chronic Diseases consortium and the UK Research Councils developed an agenda to improve implementation and reduce the treatment gaps for mental health.13

Costs: • National: The estimated financial costs of mental disorders are at least $467 billion annually and rising.20 • Global: The economic burden of poor mental health is projected to cost the global economy $16 trillion by 2030.13 The Organisation for Economic Co-operation and Development (OECD) reported that the “direct and indirect costs of mental ill-health can exceed 4% of GDP [gross domestic product]” and were estimated at $2,493 billion globally. Indirect costs include lost productivity, absenteeism, and premature mortality.21 Importance: Value-based care: Related U.S. Improvements in mental health care could significantly increase value Department of Health because mental health disorders account for a significant proportion of and Human Services total disease burden. Furthermore, there is a strong association between (HHS) priority topics mental and physical health, such that untreated mental illness is associated with increased physical health costs.21 For example, mental disorders such as depression and anxiety are negatively related to 22 engagement in preventive, health-promoting behaviors.

Other related priorities: Opioid crisis: One point of HHS’s 5-point strategy to combat the opioid crisis is “better addiction prevention, treatment, and recovery services.” Improved access and utilization of mental health services will aid in prevention, treatment, and recovery.

Spending on Mental Health (Percentage of Total Health Spending) 201 Measure Construct Spending on Mental Health (Percentage of Total Health Spending) Health insurance reform: Spending on mental health is related to the HHS priority for health insurance reform because there are significant disparities in spending on and coverage for mental health care relative to the burden of disease associated with mental disorders. Validity Construct validity: • Mental health spending is disproportionately low and inefficiently allocated.4 • Evidence indicates that health care spending is positively related to actual improvements in health.23 • There is general agreement that the level of spending should reflect the burden of disease attributable to mental disorders.21

Internal validity: • Mental health disorders are common and costly, yet the quality of care for these disorders has not improved over recent decades.24 • A key reason for the lag in mental health performance is the lack of monetary resources.25 • However, the ideal proportion of spending on mental health as a percentage of total health spending that will result in the best health outcomes is likely to vary by country, and a higher percentage of spending on mental health might not necessarily be an indicator of mental health care quality due to differences in the populations.

Discriminant validity: • The utilization of mental health services is, in part, a function of the characteristics of the population. Consequently, international comparisons of measures of mental health spending may be confounded by population characteristics, by access to care overall, and by subpopulations. Additional threats to validity include international variation in the definitions of mental illness, as well as mental health diagnostic and treatment guidelines. Feasibility for Definitions: international • The WHO definition of mental health is widely used;1 however, there comparisons are other definitions, and there is some disagreement among experts on the best definition.26 • Related to mental health spending, OECD notes: “Governments cannot fully quantify the cost of mental illness, as few countries systematically measure the resources they devote to mental health. The lack of data on costs, quality and outcomes inhibits a complete assessment of mental health system performance. The result is poor policy, and an inability to direct scarce resources to areas of need.”21

Data availability: • Although some data on mental health spending and overall health spending are currently available and in use, OECD has suggested that available data are not sufficient for a full picture of mental health system performance.21 o Global: The World Health Organization Assessment Instrument for Mental Health Systems (WHOAIMS) is a tool for collecting essential information on the mental health system of a country or region. National governments submit this information, which includes mental health spending and overall health spending, to WHO and other coalitions.27

Spending on Mental Health (Percentage of Total Health Spending) 202 Measure Construct Spending on Mental Health (Percentage of Total Health Spending) Data comparability: • Health system characteristics could play a role in diagnosis, treatment, and spending associated with mental illness. The level of cost sharing in the health system associated with health care generally, and mental health care specifically, influences the patient’s utilization of care.28 • International differences in diagnoses and treatment guidelines, as well as cross-cultural differences in the presentation of mental health conditions and related help-seeking behaviors, would likely also threaten the comparability of the data.29

Subgroup analysis and equity: • Currently, available data on mental health spending are at the national level and do not describe spending among subgroups. • Disparities in rates of mental health disorders and receipt of mental health treatment by gender30 and race/ethnicity31 will affect variation in spending within a given country. Usability: National: Current evidence of use • The United States, specifically the Substance Abuse and Mental Health Services Administration, measures the amount of spending on mental health services and the percentage of total health spending devoted to mental health services.11

Global: • WHOAIMS collects information from national governments regarding mental health spending and overall health spending.27 Usability: Mental health spending (or mental health spending as a percentage of Relationship to total health spending) is not among the current OECD measures. currently used OECD However, OECD has begun working to benchmark the performance of measures nations’ mental health care systems.32

Closest related measures: • Health expenditure by type of service: This set of measures describes the percentage of national health spending devoted to primary care, inpatient care, outpatient care, long-term care, medical goods, collective services, and others.3 The measures demonstrate that the structure of spending across various types of care varies considerably by country.

References

1. World Health Organization. Mental Health: Strengthening Our Response. 2018. Accessed May 26, 2020. https://www.who.int/en/news-room/fact-sheets/detail/mental-health-strengthening-our-response 2. DeSilva M, Samele C, Saxena S, Patel V, Darzi A. Policy actions to achieve integrated community-based mental health services. Health Aff (Millwood). 2014;33(9):1595-1602. 3. OECD. Health at a Glance 2019: OECD Indicators. Paris: OECD Publishing; 2019. 4. Vigo DV, Kestel D, Pendakur K, Thornicroft G, Atun R. Disease burden and government spending on mental, neurological, and substance use disorders, and self-harm: Cross-sectional, ecological study of health system response in the Americas. Lancet Public Health. 2019;4(2):e89-e96. 5. Liese BH, Gribble RSF, Wickremsinhe MN. International funding for mental health: A review of the last decade. Int Health. 2019;11(5):361-369. 6. Centers for Disease Control and Prevention. Data and Publications. 2018. Accessed May 26, 2020. https://www.cdc.gov/mentalhealth/data_publications/index.htm 7. National Institute for Mental Health. Mental Illness. 2019. Accessed May 21, 2020. https://www.nimh.nih.gov/health/statistics/mental-illness.shtml

Spending on Mental Health (Percentage of Total Health Spending) 203 8. Mental Health America. The State of Mental Health in America. Undated. Accessed May 21, 2020. https://www.mhanational.org/issues/state-mental-health-america 9. Kamal R. What Are the Current Costs and Outcomes Related to Mental Health and Substance Use Disorders? 2017. Accessed May 21, 2020. https://www.healthsystemtracker.org/chart-collection/ current-costs-outcomes-related-mental-health-substance-abuse-disorders/#item-start 10. Dieleman JL, Cao J, Chapin A, et al. US health care spending by payer and health condition, 1996–2016. JAMA. 2020;323(9):863-884. 11. U.S. Department of Health and Human Services, Substance Abuse and Mental Health Services Administration. Projections of National Expenditures for Treatment of Mental and Substance Use Disorders, 2010–2020; HHS Publication No. SMA-14-4883. 2014. 12. U.S. Department of Health and Human Services, Substance Abuse and Mental Health Services Administration. Behavioral Health Spending & Use Accounts 2006–2015; HHS Publication No. SMA 19- 5095. 2019. 13. Patel V, Saxena S, Lund C, et al. The Lancet Commission on Global Mental Health and Sustainable Development. Lancet. 2018;392(10157):1553-1598. 14. Rehm J, Shield KD. Global burden of disease and the impact of mental and addictive disorders. Curr Psychiatry Rep. 2019;21(2):10. 15. World Health Organization. WHO MiNDbank. 2018. Accessed May 26, 2020. https://www.who.int/mental_health/mindbank/en 16. OECD. Mental Health. Undated. Accessed May 21, 2020. https://www.oecd.org/health/mental-health.htm 17. Mulvaney-Day N, Gibbons BJ, Alikhan S, Karakus M. Mental Health Parity and Addiction Equity Act and the use of outpatient behavioral health services in the United States, 2005–2016. Am J Public Health. 2019;109(S3):S190-S196. 18. Gertner AK, Rotter J, Cruden G. Effects of the Mental Health Parity and Addiction Equity Act on specialty outpatient behavioral health spending and utilization. J Ment Health Policy Econ. 2018;21(3):91-103. 19. Collins PY, Patel V, Joestl SS, et al. Grand challenges in global mental health. Nature. 2011;475(7354):27- 30. 20. Insel TR. Assessing the economic costs of serious mental illness. Am J Psychiatry. 2008;165(6):663-665. 21. OECD. Making Mental Health Count: The Social and Economic Costs of Neglecting Mental Health Care. Paris: OECD Publishing; 2014. 22. U.S. Department of Health and Human Services, Office of Disease Prevention and Health Promotion. Mental Health and Mental Disorders. 2020. Accessed May 21, 2020. https://www.healthypeople.gov/2020/topics-objectives/topic/mental-health-and-mental-disorders 23. Martin S, Rice N, Smith PC. Does health care spending improve health outcomes? Evidence from English programme budgeting data. J Health Econ. 2008;27(4):826-842. 24. Kilbourne AM, Beck K, Spaeth-Rublee B, et al. Measuring and improving the quality of mental health care: A global perspective. World Psychiatry. 2018;17(1):30-38. 25. Kilbourne AM, Keyser D, Pincus HA. Challenges and opportunities in measuring the quality of mental health care. Can J Psychiatry. 2010;55(9):549-557. 26. Manwell LA, Barbic SP, Roberts K, et al. What is mental health? Evidence towards a new definition from a mixed methods multidisciplinary international survey. BMJ Open. 2015;5(6):e007079. 27. Pan American Health Organization. The Burden of Mental Disorders in the Region of the Americas, 2018. 2019. 28. Cook BL, Flores M, Zuvekas SH, et al. The impact of Medicare's mental health cost-sharing parity on use of mental health care services. Health Aff (Millwood). 2020;39(5):819-827. 29. Vaillant GE. Positive mental health: Is there a cross-cultural definition? World Psychiatry. 2012;11(2):93- 99. 30. World Health Organization, Department of Mental Health and Substance Dependence. Gender Disparities in Mental Health. Geneva; 2013. 31. Alegría M, Alvarez K, Ishikawa RZ, DiMarzio K, McPeck S. Removing obstacles to eliminate racial and ethnic disparities in behavioral health care. Health Aff (Millwood). 2016;35(6):991-999. 32. OECD. OECD Mental Health Performance Framework. Paris: OECD Publishing; 2019.

Spending on Mental Health (Percentage of Total Health Spending) 204