National Institutes of Health Individual Mentored Career Development Awards Program Evaluation Working Group David Banks, NINR Carol Merchant, NCRR Juliana Blome, NIGMS Jim Onken, OD Liza Bundesen, NIMH Wilma Peterman-Cross, NIAMS Jim Corrigan, NCI Louise Rosenbaum, NIAMS Genevieve deAlmeida-Morris, NIDA Ann Rothgeb, NHLBI Christie Drew, NIEHS Wally Schaffer, OD Bettie Graham, NHGRI Larry Solomon, NCI Sarah Glavin, NICHD Brent Stanfield, NIDDK Milton Hernandez, OD Jane Steinberg, NIMH Cheryl Howard, NHLBI Melissa Stick, NIDCD Chyren Hunter, NIA Jennifer Sutton, OD Henry Khachaturian, OD Roger Sorenson, NIDA Linda Kupfer, FIC Rod Ulane, OD Karl Malik, NIDDK David Wilde, NCRR Julie Mason, NCI Study Directors Laurel Haak and Joshua Schnell Discovery Logic, a Thomson Reuters business Analysts Duane Williams, Leo DiJoseph, Matt Probus, Faye Liu, Yvette Seger Discovery Logic, a Thomson Reuters business Partial support for this study came from the NIH Evaluation Set-Aside Program, 10-5203 OD-OER-OEP 2 TABLE OF CONTENTS LIST OF TABLES ………………………………………………………………………………………………………………………………………………………..6 LIST OF FIGURES ............................................................................................................................................................ 7 EXECUTIVE SUMMARY ................................................................................................................................................... 8 Who is Applying for and Receiving Individual Mentored Career Development Awards? ......................................... 8 What is the Impact of Participation on Research Productivity and Independent Careers? ...................................... 9 Implications for Program Policy and Recommendations ........................................................................................ 10 INTRODUCTION ........................................................................................................................................................... 11 NIH Individual Mentored Career Development Programs ...................................................................................... 12 Evaluation Objectives and Research Design ............................................................................................................ 12 Logic Model. ........................................................................................................................................................ 13 Data Sources. ...................................................................................................................................................... 14 Methods for Analyzing Program Impact. ............................................................................................................ 14 Study Sample. ..................................................................................................................................................... 14 Report Structure ...................................................................................................................................................... 17 PART I: WHO IS APPLYING?.......................................................................................................................................... 18 1.1 Overview .................................................................................................................................................... 18 1.2 Methods ..................................................................................................................................................... 18 1.3 Applications, Awards, and Demographics .................................................................................................. 18 1.3.1 Applications and Awards by Program and IC ......................................................................................... 18 1.3.2 Distribution of Degrees among Applicants and Awardees .................................................................... 19 1.3.3 Sex Distribution among Applicants and Awardees ................................................................................ 21 1.3.4 Applications and Awards by Race/Ethnicity .......................................................................................... 23 1.3.5 Scientific Specialty of Applicants ........................................................................................................... 25 1.3.6 Applicant Age and Average Years since Terminal Degree ..................................................................... 27 1.3.7 Prior Support of Applicants and Awardees ............................................................................................ 29 PART II: SELECTED OUTCOMES .................................................................................................................................... 32 2.1 Overview .................................................................................................................................................... 32 2.2 Outcome Analysis Methodology ................................................................................................................ 32 2.2.1 Deriving Comparison Cohorts ................................................................................................................ 32 2.2.2 Data Sources for Outcomes Analysis ..................................................................................................... 33 2.3 Composition of the Study Cohorts ............................................................................................................. 34 2.3.1 Activities, ICs, and Fiscal Years ............................................................................................................... 34 3 2.3.2 Demographic Distribution...................................................................................................................... 36 2.4 Publications and Citations .......................................................................................................................... 36 2.4.1 Publication Outcomes ............................................................................................................................ 36 2.5 Subsequent Participation in NIH Grant Programs ...................................................................................... 37 2.5.1 Composite Cohort Outcomes ................................................................................................................ 37 2.5.2 Subsequent NIH Applications and Awards by Sex ................................................................................. 39 2.5.3 Subsequent Grant Applications and Awards by Degree ........................................................................ 41 2.5.4 Subsequent Awards by IC ...................................................................................................................... 44 2.6 Medical School Faculty Rank Progression .................................................................................................. 44 2.7 Does Participation in Mentored K Programs Delay the Start of Independent Research Careers? ............ 45 2.8 Does Participation in K Programs Generally Increase R01 & RPG Success Rates? ..................................... 47 2.9 Does Participation in K Programs Increase the Duration of Research Careers? ........................................ 48 PART III: SUMMARY AND POLICY IMPLICATIONS ........................................................................................................ 51 3.1 Mentored K Evaluation Conclusions .......................................................................................................... 51 3.2 Policy Implications...................................................................................................................................... 51 Appendix I: Data Selection Methods ........................................................................................................................... 54 A.1.1. Determination of Application Pool ............................................................................................................ 54 A.1.2. Methods Used for Determination of Demographics .................................................................................. 55 A.1.2.a. Identification of IMPAC II Person Relevant Records ............................................................................ 55 A.1.2.b. Prior NIH Support ................................................................................................................................. 55 A.1.2.c. Birth Date, Race/Ethnicity, and Sex ...................................................................................................... 56 A.1.2.d. Degree ................................................................................................................................................. 57 A.1.2.e. Academic Rank ..................................................................................................................................... 58 A.1.3. Methods Used to Identify Applications “On-The-Bubble” ......................................................................... 59 A.1.4. Determination of Subsequent NIH Activity ................................................................................................ 60 A.1.5. Matching MEDLINE Publication Records to Applicants .............................................................................