A Delphi Study Regarding How, Can, and Should Individual Psychology Demonstrate Efficacy Andff E Ectiveness Given Evidence Based Practice Evaluation Standards
Total Page:16
File Type:pdf, Size:1020Kb
W&M ScholarWorks Dissertations, Theses, and Masters Projects Theses, Dissertations, & Master Projects Spring 2017 A Delphi Study Regarding How, Can, and Should Individual Psychology Demonstrate Efficacy andff E ectiveness Given Evidence Based Practice Evaluation Standards Sterling Price Travis College of William and Mary - School of Education, [email protected] Follow this and additional works at: https://scholarworks.wm.edu/etd Part of the Education Commons Recommended Citation Travis, Sterling Price, "A Delphi Study Regarding How, Can, and Should Individual Psychology Demonstrate Efficacy andff E ectiveness Given Evidence Based Practice Evaluation Standards" (2017). Dissertations, Theses, and Masters Projects. Paper 1499450001. http://doi.org/10.21220/W4P945 This Dissertation is brought to you for free and open access by the Theses, Dissertations, & Master Projects at W&M ScholarWorks. It has been accepted for inclusion in Dissertations, Theses, and Masters Projects by an authorized administrator of W&M ScholarWorks. For more information, please contact [email protected]. Running head: INDIVIDUAL PSYCHOLOGY’S EFFICACY AND EFFECTIVENESS A DELPHI STUDY REGARDING HOW, CAN, AND SHOULD INDIVIDUAL PSYCHOLOGY DEMONSTRATE EFFICACY AND EFFECTIVENESS GIVEN EVIDENCE BASED PRACTICE EVALUATION STANDARDS ________________________________________________ A Dissertation Presented to The Faculty of the School of Education The College of William & Mary in Virginia ___________________________________________________ In Partial Fulfillment Of the Requirements for the Degree Doctor of Philosophy ___________________________________________________ by Sterling P. Travis March, 2017 INDIVIDUAL PSYCHOLOGY’S EFFICACY AND EFFECTIVENESS iii A DELPHI STUDY REGARDING HOW, CAN, AND SHOULD INDIVIDUAL PSYCHOLOGY DEMONSTRATE EFFICACY AND EFFECTIVENESS GIVEN EVIDENCE BASED PRACTICE EVALUATION STANDARDS By Sterling P. Travis __________________________________________________________ Approved March 2017 by Charles (Rip) R. McAdams, Ph.D. Chairperson of Doctoral Committee Victoria A. Foster, Ph.D. Jacqueline Rodriguez, Ph.D. Richard E. Watts, Ph.D. INDIVIDUAL PSYCHOLOGY’S EFFICACY AND EFFECTIVENESS iv Dedication This dissertation is dedicated to Karen Whitcomb, Charlie Travis, Mary Carver, and Velma Walton. Whom each taught me to pursue everything with passion, to love others, and to enjoy life to the fullest. INDIVIDUAL PSYCHOLOGY’S EFFICACY AND EFFECTIVENESS v TABLE OF CONTENTS CHAPTER ONE ............................................................................................................................2 General Statements on Individual Psychology ....................................................................... 3 Evidence Based Practice ........................................................................................................... 7 Definition of Evidence Based Practice and Empirically Supported Treatments .................... 7 History of EBP Movement ...................................................................................................... 8 Goal of EBP Movement ........................................................................................................ 10 Debate Around EBP .............................................................................................................. 11 Pressure to move Towards EBP ............................................................................................ 12 Struggle for Contemporary Theories to Adapt to EBP ....................................................... 14 Statement of the Problem ....................................................................................................... 16 Purpose of the Study ............................................................................................................... 19 Sample Description and Data Gathering Procedures .......................................................... 20 Summary .................................................................................................................................. 24 CHAPTER TWO .........................................................................................................................25 Review of Selected and Current Literature .......................................................................... 25 EBP Evaluation Guidelines and Standards .......................................................................... 25 EBP General Evaluation Standards ...................................................................................... 26 Treatment efficacy. ........................................................................................................... 26 Treatment effectiveness. ................................................................................................... 28 EST Evaluation Process ........................................................................................................ 30 Focus on manualized treatment. ....................................................................................... 32 Focus on outcome research. .............................................................................................. 34 INDIVIDUAL PSYCHOLOGY’S EFFICACY AND EFFECTIVENESS vi Summary of EBP Evaluation Standards, Guidelines, and Process ....................................... 35 Limitations of the EST Evaluation Method ......................................................................... 36 Debate Around EBP and EST ............................................................................................... 37 Limitation of Evaluation Standards and Guidelines: General .............................................. 38 Limitation of Applying Evaluation Standards and Guidelines to Individual Psychology .... 41 Argument for Individual Psychology’s Continued Relevance ............................................ 44 Summary, Trends, and Pressure ........................................................................................... 47 Need for Examination of Individual Psychology’s Efficacy and Effectiveness ................. 48 Debate and Suggested Adaptations and Integration ............................................................. 50 Summary .................................................................................................................................. 52 CHAPTER THREE .....................................................................................................................53 Methodology ............................................................................................................................ 53 The Delphi Method ................................................................................................................. 53 Development of the Delphi Method ..................................................................................... 54 Strength and Weakness Considerations of the Delphi Method ............................................ 55 Panel Selection ......................................................................................................................... 58 Selection and Recruitment of Participants ............................................................................ 58 Data Collection ........................................................................................................................ 59 Role of the Researcher .......................................................................................................... 60 Data Collection and Analysis Description by Rounds ......................................................... 60 Initial Round Data Collection ............................................................................................... 60 Initial Round Data Analysis .................................................................................................. 61 Second Round Data Collection ............................................................................................. 62 INDIVIDUAL PSYCHOLOGY’S EFFICACY AND EFFECTIVENESS vii Second Round Data Analysis ................................................................................................ 63 Preparation for Round Three ................................................................................................ 63 Third Round Data Collection ................................................................................................ 64 Third Round Data Analysis .................................................................................................. 64 Ethical Considerations ........................................................................................................... 67 Limitations ............................................................................................................................... 67 Summary .................................................................................................................................. 68 CHAPTER FOUR ........................................................................................................................69 Results ...................................................................................................................................... 69 Review of Delphi Process ........................................................................................................ 70 Delphi Response Profiles by Each Round ............................................................................