Evaluating Colleges and Universities: a New Model for Institutional Rankings Lucien Robert Costley [email protected]
Total Page:16
File Type:pdf, Size:1020Kb
Seton Hall University eRepository @ Seton Hall Seton Hall University Dissertations and Theses Seton Hall University Dissertations and Theses (ETDs) Spring 3-16-2015 Evaluating Colleges and Universities: A New Model for Institutional Rankings Lucien Robert Costley [email protected] Follow this and additional works at: https://scholarship.shu.edu/dissertations Part of the Educational Assessment, Evaluation, and Research Commons, Educational Leadership Commons, and the Higher Education Commons Recommended Citation Costley, Lucien Robert, "Evaluating Colleges and Universities: A New Model for Institutional Rankings" (2015). Seton Hall University Dissertations and Theses (ETDs). 2080. https://scholarship.shu.edu/dissertations/2080 EVALUATING COLLEGES AND UNIVERSITIES: A NEW MODEL FOR INSTITUTIONAL RANKINGS Lucien Robert Costley Dissertation Committee Rong Chen, Ph.D., Mentor Robert Kelchen, Ph.D., Committee Member Luke Stedrak, Ed.D., Committee Member Submitted in partial fulfillment of the requirements for the degree of DOCTOR OF PHILOSOPHY Seton Hall University May 2015 © Copyright by Lucien Robert Costley 2015 All Rights Reserved EVALUATING COLLEGES AND UNIVERSITIES: A NEW MODEL FOR INSTITUTIONAL RANKINGS iv ABSTRACT Most colleges and universities function independently and lack the wherewithal of measuring performance areas of effectiveness, efficiency or quality. The United States Department of Education maintain a number of subsidiary organizations and external sources that provide public statistical data for analysis, yet an institutional performance output measure has not been defined, created, nor developed. At best, university rankings (from sources such as US News and World Report) have been the main source of institutional performance for decades despite researchers’ attempts to address gaps within the higher education field. These sources remain limited within their methodology and may not truly depict a thorough evaluation of a college or university. Therefore, the purpose of this study is to identify key indicators that measure whether an institution is performing well and provides a new comprehensive institutional ranking model. Using the initial framework from the Benchmark Model of Institutional Efficiency and Effectiveness (BMIEE) with guidance from Kim Cameron’s measurement of organizational effectiveness in higher education, this study links institutional characteristics, expenditures, efficiency, and effectiveness in ways that can improve the overall performance and evaluation of institutions. In addition, a review of US News ranking methodologies is examined based on peer- reviewed empirical research as well as the development of three E components for the new model (effectiveness, efficiency, and expenditures). The findings of this study result in a new set of institutional rankings of 4-year (public and private) colleges and universities using the new EVALUATING COLLEGES AND UNIVERSITIES: A NEW MODEL FOR INSTITUTIONAL RANKINGS v model. A statistical ranking comparison between the new model and US News rankings are investigated, showing significant differences within various classifications of institutions. Keywords: Rankings, Evaluation, Efficiency, Effectiveness, Expenditures, Institution Performance, Colleges and Universities EVALUATING COLLEGES AND UNIVERSITIES: A NEW MODEL FOR INSTITUTIONAL RANKINGS vi ACKNOWLEDGEMENTS The desire to pursue a doctoral degree is generally inspired by an event in one’s life. Once committed, the composition and defense of a doctoral dissertation then requires years of maintaining a focused direction, obtaining ongoing academic guidance, receiving never ending emotional and familial support, and forcing occasional, but necessary distractions. This monumental life achievement is shared with so many beautifully spirited colleagues, friends, and family. My inspiration of attaining a doctoral degree occurred early in life by two courageous and trend setting women. In the late 1990’s, my cousin, Dr. Veronica L. Estrada and high school biology instructor, Dr. Cynthia A. Perez successfully defended their doctoral degree, leaving a resounding impression and instilling an inspiring act of achievement that I then wished to accomplish one day. I now hope my efforts contribute to the prestige and honor established by each of them (within my maternal extended family and my hometown K-12 school district). I thank you both for being my example of greatness. My focused direction is attributed to Dr. Rong Chen, Associate Professor and Director of Higher Education ELMP Programs, for serving as my advisor and mentor throughout my three and a half years of completing my academic work, and defense of this dissertation. Thank you for your vision and belief in me. Your support of my research led to multiple national level organizational opportunities beyond Seton Hall University as well as my first appointment within higher education institutional research. I am forever grateful. I extend my sincerest gratitude to my professors within Jubilee Hall that aided my ongoing academic work. I received a strong foundation of higher education curricula and quality instruction from the finest within the field. A special thanks to both committee members (Dr. EVALUATING COLLEGES AND UNIVERSITIES: A NEW MODEL FOR INSTITUTIONAL RANKINGS vii Robert Kelchen and Dr. Luke Stedrak) for your time, expertise, support, and feedback throughout this process. To all other ELMP staff that made every day of my graduate assistantship exciting, fun, and filled with laughter. Our $5 lunches will be cherished. To the many Seton Hall University friends that I made along the way and who contributed to my random acts of craziness both at home and on campus (Jessica, Omayra, Will, Ryan, Jenn), I thank you. Attempting to complete a dissertation without emotional support is frankly, impossible. Such support includes all contributions that fill the mind, heart, and spirit. From the pep talk to the you need to finish that dissertation lecture and the available bended ear that was filled with doubt, anxiety, and thrill…I needed it all. All of your unique personalities provided such a combination of enriched enthusiasm that leaped me out of moments of despair. This journey was only possible with your encouragement, words of validation, and commitment that I persisted through my defense. Thank you Cristina, Marissa, Mayra, Michelle, Nancy, and Traci for each of your witty senses of humor, inappropriateness (of which I love the most), energy, true friendship, and always believing in me. Our life-long relationships are forever rooted. What kindred spirits you are! Relocating to the northeast required more than the usual familial support. This was received numerous times with wonderful care packages, seasonal cards, FaceTime opportunities, memorable visits, and uproarious phone conversations recollecting our childhood. To my siblings (Raymond Richard, Marlene Elaine, and Rex Anthony), thank you for being my true, solid foundation after all of these years. Our connection gives me strength and brings so much joy to my life! To my extended siblings (Blondi, Michelle and Ricky), thank you for your love and ongoing support. To my nieces and nephews (Talitha, Raythric Alexander, Ashley Elizabeth, EVALUATING COLLEGES AND UNIVERSITIES: A NEW MODEL FOR INSTITUTIONAL RANKINGS viii Madeleine Faith, Elizabeth Marie and Christian Rex), may this accomplishment serve as an inspiration of future educational attainment. Although all of those mentioned aided the distraction from my dissertation (in one way or another), while pursing my degree, I spent years as a part-time manager at the Pier 1 Imports Flagship Store on 5th Avenue in New York City. My time away from my academic studies truly provided a healthy balance of work and play over the years. Within said time, I met wonderful employees, encountered colorful customers, and gained a perspective of retail services that helped shaped my appreciation for those within the field. I truly admire and thank all of the managers for your positive and fun-filled, collegiate bonding working energy. Boy, did I have plenty of laughs along the way. What an amazing and talented set of individuals! I tip my hat to each of you. On a special note, within the past few years and throughout my doctoral studies, two dear friends left this world way too soon. Their influence is especially noteworthy towards my successful completion of this doctoral degree. To Homer Clifton Shirley, III, a gentleman and scholar who came into my life for a short time, yet remains forever within my heart. To Middy L. Wilkinson, my beacon of light that continues to shine brightly over me, instilling laughter and enjoyment even though we are apart. The both of you are truly missed. EVALUATING COLLEGES AND UNIVERSITIES: A NEW MODEL FOR INSTITUTIONAL RANKINGS ix IN DEDICATION To my loving and devoted parents, Deacon Richard and Mary Costley For your endless commitment and longstanding journey of building a home filled with love, God, and laughter. Words truly cannot express my deepest emotions of gratitude, respect, admiration, and pride for the both of you. Your example of hard work, commitment, spiritual devotion, and advocacy of education has truly empowered us ‘onward and upward.’ This life accomplishment is yet another groundbreaking achievement for the Costley legacy and it is because of the both of you. Well done, Mom and Dad. and IN MEMORIAM To my sister and life-long guardian angel, + Mylene Elizabeth Costley EVALUATING