Walden University ScholarWorks Walden Dissertations and Doctoral Studies Walden Dissertations and Doctoral Studies Collection 2020 Search Results: Predicting Ranking Algorithms With User Ratings and User-Driven Data Gary Michael Taylor Walden University Follow this and additional works at: https://scholarworks.waldenu.edu/dissertations Part of the Databases and Information Systems Commons This Dissertation is brought to you for free and open access by the Walden Dissertations and Doctoral Studies Collection at ScholarWorks. It has been accepted for inclusion in Walden Dissertations and Doctoral Studies by an authorized administrator of ScholarWorks. For more information, please contact [email protected]. Walden University College of Management and Technology This is to certify that the doctoral study by Gary Michael Taylor has been found to be complete and satisfactory in all respects, and that any and all revisions required by the review committee have been made. Review Committee Dr. Bob Duhainy, Committee Chairperson, Information Technology Faculty Dr. Charlie Shao, Committee Member, Information Technology Faculty Dr. Steven Case, University Reviewer, Information Technology Faculty Chief Academic Officer and Provost Sue Subocz, Ph.D. Walden University 2020 Abstract Search Results: Predicting Ranking Algorithms With User Ratings and User-Driven Data by Gary Michael Taylor MS, West Virginia University, 2010 BS, Marshall University, 2006 Doctoral Study Submitted in Partial Fulfillment of the Requirements for the Degree of Doctor of Information Technology Walden University February 2020 Abstract The purpose of this correlational quantitative study was to examine the possible relationship between user-driven parameters, user ratings, and ranking algorithms. The study’s population consisted of students and faculty in the information technology (IT) field at a university in Huntington, WV. Arrow’s impossibility theorem was used as the theoretical framework for this study. Complete survey data were collected from 47 students and faculty members in the IT field, and a multiple regression analysis was used to measure the correlations between the variables. The model was able to explain 85% of the total variability in the ranking algorithm. The overall model was able to significantly predict the algorithm ranking discounted cumulative gain, R2 = .852, F(3,115) = 220.13, p < .01. The Respondent DCG and Search term variables were the most significant predictor with p = .0001. The overall findings can potentially be useful to content providers who focus their content on a specific niche. The content created by these providers would most likely be focused entirely on that subgroup of interested users. While it is necessary to focus content to the interested users, it may be beneficial to expand the content to more generic terms to help reach potential new users outside of the subgroups of interest. User’s searching for more generic terms could potentially be exposed to more content that would generally require more specific search terms. This exposure with more generic terms could help users expand their knowledge of new content more quickly. Search Results: Predicting Ranking Algorithms With User Ratings and User-Driven Data by Gary Michael Taylor MS, West Virginia University, 2010 BS, Marshall University, 2006 Doctoral Study Submitted in Partial Fulfillment of the Requirements for the Degree of Doctor of Information Technology Walden University February 2020 Table of Contents List of Tables ..................................................................................................................... iv List of Figures ......................................................................................................................v Section 1: Foundation of the Study ......................................................................................1 Background ....................................................................................................................1 Problem Statement .........................................................................................................1 Purpose Statement ..........................................................................................................2 Nature of the Study ........................................................................................................2 Research Question .........................................................................................................4 Hypotheses .....................................................................................................................4 Theoretical Framework ..................................................................................................4 Definition of Terms........................................................................................................6 Assumptions, Limitations, and Delimitations ................................................................6 Assumptions ............................................................................................................ 6 Limitations .............................................................................................................. 7 Delimitations ........................................................................................................... 7 Significance of the Study ...............................................................................................8 Contribution to Information Technology Practice .................................................. 8 Implications for Social Change ............................................................................... 8 A Review of the Professional and Academic Literature ................................................9 Transition and Summary ..............................................................................................40 Section 2: The Project ........................................................................................................42 i Purpose Statement ........................................................................................................42 Role of the Researcher .................................................................................................43 Participants ...................................................................................................................45 Research Method and Design ......................................................................................47 Method .................................................................................................................. 47 Research Design.................................................................................................... 49 Population and Sampling .............................................................................................51 Ethical Research...........................................................................................................53 Data Collection ............................................................................................................55 Instrumentation ..................................................................................................... 55 Data Collection Technique ................................................................................... 59 Data Analysis ...............................................................................................................62 Study Validity ..............................................................................................................68 Transition and Summary ..............................................................................................71 Section 3: Application to Professional Practice and Implications for Change ..................73 Overview of Study .......................................................................................................73 Presentation of the Findings.........................................................................................74 Test of Assumptions ............................................................................................. 74 Descriptive Statistics ............................................................................................. 78 Inferential Statistics .............................................................................................. 80 Applications to Professional Practice ..........................................................................88 Implications for Social Change ....................................................................................90 ii Recommendations for Further Research ......................................................................91 Reflections ...................................................................................................................92 Summary and Study Conclusions ................................................................................93 References ..........................................................................................................................95 Appendix A: Questionnaire .............................................................................................119 Appendix B: Invitation Email .........................................................................................122 iii List of Tables Table 1. Breakdown of sources ..........................................................................................10