Human-Analytics in Information Systems Research and Applications in Personnel Selection
Total Page:16
File Type:pdf, Size:1020Kb
Human-Analytics in Information Systems Research and Applications in Personnel Selection Item Type text; Electronic Dissertation Authors Pentland, Steven J. Publisher The University of Arizona. Rights Copyright © is held by the author. Digital access to this material is made possible by the University Libraries, University of Arizona. Further transmission, reproduction, presentation (such as public display or performance) of protected items is prohibited except with permission of the author. Download date 04/10/2021 00:24:01 Link to Item http://hdl.handle.net/10150/630161 HUMAN-ANALYTICS IN INFORMATION SYSTEMS RESEARCH AND APPLICATIONS IN PERSONNEL SELECTION by Steven James Pentland _____________________________ Copyright © Steven James Pentland 2018 A Dissertation Submitted to the Faculty of the DEPARTMENT OF MANAGEMENT INFORMATION SYSTEMS In Partial Fulfillment of the Requirements For the Degree of DOCTOR OF PHILOSOPHY In the Graduate College THE UNIVERSITY OF ARIZONA 2018 1 'k* +#&(,k!k$-!k %)'k!k ^kL2L/2W^kS4k_>2kD^^2]b._DSOkSMMA__22ki2k03X_D;k_?._ki2k?.h2kY2.1k`@2k1D^^2.aBTPkUY2U.Z21k /jk5:+<(1<+6%+<_C_H21k8(,+&;7#2<#,<+!.0)6#.-<;16 (3< 20"<,< //'#6#.,4<#+<04.++%<&6#.,<.O1kW20SML2O1k_>._kD_k/2k.002U_21k.^k7gI8IIDQ<k_?2k 1D^^2._DSQkW2VfDW2L2O_k9Wk_?2k2=[22kS5kS0_SXkS4k"?DJS^SU>jk DQ.Hk.UUWSh.Kk.R1k.002U_.O02kS6k_>D^k1D^^2 ._DSQkD^k0SR_EO=2O_kdUSOk`>2k0.Q1D1._2^k^e/NF^^DSOk D_k/2k.002U_21k.^k:I4DIIDO<k`>2k1D^^2 ._DSQkW2VfDW2M2Ock ._2 k < DSQkGW20_S\ k;<9,*$ 0< ._2 k < ACKNOWLEDGEMENTS The Center for Leadership Ethics, Center for the Management of Information, and the Management Information Systems Department at the University of Arizona provided significant support for this research. I would like to thank and acknowledge Jay Nunamaker, Judee Burgoon, and Joe Valacich for their insight and encouragement. I’m truly grateful to have had the opportunity to work with such a distinguished group of academics. I would also like to recognize my colleagues Michael Byrd, Bradley Dorn, Lee Spitzley, and Rich Yueh. I feel extremely lucky to have shared this journey with such an incredible group of scholars. Undoubtably, this experience would have been less productive and enjoyable without colleagues like these. Finally, I would like to recognize Suzanne Cummins for inspiring me to pursue this endeavor and who tirelessly works to maximize the potential of her students. 4 DEDICATION I would not have been able to complete this endeavor without my loving wife, Amanda. From the very beginning, you provided support, encouragement, and laughter. Words cannot describe how thankful and lucky I feel to have you in my life. To my parents and family, Anne, Gordon, Christopher, and Mary – You have made me what I am today. Mom and Dad – you have always been an inspiration to me. Your positive attitude, work ethics, guidance, love, and commitment to our family has shaped who I am and has driven me to seek happiness and excellence in everything I pursue. To my in-laws, Patricia and Daniel – I could not ask for a better extended family. Throughout this journey, you have provided unwavering support for Amanda and me. Thank you for your frequent visits, sound advice, and encouragement. 5 Table of Contents Abstract .......................................................................................................................................... 13 1 Introduction ............................................................................................................................ 14 2 Behavioral Informatics and Human-Analytics ...................................................................... 15 2.1 Defining Human-Analytics ............................................................................................ 16 2.2 Human Sensing Technology .......................................................................................... 18 2.3 Human Sensing Systems in Information Systems Research .......................................... 20 2.3.1 Socio-Behavioral Sciences ..................................................................................... 21 2.3.2 Sensing Instrument ................................................................................................. 22 2.3.3 Data Management .................................................................................................. 22 2.3.4 Data Analytics and Decision Support .................................................................... 23 2.4 Ubiquitous vs. Specialized Sensors ............................................................................... 26 3 Human-Analytics for Organizational Value .......................................................................... 28 4 Human-Analytics for Personnel Selection – Subjective Measures ........................................ 30 4.1 Research Approach ........................................................................................................ 32 4.2 Personnel Selection ........................................................................................................ 32 4.3 Applicant Sifting ............................................................................................................ 33 4.4 Interview Ratings ........................................................................................................... 35 4.5 Source Credibility .......................................................................................................... 36 4.6 Behavioral Signals ......................................................................................................... 39 4.6.1 Verbal ..................................................................................................................... 39 6 4.6.2 Nonverbal ............................................................................................................... 40 4.7 Systems for Behavioral Analysis ................................................................................... 44 5 System Specifications & Design ............................................................................................ 46 5.1 Prototype System ........................................................................................................... 50 5.1.1 Base Asynchronous Video Interview System Platform ......................................... 50 5.1.2 Human-Analytics Extension to Base AVIS Platform ............................................ 51 6 Experiment 1 .......................................................................................................................... 53 6.1 Experiment Procedure .................................................................................................... 54 6.2 Participants ..................................................................................................................... 56 6.3 Rating Interview Performance ....................................................................................... 56 6.4 Source Credibility Factor Analysis ................................................................................ 57 6.5 Experiment 1 Analysis ................................................................................................... 60 6.5.1 Features Selection .................................................................................................. 61 6.5.2 Feature Aggregation ............................................................................................... 63 6.5.3 Outlier Detection and Feature Standardization ...................................................... 63 6.5.4 Behavioral Feature Correlations Analysis ............................................................. 64 6.5.5 Class Identification ................................................................................................ 64 6.5.6 Classification Results – Model Performance ......................................................... 73 6.6 Experiment 1 Discussion ............................................................................................... 75 6.6.1 Experiment 1 Summary Results ............................................................................. 75 6.6.2 Experiment 1 Key Contributions ........................................................................... 78 7 6.7 Experiment 1 Conclusion ............................................................................................... 80 7 Human-Analytics for Personnel Selection – Objective Measures ......................................... 81 7.1 Structured Interviews & Question Types ....................................................................... 82 7.2 Assessing Cognitive Ability .......................................................................................... 84 7.2.1 Cues to Cognitive Ability ...................................................................................... 84 7.2.2 Cues to Cognitive Load.......................................................................................... 86 7.3 Hypotheses ..................................................................................................................... 87 8 Experiment 2 .......................................................................................................................... 88 8.1 Experiment Procedure .................................................................................................... 89 8.2 Participants ....................................................................................................................