Development of Telethrone a Novel Situated Display
Total Page:16
File Type:pdf, Size:1020Kb
Telethrone: a situated display using retro-reflection based multi-view toward remote collaboration in small dynamic groups John O’Hare UNIVERSITY OF SALFORD SCHOOL OF COMPUTING,SCIENCE AND ENGINEERING DECEMBER 13, 2018 This document is toward the degree of Doctor of Philosophy Contents 0.1 Abstract . 1 0.2 Declaration . 3 0.2.1 Contributing research . 3 0.2.2 Novel Components . 5 0.3 Abbreviations and Definitions . 6 1 Introduction 11 1.1 Research Problem . 12 1.1.1 Research Questions . 13 1.2 Scope and Limitations . 14 1.3 Contributions . 15 2 Literature Review & Theoretical Framework 18 2.1 Chapter Overview . 18 i CONTENTS ii 2.2 Introduction . 19 2.3 Human - Human interaction: Communication theory . 19 2.3.1 Vocal . 20 2.3.2 Nonverbal . 22 2.4 Human - Human Interaction: Interpersonal Psychology . 29 2.4.1 Proxemics . 29 2.4.2 Attention . 31 2.4.3 Behaviour . 32 2.5 Technology-Mediated Interaction . 34 2.5.1 Dyadic . 34 2.5.2 Triadic and Small Group . 36 2.5.3 Presence, Co-presence, and Social Presence . 37 2.5.4 Mona Lisa Type Effects . 40 2.5.5 Mutual Gaze in Telepresence . 41 2.5.6 Other Systems to Support Business . 42 2.5.7 Beyond 2D Screens . 43 2.5.8 Network Issues . 57 2.6 Comparing Key Systems and their Affordances . 58 2.7 Support for Less Formal? . 60 CONTENTS iii 2.7.1 Support for Dynamic Meetings . 62 2.8 Theoretical Framework . 63 2.8.1 Problem Statement . 63 2.8.2 Core Assumptions . 64 2.8.3 Peripheral Assumptions . 66 2.8.4 Revisiting the Literature Review . 66 3 Methodology 68 3.1 Chapter Overview . 68 3.2 Introduction . 69 3.3 Aims and Objectives . 70 3.3.1 Aim . 70 3.3.2 Objectives . 70 3.3.3 Research Questions . 71 3.4 Summary of Research Process . 72 3.4.1 Common Approaches . 72 3.4.2 Literature Review . 74 3.4.3 Inclusion & Exclusion Criteria . 78 3.4.4 Software Tools Used in the Review . 79 CONTENTS iv 3.4.5 Publishing Methodology . 83 3.5 Overview of Methods for Experiments . 83 3.5.1 Common Materials . 84 3.5.2 Hypotheses . 89 3.5.3 Participants . 92 3.5.4 Variables . 93 4 Initial Exploration 96 4.1 Chapter Overview . 96 4.2 Other Materials and Investigation Prior to the PhD . 96 4.3 Image Manipulation . 97 4.3.1 Projection Mapping . 97 4.3.2 Software Masks . 98 4.4 Chromatte . 98 4.4.1 Scalability . 99 4.4.2 Testing Chromatte . 100 4.4.3 Conclusion . 101 5 IP Camera System and Triadic Experiment 106 5.1 Chapter Overview . 106 CONTENTS v 5.2 System Development . 107 5.3 Experiment . 110 5.3.1 Materials . 110 5.3.2 Procedure . 116 5.3.3 Analysis and Results . 119 5.4 Discussion . 133 6 Dynamic Meetings and Meetings Within a Meeting 135 6.1 Chapter Overview . 135 6.2 Revisiting the Literature . 136 6.2.1 Baseline: The Formal Meeting . 137 6.2.2 Business Meetings . 137 6.2.3 Faultlines . 139 6.3 Analogies in Fiction . 139 6.4 Hypothetical Maximum . 140 6.4.1 A More Pragmatic Maximum . 143 6.5 Applying to an Example Meeting . 145 6.5.1 Analysis of Space Constraints . 148 6.5.2 Limits on the Reconstructed Viewpoint . 149 CONTENTS vi 6.6 Texture Blending (Not Ideal Capture Placement) . 151 6.7 Discussion . 152 7 Reconstruction Based Telethrone and Experiments 156 7.1 Chapter Overview . 156 7.2 System Development . 157 7.2.1 Previous System . 157 7.2.2 Blending with ’withyou’ . 157 7.3 Experiment: Testing Eye Gaze Using Reconstructed Avatars . 161 7.3.1 Materials . 162 7.3.2 Results . 167 7.3.3 Discussion . 170 7.4 System Development . 172 7.5 Experiment: Testing Perception Within a Group . 173 7.5.1 Materials . 174 7.5.2 Results: Perception of Attention . 183 7.5.3 Other results: Software Performance . 186 7.5.4 Discussion . 187 7.6 Conclusion . 187 CONTENTS vii 8 Evaluation, Discussion & Conclusion 189 8.1 Chapter Overview . 189 8.2 Literature Review . 190 8.2.1 Impact of the Literature . 190 8.2.2 Point of Departure . 192 8.2.3 Revisiting the Literature Throughout, a Summary . 193 8.2.4 Impact on Literature . 195 8.3 Discussion . 195 8.3.1 Original Aims . 195 8.3.2 Summary Review of Objectives and Questions . 196 8.3.3 Review of Methodology . 200 8.3.4 Review of Hypotheses . 205 8.3.5 Evaluation . 210 8.3.6 Contributions . 214 8.3.7 Shortcomings . 218 8.3.8 Future Research . 221 8.4 Conclusion . 225 A Appendices 272 CONTENTS viii A.1 New Version of withyou, CROSSDRIVE . 272 A.2 Ethical approval forms . 274 A.3 Survey for poker . 279 A.4 Software to record participant position for Exp 2 . 301 A.5 Actionscript code for shared poker task . 305 A.6 Script for experiment 3 . 315 A.7 Experiment 3 full results . 316 A.8 Final scaled system questions . 316 A.9 GODSPEED Indices . 326 A.10 Networked Minds . 335 A.11 Presented at ICAT-EGVE in Little Rock USA . 338 A.12 Presented at International AV VR . 339 A.13 R analysis . 349 List of Figures 1 Early discussion and some testing across the group suggested that a chair (inset left) might be combined with retro-reflective material (seen demonstrating three isolated viewpoints of the same person). Rear projection of a micro-lensed material and lenticular sheets were trialled at this time with poor results. 4 2 Group and wider contributors to the system. The fields of study are in blue, while the notable researchers are in black. The litera- ture review reveals many more key players from these and other connected fields, but this diagram captures the intersections of colleagues who were directly involved. The author contributed novelty across the Venn to the previous work of others, but personal novelty is the centre of the Venn. 6 2.1 An access grid system. Such systems form a loose specification of ‘quality’ for aspects of the connection including latency, resolution, echo cancellation, etc. They are difficult to set-up and maintain and increasingly rare with Google searches for the term peaking in 2004 at 20 times the current level. 20 2.2 Head and upper body framing experiment by Nguyen and Canny. They used physical masks to block out the body shown on the large screen. ..