CORE TASK ASSISTANCE IN VIDEO GAMES By Jawad Jandali Refai B.Sc. Computer Science, University of Wollongong, 2016 A Thesis Submitted in Partial Fulfillment of the Requirements for the Degree of Master of Computer Science In the Graduate Academic Unit of Computer Science Supervisors: Scott Bateman, PhD, Computer Science Michael W. Fleming, PhD, Computer Science Examining Board: Eric Aubanel, PhD, Computer Science, Chair Weichang Du, PhD, Computer Science Erik Scheme, PhD, Electrical and Computer Engineering This thesis is accepted by the Dean of Graduate Studies THE UNIVERSITY OF NEW BRUNSWICK October, 2018 © Jawad Jandali Refai, 2019 ABSTRACT Video games can be challenging, which is part of what makes games stimulating and entertaining. However, if they are too challenging, the player may find it frustrating. Game designers may balance their game by providing players with assistance. Previous work explores the effectiveness of potential assistance techniques within a particular genre and platform. Complex games could require several types of assistance to support a wide variety of gameplay mechanics. Designers would need to gather information from scattered sources to make informed decisions to apply optimal assistance. In this thesis, we propose a generalized framework for assistance in games, irrespective of genre or target platform. We achieve this by discussing techniques targeted at the 10 fundamental core tasks in video games that are the base of any game mechanic, such as Aiming, Reaction Time, and Visual Search. We also explore the best practices for choosing, interpreting, and implementing one of the 35 assistance techniques. ii Table of Contents ABSTRACT ........................................................................................................................ ii Table of Contents ............................................................................................................... iii List of Tables .................................................................................................................... vii List of Figures .................................................................................................................. viii 1 - Introduction ................................................................................................................... 1 Organization .................................................................................................................... 4 Chapter 2 - Related Work ............................................................................................... 5 Chapter 3 - Core Tasks and Assistance........................................................................... 5 Chapter 4 - Assistance Techniques ................................................................................. 5 Chapters 5 and 6 - Demonstration and Evaluation ......................................................... 5 Chapters 7, 8, and 9 - Discussions, Future Work, and Conclusion................................. 5 2 – Background and Related Work ..................................................................................... 6 2.1 - Difficulty ................................................................................................................ 6 2.2 - Flow ........................................................................................................................ 7 2.3 - Assistance ............................................................................................................... 8 3 - Core Tasks and Assistance ............................................................................................ 9 3.1 - Core Tasks .............................................................................................................. 9 3.2 - Assistance Techniques .......................................................................................... 11 3.2.1 - Definition ....................................................................................................... 11 3.2.2 - Why explore Assistance in terms of Core Tasks? ......................................... 12 3.2.3 - Difference between Assistance and Difficulty Adjustment .......................... 13 3.2.4 - Difference between Assistance and “Doing it for them” .............................. 14 3.2.5 - Strength of Assistance Techniques ................................................................ 15 3.2.6 - Modes of Delivery ......................................................................................... 16 3.2.7 - Organization and Structure for Assistance Techniques ................................. 18 3.2.8 - Methodology .................................................................................................. 18 4 - Assistance Techniques ................................................................................................. 20 Core Tasks & Assistance List Template ........................................................................... 21 4.X – Core Task ................................................................................................................ 21 4.X.1 - Introduction....................................................................................................... 21 4.X.2 - Examples........................................................................................................... 21 4.X.2.1 Examples of Core Task Assistance .............................................................. 21 4.X.2.2 Examples of Player Exploits ........................................................................ 21 4.X.3 - Assistance Techniques ...................................................................................... 22 4.X.3.N – Assistance Technique N ........................................................................... 22 4.1 - Signal Detection ....................................................................................................... 23 4.1.1 – Introduction ....................................................................................................... 23 4.1.2 – Examples ........................................................................................................... 23 4.1.2.1 Examples of Signal Detection Assistance..................................................... 25 4.1.2.2 Examples of Player Exploits ......................................................................... 26 4.1.3 – Assistance Techniques ...................................................................................... 26 4.1.3.1 – Companion Signals .................................................................................... 27 4.1.3.2 – Augmented Parameters .............................................................................. 29 iii 4.1.3.3 – Announcements, Explanation, and Emphasis ............................................ 31 4.1.3.4 – Signal Priority ............................................................................................ 33 4.1.3.5 – Signal Transformation / Replacement ....................................................... 36 4.1.3.6 – Noise Reduction ......................................................................................... 38 4.2 – Signal Discrimination .............................................................................................. 40 4.2.1 – Introduction ....................................................................................................... 40 4.2.2 – Examples ........................................................................................................... 40 4.2.2.1 Examples of Signal Discrimination Assistance ............................................ 40 4.2.3 – Assistance Techniques ...................................................................................... 41 4.2.3.1 – Additional Cues ......................................................................................... 41 4.2.3.2 – Augmented Parameters .............................................................................. 43 4.2.3.3 – High Contrast ............................................................................................. 45 4.2.3.4 – Noise Reduction ......................................................................................... 46 4.3 – Body Controls .......................................................................................................... 48 4.3.1 – Introduction ....................................................................................................... 48 4.3.2 – Examples ........................................................................................................... 49 4.3.3 – Assistance Techniques ...................................................................................... 49 4.3.3.1 – Input Modulation (Muscle Activation) ...................................................... 49 4.3.3.2 – Detection Threshold (Body Movement) .................................................... 50 4.4 – Reaction Time .......................................................................................................... 52 4.4.1 – Introduction ....................................................................................................... 52 4.4.2 – Examples ........................................................................................................... 52 4.4.2.1 Examples of Reaction Time Assistance ........................................................ 53 4.4.3 – Assistance Techniques