Understanding and Evaluating Cooperative Video Games
Total Page：16
File Type：pdf, Size：1020Kb
Understanding and Evaluating Cooperative Video Games by Bardia Aghabeigi Bsc. Iran University of Science and Technology, 2006 THESIS SUBMITTED IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DEGREE OF MASTER OF SCIENCE School of Interactive Arts and Technology © Bardia Aghabeigi, 2011 SIMON FRASER UNIVERSITY Spring 2011 1 APPROVAL Name: Bardia Aghabeigi Degree: Master of Science Title of Thesis: Understanding and Evaluating Cooperative Video Games Examining Committee: Chair: _____________________________________________ Dr. Marek Hatala Associate Professor, School of Interactive Arts & Technology _____________________________________________ Dr. Magy Seif El-Nasr Senior Supervisor Assistant Professor, School of Interactive Arts & Technology _____________________________________________ Dr. Thecla Schiphorst Supervisor Associate Professor, School of Interactive Arts & Technology _____________________________________________ Dr. Kate Hennessy External Examiner Assistant Professor, School of Interactive Arts & Technology Date Defended/Approved: February 21, 2011 ii Declaration of Partial Copyright Licence The author, whose copyright is declared on the title page of this work, has granted to Simon Fraser University the right to lend this thesis, project or extended essay to users of the Simon Fraser University Library, and to make partial or single copies only for such users or in response to a request from the library of any other university, or other educational institution, on its own behalf or for one of its users. The author has further granted permission to Simon Fraser University to keep or make a digital copy for use in its circulating collection (currently available to the public at the “Institutional Repository” link of the SFU Library website <www.lib.sfu.ca> at: <http://ir.lib.sfu.ca/handle/1892/112>) and, without changing the content, to translate the thesis/project or extended essays, if technically possible, to any medium or format for the purpose of preservation of the digital work. The author has further agreed that permission for multiple copying of this work for scholarly purposes may be granted by either the author or the Dean of Graduate Studies. It is understood that copying or publication of this work for financial gain shall not be allowed without the author’s written permission. Permission for public performance, or limited permission for private scholarly use, of any multimedia materials forming part of this work, may have been granted by the author. This information may be found on the separately catalogued multimedia material and in the signed Partial Copyright Licence. While licensing SFU to permit the above uses, the author retains copyright in the thesis, project or extended essays, including the right to change the work for subsequent purposes, including editing and publishing the work in whole or in part, and licensing other parties, as the author may desire. The original Partial Copyright Licence attesting to these terms, and signed by this author, may be found in the original bound copy of this work, retained in the Simon Fraser University Archive. Simon Fraser University Library Burnaby, BC, Canada Last revision: Spring 09 STATEMENT OF ETHICS APPROVAL The author, whose name appears on the title page of this work, has obtained, for the research described in this work, either: (a) Human research ethics approval from the Simon Fraser University Office of Research Ethics, or (b) Advance approval of the animal care protocol from the University Animal Care Committee of Simon Fraser University; or has conducted the research (c) as a co-investigator, collaborator or research assistant in a research project approved in advance, or (d) as a member of a course approved in advance for minimal risk human research, by the Office of Research Ethics. A copy of the approval letter has been filed at the Theses Office of the University Library at the time of submission of this thesis or project. The original application for approval and letter of approval are filed with the relevant offices. Inquiries may be directed to those authorities. Simon Fraser University Library Simon Fraser University Burnaby, BC, Canada Last update: Spring 2010 Abstract Cooperative design has been an integral part of many digital and table top games since their inception. With the recent success of games like Resident Evil 5 and Left4dead, many video game designers and producers are currently exploring the addition of cooperative patterns within their games. In this thesis, I present two contributions. First, I present a set of cooperative design patterns. This framework can be used by game designers to add co-op content in their games. Second, I present a set of validated performance metrics that can be used to gauge the users' experience in a cooperative game. In this study, we developed the performance metrics. I then applied them to evaluate four commercial cooperative games. I further validated these metrics through a qualitative content analysis method where I investigated the relationship between the metrics derived by our study and the metrics derived by game reviewers. Keywords: Game Metrics; Game Design Patterns; Expert Game Reviews; Cooperative Games; Game Playability Testing iii Table of Contents Approval ............................................................................................................................ ii Abstract ............................................................................................................................. iii Table of Contents ............................................................................................................. iv List of Figures ................................................................................................................... vi List of Tables ................................................................................................................... vii Work Credit: .................................................................................................................. viii Definitions:......................................................................................................................... x Chapter 1. Introduction and Research Questions ......................................................... 1 Structure for the Thesis ................................................................................................... 7 Chapter 2. Related Work ................................................................................................. 9 2.1. Game Design Lessons or Patterns ........................................................................... 9 2.1.1. Experienced Designers discussing their design patterns................................. 10 2.1.2. User Study extracted these Design Patterns .................................................... 11 2.2. Methods for Game User Studies & Evaluation ..................................................... 14 2.2.1. Heuristics ........................................................................................................ 15 2.2.2. Play Testing .................................................................................................... 16 2.2.3. Telemetry and Metrics, Visualization ............................................................. 20 2.2.4. Physiological measurements ........................................................................... 21 2.2.5. Hybrid ............................................................................................................. 22 2.3. Cooperative Game Design Patterns ....................................................................... 23 Chapter 3. Research Objectives and Process ............................................................... 27 3.1. Goal 1: Identifying Cooperative Game Design Patterns ....................................... 28 3.2. Goal 2: Developing an Evaluation Method for Testing Effectiveness of Cooperative Patterns ......................................................................................... 30 Chapter 4. Developing Cooperative Game Design Patterns ....................................... 35 4.1. Selecting the games for the playtesting sessions ................................................... 37 4.2. The Play-testing procedure (Game-Play Analysis) ............................................... 37 4.3. Close-reading by User Experience Experts .......................................................... 40 4.4. Findings: The final Set of Patterns ........................................................................ 41 4.5. Validation Procedure ............................................................................................. 50 4.6. Results of the validation of the identified Cooperative Patterns: .......................... 51 Chapter 5. Evaluating Cooperative User Experiences ................................................ 53 5.1. Overview of the process of developing the Cooperative Performance Metrics .... 53 5.2. The main study – application of the Metrics ......................................................... 55 5.2.1. The Study ........................................................................................................ 55 iv 5.2.2. Data Collection ............................................................................................... 56 5.2.3. Data Analysis – development and application of the metrics ......................... 57 5.3. Final set of Cooperative Performance Metrics: ....................................................