DOCSLIB.ORG

UNIVERSITY of CALIFORNIA SANTA CRUZ PLAYING with WORDS: from INTUITION to EVALUATION of GAME DIALOGUE INTERFACES a Dissertation

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
UNIVERSITY of CALIFORNIA SANTA CRUZ PLAYING with WORDS: from INTUITION to EVALUATION of GAME DIALOGUE INTERFACES a Dissertation UNIVERSITY OF CALIFORNIA SANTA CRUZ PLAYING WITH WORDS: FROM INTUITION TO EVALUATION OF GAME DIALOGUE INTERFACES A dissertation submitted in partial satisfaction of the requirements for the degree of DOCTOR OF PHILOSOPHY in COMPUTER SCIENCE Serdar Sali December 2012 The Dissertation of Serdar Sali is approved: _______________________________ Professor Michael Mateas, Chair _______________________________ Associate Professor Noah Wardrip-Fruin _______________________________ Associate Professor Sri Kurniawan _______________________________ Professor Marilyn Walker _____________________________ Tyrus Miller Vice Provost and Dean of Graduate Studies Copyright © by Serdar Sali 2012 TABLE OF CONTENTS CHAPTER 1. INTRODUCTION ........................................................................................ 1 OBJECTIVES ........................................................................................................................... 3 CONTRIBUTIONS ................................................................................................................... 4 ORGANIZATION .................................................................................................................... 5 CHAPTER 2. RELATED WORK ......................................................................................... 7 DIALOGUE IN TASK-BASED SYSTEMS ................................................................................... 7 DIALOGUE SYSTEMS FOR VIRTUAL AND BELIEVABLE AGENTS ........................................... 9 DIALOGUE SYSTEMS IN GAMES AND INTERACTIVE STORIES ............................................ 11 EVALUATING DIALOGUE SYSTEMS .................................................................................... 27 Evaluation methods for task-based systems: The PARADISE framework ..................... 28 Evaluating believable agents ........................................................................................... 30 Evaluating dialogue systems in games ............................................................................ 30 CHAPTER 3. A PRIMER ON FAÇADE .......................................................................... 38 FAÇADE ............................................................................................................................... 38 FAÇADE’S DIALOGUE SYSTEM ............................................................................................ 41 PAST USER STUDIES ON FAÇADE ........................................................................................ 42 NLU Accuracy ................................................................................................................ 42 Coping with failures ........................................................................................................ 46 Effects of mediation on presence and engagement .......................................................... 48 iii IMPLEMENTING DIFFERENT DIALOGUE SYSTEMS ON FAÇADE ......................................... 50 General Implementation Details ..................................................................................... 50 Sentence-selection ............................................................................................................ 51 Abstract-response ............................................................................................................ 52 Reactive-pause ................................................................................................................. 53 Prompt-pause .................................................................................................................. 54 STRUCTURES AND SUPPORT FOR METRIC COLLECTION AND AI LOGS ............................ 54 TERMINOLOGY OF STATISTICAL METHODS USED ............................................................ 55 Cronbach’s alpha ............................................................................................................. 55 Factor analysis ................................................................................................................. 55 Non-parametric statistical significance tests .................................................................. 56 DISCUSSION & CONCLUSION ............................................................................................. 56 CHAPTER 4. STUDYING EFFECTS OF DIFFERENT INTERFACES ...................... 58 STUDY GOALS ..................................................................................................................... 58 METHODOLOGY .................................................................................................................. 59 Stimulus material ............................................................................................................ 59 Recruitment ..................................................................................................................... 60 Measurement Instruments .............................................................................................. 60 RESULTS .............................................................................................................................. 63 Qualitative results ........................................................................................................... 63 Quantitative results ........................................................................................................ 79 DISCUSSION & CONCLUSION ............................................................................................. 87 iv CHAPTER 5. STUDYING EFFECTS OF PACING ....................................................... 89 DESIGN GOALS .................................................................................................................... 89 METHODOLOGY .................................................................................................................. 90 Stimulus material ............................................................................................................ 90 Recruitment ..................................................................................................................... 91 RESULTS .............................................................................................................................. 92 Engagement ..................................................................................................................... 92 Sense of control ................................................................................................................ 95 Difficulty of use ............................................................................................................... 97 Story Involvement ......................................................................................................... 100 Presence & immersion ................................................................................................... 101 Enjoyment ..................................................................................................................... 102 DISCUSSION & CONCLUSION ........................................................................................... 103 CHAPTER 6. USING INFORMATION VISUALIZATION TO UNDERSTAND INTERACTIVE NARRATIVE ........................................................................................ 107 RELATED WORK ............................................................................................................... 109 FAÇADE LOG ANALYSIS AND VISUALIZATION TOOL ..................................................... 112 Visualization techniques employed ............................................................................... 114 CASE STUDY I: FAÇADE .................................................................................................. 117 Discourse act coverage .................................................................................................. 118 Story space coverage ...................................................................................................... 121 Average Time spent in different beats ........................................................................... 122 v Story timelines ............................................................................................................... 123 CASE STUDY II: PROM WEEK ........................................................................................... 126 Strategy Driven Play .................................................................................................... 133 Story Goal Completion .................................................................................................. 134 DISCUSSION & CONCLUSION ........................................................................................... 136 CHAPTER 7. EXPLORING QUANTITATIVE METRICS OF PLAYER SATISFACTION IN DIALOGUE SYSTEMS .............................................................. 138 STUDY DESIGN .................................................................................................................. 139 Measurement instrument .............................................................................................. 139 Collected metrics ........................................................................................................... 139 RESULTS ...........................................................................................................................
Load more

Recommended publications
  • The Poetics of Reflection in Digital Games
    © Copyright 2019 Terrence E. Schenold The Poetics of Reflection in Digital Games Terrence E. Schenold A dissertation submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy University of Washington 2019 Reading Committee: Brian M. Reed, Chair Leroy F. Searle Phillip S. Thurtle Program Authorized to Offer Degree: English University of Washington Abstract The Poetics of Reflection in Digital Games Terrence E. Schenold Chair of the Supervisory Committee: Brian Reed, Professor English The Poetics of Reflection in Digital Games explores the complex relationship between digital games and the activity of reflection in the context of the contemporary media ecology. The general aim of the project is to create a critical perspective on digital games that recovers aesthetic concerns for game studies, thereby enabling new discussions of their significance as mediations of thought and perception. The arguments advanced about digital games draw on philosophical aesthetics, media theory, and game studies to develop a critical perspective on gameplay as an aesthetic experience, enabling analysis of how particular games strategically educe and organize reflective modes of thought and perception by design, and do so for the purposes of generating meaning and supporting expressive or artistic goals beyond amusement. The project also provides critical discussion of two important contexts relevant to understanding the significance of this poetic strategy in the field of digital games: the dynamics of the contemporary media ecology, and the technological and cultural forces informing game design thinking in the ludic century. The project begins with a critique of limiting conceptions of gameplay in game studies grounded in a close reading of Bethesda's Morrowind, arguing for a new a "phaneroscopical perspective" that accounts for the significance of a "noematic" layer in the gameplay experience that accounts for dynamics of player reflection on diegetic information and its integral relation to ergodic activity.
    [Show full text]
  • Learning Board Game Rules from an Instruction Manual Chad Mills A
    Learning Board Game Rules from an Instruction Manual Chad Mills A thesis submitted in partial fulfillment of the requirements for the degree of Master of Science University of Washington 2013 Committee: Gina-Anne Levow Fei Xia Program Authorized to Offer Degree: Linguistics – Computational Linguistics ©Copyright 2013 Chad Mills University of Washington Abstract Learning Board Game Rules from an Instruction Manual Chad Mills Chair of the Supervisory Committee: Professor Gina-Anne Levow Department of Linguistics Board game rulebooks offer a convenient scenario for extracting a systematic logical structure from a passage of text since the mechanisms by which board game pieces interact must be fully specified in the rulebook and outside world knowledge is irrelevant to gameplay. A representation was proposed for representing a game’s rules with a tree structure of logically-connected rules, and this problem was shown to be one of a generalized class of problems in mapping text to a hierarchical, logical structure. Then a keyword-based entity- and relation-extraction system was proposed for mapping rulebook text into the corresponding logical representation, which achieved an f-measure of 11% with a high recall but very low precision, due in part to many statements in the rulebook offering strategic advice or elaboration and causing spurious rules to be proposed based on keyword matches. The keyword-based approach was compared to a machine learning approach, and the former dominated with nearly twenty times better precision at the same level of recall. This was due to the large number of rule classes to extract and the relatively small data set given this is a new problem area and all data had to be manually annotated.
    [Show full text]
  • Stable Treemaps Via Local Moves
    Stable treemaps via local moves Citation for published version (APA): Sondag, M., Speckmann, B., & Verbeek, K. A. B. (2018). Stable treemaps via local moves. IEEE Transactions on Visualization and Computer Graphics, 24(1), 729-738. [8019841]. https://doi.org/10.1109/TVCG.2017.2745140 DOI: 10.1109/TVCG.2017.2745140 Document status and date: Published: 01/01/2018 Document Version: Accepted manuscript including changes made at the peer-review stage Please check the document version of this publication: • A submitted manuscript is the version of the article upon submission and before peer-review. There can be important differences between the submitted version and the official published version of record. People interested in the research are advised to contact the author for the final version of the publication, or visit the DOI to the publisher's website. • The final author version and the galley proof are versions of the publication after peer review. • The final published version features the final layout of the paper including the volume, issue and page numbers. Link to publication General rights Copyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright owners and it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights. • Users may download and print one copy of any publication from the public portal for the purpose of private study or research. • You may not further distribute the material or use it for any profit-making activity or commercial gain • You may freely distribute the URL identifying the publication in the public portal.
    [Show full text]
  • Games and Rules
    Requirements for a General Game Mechanics Framework Imre Hofmann In this article I will apply a meta-theoretical approach to the question of how a game mechanics framework has to be designed in order to fulfil its task of ade- quately depicting or modeling the reality of game mechanics. I had two aims in mind when starting my research. I studied existing game theories and three game mechanics theories in particular in order to evaluate the state of the art of game mechanics theory. (Descriptive aim) The second aim followed on from these studies. With the results of my research I wanted to define the attributes a com- prehensive and general game mechanics theory might or – rather – needed to have. What are the general properties that such a theory should display? (Norma- tive aim) In my opinion the underlying mechanics of a game may be regarded in some way as its centerpiece. The reasons for this shall become clear over the course of this article. To begin with, I would like to make two terminological clarifications. First, I am not going to examine different game mechanics and typologies or categories of game mechanics. Instead, I will take a theoretical step backwards, so to speak, on the meta-level by analyzing and comparing different theories of game me- chanics (which themselves suggest categories and typologies). Secondly, I will use the expressions “game mechanics theory” “(game mechanics) framework” and “(game mechanics) model” synonymously. In my research I focused mainly on the following three key theories of game mechanics: 1. Carlo Fabricatore’s Gameplay and Game Mechanics Design (2007) 2.
    [Show full text]
  • Week 3 Day 1: Designing Games with Conditionals
    INTRODUCTION | CYBER ARCADE: PROGRAMMING AND MAKING WITH MICRO:BIT 3-1 | ELEMENTARY WEEK 3 DAY 1: DESIGNING GAMES WITH CONDITIONALS INTRODUCTION This week makers continue to use the Micro:bit microcontroller and begin coding and designing interactive games and art. ESSENTIAL QUESTIONS • How can we use code and math to create a fun game? • What is a conditional statement? • How do artists, engineers, and makers solve problems when they’re working? LEARNING OUTCOMES 1. Learn how to use code and conditionals to create a game. 2. Engage in project-based learning through problem-solving and troubleshooting by creating a game using a Micro:bit microcontroller and code. TEACHERLESSON | RESOURCE CYBER ARCADE: | CYBER PROGRAMMING ARCADE: PROGRAMMING AND MAKING AND WITH MAKING MICRO:BIT WITH MICRO:BIT 3-23-2 | | ELEMENTARY ELEMENTARY VOCABULARY Conditional: Set of rules performed if a certain condition is met Game mechanics: Basic actions, processes, visuals, and control mechanisms that are used to make a game Game designer: Person responsible for designing game storylines, plots, objectives, scenarios, the degree of difficulty, and character development Game engineer: Specialized software engineers who design and program video games Troubleshooting: Using resources to solve issues as they arise TEACHERLESSON | RESOURCE CYBER ARCADE: | CYBER PROGRAMMING ARCADE: PROGRAMMING AND MAKING AND WITH MAKING MICRO:BIT WITH MICRO:BIT 3-33-3 | | ELEMENTARY ELEMENTARY MATERIALS LIST EACH PAIR OF MAKERS NEEDS: • Micro:bit microcontroller • Laptop with internet connection • USB to micro-USB cord • USB flash drive • External battery pack • AAA batteries (2) • Notebook TEACHER RESOURCE | CYBER ARCADE: PROGRAMMING AND MAKING WITH MICRO:BIT 3-4 | ELEMENTARY They can also use the Troubleshooting Tips, search the internet for help, TEACHER PREP WORK or use the tutorial page on the MakeCode website.
    [Show full text]
  • Computer Game Flow Design, ACM Computers in Entertainment, 4, 1
    LJMU Research Online Taylor, MJ, Baskett, M, Reilly, D and Ravindran, S Game theory for computer games design http://researchonline.ljmu.ac.uk/id/eprint/7332/ Article Citation (please note it is advisable to refer to the publisher’s version if you intend to cite from this work) Taylor, MJ, Baskett, M, Reilly, D and Ravindran, S (2017) Game theory for computer games design. Games and Culture, 14 (7-8). pp. 843-855. ISSN 1555-4139 LJMU has developed LJMU Research Online for users to access the research output of the University more effectively. Copyright © and Moral Rights for the papers on this site are retained by the individual authors and/or other copyright owners. Users may download and/or print one copy of any article(s) in LJMU Research Online to facilitate their private study or for non-commercial research. You may not engage in further distribution of the material or use it for any profit-making activities or any commercial gain. The version presented here may differ from the published version or from the version of the record. Please see the repository URL above for details on accessing the published version and note that access may require a subscription. For more information please contact [email protected] http://researchonline.ljmu.ac.uk/ Game theory for computer games design Abstract Designing and developing computer games can be a complex activity that may involve professionals from a variety of disciplines. In this article, we examine the use of game theory for supporting the design of game play within the different sections of a computer game, and demonstrate its application in practice via adapted high-level decision trees for modelling the flow in game play and payoff matrices for modelling skill or challenge levels.
    [Show full text]
  • Games and Rules
    Games as a Special Zone Motivation Mechanics of Games René Bauer PLAY AS POSSIBILITY SPACE In games, sheep might speak, mountains fly, spaces move, moons disappear and faces morph; men can shrink, avatars can be moved, time rewound or frogs blown up. What would be regarded as delusional laws, imaginations and crazy ideas in other areas, as described for example in Dr. Daniel Schreber’s 1903 book “Denkwürdigkeiten eines Nervenkranken” (Memories of a Neuropath), is a tangible and interactive reality in many games. It is the special zone in which games operate that makes these divergent rules and laws culturally possible. Huizinga identified a number of playful special zones such as arenas, card tables, “Magic Circles”, stages or temples. They are all playgrounds. “The arena, the card-table, the magic circle, the temple, the stage, the screen, the tennis court, the court of justice, etc, are all in form and function play-grounds, i.e. forbidden spots, isolated, hedged round, hallowed, within which special rules obtain. All are tempo- rary worlds within the ordinary world, dedicated to the performance of an act apart.” (Huizinga 1955: 5) Thus, games (temporarily) position themselves against the ‘analog’ world with its fixed continuous rules that are based on atoms and their properties. The ana- log space surrounding us is bijective and continuous. It comes with three spatial dimensions, a continuous time and various resulting ‘laws’. The same applies to social and cultural conditions, which can also override or subvert games. This analog space and its rules become a complex, special set of rules in the much 36 | René Bauer more powerful possibility space of the games – or in other words: the analog space turns into another one of many game systems.
    [Show full text]
  • Security in Online Gaming Bachelor Thesis Information Science
    RADBOUD UNIVERSITY NIJMEGEN Security in online gaming Bachelor Thesis Information Science Rens van Summeren January 26, 2011 Online gaming has gone through an explosive growth in popularity during the last decade, and continues to grow at a great speed. With this growth in popularity and thus in the amount of players, the need for security also becomes increasingly clear. This thesis aims to provide a definition of security in online gaming, as well as security analysis for the various threats with examples and countermeasures. The goal is to help players and game developers assess online gaming security, and inform security experts about existing issues. CONTENTS 1 Introduction ................................................................................................................................... 1 Definition ............................................................................................................................... 1 Preface .................................................................................................................................. 1 2 Online Gaming ............................................................................................................................... 2 2.1 Why Look at the Security of Online Games? ................................................................... 2 2.2 Types of Online Games and Business Models ................................................................. 2 2.3 Massive Multiplayer Online Games ................................................................................
    [Show full text]
  • Learning Mechanics and Game Mechanics Under the Perspective of Self-Determination Theory to Foster Motivation in Digital Game Based Learning
    Proulx, J. N., Romero, M., & Arnab, S. (2016). Learning Mechanics and Game Mechanics Under the Perspective of Self-Determination Theory to Foster Motivation in Digital Game Based Learning. Simulation & Gaming, 1046878116674399. Learning Mechanics and Game Mechanics Under the Perspective of Self-Determination Theory to Foster Motivation in Digital Game Based Learning. Jean-Nicolas Proulx1, Margarida Romero1, Sylvester Arnab2 Abstract Background: Using digital games for educational purposes has been associated with higher levels of motivation among learners of different educational levels. However, the underlying psychological factors involved in digital game based learning (DGBL) have been rarely analyzed considering self-determination theory (SDT, Ryan & Deci, 2000b); the relation of SDT with the flow experience (Csikszentmihalyi, 1990) has neither been evaluated in the context of DGBL. Aim: This article evaluates DGBL under the perspective of SDT in order to improve the study of motivational factors in DGBL. Results: In this paper, we introduce the LMGM-SDT theoretical framework, where the use of DGBL is analyzed through the Learning Mechanics and Game Mechanics mapping model (LM-GM, Arnab et al., 2015) and its relation with the components of the SDT. The implications for the use of DGBL in order to promote learners’ motivation are also discussed. Keywords Digital game based learning, DGBL, education, flow, game mechanics, learning mechanics, LM-GM, LMGM-SDT, motivation, self-determination theory, SDT. 1 Université Laval, Québec, Canada 2 Disruptive Media Learning Lab, Coventry University, UK Corresponding Author: Jean-Nicolas Proulx, Department of Teaching and Learning Studies, Université Laval, Québec, Canada. Email : [email protected] Educational technologies and motivation One of the persistent educational myths is that technology fosters learners’ motivation by itself (Kleiman, 2000).
    [Show full text]
  • Treemap User Guide
    TreeMap User Guide Macrofocus GmbH Version 2019.8.0 Table of Contents Introduction. 1 Getting started . 2 Load and filter the data . 2 Set-up the visualization . 5 View and analyze the data. 7 Fine-tune the visualization . 12 Export the result. 15 Treemapping . 16 User interface . 20 Menu and toolbars. 20 Status bar . 24 Loading data . 25 File-based data sources. 25 Directory-based data sources . 31 Database connectivity. 32 On-line data sources . 33 Automatic default configuration . 33 Data types . 33 Configuration panel . 36 Layout . 38 Group by. 53 Size. 56 Color . 56 Height . 61 Labels . 61 Tooltip. 63 Rendering . 66 Legend . 67 TreeMap view . 69 Zooming . 69 Drilling . 70 Probing and selection . 70 TreePlot view. 71 Configuration . 71 Zooming . 72 Drilling . 72 Probing and selection . 72 TreeTable view . 73 Sorting . 73 Probing and selection . 74 Filter on a subset . 75 Search . 76 Filter . 76 See details. 77 Configure variables . 78 Formatting patterns. 78 Expression.
    [Show full text]
  • Treemap Art Project
    EVERY ALGORITHM HAS ART IN IT Treemap Art Project By Ben Shneiderman Visit Exhibitions @ www.cpnas.org 2 tree-structured data as a set of nested rectangles) which has had a rippling impact on systems of data visualization since they were rst conceived in the 1990s. True innovation, by denition, never rests on accepted practices but continues to investigate by nding new In his book, “Visual Complexity: Mapping Patterns of perspectives. In this spirit, Shneiderman has created a series Information”, Manuel Lima coins the term networkism which of prints that turn our perception of treemaps on its head – an he denes as “a small but growing artistic trend, characterized eort that resonates with Lima’s idea of networkism. In the by the portrayal of gurative graph structures- illustrations of exhibition, Every AlgoRim has ART in it: Treemap Art network topologies revealing convoluted patterns of nodes and Project, Shneiderman strips his treemaps of the text labels to links.” Explaining networkism further, Lima reminds us that allow the viewer to consider their aesthetic properties thus the domains of art and science are highly intertwined and that laying bare the fundamental property that makes data complexity science is a new source of inspiration for artists and visualization eective. at is to say that the human mind designers as well as scientists and engineers. He states that processes information dierently when it is organized visually. this movement is equally motivated by the unveiling of new In so doing Shneiderman seems to daringly cross disciplinary is exhibit is a project of the knowledge domains as it is by the desire for the representation boundaries to wear the hat of the artist – something that has Cultural Programs of the National Academy of Sciences of complex systems.
    [Show full text]
  • Florin Gheorghe Filip Constantin-Bălă Zamfirescu Cristian Ciurea Computer‐ Supported Collaborative Decision‐ Making Automation, Collaboration, & E-Services
    Automation, Collaboration, A C E S & E-Services Florin Gheorghe Filip Constantin-Bălă Zamfirescu Cristian Ciurea Computer‐ Supported Collaborative Decision‐ Making Automation, Collaboration, & E-Services Volume 4 Series editor Shimon Y. Nof, Purdue University, West Lafayette, USA e-mail: [email protected] About this Series The Automation, Collaboration, & E-Services series (ACES) publishes new devel- opments and advances in the fields of Automation, collaboration and e-services; rapidly and informally but with a high quality. It captures the scientific and engineer- ing theories and techniques addressing challenges of the megatrends of automation, and collaboration. These trends, defining the scope of the ACES Series, are evident with wireless communication, Internetworking, multi-agent systems, sensor networks, and social robotics – all enabled by collaborative e-Services. Within the scope of the series are monographs, lecture notes, selected contributions from spe- cialized conferences and workshops. More information about this series at http://www.springer.com/series/8393 Florin Gheorghe Filip • Constantin-Bălă Zamfirescu Cristian Ciurea Computer-Supported Collaborative Decision-Making 123 Florin Gheorghe Filip Cristian Ciurea Information Science and Technology Department of Economic Informatics Section, INCE and BAR and Cybernetics The Romanian Academy ASE Bucharest—The Bucharest University Bucharest of Economic Studies Romania Bucharest Romania Constantin-Bălă Zamfirescu Faculty of Engineering, Department of Computer Science and Automatic Control Lucian Blaga University of Sibiu Sibiu Romania ISSN 2193-472X ISSN 2193-4738 (electronic) Automation, Collaboration, & E-Services ISBN 978-3-319-47219-5 ISBN 978-3-319-47221-8 (eBook) DOI 10.1007/978-3-319-47221-8 Library of Congress Control Number: 2016953309 © Springer International Publishing AG 2017 This work is subject to copyright.
    [Show full text]