DOCSLIB.ORG

Player-AI Interaction: What Neural Network Games Reveal About AI As Play

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Player-AI Interaction: What Neural Network Games Reveal About AI As Play Player-AI Interaction: What Neural Network Games Reveal About AI as Play Jichen Zhu∗† Jennifer Villareale∗ Nithesh Javvaji∗ [email protected] [email protected] [email protected] Drexel University Drexel University Northeastern University Sebastian Risi Mathias Löwe Rush Weigelt [email protected] [email protected] [email protected] IT University Copenhagen IT University Copenhagen Drexel University Casper Harteveld∗ [email protected] Northeastern University Figure 1: Selection of neural network (NN) games. (From left to right, Top: How to Train Your Snake [108], Idle Machine Learning Game [141], Evolution [115], EvoCommander [114], Machine Learning Arena [117], Hey Robot [120]; Middle: Quick, Draw! [125], Semantris [126], Dr. Derks Mutant Battlegrounds [140], Forza Car Racing [139], Democracy 3 [122], Darwin’s Avatars [113], AudioinSpace [105]; Bottom: NERO [128], Black & White [106], Creatures [127], MotoGP19 [131], Supreme Commander 2 [121], Galactic Arms Race [119], Petalz [118]) ABSTRACT survey of neural network games (n = 38), we identified the dom- The advent of artificial intelligence (AI) and machine learning (ML) inant interaction metaphors and AI interaction patterns in these games. In addition, we applied existing human-AI interaction guide- arXiv:2101.06220v2 [cs.HC] 18 Jan 2021 bring human-AI interaction to the forefront of HCI research. This paper argues that games are an ideal domain for studying and exper- lines to further shed light on player-AI interaction in the context of imenting with how humans interact with AI. Through a systematic AI-infused systems. Our core finding is that AI as play can expand current notions of human-AI interaction, which are predominantly ∗These authors contributed equally to this research. productivity-based. In particular, our work suggests that game and † Currently at IT University of Copenhagen, Denmark. UX designers should consider flow to structure the learning curve of human-AI interaction, incorporate discovery-based learning to Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed play around with the AI and observe the consequences, and of- for profit or commercial advantage and that copies bear this notice and the full citation fer users an invitation to play to explore new forms of human-AI on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, interaction. to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]. CHI ’21, May 8–13, 2021, Yokohama, Japan © 2021 Association for Computing Machinery. ACM ISBN 978-1-4503-8096-6/21/05...$15.00 https://doi.org/10.1145/3411764.3445307 1 CHI ’21, May 8–13, 2021, Yokohama, Japan Zhu, Villareale and Javvaji, et al. CCS CONCEPTS gameplay. A neural network (NN) is a computational model that • Human-centered computing ! Human computer interac- includes nodes (i.e., neurons) and connections between these nodes tion (HCI); • Applied computing ! Computer games; • Com- that transmit information [76]. The strengths of these connections puting methodologies ! Artificial intelligence. (i.e., weights) are typically adjusted through some learning process. For our paper, this definition covers both NNs that control agents / KEYWORDS non-player characters (NPCs) in games [43, 88] and generative NN models that produce game content [33, 71]. Human-AI Interaction; Neural Networks; User Experience; Game We chose NN games for two key reasons. First, given the wide Design adoption of AI in games, we had to constrain our systematic (quali- ACM Reference Format: tative) review. Second, and more importantly, NN games provide Jichen Zhu, Jennifer Villareale, Nithesh Javvaji, Sebastian Risi, Mathias insights into some of the most pressing open problems in human-AI Löwe, Rush Weigelt, and Casper Harteveld. 2021. Player-AI Interaction: interaction. For example, NNs are notorious for UX designers to What Neural Network Games Reveal About AI as Play. In CHI Conference on work with because of NNs’ low interpretability of the underlying Human Factors in Computing Systems (CHI ’21), May 8–13, 2021, Yokohama, Japan. ACM, New York, NY, USA, 17 pages. https://doi.org/10.1145/3411764. process and the frequent unpredictability of its outcome. Studying 3445307 NN games can thus provide valuable information on how game designers have to work with these challenges. 1 INTRODUCTION We collected 38 NN games and applied a two-phased qualitative 1 analysis to examine them. In the first phase, we use close read- With the recent boom in artificial intelligence (AI) technology, peo- ing and grounded theory to identify the overarching interaction ple are interacting with a growing number of AI-infused products metaphors and patterns of how NNs are represented in the game in many aspects of everyday life. Already, these AI systems influ- user interface (UI). In the second phase, we apply current human-AI ence our decisions (e.g., recommendation systems [74]), inhabit our interaction design guidelines [6], compiled from a wide range of households (e.g., robotic appliances [80]), and accompany us in our productivity-based domains, to our dataset. From these analyses, playful experiences [54, 102, 103] and educational games [85, 99]. we derive design lessons for where games do well and identify The technological development has precipitated renewed in- open areas that can expand our current notion of human-AI inter- terest in the Human Computer Interaction (HCI) community. In action. A key design insight is that reframing AI as play offers a addition to improving the usability of individual products [58], HCI useful approach for considering human-AI interaction in games researchers synthesized design guidelines for human-AI interaction and beyond. from the past decades [6]. There is a growing recognition that, com- The core argument of this paper is that games are a rich and pared to traditional interactive systems, AI-infused products impose currently overlooked domain for advancing human-AI interaction. additional challenges (e.g., technical barrier, low interpretability) to The design space afforded by structuring AI as play, as game de- the current user experience (UX) design process [23]. Furthermore, signers have been exploring, can point out new opportunities for new interdisciplinary research areas have emerged around topics AI-infused products in general. At the same time, insights of the such as explainable AI [9, 66, 83, 101], ethics & fairness [12, 23, 38], generalized guidelines from other domains can be adapted to im- and machine learning (ML) as a design material for UX [93, 94]. prove player-AI interaction. The key contributions of this paper Among the fast-growing body of literature on human-AI inter- are as follows: action in the CHI community, one overlooked area is the context of play. With few exceptions, most recent literature focuses on • We propose the new research area of player-AI interaction. productivity-related domains such as e-commerce, navigation and Through the first systematic review on player-AI interaction autocomplete [6]. While these are important domains for human-AI in the context of NN games, we showcase how player-AI interaction, the history of AI and human-AI interaction has long interaction can expand the current productivity-based dis- been associated with play. For instance, ELIZA, one of the first AI cussions around human-AI interaction. programs designed to interact with lay users, was a playful satire • We adapted existing design guidelines for human-AI inter- of a certain school of psychotherapy [90]. Games such as Chess, action to the context of games. Currently, there are no syn- Poker, Go, and StarCraft have continued to serve as benchmarks thesized metrics to evaluate player-AI interaction. that propelled the development of AI since the beginning of the • We provide several insights from NN games (e.g., flow, ex- field. Since games naturally focus on end-user experience, gameAI ploration) to improve current challenges in human-AI inter- research has accumulated valuable knowledge related to human-AI action (e.g., learnability of AI). interaction [52, 54, 71, 86, 97, 100]. In this paper, we propose the new construct of player-AI interac- 2 RELATED WORK tion to highlight how people interact with AI in the context of play, In this section, we summarize related work in human-AI interac- especially through computer games. To provide an overview of tion and AI-based games research. We aim to bridge these two existing work in this area, we conducted the first systematic review disconnected areas. of player-AI interaction in the scope of Neural Network games — com- puter games in which players interact with an NN as part of the core 2.1 Human-AI Interaction 1Unless otherwise specified, we use the term AI broadly to include a wide rangeof The HCI community has developed a body of work on how to artificial intelligence and machine learning techniques. design user interactions to improve productivity through AI-based 2 Player-AI Interaction: What Neural Network Games Reveal About AI as Play CHI ’21, May 8–13, 2021, Yokohama, Japan applications [35, 39, 41, 78, 92]. Thanks to increasingly sophisticated co-creator, adversary, villain, or spectacle, and whether AI is vis- big data and deep neural networks (i.e., deep learning), AI-infused ible or guided. Cook et al. [16] further examined design patterns products have started to enter the consumer market, prompting in procedural content generation (PCG)-based games and derived a new surge of interest in human-AI interaction [6, 8, 63] and its different AI design patterns. In the context of assisting thegame societal impact in topics such as explainability and transparency [9, development process, Riedl and Zook [68] proposed that AI plays 66, 83, 101].
Load more

Recommended publications
  • Procedural Content Generation for Games
    Procedural Content Generation for Games Inauguraldissertation zur Erlangung des akademischen Grades eines Doktors der Naturwissenschaften der Universit¨atMannheim vorgelegt von M.Sc. Jonas Freiknecht aus Hannover Mannheim, 2020 Dekan: Dr. Bernd L¨ubcke, Universit¨atMannheim Referent: Prof. Dr. Wolfgang Effelsberg, Universit¨atMannheim Korreferent: Prof. Dr. Colin Atkinson, Universit¨atMannheim Tag der m¨undlichen Pr¨ufung: 12. Februar 2021 Danksagungen Nach einer solchen Arbeit ist es nicht leicht, alle Menschen aufzuz¨ahlen,die mich direkt oder indirekt unterst¨utzthaben. Ich versuche es dennoch. Allen voran m¨ochte ich meinem Doktorvater Prof. Wolfgang Effelsberg danken, der mir - ohne mich vorher als Master-Studenten gekannt zu haben - die Promotion an seinem Lehrstuhl erm¨oglichte und mit Geduld, Empathie und nicht zuletzt einem mir unbegreiflichen Verst¨andnisf¨ur meine verschiedenen Ausfl¨ugein die Weiten der Informatik unterst¨utzthat. Sie werden mir nicht glauben, wie dankbar ich Ihnen bin. Weiterhin m¨ochte ich meinem damaligen Studiengangsleiter Herrn Prof. Heinz J¨urgen M¨ullerdanken, der vor acht Jahren den Kontakt zur Universit¨atMannheim herstellte und mich ¨uberhaupt erst in die richtige Richtung wies, um mein Promotionsvorhaben anzugehen. Auch Herr Prof. Peter Henning soll nicht ungenannt bleiben, der mich - auch wenn es ihm vielleicht gar nicht bewusst ist - davon ¨uberzeugt hat, dass die Erzeugung virtueller Welten ein lohnenswertes Promotionsthema ist. Ganz besonderer Dank gilt meiner Frau Sarah und meinen beiden Kindern Justus und Elisa, die viele Abende und Wochenenden zugunsten dieser Arbeit auf meine Gesellschaft verzichten mussten. Jetzt ist es geschafft, das n¨achste Projekt ist dann wohl der Garten! Ebenfalls geb¨uhrt meinen Eltern und meinen Geschwistern Dank.
    [Show full text]
  • Innk: a Multi-Player Game to Deceive a Neural Network
    iNNk: A Multi-Player Game to Deceive a Neural Network Jennifer Villareale1, Ana Acosta-Ruiz1, Samuel Arcaro1, Thomas Fox1, Evan Freed1, Robert Gray1, Mathias Löwe2, Panote Nuchprayoon1, Aleksanteri Sladek1, Rush Weigelt1, Yifu Li1, Sebastian Risi2, Jichen Zhu1 1Drexel University, Philadelphia, USA 2IT University of Copenhagen, Copenhagen, Denmark {jmv85, ava48, saa35, tbf33, emf67, rcg48, pn355, ams939, rw643, yl3374, jichen}@drexel.edu, {malw, sebr}@itu.dk ABSTRACT experiment with different drawing strategies. This paper also sum- This paper presents iNNK, a multiplayer drawing game where hu- marizes the main strategies our players have developed in our man players team up against an NN. The players need to success- playtesting. Certainly, a lot more effort is needed to empower cit- fully communicate a secret code word to each other through draw- izens to be more familiar with AI and to engage the technology ings, without being deciphered by the NN. With this game, we aim critically. Through our game, we have seen evidence that playful to foster a playful environment where players can, in a small way, experience can turn people from passive users into creative and re- go from passive consumers of NN applications to creative thinkers flective thinkers, a crucial step towards a more mature relationship and critical challengers. with AI. CCS CONCEPTS 2 RELATED WORK • Computer systems organization ! Embedded systems; Re- With recent breakthroughs in neural networks (NN), particularly dundancy; Robotics; • Networks ! Network reliability. deep learning, designers are increasingly exploring their use in computer games. For example, researchers use NNs to procedurally KEYWORDS generate game content, which otherwise would have to be created artificial intelligence, game design, machine learning, neural net- by human artists and thus make the game more variable [13, 20].
    [Show full text]
  • Plagiarism in the Age of Massive Generative Pre-Trained Transformers (GPT- 3): “The Best Time to Act Was Yesterday
    See discussions, stats, and author profiles for this publication at: https://www.researchgate.net/publication/348583797 Plagiarism in the age of massive Generative Pre-trained Transformers (GPT- 3): “The best time to act was yesterday. The next best time is now.” Article in Ethics in Science and Environmental Politics · January 2021 DOI: 10.3354/esep00195 CITATIONS READS 0 26 1 author: Nassim Dehouche Mahidol University 30 PUBLICATIONS 9 CITATIONS SEE PROFILE Some of the authors of this publication are also working on these related projects: Improving Access to the Bangkok Transit System for Older Adults and Disabled People View project Operational Research on Football View project All content following this page was uploaded by Nassim Dehouche on 13 February 2021. The user has requested enhancement of the downloaded file. Plagiarism in the age of massive Generative Pre-trained Transformers (GPT-3): “The best time to act was yesterday. The next best time is now.” Nassim Dehouche [email protected] Business Administration Division, Mahidol University International College, Salaya, Thailand Abstract As if 2020 were not a peculiar enough year, its fifth month has seen the relatively quiet publication of a preprint describing the most powerful Natural Language Processing (NLP) system to date, GPT-3 (Generative Pre-trained Transformer-3), by Silicon Valley research firm OpenAI. Though the software implementation of GPT-3 is still in its initial Beta release phase, and its full capabilities are still unknown as of the time of this writing, it has been shown that this Artificial Intelligence can comprehend prompts in natural language, on virtually any topic, and generate relevant, original text content that is indistinguishable from human writing.
    [Show full text]
  • Arxiv:2007.12391V6 [Cs.CV] 2 Jul 2021 Techniques for Practical Purposes Has Been Artificial Intelligence (AI)
    Artificial Intelligence Review manuscript No. (will be inserted by the editor) Artificial Intelligence in the Creative Industries: A Review Nantheera Anantrasirichai · David Bull Accepted for publication in Artificial Intelligence Review (AIRE), 19 June 2021 Abstract This paper reviews the current state of the art in Artificial Intelligence (AI) tech- nologies and applications in the context of the creative industries. A brief background of AI, and specifically Machine Learning (ML) algorithms, is provided including Convolu- tional Neural Networks (CNNs), Generative Adversarial Networks (GANs), Recurrent Neu- ral Networks (RNNs) and Deep Reinforcement Learning (DRL). We categorize creative applications into five groups, related to how AI technologies are used: i) content creation, ii) information analysis, iii) content enhancement and post production workflows, iv) in- formation extraction and enhancement, and v) data compression. We critically examine the successes and limitations of this rapidly advancing technology in each of these areas. We further differentiate between the use of AI as a creative tool and its potential as a creator in its own right. We foresee that, in the near future, ML-based AI will be adopted widely as a tool or collaborative assistant for creativity. In contrast, we observe that the successes of ML in domains with fewer constraints, where AI is the ‘creator’, remain modest. The potential of AI (or its developers) to win awards for its original creations in competition with human creatives is also limited, based on contemporary technologies. We therefore conclude that, in the context of creative industries, maximum benefit from AI will be derived where its focus is human-centric – where it is designed to augment, rather than replace, human creativity.
    [Show full text]
  • The Future of Storytelling in the Age of AI and Posthuman
    The Future of Storytelling in the Age of AI and Posthuman DR. SERDAR TUNCER PROF. BOULOU EBANDA DE B'BÉRI UNIVERSITY OF OTTAWA, AMLAC&S Background Computer scientists are building a vast array of machine learning systems (often called Artificial Intelligence or AI) that can perform daily human tasks reliably, sometimes more so than humans. Indeed, AI is becoming capable of capturing the unique essence that makes us “human”: storytelling. Humans are intrinsically storytellers who express themselves through stories that already exist (Fisher, 1987; Frank, 2012). Moreover, people have always learnt about themselves and made sense of the rest of the world through narratives (Ebanda de B'béri, 2006; Tunçer, 2018). However, in recent years, AI-generated games and articles have already started to emerge (Fitch, 2019). While AI is able to exceed certain functions of natural human intelligence as it gains self- learning capacity in repetitive or analytical tasks, it may have the potential to harness the persuasive capabilities of storytelling. Guiding Questions • What will become of our humanity if AI can write and tell better stories? • Is AI the greatest danger to our humanity as Bramer (2015) has suggested? • Are we already entered the posthuman era (Wolfe, 2010; Braidotti, 2013) with such advances as neural nets that allow biological and silicon-based artificial brain cells to communicate with each other (Serb et al., 2020) – a new form of AI-human being? • What will the future look like if AI can harness the influential potential of storytelling? • What would be the storytelling landscape in such an environment of posthuman? Where we are today We are still in the infant stages of AI with errors happening along the way: ◦ Microsoft had released its AI bot named Tay, which was designed to foster “conversational understanding.” But things did not go as expected.
    [Show full text]
  • The Hitchhiker's Guide to Technology
    The Hitchhiker’s Guide to Technology: A Conversation on Careers in Tech Falaah Arif Khan Email: [email protected] Website: https://falaaharifkhan.github.io/research/ Twitter: @FalaahArifKhan Agenda ❏ The Hacker Mindset: How I pulled off 5 Hackathon wins in 1 year ❏ AI Now: A Critical Overview of Social and Technical challenges ❏ Creativity and Computer Science: Why I created a Scientific Comic about Artificial Intelligence ❏ Alice Through the Looking Glass: What I’ve learned about the IT Industry The Hacker Mindset: My experience May ‘18: Graduated college July ‘18: Joined Dell Sept ‘18: Invoice Correction --- Order Management Dec ‘18: Credit Limit Allocation --- Credit/Finance April ‘19: Network Security ---- Cyber security June ‘19: Ethical Hack of Source code ----- Dev/Ops July ‘19: Content Classification----- Marketing The Hacker Mindset: Hackathon Lessons 1. Develop business acumen: a. understand the business end to end b. gain experience with building different components of a software product/service 2. Develop design thinking and product management skills: a. Understand your client b. MVP (Minimum viable product+iterate) mindset 3. Work in a high pressure environment 4. Gain familiarity with all stages of SDLC (Software Development Lifecycle) The Hacker Mindset: Key Takeaways ❏ Take on challenging problems. Learn to work under constraints ❏ Take on things you don't know and figure it out as you go ❏ Take risks, follow your intuitions ❏ Challenge the tradition/ status quo ❏ Collaborate, build something bigger than yourself Questions?
    [Show full text]
  • Development of a Tactics RPG for Android Tablets
    Development of a Tactics RPG for Android Tablets A Major Qualifying Project Report: Submitted to the faculty of the Worcester Polytechnic Institute in partial fulfillment of the requirements for the Degree of Bachelor Science By: ___________________________________________ Dillon Lankenau Interactive Media and Game Development (Art) ___________________________________________ Gregory Tersoff Computer Science, Interactive Media and Game Development (Tech) Date: Thursday, May 1, 2014 Approved: ___________________________________________ Professor David C. Brown, Computer Science, Major Advisor ___________________________________________ Professor Britton Snyder, Interactive Media and Game Development (Art), Major Advisor 1 Abstract Our project consisted of creating a Tactics Role-Playing Game to be played on Android devices. This entailed creating our own rule set, game engine, menu interface, art assets, and game instance. In particular, there was an increased focus on optimal use of touch interfaces, good interface design, and potential for use by non-programmers. Supplementing our game, we also developed 3d printed models to act as building blocks to construct a board in physical space. 2 Acknowledgements: We would like to thank Professor Britton Snyder and Professor David Brown for their continued advice and assistance throughout our project. We’d also like to thank Professor Chrysanthe Demetry for her assistance during the initial stages of our project. Finally, we’d like to thank Daniel Irizarry for allowing us to use his tablet during
    [Show full text]
  • Grounding As a Collaborative Process
    Grounding as a Collaborative Process Luciana Benotti Patrick Blackburn Universidad Nacional de Cordoba´ Philosophy and Science Studies, IKH CONICET, Argentina Roskilde University, Denmark [email protected] [email protected] Abstract We proceed as follows. We first discuss obsta- cles to current research on dialog and interactive Collaborative grounding is a fundamental as- systems (Section2) and then present working defi- pect of human-human dialog which allows people to negotiate meaning. In this paper nitions of collaborative grounding and related con- we argue that it is missing from current deep cepts (Section3). Section4 plays with scenarios learning approaches to dialog and interactive illustrating the pitfalls of being unable to ground systems. Our central point is that making mis- collaboratively; we then turn to the language acqui- takes and being able to recover from them col- sition literature for insight into how humans do it laboratively is a key ingredient in grounding (Section5) and to the dialog systems literature to meaning. We illustrate the pitfalls of being discuss what is known (Section6). In Section7, unable to ground collaboratively, discuss what can be learned from the language acquisition we reflect on the progress made and make recom- and dialog systems literature, and reflect on mendations, while in Section8 we note possible how to move forward. objections to our account and conclude. 1 Introduction 2 Motivation Collaborative grounding is shaped by constraints Dialog and interactive systems is one of the most that are not explicit in successful dialog turns. popular research areas in computational linguistics These constraints combine information from world nowadays.
    [Show full text]
  • Deep Learning for Procedural Content Generation
    Noname manuscript No. (will be inserted by the editor) Deep Learning for Procedural Content Generation Jialin Liu1 · Sam Snodgrass2 · Ahmed Khalifa3 · Sebastian Risi2,4 · Georgios N. Yannakakis2,5,6 · Julian Togelius2,3 Received: date / Accepted: date Abstract Procedural content generation in video applied to generate game content directly or indirectly, games has a long history. Existing procedural content discusses deep learning methods that could be used for generation methods, such as search-based, solver-based, content generation purposes but are rarely used today, rule-based and grammar-based methods have been ap- and envisages some limitations and potential future di- plied to various content types such as levels, maps, char- rections of deep learning for procedural content gener- acter models, and textures. A research field centered on ation. content generation in games has existed for more than Keywords Procedural content generation · Game a decade. More recently, deep learning has powered a design · Deep learning · Machine learning · Computa- remarkable range of inventions in content production, tional and artificial intelligence which are applicable to games. While some cutting-edge deep learning methods are applied on their own, oth- ers are applied in combination with more traditional 1 Introduction methods, or in an interactive setting. This article sur- veys the various deep learning methods that have been Deep learning has powered a remarkable range of in- ventions in content production in recent years, includ- J. Liu ing new methods for generating audio, images, 3D ob- E-mail: [email protected] jects, network layouts, and other content types across S. Snodgrass a range of domains.
    [Show full text]
  • Collaborative Storytelling with Large-Scale Neural Language Models
    Collaborative Storytelling with Large-scale Neural Language Models Eric Nichols∗ Leo Gao∗ Randy Gomez Honda Research Institute Japan OrientExpress Technologies Inc. Honda Research Institute Japan [email protected] [email protected] [email protected] ABSTRACT Storytelling plays a central role in human socializing and enter- tainment. However, much of the research on automatic storytelling generation assumes that stories will be generated by an agent with- out any human interaction. In this paper, we introduce the task of collaborative storytelling, where an artificial intelligence agent and a person collaborate to create a unique story by taking turns adding to it. We present a collaborative storytelling system which works with a human storyteller to create a story by generating new utterances based on the story so far. We constructed the storytelling system by tuning a publicly-available large scale language model on a dataset of writing prompts and their accompanying fictional works. We identify generating sufficiently human-like utterances to be an important technical issue and propose a sample-and-rank approach to improve utterance quality. Quantitative evaluation shows that our approach outperforms a baseline, and we present qualitative evaluation of our system’s capabilities. Figure 1: Collaborative storytelling with an AI agent. CCS CONCEPTS • Human-centered computing ! Collaborative interaction; Natural language interfaces; Collaborative and social com- opponents, more realistic NPC behavior, and other benefits. Bet- ! puting devices; • Computer systems organization Neural ter procedural content generation algorithms help ensure unique networks. gameplay experiences that stay fresh for longer. Finally, recent breakthroughs in language modeling present a new opportunity: KEYWORDS language, and thus stories, can potentially be generated on demand.
    [Show full text]
  • How to Use Neural Networks for Automatic Item Generation In
    AUTOMATIC ITEM GENERATION 1 Let the Algorithm Speak: How to Use Neural Networks for Automatic Item Generation in Psychological Scale Development Friedrich M. Götz1,2,3*, Rakoen Maertens3*, and Sander van der Linden3 1 University of British Columbia, Canada 2 University of California, Berkeley, USA 3 University of Cambridge, UK * These authors contributed equally Draft version 1.2, 14/06/2021. Please note that this is a preprint. The manuscript is currently under peer review and is likely to change as it goes through the peer review process. AUTOMATIC ITEM GENERATION 2 Author Note Friedrich M. Götz, Department of Psychology, University of British Columbia, Canada; Institute of Personality and Social Research, University of California, Berkeley, USA; Department of Psychology, University of Cambridge, United Kingdom Rakoen Maertens, Sander van der Linden, Department of Psychology, University of Cambridge, United Kingdom. This work was financially supported by the United Kingdom Economic and Social Research Council (ESRC), the Cambridge Trust and the German Academic Exchange Service (DAAD). Parts of the current article are based on a conference talk presented by the second-named author at the 2021 annual convention of the Society for Personality and Social Psychology (SPSP). The authors would like to thank Dr Mark Schaller (University of British Columbia) for inspiring walks and thoughtful comments on the PIG. Correspondence concerning this article should be addressed to Friedrich M. Götz, Department of Psychology, University of British Columbia, 2136 West Mall, Vancouver, BC V6T 1Z4, British Columbia, Canada. Email: [email protected]. AUTOMATIC ITEM GENERATION 3 Abstract Measurement is at the heart of scientific research.
    [Show full text]
  • Download the Transcript
    AI Ignition Ignite your AI curiosity with Greg Brockman How do we take responsibility for the varied uses of AI? From Deloitte’s AI Institute, this is AI Ignition—a monthly chat about the human side of artificial intelligence with your host, Beena Ammanath. We will take a deep dive into the past, present, and future of AI, machine learning, neural networks, and other cutting-edge technologies. Here is your host, Beena. Beena Ammanath (Beena): Hi, my name is Beena Ammanath and I am the executive director for the Deloitte AI Institute, and today on AI Ignition we have Greg Brockman, the co-founder and CTO of Open AI, a research organization that aims to ensure that artificial general intelligence benefits all of humanity. Welcome to the show, Greg. We are so excited to have you. Greg, I am so happy to have you on AI Ignition today. Thank you so much for joining us. Greg: Thank you for having me. Excited to be here. Beena: So, let’s start with the current status of AI. AI is such a broad topic, and you hear so much in the news about it, everybody knows what you are doing at Open AI. What do you think is the current status of AI today? Greg: So, I think AI is definitely a field in transition. I mean, if you look at the history of the field, I think it has gotten a reputation as the field of empty promises. And you look back to the 50s and people were trying to figure out, hey maybe the hardest problem is chess, and if we can solve chess, then we are going to solve all of AI and we’ll have an artificial human and it will be great.
    [Show full text]