Developing a 5V5 Framework for Dota 2 Bot Competition

Total Page:16

File Type:pdf, Size:1020Kb

Developing a 5V5 Framework for Dota 2 Bot Competition Developing a 5v5 Framework for DotA 2 Bot Competition Dennis Nilsson Kalle Lindqvist Malmö University Malmö University [email protected] [email protected] Faculty of Science Department of Computer Science Master Thesis in Computer Science, 15 credits 2020-05-18 Supervisors: José Maria Font Fernandez & Alberto Enrique Alvarez Uribe Examiner: Johan Holmgren CONTENTS I Introduction 3 I-A Motivation . .3 I-B Goals . .4 I-C Research Questions . .4 II Literature Review 4 II-A Data collection . .4 II-A1 Game Conferences . .4 II-B Systematic search . .4 II-B1 Keywords, search string and restrictions . .5 II-B2 Databases . .5 II-B3 Selection of papers . .5 II-C Discussion and results . .5 II-C1 Applying artificial intelligence algorithms in MOBA games . .5 II-C2 Evolving a Designer-Balanced Neural Network for Ms PacMan . .6 II-C3 An Analysis of Artificial Intelligence Techniques in Multiplayer Online Battle Arena Game Environments . .6 II-C4 MOBA: a New Arena for Game AI . .6 II-C5 MOBA games: A literature review . .7 II-C6 On The Development of Intelligent Agents For MOBA . .7 II-C7 What Contributes to Success in MOBA games? An Empirical Study Of Defense of the Ancients 2 . .7 III Research Method 7 III-A Design Science . .7 III-B Experiment . .8 III-C Threats to validity . .8 IV Frameworks 8 IV-A 1v1 framework . .8 IV-B 5v5 framework . 10 IV-B1 DotA 2 Addon . 10 IV-B2 Web API . 10 IV-B3 Client . 10 V Experiments 10 V-A Experiment 1 - Hero movement . 11 V-B Experiment 2 - Level up hero abilities . 11 V-C Experiment 3 - Hero attack . 11 V-D Experiment 4 - Buy items . 11 V-E Experiment 5 - Sell items . 11 V-F Experiment 6 - Use items . 11 V-G Experiment 7 - Target Types . 11 V-G1 Experiment 7.1 - No Target . 11 V-G2 Experiment 7.2 - Toggle . 11 V-G3 Experiment 7.3 - Target Point . 11 V-G4 Experiment 7.4 - Target Area . 11 V-G5 Experiment 7.5 - Target Unit . 11 V-G6 Experiment 7.6 - Vector Targeting . 12 V-G7 Experiment 7.7 - Combination of Target Point or Target Unit . 12 V-G8 Experiment 7.8 - Target Unit with Area of Effect . 12 V-H Experiment 8 - Validating usage of all heroes . 12 V-I Experiment 9 - Full length match . 12 1 VI Experiment results 12 VI-A Experiment 1 - Hero movement . 12 VI-B Experiment 2 - Level up hero abilities . 12 VI-C Experiment 3 - Hero attack . 13 VI-D Experiment 4 - Buy items . 13 VI-E Experiment 5 - Sell items . 13 VI-F Experiment 6 - Use items . 13 VI-G Experiment 7 - Target types . 13 VI-H Experiment 7.1 - No Target . 13 VI-I Experiment 7.2 - Toggle . 13 VI-J Experiment 7.3 - Target Point . 14 VI-K Experiment 7.4 - Target Area . 14 VI-L Experiment 7.5 - Target Unit . 14 VI-M Experiment 7.6 - Vector Targeting . 14 VI-N Experiment 7.7 - Combination of Target Point and Target Unit . 14 VI-O Experiment 7.8 - Combination of Target Unit and Target Area . 14 VI-P Experiment 8 - Full length match . 15 VI-Q Experiment 9 - Validating usage of all heroes . 15 VII Discussion 15 VII-A Future work . 15 VIII Conclusion 15 References 16 2 Abstract—Multiplayer online battle arena (MOBA) games have paths are referred to as lanes. The three lanes are called bot properties that make them suitable for research in artificial and lane, mid lane, top lane. Figure 1 gives a graphic representation computational intelligence. MOBA games are generally played of the DotA 2 map, presenting the meaning of lanes and team vs team meaning planning and organizing the team is one of the most important aspects. This makes it suitable for research towers. Mid lane is usually occupied by 1 player from each in artificial intelligence agent cooperation. team. Bot and top lane is usually occupied by 2 players from This paper presents a literature review performed in the area each team. On top of this there is also a jungle in the map of artificial and computational intelligence regarding MOBA where players can kill neutral creeps for more experience games. The findings are that there is little or no research made and gold. Players can make their own modifications to the in the area. The research found concerning MOBA games is in the context of player behaviour and toxic behaviour in the game in the programming language Lua [2]. The Lua sandbox, MOBA game league of legends. What is found is encouragement included in the workshop tools that is downloadable content, on developing frameworks supporting 5v5 matches in MOBA provides a comprehensive API to control units and view the games which this paper also presents, a 5v5 framework for bot- game state [3]. matchmaking in DotA 2 making it possible for users to develop bots to be run versus the in-game AI. Keywords—ai agent framework, DotA 2, moba, agent cooper- ation I. INTRODUCTION The topic for this thesis is research within computational intelligence and artificial intelligence. Artificial intelligence has been used to play games for a long time. As mentioned by Julian Togelius in [1], Alan Turing re-invented the Minimax algorithm to play Chess. Furthermore it sheds light on the suitability games provide for artificial intelligence research. This is due to their ability of challenging players and training the cognitive capabilities of players [1]. Different games provide different challenges. Some games challenge one player and some games challenge a team of players. Therefore the research that can be done could differ depending on which game is chosen. In this thesis a framework has been developed to provide a platform for research of artificial intelligence teamwork. The chosen game for this framework is DotA 2. Conveniently Fig. 1. Overview of the DotA 2 map. Radiant team is marked in green and a framework exists for DotA 2 but it can only handle 1v1 Dire team in red. The circles in green and red represent the teams defending matches which takes away the ability to research teamwork of towers [4] artificial intelligent agents. DotA 2 is a MOBA game where the ultimate goal is A. Motivation to destroy the opponent’s base. The opponent’s base, called Ancient, is positioned at the opposite end of the map and Ms Pac-Man [5] is a framework for competition in Ms outputs creeps that pushes the lanes during the game. Creeps Pac-Man. This is partly used for competition because of are in-game controlled AI units that are either neutral or lane the properties of the game. Research within computational creeps. Neutral creeps are found in the jungle in small camps and artificial intelligence fields is made by the help of this and provide the possibility for players to farm experience and framework. The complexity of the game is fitting to research gold. The lane creeps, spawning every 30 seconds, pushes all due to its challenges in real-time decision-making and hetero- lanes automatically towards the enemy’s Ancient. A match geneous player types. There are other AI-agent frameworks traditionally consists of two teams each having their own base used in competitions around the world such as the TAC SCM to protect and an opponent’s base to attack. Each team consists framework [6]. The idea behind these competitions is to use of five players. Each player controls their own hero i.e. a them as a testbeds for new techniques and algorithms that playable character with multiple abilities and different play can be applied, not just to game AI field, but rather the field styles. Each player is assigned a courier, used to buy and of AI research [7]. As an example, in 2017, researchers at transport items to the player, enabling the player to stay in it’s Microsoft developed an AI-agent for Ms Pac-Man that scored lane without going back to base to buy items. A hero levels the highest score ever. Rahul Mehrotra [8] who is a product up during.
Recommended publications
  • Empirical Investigation on Measurement of Game Immersion Using Real World Dissociation Factor
    Thesis no: MSCS-2016-13 Empirical Investigation on Measurement of Game Immersion using Real World Dissociation Factor Gadila Swarajya Haritha Reddy Faculty of Computing Blekinge Institute of Technology SE–371 79 Karlskrona, Sweden This thesis is submitted to the Faculty of Computing at Blekinge Institute of Technology in partial fulfillment of the requirements for the degree of Master of Science in Computer Science. The thesis is equivalent to 20 weeks of full time studies. Contact Information: Author(s): Gadila Swarajya Haritha Reddy E-mail: [email protected] University advisor: Prof. Sara Eriksén Department of Creative Technologies Faculty of Computing Internet : www.bth.se Blekinge Institute of Technology Phone : +46 455 38 50 00 SE–371 79 Karlskrona, Sweden Fax : +46 455 38 50 57 Abstract Context. Games involve people to a large extent where they relate them- selves with the game characters; this is commonly known as game immer- sion. Generally, some players play games for enjoyment, some for stress relaxation and so on.Game immersion is usually used to describe the degree of involvement with a game. When people play games, they don’t necessar- ily realize that they have been dissociated with the surrounding world. Real world dissociation (RWD) can be defined as the situation where a player is less aware of the surroundings outside the game than about what is happen- ing in the game itself. The RWD factor has been expected to measure the losing track of time, lack of awareness of surroundings and mental trans- portation. Objectives. In this thesis, we measure and compare the difference in game immersion between experienced and inexperienced players using RWD fac- tor.
    [Show full text]
  • Artificial Intelligence: with Great Power Comes Great Responsibility
    ARTIFICIAL INTELLIGENCE: WITH GREAT POWER COMES GREAT RESPONSIBILITY JOINT HEARING BEFORE THE SUBCOMMITTEE ON RESEARCH AND TECHNOLOGY & SUBCOMMITTEE ON ENERGY COMMITTEE ON SCIENCE, SPACE, AND TECHNOLOGY HOUSE OF REPRESENTATIVES ONE HUNDRED FIFTEENTH CONGRESS SECOND SESSION JUNE 26, 2018 Serial No. 115–67 Printed for the use of the Committee on Science, Space, and Technology ( Available via the World Wide Web: http://science.house.gov U.S. GOVERNMENT PUBLISHING OFFICE 30–877PDF WASHINGTON : 2018 COMMITTEE ON SCIENCE, SPACE, AND TECHNOLOGY HON. LAMAR S. SMITH, Texas, Chair FRANK D. LUCAS, Oklahoma EDDIE BERNICE JOHNSON, Texas DANA ROHRABACHER, California ZOE LOFGREN, California MO BROOKS, Alabama DANIEL LIPINSKI, Illinois RANDY HULTGREN, Illinois SUZANNE BONAMICI, Oregon BILL POSEY, Florida AMI BERA, California THOMAS MASSIE, Kentucky ELIZABETH H. ESTY, Connecticut RANDY K. WEBER, Texas MARC A. VEASEY, Texas STEPHEN KNIGHT, California DONALD S. BEYER, JR., Virginia BRIAN BABIN, Texas JACKY ROSEN, Nevada BARBARA COMSTOCK, Virginia CONOR LAMB, Pennsylvania BARRY LOUDERMILK, Georgia JERRY MCNERNEY, California RALPH LEE ABRAHAM, Louisiana ED PERLMUTTER, Colorado GARY PALMER, Alabama PAUL TONKO, New York DANIEL WEBSTER, Florida BILL FOSTER, Illinois ANDY BIGGS, Arizona MARK TAKANO, California ROGER W. MARSHALL, Kansas COLLEEN HANABUSA, Hawaii NEAL P. DUNN, Florida CHARLIE CRIST, Florida CLAY HIGGINS, Louisiana RALPH NORMAN, South Carolina DEBBIE LESKO, Arizona SUBCOMMITTEE ON RESEARCH AND TECHNOLOGY HON. BARBARA COMSTOCK, Virginia, Chair FRANK D. LUCAS, Oklahoma DANIEL LIPINSKI, Illinois RANDY HULTGREN, Illinois ELIZABETH H. ESTY, Connecticut STEPHEN KNIGHT, California JACKY ROSEN, Nevada BARRY LOUDERMILK, Georgia SUZANNE BONAMICI, Oregon DANIEL WEBSTER, Florida AMI BERA, California ROGER W. MARSHALL, Kansas DONALD S. BEYER, JR., Virginia DEBBIE LESKO, Arizona EDDIE BERNICE JOHNSON, Texas LAMAR S.
    [Show full text]
  • The Development and Validation of the Game User Experience Satisfaction Scale (Guess)
    THE DEVELOPMENT AND VALIDATION OF THE GAME USER EXPERIENCE SATISFACTION SCALE (GUESS) A Dissertation by Mikki Hoang Phan Master of Arts, Wichita State University, 2012 Bachelor of Arts, Wichita State University, 2008 Submitted to the Department of Psychology and the faculty of the Graduate School of Wichita State University in partial fulfillment of the requirements for the degree of Doctor of Philosophy May 2015 © Copyright 2015 by Mikki Phan All Rights Reserved THE DEVELOPMENT AND VALIDATION OF THE GAME USER EXPERIENCE SATISFACTION SCALE (GUESS) The following faculty members have examined the final copy of this dissertation for form and content, and recommend that it be accepted in partial fulfillment of the requirements for the degree of Doctor of Philosophy with a major in Psychology. _____________________________________ Barbara S. Chaparro, Committee Chair _____________________________________ Joseph Keebler, Committee Member _____________________________________ Jibo He, Committee Member _____________________________________ Darwin Dorr, Committee Member _____________________________________ Jodie Hertzog, Committee Member Accepted for the College of Liberal Arts and Sciences _____________________________________ Ronald Matson, Dean Accepted for the Graduate School _____________________________________ Abu S. Masud, Interim Dean iii DEDICATION To my parents for their love and support, and all that they have sacrificed so that my siblings and I can have a better future iv Video games open worlds. — Jon-Paul Dyson v ACKNOWLEDGEMENTS Althea Gibson once said, “No matter what accomplishments you make, somebody helped you.” Thus, completing this long and winding Ph.D. journey would not have been possible without a village of support and help. While words could not adequately sum up how thankful I am, I would like to start off by thanking my dissertation chair and advisor, Dr.
    [Show full text]
  • Valve Corporation Tournament License
    VALVE CORPORATION DOTA 2 TOURNAMENT LICENSE AND PAID SPECTATOR SERVICE AGREEMENT By pressing “Submit” you and/or the party you represent in submitting this web form (“Licensee”) agree to be bound be the terms of this Dota 2 Tournament License and Paid Spectator Service Agreement (the “Agreement”). It is entered into and effective by and between Valve Corporation, a Washington, U.S.A. corporation (“Valve”), and the Licensee as of the day that Valve accepts and confirms the submission by making it accessible through the Paid Spectator Service. 1. Definitions 1.1 “Adjusted Gross Revenue” mean the gross revenue actually received by Valve from Valve’s sale of the Tournaments via the Paid Spectator Service, less (a) actual costs resulting directly from returns, discounts, refunds, fraud or chargebacks; (b) taxes that are imposed on a customer of the Paid Spectator Service on the distribution, sale or license of the Tournaments (such as sales, use, excise, value-added and other similar taxes) that are received from such customer by Valve for payment to governmental authorities. 1.2 “Confidential Information” means (i) any trade secrets relating to Valve’s product plans, designs, costs, prices and names, finances, marketing plans, business opportunities, personnel, research development or know-how; (ii) any unreleased Valve products; and (iii) any other information that Valve designates to Licensee as being confidential or which, based on the nature of such information and the circumstances surrounding its disclosure, ought in good faith to be treated as confidential. 1.3 “Game” means the game Dota 2. 1.4 “Game-Related Intellectual Property,” means the Dota™ trademark and Dota 2 logo.
    [Show full text]
  • Taking College Esports Seriously Nyle Sky Kauweloa and Jenifer Sunrise Winter
    Document generated on 09/30/2021 4:30 a.m. Loading The Journal of the Canadian Game Studies Association Taking College Esports Seriously Nyle Sky Kauweloa and Jenifer Sunrise Winter Volume 12, Number 20, Fall 2019 Article abstract This study examined how collegiate esports players conceptualized their own URI: https://id.erudit.org/iderudit/1065896ar competitive gameplay as situated between work and play. Using interviews DOI: https://doi.org/10.7202/1065896ar guided by Stebbins’ (2007) serious leisure perspective, 16 collegiate esports players described how belonging to a collegiate esports team has shaped their See table of contents identity, and how they experienced gaming within the structured environment of a collegiate esports team and club. Stebbins’ description of skill and knowledge development was supported, and the findings are in accord with Publisher(s) Stebbins’ conceptualization of “personal rewards,” such as self-expression, self-image, and self-actualization. Canadian Game Studies Association ISSN 1923-2691 (digital) Explore this journal Cite this article Kauweloa, N. & Winter, J. (2019). Taking College Esports Seriously. Loading, 12(20), 35–50. https://doi.org/10.7202/1065896ar Copyright, 2019 Nyle Sky Kauweloa, Jenifer Sunrise Winter This document is protected by copyright law. Use of the services of Érudit (including reproduction) is subject to its terms and conditions, which can be viewed online. https://apropos.erudit.org/en/users/policy-on-use/ This article is disseminated and preserved by Érudit. Érudit is a non-profit inter-university consortium of the Université de Montréal, Université Laval, and the Université du Québec à Montréal. Its mission is to promote and disseminate research.
    [Show full text]
  • Dota2 Pick/Ban Recommendation System
    Special Issue - 2021 International Journal of Engineering Research & Technology (IJERT) ISSN: 2278-0181 NTASU - 2020 Conference Proceedings Dota2 Pick/Ban Recommendation System Vhitesh More Atul Naik COMP student, dept. Computer Engineering COMP student, dept. Computer Engineering VCET Mumbai, India VCET Mumbai, India Juneeth Panjri COMP student, dept. Computer Engineering VCET Mumbai, India Abstract— Multiplayer Online Battle Arena (MOBA) games have received enormous recognition recently. In a match of such video games, players compete in groups of 5 every controlling an in-recreation avatar, known as heroes, selected from a roster of more than a hundred. The choice of heroes, additionally known as select or draft, takes place earlier to the match and alternates among the two teams till each participant has selected one hero. Heroes are designed with one of a kind strengths and weaknesses to promote group cooperation in a sport. Intuitively, heroes in a sturdy group need to supplement each different strength’s and suppress those of combatants. Hero drafting is therefore a tough hassle due to the complicated hero-to-hero relationships to consider. In this paper, we recommend a singular hero recommendation device that indicates heroes to add to a present group at the same time as maximizing the crew’s prospect for victory. For exploits the shortcomings and decreases the strengths of that case, we represent the drafting among teams as a the heroes chosen by the opposing team. Assuming equally combinatorial sport. Our empirical assessment indicates that skilled teams, the aftermath of hero selection can be so hero groups drafted by our recommendation set of rules have astonishing that well devised hero choices can totally give substantially better win chance in opposition to groups a team a large advantage before the match even begins.
    [Show full text]
  • Applications of Machine Learning in Dota 2: Literature Review and Practical Knowledge Sharing
    Applications of Machine Learning in Dota 2: Literature Review and Practical Knowledge Sharing Aleksandr Semenov1, Peter Romov2;3, Kirill Neklyudov2;3, Daniil Yashkov2;3, and Daniil Kireev4 1 International Laboratory for Applied Network Research, National Research University Higher School of Economics, Moscow, Russia 2 Yandex Data Factory, Moscow, Russia 3 Moscow Institute of Physics and Technology, Moscow, Russia 4 Moscow State University, Moscow, Russia [email protected], [email protected], [email protected], [email protected], [email protected] Abstract. We present the review of recent applications of Machine Learning in Dota 2. It includes prediction of the winning team from the drafting stage of the game, calculating optimal jungling paths, pre- dict the result of teamfights, recommendataion engine for the draft, and detection of in-game roles with emphasis on win prediction from team composition data. Besides that we discuss our own experience with mak- ing Dota 2 Machine Learning hachathon and Kaggle competitions. Keywords: Dota 2, MOBA, eSports, Machine Learning 1 Introduction to Dota 2 game rules and mechanics DotA 2 is an online multiplayer video game and its first part, DotA (after \De- fense of the Ancients") created a new genre, called Multiplayer Online Battle Arena (MOBA). It is played by two teams, called Radiant and Dire which con- sist of five players each. The main goal of the game is to destroy other team's \Ancient", located at the opposite corners of the map. Each of the players choose one hero to play with from a pool of 113 heroes in the drafting stage of the game (sometimes called 'picks').
    [Show full text]
  • 1935-01-04 1.Pdf
    i —. E#l- •:js. w*^ *** 'E^:- J f .« s . ' IJET uS'iJSTXE •_-•> J : -: BEWARE OF fCS ROADS ' Throujhout J9S5:*> ***** J Ji>rive.{ Slowly. Yon.Are KespuisLble TSortiviil*^A Better Kaie j- ' 1 For-Your soruwii F« Your Life AmJTh2torOt%«35 • • i-Jj^'^iii u ::jS*sL.Z. -:'.te= ^oi^64, SK; ;^> :¾^¾^ ^: - laSf--^----".-; Northville, Michigan, Friday, JSiiuiry. 4, 1935" $1.50 PER YEAR IN ADVANCE a.=^ ,-.,.-,. -..-^¾¾¾¾¾^ r+^ 4&S^ T .EEJiirfICYv ROADSit?r\-kiSQ , ^LDirrSift^TffiTT NORTHVlLLMH^TMV/TI f Eir 11^ U= ^HEC^tA3cE?i ~; H »1 ••" ••".-• • ' : 3 --• '•'''' - -"•: : ^ - -n ••:: • • = '" " -- ' : f IS DISCONTINUED i'c Will ; MH -E:^EE,E E^ d:- -. *:-t:.j-a::^^H-.--'.. :---41= I*- i' Warnier Weather Gomes; But Gives Way^To Predictions! E [E Formal' notice;.£as been., .received;. <-. '.'.' ..'."Of More Snow AndELbw Temperatures- .' EE i B f" -JDeposa'crs ^te;JBsd^,,tk3i; oh i>EE. Ur. -..' .-,--.. •-•* liiili iilsi •^/3i-- --:-..--=-- - •:>.-'--..-:"'%'<-. .- ,.. ... 0=?i--jcember;3i, Sertw^oeat federal taSci, Oil : \& allchecis was diSxffitiiued. -. |. i -... o:ChiU^blasts and^icy;stre.et^-that hacLprevailed ^or I jnea^lyEa^yreeki gave way^ednes^ay .and early Thursday { The twoseeht elSS-tax wasrlev-.! fto a:^n«ralJt&atv;i.;E-v•;-^5¾¾-E.-;E-:.EE-: i: -ft " I t :^::^-:¾¾¾¾¾ aadia its crg££al], # ilffi : - jfoA-sail^tb^fii^nfSi^ediintil; r- _ :-,-, .^ •-- "- - E- --- -'- -,| EE^oittyflie-^as-^KlyQmg^^ga|nEl^^^aV;-hdw-eve¥, j eiiit : t f iiulyl, 1955. ^Howevery'S-i .tlfe'-Iast • •'• E '"E^ r-. :.. - •"-. ~ . - - ; fSiEs-EE -::-E. „". -,; -. '•' iwhen a strong.^!ei-%pn^ng Mo^an^fur'ther indications- 'session of'Cosisress" "the closicsrdate if-. -• - --*:- -ts~ ^ '-- -ir> •• '• ' i93?r RoU ,bf $5d,^Jr:39 is Da g w Ra 0 5 ChiS'^ ]^a^T5 Be Fo>^ ; - E-- :•• E i Gaice In L<kal [Gyma&ixxim^s change :o the"Sst 3^¾ i^:i ° *^ : ^J ^^f*™ • Lower Thoa That Of .^'Annual Dabc^Sporisored 1.- The low^ tem^ei«rareJxecorded .during .the week' Termed- «»ic-.vi-^"Most Cruciali '• j^ norfc«-.iras 3ssBed.:tfirSs*h:tlie;-.
    [Show full text]
  • Towards Incremental Agent Enhancement for Evolving Games
    Evaluating Reinforcement Learning Algorithms For Evolving Military Games James Chao*, Jonathan Sato*, Crisrael Lucero, Doug S. Lange Naval Information Warfare Center Pacific *Equal Contribution ffi[email protected] Abstract games in 2013 (Mnih et al. 2013), Google DeepMind devel- oped AlphaGo (Silver et al. 2016) that defeated world cham- In this paper, we evaluate reinforcement learning algorithms pion Lee Sedol in the game of Go using supervised learning for military board games. Currently, machine learning ap- and reinforcement learning. One year later, AlphaGo Zero proaches to most games assume certain aspects of the game (Silver et al. 2017b) was able to defeat AlphaGo with no remain static. This methodology results in a lack of algorithm robustness and a drastic drop in performance upon chang- human knowledge and pure reinforcement learning. Soon ing in-game mechanics. To this end, we will evaluate general after, AlphaZero (Silver et al. 2017a) generalized AlphaGo game playing (Diego Perez-Liebana 2018) AI algorithms on Zero to be able to play more games including Chess, Shogi, evolving military games. and Go, creating a more generalized AI to apply to differ- ent problems. In 2018, OpenAI Five used five Long Short- term Memory (Hochreiter and Schmidhuber 1997) neural Introduction networks and a Proximal Policy Optimization (Schulman et al. 2017) method to defeat a professional DotA team, each AlphaZero (Silver et al. 2017a) described an approach that LSTM acting as a player in a team to collaborate and achieve trained an AI agent through self-play to achieve super- a common goal. AlphaStar used a transformer (Vaswani et human performance.
    [Show full text]
  • DEEP LEARNING TECHNOLOGIES for AI Considérations
    DEEP LEARNING TECHNOLOGIES FOR AI Marc Duranton CEA Tech (Leti and List) Considérations énergétiques de l’IA et perspectives Marc Duranton CEA Fellow 22 Septembre 2020 Séminaire INS2I- Systèmes et architectures intégrées matériel-logiciel pour l’intelligence artificielle KEY ELEMENTS OF ARTIFICIAL INTELLIGENCE “…as soon as it works, no one calls it AI anymore.” “AI is whatever hasn't been done yet” John McCarthy, AI D. Hofstadter (1980) who coined the term “Artificial Intelligence” in 1956 Traditional AI, Analysis of Optimization of energy symbolic, “big data” in datacenters algorithms Data rules… analytics “Classical” approaches ML-based AI: Our focus today: to reduce energy consumption Bayesian, … - Considerations on state of the art systems Deep (learninG + inference) Learning* - Edge computing ( inference, federated learning, * Reinforcement Learning, One-shot Learning, Generative Adversarial Networks, etc… neuromorphic) From Greg. S. Corrado, Google brain team co-founder: – “Traditional AI systems are programmed to be clever – Modern ML-based AI systems learn to be clever. | 2 CONTEXT AND HISTORY: STATE-OF-THE-ART SYSTEMS 2012: DEEP NEURAL NETWORKS RISE AGAIN They give the state-of-the-art performance e.g. in image classification • ImageNet classification (Hinton’s team, hired by Google) • 14,197,122 images, 1,000 different classes • Top-5 17% error rate (huge improvement) in 2012 (now ~ 3.5%) “Supervision” network Year: 2012 650,000 neurons 60,000,000 parameters 630,000,000 synapses • Facebook’s ‘DeepFace’ Program (labs headed by Y. LeCun) • 4.4 millionThe images, 2018 Turing4,030 identities Award recipients are Google VP Geoffrey Hinton, • 97.35% accuracy,Facebook's vs.Yann 97.53% LeCun humanand performanceYoshua Bengio, Scientific Director of AI research center Mila.
    [Show full text]
  • TUBC 2015 Case
    0! ! ! ! ! ! ! ! ! ! ! ! “GROWING E-SPORT IN SOUTH EAST ASIA” ! ! ! ! ! ! ! ! ! ! ! ! ! 1 | TUBC 2015 ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! !Supawat Likittanawong prepared this case with assistance of Pakapol Thangtongchin under the supervision of the case company. The case was prepared solely as a basis for ! discussion. Cases are written in the past tense; this is not meant to imply that all practices, !organizations, people, places or facts mentioned in the case no longer occur, exist or apply. Cases are not intended to serve as endorsements, sources of primary data, or !illustration of effective or ineffective handling of a business situation. ! The case was written under the permission granted by the case company. © 2015 by BBA !International Program, Thammasat Business School, Thammasat University. This publication may not be digitized, photocopied or otherwise reproduced, posted,or ! transmitted without the permission of BBA International Program, Thammasat Business !School, Thammasat University. TUBC 2015 | 2 ! ! ! ! “At Garena, we focus on bringing joy and convenience to people across Asia through the power of our technology platform. We aspire to make the world an ever more connected community through innovative products and services.” -! Forrest Li, Garena’s Founder, Chairman and Group CEO ! 3 | TUBC 2015 ! 1.! INTRODUCTION It was July 2015 and Nok was waiting for the rest of her team in the main meeting room at Garena’s office in downtown Bangkok. A week ago, Nok attended the top team meeting at Garena’s headquarter in Singapore where the topic of growing eSports in Southeast Asia (SEA) was the center of discussion. Being a leader in online gaming in the region, Garena is at the forefront of the industry development.
    [Show full text]
  • An Overview of Esports in Europe
    THIS REPORT IS BROUGHT TO YOU BY ESPORTS BAR AN OVERVIEW OF ESPORTS IN EUROPE FEATURING AN IN-DEPTH LOOK AT FOUR OF EUROPE’S MOST VIBRANT ESPORTS ECOSYSTEMS SWEDEN POLAND SPAIN GERMANY DECEMBER 2017 TABLE OF CONTENTS 1. Foreword 3 2. Key Facts About Europe 4 3. European Market Trends 6 4. Local Impact 10 5. Biggest Events 15 6. Using Consumer Insights 18 FOREWORD A NEW PHASE FOR ESPORTS COMMENCES Esports is entering a new phase toward becoming a mature ESPORTS ENTERING A CRUCIAL PHASE TOWARDS MATURITY market. The coming two years will be crucial in how fast it grows into a multi-billion-dollar business. The key determining factors are the success of local leagues and the franchising approach, the implementation of regulations, the arrival of new game formats and competition, the uptake of content rights sales, team profitability, and the impact of industry convergence involving traditional media, entertainment, telecom, and sports companies. Depending on how these factors play out in the coming year or two, esports’ growth could accelerate and reach $2.4 billion in 2020 in an optimistic scenario, almost $1 billion higher than the base scenario of $1.5 billion. Europe has been one of the most important regions in the development of the esports industry. Some of the first organizations that made esports popular, especially in the West, originate from Europe. Most notable is ESL, arguably the world’s largest esports organization, which has its roots in Germany. The company has helped build and shape esports from small community events to record-breaking events, including the Intel Extreme Masters in Katowice and ESL One in Cologne.
    [Show full text]