Arago's Artificial Intelligence Platform HIRO™ Beats Human Players At

Total Page:16

File Type:pdf, Size:1020Kb

Arago's Artificial Intelligence Platform HIRO™ Beats Human Players At Arago’s Artificial Intelligence Platform HIRO™ Beats Human Players at Freeciv – Shows Highest Degree of Decision Making Capability for AI The Freeciv Challenge Unveiled at TechCrunch Disrupt London 2016 Shows Machine Rea- soning Behind Complex Decisions, Not Just Brute Force Logic FRANKFURT / LONDON – 06 December, 2016 – Arago, a pioneer in artificial intelligence (AI) and leader in intelligent IT automation based in Frankfurt and New York City, today an- nounced that HIRO (Human Intelligence Robotically Optimized)™, the company’s flagship AI technology capable of learning, understanding and reasoning to solve problems, has defeat- ed human players in the computer game Freeciv, after it became an unbeatable opponent for the game’s built-in AI. Freeciv is a turn-based strategy game inspired by the popular Sid Meier's Civilization series. This signifies a major step forward in one of the challenges in the development of AI: evolving decisions from brute force testing, to more nuanced role playing without defined outcomes for victory. The announcement, which included game footage screened Tuesday afternoon at Tech- Crunch’s Disrupt London 2016, represents an exponential advancement in machine intelli- gence due to Freeciv’s game complexity. With all the different options, opponents acting un- predictably, and changing parameters throughout the whole game, there are more than 10 to the power of 15,000 possible games imaginable – for comparison there are only 10 to the power of 80 atoms in the universe. Advancements from simple trial and error represented by machine learning, to combining this approach with machine reasoning that takes the “why” into account was Arago’s goal. ! The chart shows the level of complexity across Chess, Go and Freeciv, which AIs can apply to sort through possible combinations, and then beat human players. !1 “It has become good tradition to showcase the advancement in AI through playing games; starting at chess to Jeopardy to Atari games to Go. Winning in a strategy game like Freeciv is the next logical step,” said Arago founder and CEO Chris Boos.“Beyond the simple growth of complexity, Freeciv introduces additional layers of realism by adding chance and no longer having god-like information about the game. HIRO required less time and resources for training than previous AI showcases. We’re able to demonstrate the power of the hybrid platform based on machine reasoning enhanced with machine learning underlying the HIRO system.“ On top of the scientific showcase of winning Freeciv the same HIRO system is used by global enterprises for automating IT operations across the entire IT stack. Commercially, the HIRO platform amplifies human IT experts through continuous learning and built-in self-op- timization. Faster Learning through Optimized Efficiency Despite the fact that Freeciv holds an exponential amount more moves than Go, Arago’s HIRO actually required less data and trainers in order to advance to victory. Winning against human players is a major milestone, because it shows that hybrid systems of machine rea- soning and machine learning can reuse their knowledge and though easily be trained by dif- ferent independent coaches simultaneously. “A common misconception with regards to AI can stem from popular culture and fantasy, that we are looking for cognizance or singularity,” added Boos. “In fact, we are looking for ma- chines with memory and adaptation for long-term planning. These properties give HIRO the capabilities to excel in very complex situations such as IT system management and also in Freeciv.” Boos spoke with former TechCrunch Editor John Biggs onstage at TechCrunch’s annual Dis- rupt conference in London where the crowd was treated to a time-lapsed encapsulation of wins against humans and other outstanding scenes from game play. About Arago http://www.arago.co. To get up-to-date news on advancements made in the field of artificial intelligence visit http:// www.arago.ai. For Arago Ryan Sommer Director, MaintainPR [email protected] 646-220-4256 !2.
Recommended publications
  • Helpfile for Freeciv ; ; Each [Help *] Is a Help Node
    ; Helpfile for Freeciv ; ; Each [help_*] is a help node. ; ; 'name' = name of node as shown in help browser; the number of leading ; spaces in 'name' indicates nesting level for display. ; ; 'text' = the helptext for this node; can be an array of text, which ; are then treated as paragraphs. (Rationale: easier to update ; translations on paragraph level.) ; ; 'generate' = means replace this node with generated list of game ; elements; current categories are: ; "Units", "Improvements", "Wonders", "Techs", ; "Terrain", "Governments" ; ; Within the text, the help engine recognizes a few "generated table"s. ; These are generated by the help engine, and inserted at the point of ; reference. They are referenced by placing a $ in the first column ; of a separate paragraph, followed immediately with the name of the ; generated table. See the code in helpdlg.c for the names of tables w ; hich can be referenced. ; ; This file no longer has a max line length: strings are wrapped ; internally. However to do nonwrapping formatting, make sure to ; insert hard newlines "\n" such that lines are less than 68 chars ; long. ; This marks 68 char limit > ; ; Notice not all entries are marked for i18n, as some are not ; appropriate to translate. ; ; Comments with cstyle comments are just to stop xgettext from ; complaining about stray singlequote characters. [help_about] name = _("About") text = _("\ Freeciv is a turnbased strategy game, in which each player becomes \ the leader of a civilization, fighting to obtain the ultimate goal: \ the extinction of all other civilizations.\ "), _("\ Original authors:\n\ (they are no longer involved, please don't mail them!)\ "), "\ Allan Ove Kjeldbjerg [email protected]\n\ Claus Leth Gregersen [email protected]\n\ Peter Joachim Unold [email protected]\ ", _("\ Present administrators: \ "), "\ Marko Lindqvist [email protected]\n\ R.
    [Show full text]
  • Release Notes for Fedora 15
    Fedora 15 Release Notes Release Notes for Fedora 15 Edited by The Fedora Docs Team Copyright © 2011 Red Hat, Inc. and others. The text of and illustrations in this document are licensed by Red Hat under a Creative Commons Attribution–Share Alike 3.0 Unported license ("CC-BY-SA"). An explanation of CC-BY-SA is available at http://creativecommons.org/licenses/by-sa/3.0/. The original authors of this document, and Red Hat, designate the Fedora Project as the "Attribution Party" for purposes of CC-BY-SA. In accordance with CC-BY-SA, if you distribute this document or an adaptation of it, you must provide the URL for the original version. Red Hat, as the licensor of this document, waives the right to enforce, and agrees not to assert, Section 4d of CC-BY-SA to the fullest extent permitted by applicable law. Red Hat, Red Hat Enterprise Linux, the Shadowman logo, JBoss, MetaMatrix, Fedora, the Infinity Logo, and RHCE are trademarks of Red Hat, Inc., registered in the United States and other countries. For guidelines on the permitted uses of the Fedora trademarks, refer to https:// fedoraproject.org/wiki/Legal:Trademark_guidelines. Linux® is the registered trademark of Linus Torvalds in the United States and other countries. Java® is a registered trademark of Oracle and/or its affiliates. XFS® is a trademark of Silicon Graphics International Corp. or its subsidiaries in the United States and/or other countries. MySQL® is a registered trademark of MySQL AB in the United States, the European Union and other countries. All other trademarks are the property of their respective owners.
    [Show full text]
  • Descargar Un Splash De Begins Para El GRUB
    07 FEB / 07 La Revista de Software Libre y Código Abierto EN ESTA EDICIÓN - Entrevista a Federico Mena - Joomla! o Drupal? (Primera parte) - Procedimiento de respaldo, envío y recuperación de bases de datos MySQL a través de la consola de comandos en Linux. - Gobby, una nueva forma colaborativa de trabajar en tus textos. - QEMU, emulando un OLPC. - Domando al escritor Openoffice.org Writer. PROGRAMACIÓN El entorno de desarrollo MAEMO para Nokia 770 (Segunda parte) TALLER DISTRIBUCIONES CUPS: Instalando una ¡Linux está vivo! impresora Epson en Linux. Una revisión a las distros Live-CD más conocidas. Además: Ojo del novato - Zona de Enlaces – Eventos – Y mucho más... Editorial Comienza el 2007 y Begins cuenta con un nuevo refuerzo que se integra al equipo para continuar aportando pero ahora de una manera más estrecha. Bienvenido Eric Báez, seguro que la comunidad Linux ha ganado mucho contigo tomando decisiones desde dentro de la publicación. Redacción Rosana Cáceres [email protected] Juan P. Torres H. [email protected] Este año se viene una intensa competencia en lo que a sistemas Ricardo Gabriel Berlasso [email protected] Alberto Rivera [email protected] operativos se trata, con la entrada de MacOS en la plataforma Intel, Rodrigo Ramírez [email protected] Óscar Calle [email protected] ahora son varios más los rivales para el sistema de Redmond. Por Dionisio Fernández [email protected] Alex Sandoval [email protected] un lado tenemos a Windows Vista, que con sus requerimientos de Staff Begins [email protected] hardware, es muy probable que algo de terreno pierda, oportunidad que será aprovechada por el resto de los jugadores.
    [Show full text]
  • Civ 5 Android Apk
    Civ 5 android apk Continue Where's the modding kit? Modding SDK is available as a free download on Steam: Open Steam and select Library. Civilization free download - Laws of Civilization, Age of Forge: Civilization and Empire, Civilization Revolution 2, and many other programs. November 05, 2019 There are developers who build some mods for this game and release it online where we can download and enjoy the benefits of mods. READ ALSO: 7 best sleep tracking apps for Apple Watch 2019; An easy way to eradicate Vivo without a PC (all models) How to remove pop-up ads on Android, forever! (Without root) HOW TO BE IN CIVILIZATION 5. Download Game: Civilization 5 APK 1.1.0 (Latest version) - com.publishadventures.gqciv - Post Adventures. Learn more about your favorite game - guidebooks, secrets, Easter eggs and tactics. Civilization Sid Meyer VI Free download PC Game Multiplayer Full Repackaging Direct Download Links Squeezed Civilization By Sid Meyer 6 Free Android download. How to download gta 5 iso ppsspp game for Android in 78mb only for Android download now. Sid Meier's Civilization VI Game Overview: With almost every age and tribe, Civilization VI Side Meyer is indeed the flagship killer of Sid Meyer's video game trilogy. Being the sixth main installment of Sid.Civilization Download for PcExperience one of the greatest in turn strategy games of all time, The Civilization of Sid Meyer® V.———————————————————————————B E G I N W I T H 2 0 H I S T O R I C L L L E A D E R R S———————————————————————————Become Ruler of the world by creating and leading civilization since the dawn of man in the space age.
    [Show full text]
  • Linux Games Page 1 of 7
    Linux Games Page 1 of 7 Linux Games INTRODUCTION such as the number of players and the size of the map, then you start the game. Once the game is running clients may Hello. My name is Andrew Howlett. I've been using Linux join the game. Clients connect to the game using TCP/IP, since 1997. In 2000 I cutover to Linux for all my projects, so it is very easy to play multi-player games over the except I dual-booted Windows to play games. I like to play Internet. Like many Free games, clients are available for computer games. About a year ago I stopped dual booting. many platforms, including Windows, Amiga and Now I play computer games under Linux. The games I Macintosh. So there are lots of players out there. If you play can be divided into four groups: Free Games, native don't want to play against other humans, then Freeciv linux commercial games, Windows Emulated games, and includes some nasty AIs. Win4Lin enabled games. This presentation will demonstrate games from each of these four groups. BZFlag Platform BZFlag is a tank combat game along the same lines as the old BattleZone game. Like FreeCiv, BZFlag uses a client/ Before I get started, a little bit about my setup so you can server architecture over TCP/IP networks. Unlike FreeCiv, relate this to whatever you are running. This is a P3 900 the game contains no AIs – you must play this game MHz machine. It has a Crystal Sound 4600 sound card and against other humans (? entities ?) over the Internet.
    [Show full text]
  • HUBERT, Our Freeciv AI
    HUBERT, Our FreeCiv AI Michael Arcidiacono, Joel Joseph Dominic, Richard Akira Heru Friday 7th December, 2018 Abstract FreeCiv is an open-source alternative to Civilization, which is a turn-based strategy game that allows the player to control an empire by building cities, constructing and moving units, and engaging in diplomacy and war with other nations. We build an artificial intelligence (AI) nicknamed HUBERT to play this game. We use a modified SARSA algorithm with linear approximation of the Q function. We have also tried training HUBERT using a memetic algorithm. 1 Introduction The Civilization video game series is a collection of turn-based strategy games that allow the player to control an empire by building cities, constructing and moving units, and engaging in diplomacy and war with other nations. There are several different ways of winning the game such as through military dominion (i.e. by taking over all the cities of other empires). We use an open-source alternative to Civilization, FreeCiv and focus on getting the highest score for this agent. A screenshot of the game in progress can be seen in Figure1. We model this game as a Markov Decision Process (MDP) with states, actions and re- wards. In our model, the states are quantified as a β vector per city containing the total number of cities, total amount of gold, tax, science, luxury, gold per turn, turn number, the number of technologies, city population, city surplus, city unhappiness level, and city food. At any given turn, the player can choose to build cities, build units, move units, declare war, trade resources, research technology, and engage in many other possible actions.
    [Show full text]
  • Playing a Strategy Game with Knowledge-Based Reinforcement Learning
    Noname manuscript No. (will be inserted by the editor) Playing a Strategy Game with Knowledge-Based Reinforcement Learning Viktor Voss · Liudmyla Nechepurenko · Dr. Rudi Schaefer · Steffen Bauer Received: date / Accepted: date Abstract This paper presents Knowledge-Based Reinforcement Learning (KB- RL) as a method that combines a knowledge-based approach and a reinforcement learning (RL) technique into one method for intelligent problem solving. The pro- posed approach focuses on multi-expert knowledge acquisition, with the reinforce- ment learning being applied as a conflict resolution strategy aimed at integrating the knowledge of multiple exerts into one knowledge base. The article describes the KB-RL approach in detail and applies the reported method to one of the most challenging problems of current Artificial Intelligence (AI) research, namely playing a strategy game. The results show that the KB-RL system is able to play and complete the full FreeCiv game, and to win against the computer players in various game settings. Moreover, with more games played, the system improves the gameplay by shortening the number of rounds that it takes to win the game. Overall, the reported experiment supports the idea that, based on human knowledge and empowered by reinforcement learning, the KB-RL system can de- liver a strong solution to the complex, multi-strategic problems, and, mainly, to improve the solution with increased experience. Keywords Knowledge-Based Systems · Reinforcement Learning · Multi-Expert Knowledge Base · Conflict Resolution V. Voss arago GmbH, E-mail: [email protected] L. Nechepurenko arago GmbH, E-mail: [email protected] Dr. R. Schaefer arXiv:1908.05472v1 [cs.AI] 15 Aug 2019 arago GmbH, E-mail: [email protected] S.
    [Show full text]
  • Integrating Reinforcement Learning Into Strategy Games
    Integrating Reinforcement Learning into Strategy Games by Stefan Wender Supervised by Ian Watson The University of Auckland Auckland, New Zealand A Thesis submitted in fulfillment of the requirements for the degree of Master of Science in Computer Science The University of Auckland, February 2009 Abstract The present thesis describes the design and implementation of a machine learning agent based on four different reinforcement learning algorithms. The reinforcement learning agent is integrated into the commercial computer game Civilization IV. Civilization IV is a turn- based empire building game from the Civilization series. The reinforcement learning agent is applied to the city placement selection task. The city placement selection determines the founding sites for a player’s cities. The four reinforcement learning algorithms that are evaluated are the off-policy algorithms one-step Q-learning and Q(λ) and the on-policy algorithms one-step Sarsa and Sarsa(λ). The aim of the research presented in this thesis is the creation of an adaptive machine learning approach for a task which is originally performed by a complex deterministic script. Since the machine learning approach is nondeterministic, it results in a more challenging and dynamic computer AI. The thesis presents an empirical evaluation of the performance of the reinforcement learning approach and compares the performance of the adaptive agent with the original deterministic game AI. The comparison shows that the reinforcement learning approach outperforms the deterministic game AI. Finally, the behaviour and performance of the reinforcement learn- ing algorithms are elaborated on and the algorithms are further improved by analysing and revising their parameters.
    [Show full text]
  • Non-Linear Monte-Carlo Search in Civilization II S.R.K
    Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence Non-Linear Monte-Carlo Search in Civilization II S.R.K. Branavan David Silver * Regina Barzilay Computer Science and Artificial Intelligence Laboratory * Department of Computer Science Massachusetts Institute of Technology University College London {branavan, regina}@csail.mit.edu [email protected] Abstract This paper presents a new Monte-Carlo search al- gorithm for very large sequential decision-making problems. We apply non-linear regression within ! Monte-Carlo search, online, to estimate a state- action value function from the outcomes of ran- dom roll-outs. This value function generalizes be- tween related states and actions, and can therefore Figure 1: An extract from the game manual of Civilization II. provide more accurate evaluations after fewer roll- outs. A further significant advantage of this ap- A common approach to value generalization is value func- proach is its ability to automatically extract and tion approximation (VFA), in which the values of all states leverage domain knowledge from external sources and actions are approximated using a smaller number of pa- such as game manuals. We apply our algorithm rameters. Monte-Carlo search can use VFA to estimate state to the game of Civilization II, a challenging multi- and action values from the roll-out scores. For instance, lin- agent strategy game with an enormous state space ear Monte-Carlo search [Silver et al., 2008] uses linear VFA: and around 1021 joint actions. We approximate the it approximates the value function by a linear combination of value function by a neural network, augmented by state features and weights.
    [Show full text]
  • A History of Linux Gaming
    FEATURE A HISTORY OF LINUX GAMING A HISTORY OF LINUX GAMING Liam Dawe peeks into the belly of an unstoppable beast. n the first ever issue of Linux Voice we briefly developer possible, to having major publishers on touched down on the colourful history of Linux board. Let that just sink in for a moment, as two years Igaming. Now we’re here again to give you a better ago we didn’t have anything looking as bright as it is picture of how we went from being an operating now. That’s an insanely short amount of time for such system that was mostly ignored by every major a big turnaround. The dark ages We start our look in the early 90s, before most popular Linux distro even existed. ack in the 90s, people would most likely laugh at you for telling them Byou used Linux on the desktop. It was around this time that Id Software was creating the game Doom, which actually helped push Windows as a gaming platform. Ironically it was Id that threw us our first bone. A man named Dave Taylor ported Doom to Linux the year after the original release, and he only did it because he loved Linux. In the README.Linux file Dave gave his reasons for the port: “I did this ‘cause Linux gives me a woody. It doesn’t generate revenue. Please don’t call or write us with bug reports. They cost us money, and I get sorta ragged on for wasting One of the first big name games to ever grace our platform, Doom has left quite a legacy.
    [Show full text]
  • MX-19.2 Users Manual
    MX-19.2 Users Manual v. 20200801 manual AT mxlinux DOT org Ctrl-F = Search this Manual Ctrl+Home = Return to top Table of Contents 1 Introduction...................................................................................................................................4 1.1 About MX Linux................................................................................................................4 1.2 About this Manual..............................................................................................................4 1.3 System requirements..........................................................................................................5 1.4 Support and EOL................................................................................................................6 1.5 Bugs, issues and requests...................................................................................................6 1.6 Migration............................................................................................................................7 1.7 Our positions......................................................................................................................8 1.8 Notes for Translators.............................................................................................................8 2 Installation...................................................................................................................................10 2.1 Introduction......................................................................................................................10
    [Show full text]
  • Pipenightdreams Osgcal-Doc Mumudvb Mpg123-Alsa Tbb
    pipenightdreams osgcal-doc mumudvb mpg123-alsa tbb-examples libgammu4-dbg gcc-4.1-doc snort-rules-default davical cutmp3 libevolution5.0-cil aspell-am python-gobject-doc openoffice.org-l10n-mn libc6-xen xserver-xorg trophy-data t38modem pioneers-console libnb-platform10-java libgtkglext1-ruby libboost-wave1.39-dev drgenius bfbtester libchromexvmcpro1 isdnutils-xtools ubuntuone-client openoffice.org2-math openoffice.org-l10n-lt lsb-cxx-ia32 kdeartwork-emoticons-kde4 wmpuzzle trafshow python-plplot lx-gdb link-monitor-applet libscm-dev liblog-agent-logger-perl libccrtp-doc libclass-throwable-perl kde-i18n-csb jack-jconv hamradio-menus coinor-libvol-doc msx-emulator bitbake nabi language-pack-gnome-zh libpaperg popularity-contest xracer-tools xfont-nexus opendrim-lmp-baseserver libvorbisfile-ruby liblinebreak-doc libgfcui-2.0-0c2a-dbg libblacs-mpi-dev dict-freedict-spa-eng blender-ogrexml aspell-da x11-apps openoffice.org-l10n-lv openoffice.org-l10n-nl pnmtopng libodbcinstq1 libhsqldb-java-doc libmono-addins-gui0.2-cil sg3-utils linux-backports-modules-alsa-2.6.31-19-generic yorick-yeti-gsl python-pymssql plasma-widget-cpuload mcpp gpsim-lcd cl-csv libhtml-clean-perl asterisk-dbg apt-dater-dbg libgnome-mag1-dev language-pack-gnome-yo python-crypto svn-autoreleasedeb sugar-terminal-activity mii-diag maria-doc libplexus-component-api-java-doc libhugs-hgl-bundled libchipcard-libgwenhywfar47-plugins libghc6-random-dev freefem3d ezmlm cakephp-scripts aspell-ar ara-byte not+sparc openoffice.org-l10n-nn linux-backports-modules-karmic-generic-pae
    [Show full text]