DOCSLIB.ORG

Planejamento E Tomada De Decisão Em Jogos De Estratégia Por Turnos

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Planejamento E Tomada De Decisão Em Jogos De Estratégia Por Turnos UM FRAMEWORK PARA PESQUISA DE INTELIGÊNCIA ARTIFICIAL EM JOGOS DE ESTRATÉGIA POR TURNOS ISRAEL HERINGER LISBOA DE CASTRO UM FRAMEWORK PARA PESQUISA DE INTELIGÊNCIA ARTIFICIAL EM JOGOS DE ESTRATÉGIA POR TURNOS Dissertação apresentada ao Programa de Pós-Graduação em Ciência da Computação do Instituto de Ciências Exatas da Universidade Federal de Minas Gerais como requisito parcial para a obtenção do grau de Mestre em Ciência da Computação. Orientador: Luiz Chaimowicz Coorientadora: Gisele Lobo Pappa Belo Horizonte Julho de 2012 © 2012, Israel Heringer Lisboa de Castro Todos os direitos reservados Castro, Israel Heringer Lisboa de C355f Um framework para pesquisa de inteligência artificial em jogos de estratégia por turnos / Israel Heringer Lisboa de Castro. — Belo Horizonte, 2012. xxiv, 131 f. : il. col. ; 29cm Dissertação (mestrado) — Universidade Federal de Minas Gerais Orientador: Luiz Chaimowicz Coorientadora: Gisele Lobo Pappa 1. Jogos por computador – Teses. 2. Inteligência artificial – Teses. I. Título. II. Orientador. III. Coorientadora CDU 519.6*82(043) Este trabalho é dedicado a todos os jogadores que, como eu, são ávidos por experiências mais desafiadoras contra adversários controlados por Inteligência Artificial. vii viii Agradecimentos Em primeiro lugar agradeço de todo meu coração a Deus, que ao longo da minha vida tem guiado passos de forma que eu sozinho certamente não seria capaz. Agradeço a Ele que, mesmo sem eu merecer, se mantém fiel com Seu amor e misericórdia todos os dias. De forma mais do que especial, agradeço à minha querida esposa Ariana, com quem me casei durante o período de estudos do mestrado. Obrigado por me amar e apoiar nesta empreitada, além de suportar minha ausência logo no primeiro ano do nosso casamento, devido ao volume de trabalho, especialmente nos períodos finais de conclusão deste trabalho. À minha família – principalmente meus pais Marcelo e Anavera minha irmã Rebeca – que sempre me deram todo tipo de apoio que precisei em todos os momentos da minha vida, além de sempre terem me incentivado nos estudos. Provavelmente nem sei o tanto que vocês já se sacrificaram por mim para que hoje eu esteja concluindo mais esta etapa, mas de toda forma reconheço e agradeço por tudo que são na minha vida. Também agradeço muito aos meus dois orientadores, Luiz Chaimowicz e Gisele Pappa, que com sua experiência me ajudaram a conduzir o trabalho até o escopo atual – por sinal bem diferente do original – e contribuíram bastante com diversas sugestões e revisões. Obrigado pela paciência e pelas cobranças em meio a tantas mudanças e ausências durante este tempo. Agradeço a todos os meus amigos, aos quais tão pouco tempo dediquei nos últimos tempos. Finalmente poderemos voltar a sair, conversar e nos divertir. Obrigado especialmente ao pessoal da célula, que me apoiou muito com as orações durante esses últimos meses. Gostaria ainda de destacar meu obrigado ao Flávio e ao Lucas, que além de compartilhar a paixão por jogos, me ajudaram diretamente neste trabalho. Também agradeço aos meus chefes de trabalho, tanto no meu emprego atual quanto no anterior, onde estava quando comecei o curso. Obrigado pela compreensão ix ao permitirem horários de trabalhos mais flexíveis que permitiram que eu frequentasse as aulas durante o dia. Obrigado também aos meus colegas de trabalho que, especialmente nessa reta final, trabalharam ainda mais para suprir a minha ausência nos momentos em que houve o projeto demandava algum esforço extra. Ao DCC e a UFMG, pela oportunidade de realizar este curso e permitir que conduzisse um trabalho que para mim foi muito interessante e motivador. Agradeço também a todos os que participaram das avaliações relatadas neste trabalho. Vocês foram de grande ajuda ao dedicarem tempo a este projeto e apresentarem abertamente suas opiniões e sugestões. Por fim, agradeço aos criadores da série Sid Meier’s Civilization, especialmente do jogo Civilization II. Foi em meio a centenas de horas neste jogo que por volta de 15 anos atrás comecei a me interessar pela área da inteligência artificial nos jogos, o que me motivou a estudar tanto a graduação quanto o mestrado. Certamente este trabalho seria bem diferente se não fosse por essa experiência. x “Nossa abordagem para criar jogos é encontrar a diversão em primeiro lugar, e então usar a tecnologia para aumentar a diversão.” (Sid Meier) xi xii Resumo Em jogos digitais, a Inteligência Artificial (IA) é um dos elementos mais importantes para garantir o desafio e a diversão, especialmente em gêneros como os jogos de estratégia. No entanto, devido à grande complexidade dos jogos desse gênero, quase sempre o desempenho da IA é muito fraco quando comparado aos jogadores razoavelmente experientes. Nesse cenário, a necessidade de técnicas e algoritmos de IA mais robustos trazem desafios muito interessantes para as pesquisas da área. Uma grande dificuldade existente, porém, é a ausência de ferramentas adequadas para os experimentos em jogos reais, seja porque a manutenção dos códigos é muito complicada ou porque em jogos comerciais não se tem acesso a todas as modificações necessárias. Nesse contexto, propomos a criação de um framework propício à pesquisa de algoritmos de IA em jogos de estratégia por turnos (TBS) através da criação de um jogo com arquitetura especialmente planejada para a pesquisa de IA em jogos TBS de forma que futuros trabalhos na área possam ter uma ferramenta adequada aos experimentos necessários. O objetivo principal do trabalho é fornecer uma ferramenta completa para o desenvolvimento e a experimentação de IA em jogos TBS. Os principais requisitos que devem ser atendidos por esta ferramenta são (i) permitir a realização de confrontos entre diferentes agentes de IA sem a necessidade de um jogador humano, (ii) possibilitar o desenvolvimento de algoritmos de IA sem a necessidade de se escrever muito código não relacionado ao algoritmo utilizado, (iii) possuir arquitetura bem modularizada de forma que a IA esteja em módulos independentes do restante do jogo e não possa trapacear e (iv) conter um jogo TBS que contemple os principais elementos existentes em outros jogos do gênero, de forma que os experimentos realizados sejam aplicáveis em jogos reais. Após a conclusão do desenvolvimento do framework, conduzimos experimentos de avaliação com participantes de diferentes níveis de experiência, tanto em relação à xiii área de IA quanto a desenvolvimento de jogos de forma geral. De acordo com os resultados obtidos, verificamos que a ferramenta construída conseguiu alcançar os objetivos propostos e tem grande potencial na utilização em experimentos de novas técnicas e algoritmos de IA em jogos TBS. Palavras-chave: Jogos Digitais, Jogos de Estratégia por Turnos, Inteligência Artificial, Framework para Experimentos. xiv Abstract In digital games, the Artificial Intelligence (AI) is one of the most important elements to ensure both challenge and fun, especially in genres such as strategy games. However, due to the high complexity of games of this genre, the AI performance is often very weak when compared to fairly experienced players. With this scenario, the need for more robust AI techniques and algorithms bring very interesting challenges to researches in the area. However, a major difficulty faced by researchers is the lack of proper tools for conducting experiments in real games, either because the maintenance of the code is too complicated or because real commercial games do not offer the access for modifying everything needed. In this context, we propose the creation of a framework appropriate for the research on AI algorithms in Turn-Based Strategy (TBS) games by creating a game with its architecture specially designed for AI research on TBS games, in order to have a proper tool for experiments for future works. The main goal of the work is to provide a comprehensive tool for the development and experimentation of AI in TBS games. The main requirements which must be with are to (i) allow the performance of contests between different AI agents without the need for a human player, (ii) enable the development of AI algorithms with no need of writing much code not related to the algorithm itself, (iii) have a well modularized architecture so the AI is totally in independent modules from the rest of the game and is not allowed to cheat and (iv) contain a TBS game which includes the main elements present on other games of the genre, so that the experiments on it are applicable in real games. Upon completion of the development phase, we conducted evaluation experiments with participants from different experience levels, both relating to AI area and games development in general. According to the results, we found that the tool built on this work achieved the proposed objectives and has a great potential for use in experiments of new algorithms and techniques applied to TBS games. xv Keywords: Videogames, Turn-Based Strategy Games, Artificial Intelligence, Framework for Experiments. xvi Lista de figuras Figura 1.1: Tabuleiro do jogo War®, baseado no jogo norte-americano Risk. ............... 3 Figura 2.1: Captura de tela do jogo Civilization V. ................................................... 12 Figura 2.2: Arquitetura básica da IA para jogos TBS. ............................................... 14 Figura 2.3: Planejamento de rota no jogo Civilization V............................................ 17 Figura 3.1: Representação de um mapa hexagonal. ................................................... 29 Figura 3.2: Atributos dos tipos de terreno. ...............................................................
Load more

Recommended publications
  • Civ 2 Pages 1-72 A5
    © 1999 Hasbro Interactive and MicroProse, Inc. All Rights Reserved. MICROPROSE, SID MEIER’S CIVILIZATION, and CIVILIZATION are U.S. registered trademarks and HASBRO INTERACTIVE, the HASBRO INTERACTIVE logo, CIVILIZATION II: TEST OF TIME, TEST OF TIME, LALANDE 21185, CIV, and related marks are trademarks of Hasbro or its affiliates. MicroProse is a subsidiary of Hasbro. The MSN GAMING ZONE is either a registered trademark or a trademark of Microsoft Corporation in the United States and/or other countries. Hasbro and its affiliates disclaim any responsibility or liability for any content on or available through the MSN Gaming Zone, an independent gaming service run by Microsoft Corp. All other trademarks are the property of their respective holders. ii You can’t start playing until you install the game. Here’s how. REQUIREMENTS Before you can install Civilization II: Test of Time and start playing, check this list to make sure that your computer has everything you need: • The processor has to be a 166 MHz Pentium® or better. For best performance, we recommend at least a 200 MHz Pentium with MMX. • You must have at least 16 Mb (megabytes) of RAM. (If you’re running Windows 95, it’s a safe bet you have 16 Mb or more.) For best performance, we recommend 32 Mb or more. • You must have at least 16 MB (megabytes) of RAM. (If you’re running Windows 95 or 98, it’s a safe bet you have 16 MB or more.) For best performance, we recommend 32 MB or more. • You must have a 4x speed (or faster) CD-ROM drive.
    [Show full text]
  • Helpfile for Freeciv ; ; Each [Help *] Is a Help Node
    ; Helpfile for Freeciv ; ; Each [help_*] is a help node. ; ; 'name' = name of node as shown in help browser; the number of leading ; spaces in 'name' indicates nesting level for display. ; ; 'text' = the helptext for this node; can be an array of text, which ; are then treated as paragraphs. (Rationale: easier to update ; translations on paragraph level.) ; ; 'generate' = means replace this node with generated list of game ; elements; current categories are: ; "Units", "Improvements", "Wonders", "Techs", ; "Terrain", "Governments" ; ; Within the text, the help engine recognizes a few "generated table"s. ; These are generated by the help engine, and inserted at the point of ; reference. They are referenced by placing a $ in the first column ; of a separate paragraph, followed immediately with the name of the ; generated table. See the code in helpdlg.c for the names of tables w ; hich can be referenced. ; ; This file no longer has a max line length: strings are wrapped ; internally. However to do nonwrapping formatting, make sure to ; insert hard newlines "\n" such that lines are less than 68 chars ; long. ; This marks 68 char limit > ; ; Notice not all entries are marked for i18n, as some are not ; appropriate to translate. ; ; Comments with cstyle comments are just to stop xgettext from ; complaining about stray singlequote characters. [help_about] name = _("About") text = _("\ Freeciv is a turnbased strategy game, in which each player becomes \ the leader of a civilization, fighting to obtain the ultimate goal: \ the extinction of all other civilizations.\ "), _("\ Original authors:\n\ (they are no longer involved, please don't mail them!)\ "), "\ Allan Ove Kjeldbjerg [email protected]\n\ Claus Leth Gregersen [email protected]\n\ Peter Joachim Unold [email protected]\ ", _("\ Present administrators: \ "), "\ Marko Lindqvist [email protected]\n\ R.
    [Show full text]
  • Investigating the Effect of Pace Mechanic on Player Motivation And
    Investigating the Effect of Pace Mechanic on Player Motivation and Experience by Hala Anwar A thesis presented to the University of Waterloo in fulfillment of the thesis requirement for the degree of Master of Applied Science (MASc) in Management Sciences Waterloo, Ontario, Canada, 2016 © Hala Anwar 2016 AUTHOR'S DECLARATION I hereby declare that I am the sole author of this thesis. This is a true copy of the thesis, including any required final revisions, as accepted by my examiners. I understand that my thesis may be made electronically available to the public. Hala Anwar ii Abstract Games have long been employed to motivate people towards positive behavioral change. Numerous studies, for example, have found people who were previously disinterested in a task can be enticed to spend hours gathering information, developing strategies, and solving complex problems through video games. While the effect of factors such as generational influence or genre appeal have previously been researched extensively in serious games, an aspect in the design of games that remains unexplored through scientific inquiry is the pace mechanic—how time passes in a game. Time could be continuous as in the real world (real-time) or it could be segmented into phases (turn- based). Pace mechanic is fiercely debated by many strategy game fans, where real-time games are widely considered to be more engaging, and the slower pace of turn-based games has been attributed to the development of mastery. In this thesis, I present the results of an exploratory mixed-methods user study to evaluate whether pace mechanic and type of game alter the player experience and are contributing factors to how quickly participants feel competent at a game.
    [Show full text]
  • Release Notes for Fedora 15
    Fedora 15 Release Notes Release Notes for Fedora 15 Edited by The Fedora Docs Team Copyright © 2011 Red Hat, Inc. and others. The text of and illustrations in this document are licensed by Red Hat under a Creative Commons Attribution–Share Alike 3.0 Unported license ("CC-BY-SA"). An explanation of CC-BY-SA is available at http://creativecommons.org/licenses/by-sa/3.0/. The original authors of this document, and Red Hat, designate the Fedora Project as the "Attribution Party" for purposes of CC-BY-SA. In accordance with CC-BY-SA, if you distribute this document or an adaptation of it, you must provide the URL for the original version. Red Hat, as the licensor of this document, waives the right to enforce, and agrees not to assert, Section 4d of CC-BY-SA to the fullest extent permitted by applicable law. Red Hat, Red Hat Enterprise Linux, the Shadowman logo, JBoss, MetaMatrix, Fedora, the Infinity Logo, and RHCE are trademarks of Red Hat, Inc., registered in the United States and other countries. For guidelines on the permitted uses of the Fedora trademarks, refer to https:// fedoraproject.org/wiki/Legal:Trademark_guidelines. Linux® is the registered trademark of Linus Torvalds in the United States and other countries. Java® is a registered trademark of Oracle and/or its affiliates. XFS® is a trademark of Silicon Graphics International Corp. or its subsidiaries in the United States and/or other countries. MySQL® is a registered trademark of MySQL AB in the United States, the European Union and other countries. All other trademarks are the property of their respective owners.
    [Show full text]
  • Descargar Un Splash De Begins Para El GRUB
    07 FEB / 07 La Revista de Software Libre y Código Abierto EN ESTA EDICIÓN - Entrevista a Federico Mena - Joomla! o Drupal? (Primera parte) - Procedimiento de respaldo, envío y recuperación de bases de datos MySQL a través de la consola de comandos en Linux. - Gobby, una nueva forma colaborativa de trabajar en tus textos. - QEMU, emulando un OLPC. - Domando al escritor Openoffice.org Writer. PROGRAMACIÓN El entorno de desarrollo MAEMO para Nokia 770 (Segunda parte) TALLER DISTRIBUCIONES CUPS: Instalando una ¡Linux está vivo! impresora Epson en Linux. Una revisión a las distros Live-CD más conocidas. Además: Ojo del novato - Zona de Enlaces – Eventos – Y mucho más... Editorial Comienza el 2007 y Begins cuenta con un nuevo refuerzo que se integra al equipo para continuar aportando pero ahora de una manera más estrecha. Bienvenido Eric Báez, seguro que la comunidad Linux ha ganado mucho contigo tomando decisiones desde dentro de la publicación. Redacción Rosana Cáceres [email protected] Juan P. Torres H. [email protected] Este año se viene una intensa competencia en lo que a sistemas Ricardo Gabriel Berlasso [email protected] Alberto Rivera [email protected] operativos se trata, con la entrada de MacOS en la plataforma Intel, Rodrigo Ramírez [email protected] Óscar Calle [email protected] ahora son varios más los rivales para el sistema de Redmond. Por Dionisio Fernández [email protected] Alex Sandoval [email protected] un lado tenemos a Windows Vista, que con sus requerimientos de Staff Begins [email protected] hardware, es muy probable que algo de terreno pierda, oportunidad que será aprovechada por el resto de los jugadores.
    [Show full text]
  • Non-Linear Monte-Carlo Search in Civilization II
    Non-Linear Monte-Carlo Search in Civilization II The MIT Faculty has made this article openly available. Please share how this access benefits you. Your story matters. Citation Branavan, S. R. K. David Silver, and Regina Barzilay. "Non-Linear Monte-Carlo Search in Civilization II." in Proceedings of the Twenty- Second International Joint Conference on Artificial Intelligence, Barcelona, Catalonia, Spain, 16–22 July 2011. p.2404. As Published http://ijcai-11.iiia.csic.es/program/paper/1252 Publisher AAAI Press/International Joint Conferences on Artificial Intelligence Version Author's final manuscript Citable link http://hdl.handle.net/1721.1/74248 Terms of Use Creative Commons Attribution-Noncommercial-Share Alike 3.0 Detailed Terms http://creativecommons.org/licenses/by-nc-sa/3.0/ Non-Linear Monte-Carlo Search in Civilization II S.R.K. Branavan David Silver * Regina Barzilay Computer Science and Artificial Intelligence Laboratory * Department of Computer Science Massachusetts Institute of Technology University College London fbranavan, [email protected] [email protected] Abstract Several factors influence a city's production of shields: the terrain within your city radius is most important. This paper presents a new Monte-Carlo search al- You might find it worthwhile to set Settlers to improving gorithm for very large sequential decision-making the terrain squares within your city radius. problems. We apply non-linear regression within Beyond terrain , the form of government your civilization Monte-Carlo search, online, to estimate a state- chooses can cause each city to spend some of its raw action value function from the outcomes of ran- materials as maintenance dom roll-outs.
    [Show full text]
  • Civ 5 Android Apk
    Civ 5 android apk Continue Where's the modding kit? Modding SDK is available as a free download on Steam: Open Steam and select Library. Civilization free download - Laws of Civilization, Age of Forge: Civilization and Empire, Civilization Revolution 2, and many other programs. November 05, 2019 There are developers who build some mods for this game and release it online where we can download and enjoy the benefits of mods. READ ALSO: 7 best sleep tracking apps for Apple Watch 2019; An easy way to eradicate Vivo without a PC (all models) How to remove pop-up ads on Android, forever! (Without root) HOW TO BE IN CIVILIZATION 5. Download Game: Civilization 5 APK 1.1.0 (Latest version) - com.publishadventures.gqciv - Post Adventures. Learn more about your favorite game - guidebooks, secrets, Easter eggs and tactics. Civilization Sid Meyer VI Free download PC Game Multiplayer Full Repackaging Direct Download Links Squeezed Civilization By Sid Meyer 6 Free Android download. How to download gta 5 iso ppsspp game for Android in 78mb only for Android download now. Sid Meier's Civilization VI Game Overview: With almost every age and tribe, Civilization VI Side Meyer is indeed the flagship killer of Sid Meyer's video game trilogy. Being the sixth main installment of Sid.Civilization Download for PcExperience one of the greatest in turn strategy games of all time, The Civilization of Sid Meyer® V.———————————————————————————B E G I N W I T H 2 0 H I S T O R I C L L L E A D E R R S———————————————————————————Become Ruler of the world by creating and leading civilization since the dawn of man in the space age.
    [Show full text]
  • Course Syllabus
    RANGER COLLEGE COURSE SYLLABUS World Civilization II HIST 2322 3 credit hours INSTRUCTOR: Dr. Twila Johnson HIST 2322 INSTRUCTOR: Dr. Twila Johnson EMAIL: [email protected] OFFICE: online PHONE: 361-646- 9075 HOURS: may text or call between 7:30 am and 7:30 pm I. Texas Core Curriculum Statement of Purpose Through the Texas Core Curriculum, students will gain a foundation of knowledge of human cultures and the physical and natural world, develop principles of personal and social responsibility for living in a diverse world, and advance intellectual and practical skills that are essential for all learning. II. Course Description A survey of the social, political, economic, cultural, religious, and intellectual history of the world from the 15th century to the present. The course examines major cultural regions of the world in Africa, the Americas, Asia, Europe, and Oceania and their global interactions over time. Themes include maritime exploration and transoceanic empires, nation/state formation and industrialization, imperialism, global conflicts and resolutions, and global economic integration. The course emphasizes the development, interaction and impact of global exchange. III. Required Background or Prerequisite Successful completion of TSI. IV. Required Textbook and Course Materials Stearns, Adas, Schwartz, Gilbert World Civilizations: The Global Experience, Pearson Education, 2015, 7th edition. 2321: ISBN: 9781323864784 2322: ISBN: 9781323864807 V. Course Purpose To gain wider understanding of World History, Cultures, Politics, Religion, and Economies. Also, to gain larger understanding of human history, interactions, and movements before the modern era. 2 HIST 2322 VI. Learning Outcomes Upon successful completion of this course, students will: 1. Create an argument through the use of historical evidence.
    [Show full text]
  • Linux Games Page 1 of 7
    Linux Games Page 1 of 7 Linux Games INTRODUCTION such as the number of players and the size of the map, then you start the game. Once the game is running clients may Hello. My name is Andrew Howlett. I've been using Linux join the game. Clients connect to the game using TCP/IP, since 1997. In 2000 I cutover to Linux for all my projects, so it is very easy to play multi-player games over the except I dual-booted Windows to play games. I like to play Internet. Like many Free games, clients are available for computer games. About a year ago I stopped dual booting. many platforms, including Windows, Amiga and Now I play computer games under Linux. The games I Macintosh. So there are lots of players out there. If you play can be divided into four groups: Free Games, native don't want to play against other humans, then Freeciv linux commercial games, Windows Emulated games, and includes some nasty AIs. Win4Lin enabled games. This presentation will demonstrate games from each of these four groups. BZFlag Platform BZFlag is a tank combat game along the same lines as the old BattleZone game. Like FreeCiv, BZFlag uses a client/ Before I get started, a little bit about my setup so you can server architecture over TCP/IP networks. Unlike FreeCiv, relate this to whatever you are running. This is a P3 900 the game contains no AIs – you must play this game MHz machine. It has a Crystal Sound 4600 sound card and against other humans (? entities ?) over the Internet.
    [Show full text]
  • HUBERT, Our Freeciv AI
    HUBERT, Our FreeCiv AI Michael Arcidiacono, Joel Joseph Dominic, Richard Akira Heru Friday 7th December, 2018 Abstract FreeCiv is an open-source alternative to Civilization, which is a turn-based strategy game that allows the player to control an empire by building cities, constructing and moving units, and engaging in diplomacy and war with other nations. We build an artificial intelligence (AI) nicknamed HUBERT to play this game. We use a modified SARSA algorithm with linear approximation of the Q function. We have also tried training HUBERT using a memetic algorithm. 1 Introduction The Civilization video game series is a collection of turn-based strategy games that allow the player to control an empire by building cities, constructing and moving units, and engaging in diplomacy and war with other nations. There are several different ways of winning the game such as through military dominion (i.e. by taking over all the cities of other empires). We use an open-source alternative to Civilization, FreeCiv and focus on getting the highest score for this agent. A screenshot of the game in progress can be seen in Figure1. We model this game as a Markov Decision Process (MDP) with states, actions and re- wards. In our model, the states are quantified as a β vector per city containing the total number of cities, total amount of gold, tax, science, luxury, gold per turn, turn number, the number of technologies, city population, city surplus, city unhappiness level, and city food. At any given turn, the player can choose to build cities, build units, move units, declare war, trade resources, research technology, and engage in many other possible actions.
    [Show full text]
  • Playing a Strategy Game with Knowledge-Based Reinforcement Learning
    Noname manuscript No. (will be inserted by the editor) Playing a Strategy Game with Knowledge-Based Reinforcement Learning Viktor Voss · Liudmyla Nechepurenko · Dr. Rudi Schaefer · Steffen Bauer Received: date / Accepted: date Abstract This paper presents Knowledge-Based Reinforcement Learning (KB- RL) as a method that combines a knowledge-based approach and a reinforcement learning (RL) technique into one method for intelligent problem solving. The pro- posed approach focuses on multi-expert knowledge acquisition, with the reinforce- ment learning being applied as a conflict resolution strategy aimed at integrating the knowledge of multiple exerts into one knowledge base. The article describes the KB-RL approach in detail and applies the reported method to one of the most challenging problems of current Artificial Intelligence (AI) research, namely playing a strategy game. The results show that the KB-RL system is able to play and complete the full FreeCiv game, and to win against the computer players in various game settings. Moreover, with more games played, the system improves the gameplay by shortening the number of rounds that it takes to win the game. Overall, the reported experiment supports the idea that, based on human knowledge and empowered by reinforcement learning, the KB-RL system can de- liver a strong solution to the complex, multi-strategic problems, and, mainly, to improve the solution with increased experience. Keywords Knowledge-Based Systems · Reinforcement Learning · Multi-Expert Knowledge Base · Conflict Resolution V. Voss arago GmbH, E-mail: [email protected] L. Nechepurenko arago GmbH, E-mail: [email protected] Dr. R. Schaefer arXiv:1908.05472v1 [cs.AI] 15 Aug 2019 arago GmbH, E-mail: [email protected] S.
    [Show full text]
  • Western Civilization II HIST 0101 3 Credits
    Western Civilization II HIST 0101 3 Credits Description: This is an introductory-level course in Western European History that handles topics from the Scientific Revolution to the Cold War. It provides a framework for those who will continue in the study of History, and it provides an overview for those seeking to fulfill “General Education” requirements. There are no prerequisites. This course will introduce major questions of historical process and it will emphasize chronological, comparative, and contextual reasoning and the construction of original arguments grounded in historical evidence. Each student will encounter and engage secondary and primary sources, assigned regularly throughout the course. They will participate in detailed discussions and debates about these sources. They should conduct independent research and develop original arguments to present verbally and/or in written form. Formal evaluations consist mainly of essay–based quizzes, midterms and a final exam. In all cases, students work to assimilate the different types of historical evidence and to develop their own interpretive analyses. Prerequisite: No prerequisite required Grading: The grade in this course is based on verbal participation in discussions and debates, presentations, research papers, quizzes and examinations. Textbook: The course should utilize a college-level textbook (one example is Lynn Hunt’s Making of the West, Vol II, or another textbook approved by the AP board) plus carefully selected scholarly articles. It should also provide students with a large and varied collection of primary sources. Many of these are available excerpted online, but a few, strategically selected, sources should be full-length texts. The following is a list of topics covered in Western Civilization II: 1.
    [Show full text]