DOCSLIB.ORG

World Domination

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
World Domination LINUX USER Freeciv The Freeciv Strategy Game World Domination he Andy Empire is at the zenith of Wanted: Amateur politicians and part-time rulers for responsible position as its power when a fleet of raiders Tfrom Johnia lands on its coasts. head of state. In Freeciv, the classic role-playing game, you can head the Passville, and Regentstown succumb to the wild force of warrior hordes; the cap- transition of a civilization from a nomadic tribe to a world power. ital, Freeonia, can only be rescued by a BY ELISABETH BAUER AND ANDREA MÜLLER massive arms race, and a counter assault. While these two parties are fighting, a third party seizes its opportu- nity: while the Andy-Johnian conflict is at its fiercest, a message from the Lizians arrives, announcing that they have just won the game via a peaceful approach by flying to Alpha-Centauri. It would seem that investing in research and development does pay… Welcome to the world of Freeciv, the free version of the classic strategy game, Civilization, which has fascinated whole generations of world conquerors and founding fathers. The idea of the game is easily explained. The goal of Freeciv is no less than achieving world domination – either by military or technological ad- vances. Each player starts off with two settlers and a guide in the year 4000 BC. The idea is to found a settlement with this society, to build up an infrastructure, introduce trade and research and to keep your nose in front of the other players. Figure 1:The Freeciv Client interface. An advanced game with a large area of explored territory Installing Freeciv on SuSE •You will be prompted to insert CD The freeciv menu item launches the Red Hat users can just start playing, but number 2. After doing so, click on OK Freeciv client, which will initially SuSE users, will first need to install to start installing the game. The YaST2 prompt you for a server connection. You freeciv. The SuSE work menu allows you software installation module termi- can either attach to a game server in the to perform this step quickly: nates automatically after installing the local network, or on the Internet, or you • In the Work menu select install software. can launch a server on your own software package / Games / Tactics and SuSE users will then find the newly machine. Strategy / CIVclient. This menu also installed programs in the Games / Tac- Although the Freeciv server menu entry contains the CIVserver option, but in tics and Strategy area of the KDE menu. would suggest otherwise, SuSE users fact it does not matter which option civworld is also installed on SuSE 8.2. should not launch the server via this you choose, as both programs are part This program allows you to design your menu item, as SuSE has configured the of the freeciv package. Those who have own Freeciv worlds. entry incorrectly – although the server already updated to SuSE 8.2 will dis- launches, you cannot access the server cover that the installation menu item Starting & Playing the Game to start a game. However, you can launch has now moved to install software Freeciv comprises two distinct programs: a terminal window instead, and type package / Games / Tactics and Strategy civserver handles the game operations civserver as a command. The modified / Freeciv (Strategy Game). and organization; civclient provides the prompt and the welcome message indi- • Enter your root password in the dialog players with a GUI and transmits their cate that you are now accessing the box that then appears and click OK. commands and moves to the server. command center for the Freeciv server. 80 August 2003 www.linux-magazine.com Freeciv LINUX USER The set aifill=4 creates three comput- construct new buildings or units. A sion number. The next thing to decide on erized opponents – artificial intelligences nation of mariners would need to con- is who will run the server. After sorting (or AIs for short) – for you to battle centrate research efforts on navigation. that out, follow these steps: against. If you want to play a solo game The competition between civilizations • The server provider connects to the to get yourself into the flow, simply omit is enormous – to succeed, you will need Internet and launches civserver in a the set aifill= command. something more imaginative than simple terminal session. Use the K menu to launch the Freeciv temples. A world wonder is a good way • The player who launched the server client and click on Connect in the dialog to really impress your opponents. needs to tells the other players the IP box that appears. The server settings address, by phone, email or IRC. should point to port 5555 on localhost. Saving and Ending a Game • After connecting to the Internet, all Now type start at the server console Trying to finish a game of Freeciv in your opponents, including the server The client will first prompt you to specify one day is extremely hard going. The provider, will need to launch their a nationality and a name for your leader Freeciv server will save the game auto- Freeciv clients. figure, and then start right in the middle matically every couple of hundred years • Players will need to enter the IP for the of the game. You can then guide your game time. This allows you to restore the server in the Connect to Freeciv server units – two caravans and a guide – to game at its current levels. save dialog box and then click on Connect. scout the unknown territory and find a name_of_game allows you to save the • The server shows the connected play- good spot for your future capital. Table 1 game at any time, and quit terminates ers. After everyone has connected, the contains a list of keyboard shortcuts. the server. To restore a saved game, call server master can kick off the game The game is divided up into rounds, civserver --file name_of_game. using start. Game options can be set with each unit having one turn per using the set command. round. The units will flash to indicate The Battle on the Network • And off you go. The bottom line of the that it is their turn. If none of your units If you prefer to battle it out with human main window allows you to exchange are flashing, click on Done. Your artificial opponents, again Freeciv is a good messages with other players. opponents will now take their turns. choice. Just like its commercial siblings, Freeciv is a networked game, and play- Removing Obstacles Cities ing against friends across the local If you are having trouble connecting to Cities are the focus of civilization in network, or the global Internet, is not the server, this may be due to firewall Freeciv. After locating a suitable spot, much more complex than the solo game. configuration. The server provider may you can start to convince your nomads Each player will need a Freeciv client need to modify their firewall configura- that it might be a good idea to settle. The (incidentally, the client is not only avail- tion for the duration of the game. If you b key or the Commands/Build city func- able for Linux, but also in Windows and do not want to do so, you might like to tion will do that. MacOS X versions) with the same ver- try one of the Freeciv Metaservers. ■ You can click on your city to display an overview, containing the number of Table 1: Keyboard Shortcuts inhabitants, the area ruled by the city, its Shortcut Action Effect production and income figures, and lots [Return] End round Return or Enter ends a round – even if your units could of other statistics. The Edit button allows still make a move. you to specify what should be produce in b Build city Fields with cities are automatically assigned a road and the next few rounds. The artefacts all will have at least one trading point. serve a specific function: Barracks will g Move a figure to a specific location. You can use the mouse to choose a target for the figure to make the figure move towards that point in the next increase the impact made by your war- few rounds. riors, grain stores will help to avoid [Shift-d] Disband unit. Population control by keyboard.This unit will not cause famine and settlers can irrigate the sur- any expense for your home city after this. rounding fields and/or found new cities. Space no action for the current unit. The unit will miss a round – this is useful if units are waiting for something,such as the completion of a Science and Research transport vessel. The scant production options available w wait The unit’s turn will be later in this round. to your city are indicative of your set- [Shift-f] Display list of cities. Double clicking will shift the focus to a city. tlers’ early stage of civilization. You s Guard (only for military units) The unit will guard this point and automatically challenge any attacking troops. should not worry as there is quite a lot of r Build road; on fields already An additional trading point will be assigned to the field. research going on. [F6] or the menu item containing a road:lay down railtracks Reports/Research shows you what your (assuming trains have been invented) civilization is focussing on at present. Of i Build irrigation; irrigated fields can The field will then produce an additional food unit. course, as an absolute ruler, you can dic- be used as arable land later.
Load more

Recommended publications
  • Helpfile for Freeciv ; ; Each [Help *] Is a Help Node
    ; Helpfile for Freeciv ; ; Each [help_*] is a help node. ; ; 'name' = name of node as shown in help browser; the number of leading ; spaces in 'name' indicates nesting level for display. ; ; 'text' = the helptext for this node; can be an array of text, which ; are then treated as paragraphs. (Rationale: easier to update ; translations on paragraph level.) ; ; 'generate' = means replace this node with generated list of game ; elements; current categories are: ; "Units", "Improvements", "Wonders", "Techs", ; "Terrain", "Governments" ; ; Within the text, the help engine recognizes a few "generated table"s. ; These are generated by the help engine, and inserted at the point of ; reference. They are referenced by placing a $ in the first column ; of a separate paragraph, followed immediately with the name of the ; generated table. See the code in helpdlg.c for the names of tables w ; hich can be referenced. ; ; This file no longer has a max line length: strings are wrapped ; internally. However to do nonwrapping formatting, make sure to ; insert hard newlines "\n" such that lines are less than 68 chars ; long. ; This marks 68 char limit > ; ; Notice not all entries are marked for i18n, as some are not ; appropriate to translate. ; ; Comments with cstyle comments are just to stop xgettext from ; complaining about stray singlequote characters. [help_about] name = _("About") text = _("\ Freeciv is a turnbased strategy game, in which each player becomes \ the leader of a civilization, fighting to obtain the ultimate goal: \ the extinction of all other civilizations.\ "), _("\ Original authors:\n\ (they are no longer involved, please don't mail them!)\ "), "\ Allan Ove Kjeldbjerg [email protected]\n\ Claus Leth Gregersen [email protected]\n\ Peter Joachim Unold [email protected]\ ", _("\ Present administrators: \ "), "\ Marko Lindqvist [email protected]\n\ R.
    [Show full text]
  • Release Notes for Fedora 15
    Fedora 15 Release Notes Release Notes for Fedora 15 Edited by The Fedora Docs Team Copyright © 2011 Red Hat, Inc. and others. The text of and illustrations in this document are licensed by Red Hat under a Creative Commons Attribution–Share Alike 3.0 Unported license ("CC-BY-SA"). An explanation of CC-BY-SA is available at http://creativecommons.org/licenses/by-sa/3.0/. The original authors of this document, and Red Hat, designate the Fedora Project as the "Attribution Party" for purposes of CC-BY-SA. In accordance with CC-BY-SA, if you distribute this document or an adaptation of it, you must provide the URL for the original version. Red Hat, as the licensor of this document, waives the right to enforce, and agrees not to assert, Section 4d of CC-BY-SA to the fullest extent permitted by applicable law. Red Hat, Red Hat Enterprise Linux, the Shadowman logo, JBoss, MetaMatrix, Fedora, the Infinity Logo, and RHCE are trademarks of Red Hat, Inc., registered in the United States and other countries. For guidelines on the permitted uses of the Fedora trademarks, refer to https:// fedoraproject.org/wiki/Legal:Trademark_guidelines. Linux® is the registered trademark of Linus Torvalds in the United States and other countries. Java® is a registered trademark of Oracle and/or its affiliates. XFS® is a trademark of Silicon Graphics International Corp. or its subsidiaries in the United States and/or other countries. MySQL® is a registered trademark of MySQL AB in the United States, the European Union and other countries. All other trademarks are the property of their respective owners.
    [Show full text]
  • Descargar Un Splash De Begins Para El GRUB
    07 FEB / 07 La Revista de Software Libre y Código Abierto EN ESTA EDICIÓN - Entrevista a Federico Mena - Joomla! o Drupal? (Primera parte) - Procedimiento de respaldo, envío y recuperación de bases de datos MySQL a través de la consola de comandos en Linux. - Gobby, una nueva forma colaborativa de trabajar en tus textos. - QEMU, emulando un OLPC. - Domando al escritor Openoffice.org Writer. PROGRAMACIÓN El entorno de desarrollo MAEMO para Nokia 770 (Segunda parte) TALLER DISTRIBUCIONES CUPS: Instalando una ¡Linux está vivo! impresora Epson en Linux. Una revisión a las distros Live-CD más conocidas. Además: Ojo del novato - Zona de Enlaces – Eventos – Y mucho más... Editorial Comienza el 2007 y Begins cuenta con un nuevo refuerzo que se integra al equipo para continuar aportando pero ahora de una manera más estrecha. Bienvenido Eric Báez, seguro que la comunidad Linux ha ganado mucho contigo tomando decisiones desde dentro de la publicación. Redacción Rosana Cáceres [email protected] Juan P. Torres H. [email protected] Este año se viene una intensa competencia en lo que a sistemas Ricardo Gabriel Berlasso [email protected] Alberto Rivera [email protected] operativos se trata, con la entrada de MacOS en la plataforma Intel, Rodrigo Ramírez [email protected] Óscar Calle [email protected] ahora son varios más los rivales para el sistema de Redmond. Por Dionisio Fernández [email protected] Alex Sandoval [email protected] un lado tenemos a Windows Vista, que con sus requerimientos de Staff Begins [email protected] hardware, es muy probable que algo de terreno pierda, oportunidad que será aprovechada por el resto de los jugadores.
    [Show full text]
  • Civ 5 Android Apk
    Civ 5 android apk Continue Where's the modding kit? Modding SDK is available as a free download on Steam: Open Steam and select Library. Civilization free download - Laws of Civilization, Age of Forge: Civilization and Empire, Civilization Revolution 2, and many other programs. November 05, 2019 There are developers who build some mods for this game and release it online where we can download and enjoy the benefits of mods. READ ALSO: 7 best sleep tracking apps for Apple Watch 2019; An easy way to eradicate Vivo without a PC (all models) How to remove pop-up ads on Android, forever! (Without root) HOW TO BE IN CIVILIZATION 5. Download Game: Civilization 5 APK 1.1.0 (Latest version) - com.publishadventures.gqciv - Post Adventures. Learn more about your favorite game - guidebooks, secrets, Easter eggs and tactics. Civilization Sid Meyer VI Free download PC Game Multiplayer Full Repackaging Direct Download Links Squeezed Civilization By Sid Meyer 6 Free Android download. How to download gta 5 iso ppsspp game for Android in 78mb only for Android download now. Sid Meier's Civilization VI Game Overview: With almost every age and tribe, Civilization VI Side Meyer is indeed the flagship killer of Sid Meyer's video game trilogy. Being the sixth main installment of Sid.Civilization Download for PcExperience one of the greatest in turn strategy games of all time, The Civilization of Sid Meyer® V.———————————————————————————B E G I N W I T H 2 0 H I S T O R I C L L L E A D E R R S———————————————————————————Become Ruler of the world by creating and leading civilization since the dawn of man in the space age.
    [Show full text]
  • D3D11 Software Tessellation
    D3D11 Software Tessellation John Kloetzli, Jr Graphics Programmer, Firaxis Games About Firaxis ● Founded in 1996 ● Strategy games! ● Sid Meier lead designer ● 20+ shipped games ● Civilization V ● XCOM: Enemy Unknown “Games that stand the test of time” About Me ● I work on the Civilization team ● Graphics programmer ● Over 7 years at Firaxis ● Procedural modeling ● Terrain rendering Civilization V ● Shipped Sept. 2010 ● One of the first DX11 games ● Variable-bitrate GPU texture decompression ● Hardware tessellation ● Two large expansions ● Gods & Kings ● Brave New World OLANO et al. Variable Bit Rate GPU Texture Decompression. In EGSR 2011 Civilization V ● Low-res Heightmap ● 64x64 per hex ● Procedurally generated ● Unique – no repeat ● High-res Materials ● 512x512 per hex ● Artist-created ● Repeats across the world Better Terrain ● Problem: Sharp features ● Low-res heightmap cannot display unique, high-res detail ● Solution: High-res heightmap ● More data (Compression? Streaming?) ● Efficient Tessellation GPU Displacement Tessellation Demo Simple procedural terrain... ● Ridges to test difficult case ● Assume strategy game camera (lots of pan/zoom) ● High res: 256x256 Heightmap per tile ● Large: 128x128 tiles (32,768x32,768 heightmap) ...all done on the GPU ● Heightmap/Normalmap created on demand ● Use texture arrays to implement megatexture ● Tessellation created on demand using GPU CPU GPU Resources Compute Visible Tiles Create Heightmap Height Build New Tiles Create Normalmap Normal Render Visible Cells Tessellation ? Shade Overview
    [Show full text]
  • Linux Games Page 1 of 7
    Linux Games Page 1 of 7 Linux Games INTRODUCTION such as the number of players and the size of the map, then you start the game. Once the game is running clients may Hello. My name is Andrew Howlett. I've been using Linux join the game. Clients connect to the game using TCP/IP, since 1997. In 2000 I cutover to Linux for all my projects, so it is very easy to play multi-player games over the except I dual-booted Windows to play games. I like to play Internet. Like many Free games, clients are available for computer games. About a year ago I stopped dual booting. many platforms, including Windows, Amiga and Now I play computer games under Linux. The games I Macintosh. So there are lots of players out there. If you play can be divided into four groups: Free Games, native don't want to play against other humans, then Freeciv linux commercial games, Windows Emulated games, and includes some nasty AIs. Win4Lin enabled games. This presentation will demonstrate games from each of these four groups. BZFlag Platform BZFlag is a tank combat game along the same lines as the old BattleZone game. Like FreeCiv, BZFlag uses a client/ Before I get started, a little bit about my setup so you can server architecture over TCP/IP networks. Unlike FreeCiv, relate this to whatever you are running. This is a P3 900 the game contains no AIs – you must play this game MHz machine. It has a Crystal Sound 4600 sound card and against other humans (? entities ?) over the Internet.
    [Show full text]
  • Freecol Documentation, User Guide for Version V0.11.6
    FreeCol Documentation User Guide for Version v0.11.6 The FreeCol Team December 30, 2019 2 Contents 1 Introduction7 1.1 About FreeCol..........................7 1.2 The Original Colonization....................7 1.3 About this manual........................9 1.3.1 Differences between the rule sets.............9 1.4 Liberty and Immigration..................... 11 2 Installation 13 2.1 System Requirements....................... 13 2.1.1 FreeCol on Windows................... 14 2.2 Compiling FreeCol........................ 14 3 Interface 15 3.1 Starting the game......................... 15 3.1.1 Command line options.................. 15 3.1.2 Game setup........................ 19 3.1.3 Map Generator Options................. 21 3.1.4 Game Options....................... 22 3.2 Client Options........................... 25 3.2.1 Display Options...................... 25 3.2.2 Translations........................ 26 3.2.3 Message Options..................... 27 3.2.4 Audio Options...................... 28 3.2.5 Savegame Options.................... 29 3.2.6 Warehouse Options.................... 29 3.2.7 Keyboard Accelerators.................. 29 3.2.8 Other Options....................... 29 3.3 The main screen.......................... 30 3 4 CONTENTS 3.3.1 The Menubar....................... 31 3.3.2 The Info Panel...................... 36 3.3.3 The Minimap....................... 36 3.3.4 The Unit Buttons..................... 36 3.3.5 The Compass Rose.................... 37 3.3.6 The Main Map...................... 37 3.4 The Europe Panel......................... 42 3.5 The Colony panel......................... 43 3.5.1 The Warehouse Dialog.................. 46 3.5.2 The Build Queue Panel.................. 46 3.6 Customization........................... 47 4 The New World 49 4.1 Terrain Types........................... 49 4.2 Goods............................... 50 4.2.1 Trade Routes....................... 52 4.3 Special Resources........................
    [Show full text]
  • HUBERT, Our Freeciv AI
    HUBERT, Our FreeCiv AI Michael Arcidiacono, Joel Joseph Dominic, Richard Akira Heru Friday 7th December, 2018 Abstract FreeCiv is an open-source alternative to Civilization, which is a turn-based strategy game that allows the player to control an empire by building cities, constructing and moving units, and engaging in diplomacy and war with other nations. We build an artificial intelligence (AI) nicknamed HUBERT to play this game. We use a modified SARSA algorithm with linear approximation of the Q function. We have also tried training HUBERT using a memetic algorithm. 1 Introduction The Civilization video game series is a collection of turn-based strategy games that allow the player to control an empire by building cities, constructing and moving units, and engaging in diplomacy and war with other nations. There are several different ways of winning the game such as through military dominion (i.e. by taking over all the cities of other empires). We use an open-source alternative to Civilization, FreeCiv and focus on getting the highest score for this agent. A screenshot of the game in progress can be seen in Figure1. We model this game as a Markov Decision Process (MDP) with states, actions and re- wards. In our model, the states are quantified as a β vector per city containing the total number of cities, total amount of gold, tax, science, luxury, gold per turn, turn number, the number of technologies, city population, city surplus, city unhappiness level, and city food. At any given turn, the player can choose to build cities, build units, move units, declare war, trade resources, research technology, and engage in many other possible actions.
    [Show full text]
  • Playing a Strategy Game with Knowledge-Based Reinforcement Learning
    Noname manuscript No. (will be inserted by the editor) Playing a Strategy Game with Knowledge-Based Reinforcement Learning Viktor Voss · Liudmyla Nechepurenko · Dr. Rudi Schaefer · Steffen Bauer Received: date / Accepted: date Abstract This paper presents Knowledge-Based Reinforcement Learning (KB- RL) as a method that combines a knowledge-based approach and a reinforcement learning (RL) technique into one method for intelligent problem solving. The pro- posed approach focuses on multi-expert knowledge acquisition, with the reinforce- ment learning being applied as a conflict resolution strategy aimed at integrating the knowledge of multiple exerts into one knowledge base. The article describes the KB-RL approach in detail and applies the reported method to one of the most challenging problems of current Artificial Intelligence (AI) research, namely playing a strategy game. The results show that the KB-RL system is able to play and complete the full FreeCiv game, and to win against the computer players in various game settings. Moreover, with more games played, the system improves the gameplay by shortening the number of rounds that it takes to win the game. Overall, the reported experiment supports the idea that, based on human knowledge and empowered by reinforcement learning, the KB-RL system can de- liver a strong solution to the complex, multi-strategic problems, and, mainly, to improve the solution with increased experience. Keywords Knowledge-Based Systems · Reinforcement Learning · Multi-Expert Knowledge Base · Conflict Resolution V. Voss arago GmbH, E-mail: [email protected] L. Nechepurenko arago GmbH, E-mail: [email protected] Dr. R. Schaefer arXiv:1908.05472v1 [cs.AI] 15 Aug 2019 arago GmbH, E-mail: [email protected] S.
    [Show full text]
  • Into the Cosmos: Board Game Project Blending 4X and Eurogame Styles
    Salvation: Into the Cosmos: Board Game Project Blending 4X and Eurogame Styles A Senior Project Presented To: the Faculty of the Liberal Arts and Engineering Studies Department California Polytechnic State University, San Luis Obispo In Partial Fulfillment of the Requirements for the Degree Bachelor of Arts in Liberal Arts and Engineering Studies by Zachary Griffith June 2017 © Zachary Griffith 2017 Griffith 1 Table of Contents Introduction .................................................................................................................................................. 2 How to Play................................................................................................................................................... 3 Blending Eurogames and 4X ........................................................................................................................ 3 Eurogames ....................................................................................................................................... 3 4X Strategy ....................................................................................................................................... 4 Putting it All Together ...................................................................................................................... 4 Influences ..................................................................................................................................................... 4 The Game Design Process ...........................................................................................................................
    [Show full text]
  • Narrative Representation and Ludic Rhetoric of Imperialism in Civilization 5
    Narrative Representation and Ludic Rhetoric of Imperialism in Civilization 5 Masterarbeit im Fach English and American Literatures, Cultures, and Media der Philosophischen Fakultät der Christian-Albrechts-Universität zu Kiel vorgelegt von Malte Wendt Erstgutachter: Prof. Dr. Christian Huck Zweitgutachter: Tristan Emmanuel Kugland Kiel im März 2018 Table of contents 1 Introduction 1 2 Hypothesis 4 3 Methodology 5 3.1 Inclusions and exclusions 5 3.2 Structure 7 4 Relevant postcolonial concepts 10 5 Overview and categorization of Civilization 5 18 5.1 Premise and paths to victory 19 5.2 Basics on rules, mechanics, and interface 20 5.3 Categorization 23 6 Narratology: surface design 24 6.1 Paratexts and priming 25 6.1.1 Announcement trailer 25 6.1.2 Developer interview 26 6.1.3 Review and marketing 29 6.2 Civilizations and leaders 30 6.3 Universal terminology and visualizations 33 6.4 Natural, National, and World Wonders 36 6.5 Universal history and progress 39 6.6 User interface 40 7 Ludology: procedural rhetoric 43 7.1 Defining ludological terminology 43 7.2 Progress and the player element: the emperor's new toys 44 7.3 Unity and territory: the worth of a nation 48 7.4 Religion, Policies, and Ideology: one nation under God 51 7.5 Exploration and barbarians: into the heart of darkness 56 7.6 Resources, expansion, and exploitation: for gold, God, and glory 58 7.7 Collective memory and culture: look on my works 62 7.8 Cultural Victory and non-violent relations: the ballot 66 7.9 Domination Victory and war: the bullet 71 7.10 The Ex Nihilo Paradox: build like an Egyptian 73 7.11 The Designed Evolution Dilemma: me, the people 77 8 Conclusion and evaluation 79 Deutsche Zusammenfassung 83 Bibliography 87 1 Introduction “[V]ideo games – an important part of popular culture – mediate ideology, whether by default or design.” (Hayse, 2016:442) This thesis aims to uncover the imperialist and colonialist ideologies relayed in the video game Sid Meier's Civilization V (2K Games, 2010) (abbrev.
    [Show full text]
  • Integrating Reinforcement Learning Into Strategy Games
    Integrating Reinforcement Learning into Strategy Games by Stefan Wender Supervised by Ian Watson The University of Auckland Auckland, New Zealand A Thesis submitted in fulfillment of the requirements for the degree of Master of Science in Computer Science The University of Auckland, February 2009 Abstract The present thesis describes the design and implementation of a machine learning agent based on four different reinforcement learning algorithms. The reinforcement learning agent is integrated into the commercial computer game Civilization IV. Civilization IV is a turn- based empire building game from the Civilization series. The reinforcement learning agent is applied to the city placement selection task. The city placement selection determines the founding sites for a player’s cities. The four reinforcement learning algorithms that are evaluated are the off-policy algorithms one-step Q-learning and Q(λ) and the on-policy algorithms one-step Sarsa and Sarsa(λ). The aim of the research presented in this thesis is the creation of an adaptive machine learning approach for a task which is originally performed by a complex deterministic script. Since the machine learning approach is nondeterministic, it results in a more challenging and dynamic computer AI. The thesis presents an empirical evaluation of the performance of the reinforcement learning approach and compares the performance of the adaptive agent with the original deterministic game AI. The comparison shows that the reinforcement learning approach outperforms the deterministic game AI. Finally, the behaviour and performance of the reinforcement learn- ing algorithms are elaborated on and the algorithms are further improved by analysing and revising their parameters.
    [Show full text]