Virtual Quidditch: A Challenge Problem for Automatically Programmed Software Agents Lee Spector Cognitive Science Hampshire College Amherst, MA 01002 [email protected] Ryan Moore Cognitive Science Hampshire College Amherst, MA 01002 ryan [email protected] Alan Robinson Cognitive Science Hampshire College Amherst, MA 01002 [email protected] In Late-Breaking Papers of GECCO-2001, the Genetic and Evolutionary Computation Confer- ence, edited by Erik D. Goodman. Published by the International Society for Genetic and Evolutionary Computation. Virtual Quidditch: A Challenge Problem for Automatically Programmed Software Agents Lee Spector Ryan Moore Alan Robinson Cognitive Science Cognitive Science Cognitive Science Hampshire College Hampshire College Hampshire College Amherst, MA 01002 Amherst, MA 01002 Amherst, MA 01002 [email protected] ryan [email protected] [email protected] Abstract articial ant and food foraging problems (Bennett, 1996; Bongard, 2000), simulated robotic soccer (An- This paper describes a new challenge prob- dre and Teller, 1999; Luke, 1998; Salustowicz, Wiering, lem for the automatic programming of soft- and Schmidhuber, 1997), high-delity ight simulators ware agents, a virtual version of the quid- (Cribbs, 1999), and other dynamic environments. ditch game invented by J. K. Rowling in her best-selling Harry Potter books (Rowl- 2 VIRTUAL QUIDDITCH ing and Grandpre, 1998; Rowling and Whisp, 2001). Good performance in this game re- For our work on control and adaptation in complex, quires adaptive control in a complex, hetero- dynamic environments we required a problem environ- geneous, and dynamic 3-dimensional environ- ment with additional features that are representative ment. In this short paper we briey describe of a wider range of real-world problems. Virtual quid- virtual quidditch and the challenges that it ditch was developed to ll this need. In particular, presents. A quidditch simulator environment virtual quidditch is: is currently being developed; when it is com- plete it will be made publicly available. Richly heterogeneous — Not only are there players with dierent roles, on two dierent teams, but the balls themselves are active and to some extent 1 VIRTUAL WORLDS FOR AGENT intelligent. DEVELOPMENT/EVOLUTION Richly 3-dimensional — Quidditch is a ying Several technical challenges face the designer of a con- game in which it is essential to reason about 3D trol system for an agent in a complex, dynamic envi- positions and movement. Most previously studied ronment. While the ultimate goal for many researchers environments are either 2D or, like soccer, make is the development of techniques that will enable au- limited use of the third dimension. tonomous agents to perform well in the real (physical) Extensible — The rules are not uniquely de- world, the diculties and expense involved in robotics experimentation has led many researchers to test their termined by the Rowling books and amend- ideas rst in game-like virtual environments. ments/adjustments can easily be made to increase task diculty or to broaden task requirements. Such environments have been host both to hand- Indeed, since the mechanics of the game are main- coded agents and to agents developed with the aid tained by magic spells anyway, no conceivable ad- of automatic programming techniques such as ge- justments will seem out of character! netic programming (Koza, 1992). In particular, ge- netic programming and related techniques have been Beyond human experience — While Rowling’s used to develop agents for TileWorld (Iba, 1999), books describe elements of Quidditch strategy we Wumpus World (Spector, 1994), predator/prey and have no real evidence about what sorts of strate- pursuer/evader problems (Deakin and Yates, 1998; gies will be most eective. This means that agent Haynes and Sen, 1996; Luke and Spector, 1996), coor- designers cannot intentionally or unintentionally dinated vehicle movement problems (Qureshi, 1996), leverage their own experience with the game in designing agents. Neither can users of automatic 3.2 THE FIELD OR “PITCH” programming technologies build experience-based assumptions into the primitives or parameters of Quidditch is played above a large oval eld measuring their systems. 500 feet long and 180 feet wide (larger than a football eld) with a two foot diameter circle in the middle. Be- cause the game takes place in the air, the pitch should Like real-time, only faster — Our quidditch server be thought of as an innitely vertical boundary space will model some aspects of real-time behavior but rather than a delineated plane. At each end of the in contrast to truly real-time simulators (such as eld there are three hoops on 50 foot poles. A small that for Simulation League RoboCup (Corten et space around the three poles is the scoring area. The al., 1999)) it will be possible to run our simulator boundary of the scoring area is an arc with a radius signicantly faster. This is will allow for rapid of 20 feet drawn from a center point at the end of the assessment of team quality which will facilitate eld. the application of genetic programming and other automatic programming techniques. Bleachers are generally oating 50 feet in the air — of course this has no direct impact on virtual quidditch since there is no role for simulated spectators, but a 50- 3 RULES OF THE GAME foot-high perspective should be used for visualization. Figure 1 shows one view of the quidditch pitch. J. K. Rowling’s books do not provide full details on the mechanics of the game of Quidditch. Even where they 3.3 THE FOUR QUIDDITCH BALLS do provide details they are not always completely com- patible with the requirements for computer simulation Players score goals with the quae. It is red, twelve or with the goals of this project. What follows is our inches in diameter, and made of seamless leather. It attempt to esh out the rules in a manner that is con- is enspelled in such a way that it can be held with sistent both with our goals and with the rules that are only one hand. Although it does not y per se, it will provided by Rowling, although some simplications, remain suspended in mid air wherever it is released. extensions, and adjustments to Rowling’s rules have Two balls called bludgers y around the eld trying to been made in the process. hit players. They are made of iron and are ten inches in diameter. The fourth ball, the golden snitch, is about Further details have yet to be completely specied; the size of a walnut and has two silver wings attached. for example, we have not yet worked out the simula- It avoids capture by either team with great speed and tion details for the way in which players will grip balls maneuverability. The snitch can also vanish for long or the penalties to be levied for various fouls. These periods of time and reappear at random places and issues will be addressed as we complete our implemen- times; for this reason a team cannot concentrate all of tation of the quidditch server and will be documented its eorts on the snitch but must also work to score in the accompanying user guide. The rules specied goals (and to prevent the opposing team from scoring) below will suce to give the reader the basic avor when the snitch cannot be found. and rules of the game. 3.4 QUIDDITCH PLAYERS 3.1 OVERVIEW Each team has a keeper to protect the goals, three The game of quidditch involves two opposing teams chasers for scoring, two beaters to hit the bludgers, on ying broomsticks trying to score goals. Goals are and one seeker to catch the golden snitch. scored by throwing a large leather ball through one of three round hoops that each team guards at their The keeper guards the three hoops at his or her team’s end of a large oval eld. Simultaneously, two large y- end of the eld. The keeper usually stays in the scoring ing iron balls are trying to knock players o of their area. Two interesting keeper strategies from the Rowl- broomsticks, the prevention of which is attempted by ing books are 1) weaving at very high speed around two players on each team using large bats. Finally, a all three hoops, and 2) hanging o the broomstick by small fourth ball is avoiding capture by a single desig- an arm and a leg with all other limbs outstretched. nated player from each team; the capture of this ball Because we do not model player bodies in detail, how- is the equivalent of 15 goals and also marks the end of ever, the second of these strategies and others like it the game. are not available in virtual quidditch. We model play- Figure 1: A view of the quidditch pitch including four players (a keeper, a beater, and two chasers), the golden snitch, a bludger, and one team’s scoring area and goals. ers as spheres with various bodily motions (hitting, 3.5 STARTING THE GAME catching, etc.) implemented as primitive actions. After all the players shake hands (simulated very The three chasers use the quae to try and score goals. coarsely, as the players have no hands), the referee They may throw the quae to each other as well as stands in the two foot circle in the middle of the pitch y while carrying the quae. A chaser can enter the surrounded by the 14 quidditch players. Play begins scoring area only while carrying the quae; if more when the referee releases all four quidditch balls. than one oensive player is in the scoring area when a goal is scored then the goal is disallowed. 3.6 SCORING Two beaters on each team use bats to defend their teammates from the bludgers.