Technical Report 2020-001 Improved Balance in Multiplayer Online Battle

(c) Department of Computer Science, Bishop’s University http://cs.ubishops.ca/research antgaatetelylyo h as lyr ilgtbrdesl fte nyhv e pin to options few a have game only imbalanced they An if easily game. bored MOBA get will competitive players a fans; in the important of work- loyalty more the the producing even is guarantee Balance of is cannot process required. and also a games, is actually workmanship of is exquisite for manship design criticized inspiration, Game commonly and are creativity plagiarism. them beside of even artwork: most setting, but unbalanced games, MOBA quality, more low even their are there China In above. tioned balanced as players. not of are number they large though Even a have games. Entertainment, MOBA still Blizzard excellent they famous DOTA, all the are as from Games Storm S2 the came from games of Newerth MOBA Heroes of similar Games, Heroes of Riot batch popularity, from a enduring Legends so Of its opportunities, Witnessing League business DOTA2. out, the generation seen second have companies the more as and popular more very areas balance. still of its is kinds in it all history, lies in year pleasure competition competitive the this of is lovers basis The game playful MOBA teamwork. and strategy, many interesting operation, Battle so their as are Online of such there Multiplayer because why people life. reason young daily The among people’s popular features. very to are coming [2] are games a (MOBA) games have Arena high-quality games of that types shows various Research ment, minors. in [3]. especially way brain, educational for the of help an development good in the games a happily healthy on is Some effect up good game working. grow and electronic children studying the of help pressure life, even mental daily can the reduce in and entertainment especially fatigue eliminate common mainstream, gradual to more a the people and As and more life people. becoming social are young diversified games among increasingly have electronic the games, minds, With people’s e-sports lives. of especially people’s emancipation [10], of games part Electronic important leisure an diversified. made become also more and much people, to style convenience entertainment great brought and has Internet the of development explosive The Introduction 1 mrvdBlnei utpae nieBtl rn Games Arena Battle Online Multiplayer in Balance Improved ucs n alr laseitsmlaeul,s o l ae r secleta h nsmen- ones the as excellent as are games all not so simultaneously, exist always failure and Success 15- a with game classic A game. MOBA independent first the is Ancient) the of (Defense DOTA entertain- better pursue to desire people’s and performance hardware in increase substantial the With eosfradvrie aeevrnetadmr aaspl,wihmksfravruu circle virtuous a different for more makes try which supply, to data players more encourage system. system evaluation and to matching the environment system ideal within game evaluation an diversified an provide a neural and then for analysis, system We heroes clustering rating sample. with Elo a data the develop as big We on collection on based real-time. data based DOTA2 not small-scale the and on a for games and based system the networks, mostly evaluation The all is an DOTA2 of updates. paper like minority this constant game small competi- in by MOBA a fair a is is a which in balance secure tournaments, factors data to professional unbalanced dynamic factor finding achieve important of to most method way the traditional common is The balance complexity, environment. high tive the to Due players. h utpae nieBtl rn MB)gm sapplrtp o t optto between competition its for type popular a is game (MOBA) Arena Battle Online Multiplayer The eateto optrSine ihpsUniversity Bishop’s Science, Computer of Department mis [email protected] [email protected] [email protected], emails: ehia eot2020-001 Report Technical hiogHagadSea .Bruda D. Stefan and Huang Chailong hrroe ubc Canada Quebec, Sherbrooke, aur 2020 January 8 Abstract 1 (c) Department of Computer Science, Bishop’s University http://cs.ubishops.ca/research nyb lydo oa rantok,s A atepafr eaeaohrbsns opportunity. business another became VS. and platform Game) battle (Good LAN GG North as so and such networks, could appeared, South DOTA platforms area including Europe, such III local Warcraft Asia, Many time on the months. played At all few lovers. be balance, and a only players improved DOTA in of world constantly full the the suddenly were sweep course America to of DOTA and allowed tactics, advantages imaginative these operability, type. game fine real items, a various into evolved MOBA to Defense when updates and is continuous Dissent This with of balance. map, Valley DOTA a adjust ultimate by In and MOBA the followed bugs of became out, fix maps. milestone All-Star DOTA came the custom DOTA, Eventually, first of designing Ancient. Strife seed released the of the of of was madness planted Aeon editor and the warcraft-version together map in The got a designer again games. before, map once of As players group a Chaos. threw time, of which short Reign itself, III: game Warcraft the named with series MOBA Warcraft all the of of originator quel became player all Among unknown map. an that own from time their Strife first edit to of the players Aeon was the games. named This all one allows which Craft. the game, Star maps, a game custom with RTS editor map classic a the bound released Blizzard Entertainment Blizzard Games 1998 MOBA In of Path Development players. The start. of number to large easier a 2.1 and for threshold universal, low any more another requiring is games deliberately which MOBA Not games, makes free players. also strength are average mental games the MOBA and of Most operation most of for level acceptable be high to to designed slots is and operation abilities specific has MOBA which Craft, Star “hero”, Unlike and called Throne only side. items. other Frozen character with the The equip one of III: controls building Warcraft both usually certain as can player a such these game destroy up; games level to RTS to is hard-core experience goal for traditional two ultimate and most into The items divided buy units. usually to players’ gold are the more Players for strengthen games. fight RTS and five, traditional versus in five common Games. camps all Strategy are Real-time of which organization, subclass a unit all (Ac- is Games turn Strategy in Real-time This Action Games. called DOTA-like also or ARTS), are RTS, games tion (MOBA) Arena Battle Online Mutiplayer Overview Games MOBA 2 on based system rank/matching for the algorithm on ideal improvement balance. an an data design with dynamic also up of we come analysis Legends), uses we the of (which League Finally system as rank/matching also system. ratings original system matching Elo DOTA2 matching the on on fair based Based a system game, rank balance. balance, same online game dynamic the multiplayer in of a role implementation As important better sample. an a the a achieve plays is, as to That collection method original. data new the a small-scale over is with improvement paper are an this as it of designed achieve contribution is to system main way matching the ideal as an then well and as DOTA2, game the of balance the of understanding deep Bruda necessary. D. a both S. Thus Huang, game. C. a win Games Arena Battle Online Multiplayer in Balance Improved 2019-003: TR oeadmr lyr aeu nalkn fcso assc s3,RG(oepaiggame), (Role-playing RPG 3C, as such maps custom of kind all on up gave players more and More heroes, unique of Tens time. short very a in players countless attracted play game fantastic The se- legendary the released Entertainment Blizzard industry” gaming the of conscience “the 2002 In the of difficulty the so entertaining, more are games MOBA game, RTS traditional with Compared or tree, technology training, arms resources, population, buildings, no are there game MOBA a In in balance dynamic of implementation better a achieving for method new a develops paper This 2 (c) Department of Computer Science, Bishop’s University http://cs.ubishops.ca/research ilcep n nm eost angl n xeine odcnb sdt ul tm strengthening to items build heroes to their used control be Players can Gold them. experience. in over and creeps grow gold neutral gain creeps to some of (melee, heroes with number enemy “creeps” jungles, and and two of creeps strength Defense has kill types The lane. also the three side range. along Each produce units their enemy Barracks time. within (melee the enemies barracks all two attack attack lane. automatically are automatically on each who there towers located seconds, side, on 30 are each every towers bases For siege) The defense and side. are range bases. tree other camps their the two and to of The range) lanes each confrontation. three in and 5 with structure versus ground, ancient 5 high one a side’s have in each and our resulting Dire game, to the and related of Radiant beginning are called the that at elements control to the hero introduce only will paper This game. complex research. very a is DOTA2 DOTA2 of the Properties have which balance, 2.2 the is MOBA historical of and basis FPS, series. DOTA the as the game, such in creativity the implementation these own successful matter their general, most No with In combined DOTA, background. examples. of representative mythological idea some or the just from There are came above Entertainment. all Blizzard the games by games; Overwatch MOBA and Studios, successful Hi-Rez many from are Smite Games, S2 by (HON) an erth as DOTA2 take As will paper game. this this of balance, Players balance and pool. and gameplay template. prize nature remarkable analysis dollar classic with million In the game, 24 shows MOBA than game. again high-quality more e-sports which a a DOTA2, professional with to on U.S. returned leader DOTA Seattle, left the in who held is DOTA2 was Also 7 International Valve). the of 2017, platform (the Steam stand on new a players brand became with also DOTA, DOTA2 in reports. fixed III. and Warcarft be community, from never chat, detached Based would voice game, world. that alone matching, the bugs watch, around most skins, players fixed like of DOTA2 praise features the [16], won Engine immediately Source and on out, came DOTA2 years, finally two DOTA2. years, After make for is, benefits that any DOTA’s life, without in DOTA step updating new history. kept a of from take who stage DOTA” away to the of players exit decided father potential gradually more “the to and meant Icefrog, was more 2008 DOTA kept that In so suggest players DOTA to and for publicity, seemed competed phenomenon good Legends This Of and DOTA. DOTA. League engines of and own development Smite their further as engine the on such game restricted games based the MOBA have on new problems time, based image these same bugs Low All the DOTA. some At items. in least, fixed no and but be abilities never Last heroes, can players. inevitably new itself to day including intolerable DOTA, one becoming that to also means added was which be maps, quality development could custom shortcoming rapid elements III their Warcarft the new of for With more because limit 2002. no eliminated 8MB from be a is to game There destined a based limitations: are is map and engines which custom game a all, old just after technology, is [11] information it engine of balanced, game and classic III is Warcarft DOTA Though the profit. another. on huge or excellent way and one some success in features, result, great own out. a with coming As kept out, games came MOBA cake. more Legends even MOBA Of success this this League on players share and of Based number to Smite huge including tried the that game which time that MOBA companies, at also game was It other Bruda fans. DOTA D. attracted became S. to Huang, itself C. III Warcraft even and Games Arena Battle Online Multiplayer in Balance Improved 2019-003: TR vr OA aehsgnrly1 lyr,dvddit w ap.Eeypae ed opc a pick to needs player Every camps. two into divided players, 10 generally has game DOTA2 Every New- of Heroes Games, Riot by developed LOL or Legends Of League include games MOBA Other online of number highest million 1.2 a with players, of number large a have to continues DOTA2 DOTA2. on work research and development the starting agreement, an hit Valve and Icefrog 2009 In their got them of most course, Of trend. the followed imitations countless out, came DOTA Since 3 (c) Department of Computer Science, Bishop’s University http://cs.ubishops.ca/research R21-0:Ipoe aac nMlilyrOln ateAeaGmsC un,S .Bruda D. S. Huang, C. Games Arena Battle Online Multiplayer in Balance Improved 2019-003: TR taksed ai eitne elhMn ons aae oraiiiswt ifrn oldown cool speed, different Move with Armor, abilities including four 3), Damage, etc. (Figure points, types, types damage Health/Mana more and three are resistance, There these Magic Intelligence. beside speed, and hero Agility Attack Strength, every 1 types: in three Figure following combined the base. attributes of their one is of hero center four each very tributes, their the The of at levels). one right map. certain DOTA2 for structure on the level ancient gained of enemy’s each structure be destroy basic point only to the can spell shows is which one win ability get to ultimate way can one only and heroes abilities up, basic leveling (three for abilities is Experience heroes. hr r 1 different 113 are There heroes iue3 trbtsadaiiisinterface. abilities and Attributes 3: Figure htcnb ikdb lyr.Bsdo hi ao at- major their on Based players. by picked be can that 2) (Figure iue1 OA iimap. mini DOTA2 1: Figure iue2 eoprofiles. Hero 2: Figure 4 (c) Department of Computer Science, Bishop’s University http://cs.ubishops.ca/research rdcs(sdt etr eos elhpitadmn ons,Wrs(opoiesm iinfra for abilities. vision specific and some attributes provide their (to on addition Wards some points), Recovery provide into mana can divided which and be items can point other Items and health shop. time) heroes’ lane certain restore Side the to and (used Shop, products Neutral heroes the Some heroes), for players. recovery by vide killed them. are for they fight to if them creeps of minute (2 specific every creeps summon refresh neutral to with will creeps abilities side enemy’s have which each down, camps creeps), are jungle neutral 9 barracks have ancient six also are the Dire all and Radiant If creeps. creeps. mega super become produce will lane Bruda corresponding D. enemy’s S. Huang, C. Games Arena Battle Online Multiplayer in Balance Improved 2019-003: TR fe h einaddvlpet u eoeterlaeo h ae l h aaeesi h aeare game the in parameters the all game, the of release the before but development, and design there the every for even after model and 50%, idealized cast to ability the possible to always as build close item is and as 50% pick it course hero make from Of to sure game, move. is every make 50%. in do to choices to can teams million designers possible thousands both What are as of achieved. close strength be be as never the to is can need balance which rate experience always win and should side’s skills system each of matching levels that A different mutiplayer, well. game is every as game for supported the factor that important Given most fairness. the achieve always hero is unbalanced balance end. an all, the by In to caused beginning system. be from developer, on matching could and the who based situation designer one in This are the bug these game. skill, a better the all by or win and experience or always courage more game, choice” have and a you “perfect intelligence if from the the matter gain grabs even games; doesn’t player MOBA it every of balance, can Without soul with pleasure balance. panel the heroes’ much is the how Competition or in determines scenery, than time. beautiful contest playability long effects, for a at important for stare more would even numbers is nobody many balance Indeed, games games. MOBA of In types be. other will life time. its long the how all try decides rules can same you the game follows MOBA who balanced of robot sets a different a in and words, unlike time, is other win, every In game to choices everything MOBA results. good different balanced several produce a always eventually are contrast, will there Bu options but one winning choices, imbalance. only so bad is if and have But repetition, This to meaningless not. supposed boring. a the are become others gradually in soon victory, becomes will final game competition game a the to the the crossroad, like everywhere. players every lead win minute choices at can every countless correct to which player is game, good, every is choice and the by wise goal in made are are items the them strategy and of combat games, Some heroes and MOBA hundred choice a to item than composition, Back more team are there goals. Since their competition. achieve to choices multiple Overview give Balance to Game 25 added and also 20 was 15, 3 slow tree 10, talent level stun, at A damage, talent dealing allies. their as bonus. choose its ability such can and or effect status hero hero different unique Each the a a only themselves for ago. up has status leveled patches ability be several beneficial DOTA2 Every can provide into ability or ultimate 18. units, The and enemy 4. 12 level the 6, maximum a level with hero’s up at leveled be can ability ordinary othre aefour have heroes Most Items of types three has side Each aedt aac ssbiie nosai n yai aac.Sai aablnemasthat means balance data Static balance. dynamic and static into subdivided is balance data Game to required is support data of amount large a and attributes, competitive reveals Arena” Battle “The game a of playability the so pleasure, gain to is game a play to player a for purpose fundamental The have to supposed is player every that namely balance, game of nature the reveals above quote The Agm sasre fmaigu hie. i Meier Sid — choices.” meaningful of series a is game “A a ebuh n ul nec iebss pig(h eurcinpaewihcnas pro- also can which place resurrection (the Spring bases’ side each in built and bought be can abilities creeps he r riayaiiisadoei nutmt blt.Each ability. ultimate an is one and abilities ordinary are three ; ee,RneadSee nebrak r ulddw,the down, pulled are barracks Once Siege. and Range Melee, : 5 (c) Department of Computer Science, Bishop’s University http://cs.ubishops.ca/research iia opeiy aacdgo aesol lasflo h olwn he ue nalstages all in rules their three of following because the games system follow a complicated always development. of more development should and and the design game as more of good game With balanced a A of balance. development complexity. a the af- similar treat satisfactory adjustments is to more facilitate blueprint tries a also one design even out, can game coming achieve which good to development, a release game’s However, the the ter before second. even every balanced result highly the always influence factors unpredictable the of then so, If scissors rate. rate. win win same 50% the updates. a have or has will player feedback they each level any where skill without scissors”, same paper, game the completed in at the is are game in teams MOBA exists the as that long balance as the Ideally, is balance data Static Balance Data Static DOTA2. like game MOBA a 3.1 better in a balance achieve data achieving to of the update process beta, and the public on maintenance and elaborate through test will elements 5 internal new Section during add balance. feedback and the data after adjusts that Bruda team means D. production balance S. data Huang, Dynamic C. balance. in Games Arena Battle Online Multiplayer in Balance Improved 2019-003: TR ne l ye fdt eur esnberne.Tebgetcalnefrmcorglto shwto how is micro-regulation for challenge biggest The ranges. reasonable require data of types All ance. 3. 2. 1. Rc,ppr csos olw nielsai aablnebcueo t iperules: simple its of because balance data static ideal an follows scissors” paper, “Rock, eietetrerlsabove, rules three the Beside h aecnet ayt nesadfrpaesi loeeydsge’ duty. designer’s every also is Making players be. for necessary. clean, will understand is adjustments and to later part simple easy difficult every concepts more be sure the game make must is, the to design design originally stages whole the all complicated The through more followed The always understand. be to should easy concepts and basic simple things ”keep lows introduced. this thus pick Suppression: imbalance to Complexity the not the to default that due Arc by play so decided two to Players mobility, be hero time. and a will same strong Warden, down the there too at Arc cool activated heroes is ability is two concept controls status, ability effectively this this points, player fit Once health/mana individual not ability. with does with ultimate unit Wardens that hero as example unique Double” a An “Tempest controls player with compete”. “every that to is DOTA abilities of will corresponding concept game important the most of the concept based of the designed One of imbalance. be independent of should is deal that elements great element the a An all about game. that bring the means of It concept overall stage. the design on initial the in designer game principle: convenient. design Coherent more “mixed” much the DOTA2 became In adjustments result. so expected and the achieve eliminated, to is damage damage to calculations of considered more type many be “mixed” implement both the do physical must adjusting to needed and when armor Icefrog magic and Therefore both resistance nightmare reduction. deals magic a damage but hero’s the really creeps, means calculate was on which which damage units, DOTA, full hero in deals to damage type damage of This type Icefrog. affect “mixed” designer a not the be will for to part used one there on example, adjustment have For for not will on, game. designers later the beginning, problem of very parts any the other adjusting from or followed fixing be trouble can much rule this If purposes. elements: necessary game of modularity The > ae,paper paper, ttcdt balance data static > ok rock rock, h sec fcmlxt upeso st a esmaie sfol- as summarized be can to is suppression complexity of essence The stems motn uefrevery for rule important most the is [13] principle design coherent The micro-regulation > cso.We tcmst OAgm,tosnso millions of thousands game, MOBA a to comes it When scissor. aysml ae nra iestsyti oe,sc as“Rock, such model, this satisfy life real in games simple Many . vr lmn ntegm utol xs o n rafew a or one for exist only must game the in element Every 6 sa motn tpt civ ai ttcdt bal- data static basic achieve to step important an is (c) Department of Computer Science, Bishop’s University http://cs.ubishops.ca/research et nyhpe vr o3mnh) hsi h anpolmw r oadesi hsppr new a paper; this in address to try we problem main the is This months). 3 to 2 every small comprehensively. happen very factors only a imbalanced ments only the are reflect players cannot method professional this that significant DOTA2 so mentioned only every community, DOTA2 be ) 5 While the (Figure also of collection should games. part data It professional limited in identified. a be especially such can with be, imbalance games, more will 100 the it conditions, around most popular of in consists more effective: tournament the but in simple is, nerf is a hero idea got a the This 5 in popularity. Figure powerful their example, in weaken shown For single to list hottest. every Ban/Pick” update the next “Most “balance (weaken) the on principle nerf hero the every and With almost heroes tournament, unpopular least. 2013 most the analyzes International Valve the which as items, and strength and most will heroes the they the picked hero”, of are popularity items the or the Pro- on heroes From is based which [15]. reference most tournament important players, professional DOTA2 Another professional a of in update. (or games behaviour next problem 100 for around imbalanced are considered single There be a Tournaments. will report fessional players adjustment many and too analysis If bug), community. nexta DOTA2 The the in world). world the the in around player still single is 4). bugs (every Figure This fix larger (see much designers released. balance is that the is testers adjust means game of then actually the group will after It the update feedback but time. way, and the some reaction in all ad- players’ testing and balance to feedback healthy according through a adjustments designers do in game and game and the players keep between to interaction justments the is balance data Dynamic Balance Data Dynamic and 3.2 testers is The conjecture the tests: if game verify of then lots consequences, do operation. the actual to predict through is conditions, correct certain micro-regulation discuss for principle designers way design game effective coherent the the most and The elements game of essential. modularity are the procedure, this During problems. find Bruda D. S. Huang, C. Games Arena Battle Online Multiplayer in Balance Improved 2019-003: TR h bv ehdlg ae h vlainoesddadntra ie(i rfsinltourna- professional (big time real not and one-sided evaluation the makes methodology above The players from reports accept to team dedicated a has Valve example, an as DOTA2 on again Focusing iue4 OA updates. DOTA2 4: Figure 7 (c) Department of Computer Science, Bishop’s University http://cs.ubishops.ca/research R21-0:Ipoe aac nMlilyrOln ateAeaGmsC un,S .Bruda D. S. Huang, C. Games Arena Battle Online Multiplayer in Balance Improved 2019-003: TR ist atto the afterwards. standard partition same to the aims with [8] assessed clustering be K-means can heroes of type same the that so data, their to analysis cluster K-means Preliminaries Further with system 4 matching ideal an system, matching DOTA2 of analysis developed. detailed be will a improvements through level. player’s 5, the Section reflect In objectively large can a system in evaluation performance the their awhile, to After according player games. every every past level for player’s of starts. every judgement game number judge general the to a before on able level have evaluation not overall still are similar appropriate they system a movement, have an matching to games’ player team MOBA both every most up if give set even Fortunately, can to impossible that be would system it matching level their reasonable physical/mental and a awareness Without teamwork time, reaction status. personal experience, on depends level player’s A Balance System Matching 5. 3.3 Section in developed is players all for analysis data on based method etod,cluaenwcnrisb vrgn h oriae ftevcosi h urn lses and clusters, current converges. the selection in centroid vectors the the until of process coordinates this the repeat averaging randomly by by centroids new accomplished calculate is centroids, This variance). (i.e., WCSS or selecting squares of sum within-cluster the minimize ie e fobservations of set a Given player. single every for Rating) Making (Match MMR with system matching excellent an has DOTA2 ossso ueossml nt onc santok There network. a as connect units simple numerous of consists [17] network neural artificial An k lse centroids cluster iue5 otBnPc eosi h nentoa 2013. international the in heroes Ban/Pick Most 5: Figure ilb sdi hspprt lse l h eosit ifrn ye according types different into heroes the all cluster to paper this in used be will µ j 1 , ( x 1 ≤ , x 2 j ,..., ≤ k eemn lse ebrhpbsdo h itnefrom distance the on based membership cluster determine , x n n ) hr ahosraini a is observation each where , bevtosinto observations 8 k ≤ n sets S d = dmninlra vector, real -dimensional { S 1 , S 2 ,..., S k } oa to as so (c) Department of Computer Science, Bishop’s University http://cs.ubishops.ca/research ecito faohrMB aeLau fLgnscnrstefc htisrn/ac ytmis system rank/match its that fact the confirms Legends of basic League the official game satisfies Finally, MOBA which games. competitive another game, in the of similar before description is rating behaviour opponent’s Players’ DOTA2. the of and system (win/lose) ranking/matching game 100). the even of or outcome 50, the (10, game each for unit score else the game, is the what won on player depends and rules scoring the on scored B oee,patc hw httepromneo h lyr sntnral itiue,s h current the so distributed, normally distribution. distribution not normal logistic is a x the on players uses based the usually originally system of scoring was performance hierarchical model the Elo that The shows chess. practice as However, such games zero-sum in players rank System individual Rating two Elo has The DOTA2 game, the respectively. modes, in two strangers game these and than in behaviour used rather different being life have “solo”and“party”scores would real with people in systems, most friends that language. their Considering same the with group. have a styles side as same game on a players the start 5 have players the who least players at the or all setting, match their and an to a on also more tries is based has team Language system language also lower-score matching first system. the team DOTA2 same matching reward they higher-score games. the will if the for MOBA system compensation in more system, a the factor this lose as way, important In more, or other team the game, higher-score side. goes the the other punish result winning the also the if significantly for if a true less rate; has is gain win side opposite will higher one The they If side, game. matching. other the final the lose the than in weight score largest average the changes higher has these which game, score, a average after similar players view. surprise of may point scores statistical in a changes from reasonable the all system are mission. this and impossible tolerate, under an to While be player might normal ence. time a this for within time time scores limited matching same with the maximum life exactly the real the with be in with players achieve would while 10 to players minutes scores, finding difficult 10 certain 10 is earn to however Select can 5 model winner This players: each system: completed, and scores. rank is same game the a the loses on once loser game; based each a start established to be scores rank can same model matching idealized An System Matching DOTA2 The optimization 4.1 techniques. BP- nonlinear optimization a a in Thus, into used commonly samples data. most of algorithm training group descent the gradient a on a of uses based problem which neurons. neurons problem, input/output of the the layer of “hidden” converts parameters a network also the neural but adjusts neurons algorithm output and learning input The featuring learning, supervised with system. evaluation work complete final a the use for respectively, will heroes paper of this type requirement every processing for data data our on based but Bruda network networks, D. BP-neural S. neural Huang, of C. kinds several are Games Arena Battle Online Multiplayer in Balance Improved 2019-003: TR o h xetdsoeo Player of score expected the for vleo h imi’ midpoint, sigmoid’s the of -value is nteEortn ytmtenwudtdrtn o lyri nyrltdt i rgnlrating, original his to related only is player a for rating updated new the system rating Elo the In fPlayer If party 5 to 2 cases most in yet players, solo 10 matching about cares only system matching the far So a have sides both that is system matching DOTA2 in principle important most the example, For experi- better a provide to system matching its on adjustments effective some did therefore DOTA2 net- learning multi-level a is It algorithm. back-propagation the on based is network BP-neural The E A S = A ons h oml o paigterrtn is rating their updating for formula the points, 1 / A ( 1 a aigof rating a has + 10 .Sc ewr ilb sdt eemn h pcfi egt fec yeof type each of weights specific the determine to used be will network a Such [14]. ( R A − R B S samto o acltn h eaiesillvl of levels skill relative the calculating for method a is [7] system rating Elo The ) / A 400 = R ) A A 0. upsn Player Supposing . n Player and is L E stecresmxmmvle and value, maximum curve’s the is A = 1 / ( B 1 aigof rating a + 10 9 ( R A B − a xetdt cr of score to expected was R A R R ) / A 0 B 400 hntefrua(sn h oitccurve) logistic the (using formula the then , = ) R iial h xetdsoefrPlayer for score expected the Similarly . f A ( x + = ) K ( L S k / A h tens ftecurve. the of steepness the ( − 1 + E A e ) − h factor The . k E ( x A − onsbtactually but points x 0 ) hr x where , K S sbased is A 0 = sthe is if 1 (c) Department of Computer Science, Bishop’s University http://cs.ubishops.ca/research i l ae hyhv lyd(agn rm2to 2 from (ranging played have they games all data in simplify 8 to Figure in heroes shown these as heroes on 17 focus these of only behaviour will the we but needed later, is figures. data API these of in an types heroes more different through 17 Considering processing. collected are figures. There be both [1]. will in strong 7) appear too and (Figure Devourer is dealt Outworld hero damage and a and Huskar if 6) Zeus, judge (Figure rate to win choices factors, good imbalanced Heroes be potential of would find Balance to Data is Dynamic purpose the the Since for System Evaluation An balance. 5.1 the better on a based achieve system to matching improvements ideal other an some introduce with then In together we system system updates. evaluation system rating and an evaluation Elo patches important establish this by Especially will by balance paper Inspired game. dynamic this factors, Heroes. its a imbalance of for of balance/ guarantee stages the a evaluate design keep accurately and to to research is order DOTA2 the like in game MOBA concern a a for only is balance data Static DOTA2 in Implementation Balance 5 follows DOTA2 that way. assume same thus the we similarity, in of system level rating high Elo their the Considering [12]. ratings Elo on based Bruda D. S. Huang, C. Games Arena Battle Online Multiplayer in Balance Improved 2019-003: TR hnw olce 0pae ape(admslce rmoeo h uhrsfinsls)with list) friends aurhor’s the of one from selected (random sample 10-player a collected we Then iue7 OA o 0dmg el eosi eyhg kl ae Jnay2018). (January games skill high very in heroes dealt damage 10 top DOTA2 7: Figure iue6 OA o 0wnrt eosi eyhg kl ae Jnay2018). (January games skill high very in heroes rate win 10 top DOTA2 6: Figure 10 (c) Department of Computer Science, Bishop’s University http://cs.ubishops.ca/research R21-0:Ipoe aac nMlilyrOln ateAeaGmsC un,S .Bruda D. S. Huang, C. Games Arena Battle Online Multiplayer in Balance Improved 2019-003: TR aetems aae rmeeyi vr emfih,adas el oedmg ttesm time. same kills. to easy the environment have at better allies a damage let to have some to supposed dealers) deals heroes (damage is enemy also cores tank, stun helps and representative and support, fight, a farm a Warrunner, team as Centaur every played in usually it. enemy Shaman, with Shadow from damage damages of most lot the heroes. a evaluate take deal to can way wise player from a bad damage not a take is and data with healing specific actions few by heroes’ a teammates enemy or help limiting one to at on good supposed to Focusing are are meant enemy. hand others are the other some heroes the etc; some on silence, example, some slow, features For damage; stuns, these of game. DOTA2 All amount every huge abilities. in for a and effects considered deal attributes be different must have positions, that different heroes factors have various more heroes of obviously whether are Different evaluate there However to picture. standard not. complete or important a strong an too be is to hero appears specific dealt a 8. damage Figure Thus in substantially. example differ an damage as used is dealt damage 2018; January in individually) games 23 so he ifrn ye fhre:Zu a aaedaigaiiiso ,s hteven that so 4, of abilities damage-dealing a has Zeus heroes: of types different three show 10 Figure deal to ability heroes’ different that see to easy is it 9 Figure in shown distribution the to According iue8 vrg aaedatprgm sn 7hre y1 lyr Jnay2018) (January players 10 by heroes 17 using game per dealt damage Average 8: Figure iue9 ifrn eos efrac ndaigdamage. dealing on performance heroes’ Different 9: Figure 11 (c) Department of Computer Science, Bishop’s University http://cs.ubishops.ca/research ihalteedt,cmrhnieaayi eoe osbe h olwn r h atr htare that factors the are following The game. hero: single a every possible. of for becomes assessment time” programming the “stun analysis application in or comprehensive significant taken” an schemes, data, “damage these has as these From such itself 18]. all directly DOTA2 [5, With obtained Fortunately, data be detailed can game’s types data. single more every of many including database types deficiencies its few many for have too (API) still dotamax.com interface features website analysis it data the that even aspect, in this In hero. a of abilities Bruda D. S. Huang, C. Games Arena Battle Online Multiplayer in Balance Improved 2019-003: TR 6. 5. 4. 3. 2. 1. hs ape hwta h vlainsol edn nacmrhniewycnieigalthe all considering way comprehensive a in done be should evaluation the that show samples These blte uha oe tak sn blt ries ote r vnwae hnsu n hex. and stun than weaker even are they so items, or ability using Weight attack, move, as such abilities and base, Ancient every enemy’s for important the both destroy are factors to two is these game push, DOTA2 Weight easy a an game. to single win lead to would heroes way enemy’s only killing the Since dealt. aedmg a vnpooemsae.I l hsi ekrta l h atr bv;weight above; factors the all than weaker is this all given. In is mistakes. promote even may damage take weight same taken Damage the have factors two These (heal). debuff. points as health/mana their regenerate allies help heal and Buff damage like debuff happen of killing Time a make weight cannot lighter themselves a hex have and they stun so However dealt, kill. easy an to lead hex: and stun of Time dealt Damage rate Win C stems motn atrt vlae weight evaluate, to factor important most the is sgiven. is rvd eeca fetfrale nldn pe padetadmg bf) and (buff), damage extra and up speed including allies for effect beneficial a provide shlflbti sntncsayaltetm.Smtmshvn ihcpct to capacity high a having Sometimes time. the all necessary not is it but helpful is a edvddit w ucassa uligdmg el,adHr damage Hero and dealt, damage Building as subclasses two into divided be can nldsslne ot lwadmt.Teedbfscnol etitoeo the of one restrict only can debuffs These mute. and slow root, silence, includes A tnadhxcnttlyrsrc n feeyhre’atos hc will which actions, heroes’ enemy of any restrict totally can hex and Stun sgiven. is iue1:Dfeettpso heroes. of types Different 10: Figure B . 12 S sgiven. is D C (c) Department of Computer Science, Bishop’s University http://cs.ubishops.ca/research r iie notopiayrls nw steCryadteSpot are,wihaeas called also are which Carries, Support. the and Carry the as known roles, primary two into divided are time, stun for statistics players statistics the 10 average the on the shows of two dealing. 11 summary these damage Figure combat for and the 2018. from healing, available January data hero in directly game heroes data of 17 big types using 2 earlier, no other mentioned is the There obtained we Buff). Instead website. of representative a (as required. is is ing above classification assessment better The A different healing. hero. their hero unique of of every because amounts for so huge suitable are all and not heroes weights stuns therefore imbalanced highest long-time Many the as simple. have such that data abilities, not two functional are these things since practice assessment In best time. the the have always whether heroes decide type to towers) tests or last more the after that needed likely be very may is fix necessary. A it is low), hero. update or this new on high a effect (too imbalanced value very balance a abnormal has significantly update a has hero specific a and the time, of period a over games DOTA2 where Bruda D. S. Huang, C. Games Arena Battle Online Multiplayer in Balance Improved 2019-003: TR u i st rvd ehdrte hncmlt h aclto.Oc h egt r determined are weights the as Once heroes of calculation. assessment the the data. complete for big than formula rather on the method construct based can a verification we provide iterative to and is computation aim massive Our requires weights accurate Obtaining 7. aac value Balance h rtse st eemn h ubro lses codn oterlso OA,Heroes DOTA2, of rules the to According clusters. of number the determine to is step Weka. using first [9] The analysis clustering performed then have We Heal- Hero and Time Stun considered: now are data more two above, data dealt damage the Besides heroes (to dealt” “damage the that see to easy is it above outlined idea general the on based However, ad opoievso n utsnr o eeto.Spotv eaiu svr motn in important very is behaviour weight Supportive the give detection. we DOTA2; for including dust/sentry games MOBA and vision provide to wards ability Support F i ersn h omlzdaeaevle o h atr itdaoe ae ntedt rmall from data the on based above, listed factors the for values average normalized the represent nacranpro ftm freapeamnhatrtels paei eesd,if released), is update last the after month a example (for time of period certain a In . smil eetdi ucaigspotv tm o h hl em uhas such team, whole the for items supportive purchasing in reflected mainly is iue1:Aeaesaitc f1 heroes. 17 of statistics Average 11: Figure W i r h orsodn egt itdabove. listed weights corresponding the are M = i ∑ − n 13 1 W i × F i B o it. for M hsbecomes thus (1) (c) Department of Computer Science, Bishop’s University http://cs.ubishops.ca/research R21-0:Ipoe aac nMlilyrOln ateAeaGmsC un,S .Bruda D. S. Huang, C. Games Arena Battle Online Multiplayer in Balance Improved 2019-003: TR atr icse ale.W ii u lse nlssol nteetredt onsdet h limited immediate. other however the the is to data on lows: due more also points to but data analysis the here, three our considered determining these Extending data that on work. of only Notice this types analysis to three Cluster cluster situation. allocated the damage in our resources world on most limit elements only real We most 10 not earlier. the have based as discussed reflects to be picked factors supposed which should was is hero 1, sample a data Cluster of the the damage in type that so purely elements heroes, is are least rate Others hero and win support time. 2 highest same one 7 the only and at is heroes stun there dealing and in healing reason hero offer able The position and indeed support damage are dealers. excellent Warrunner of an Centaur amount indeed and concretely, some is More Omiknight deal which Underlord, time. to same Shaman, Knight, the Shadow Chaos at is Spirit, Vegenful healing 1 and DOTA2. Cluster stun, contributes in damage, mainly element on 2 only well Cluster pretty the stun, does contributes 0 mainly Cluster 1 and Cluster damage, Hence respectively. of Carry, kind and Support, this called players “Functional and Most “Support” “Carry” time. called same types needed. three the are not that at Core” (maybe submit healing damage therefore We some and our Cores. deal stun in Functional can However offering DOTA2 heroes allies. in while create healing heroes Supports though), by Some while much or enough. damage, (stun) that not enemy of are the amount classifications controlling huge their deal two by dealing for eg, opinion, that assistance for Carries, abilities their provide responsible lack the for that is chances in generally utility Carry better later and Supports a powerful functionality basically victory. more more So to with become carries. ones team to having their able instead “carry” are damage, but to heavy able vulnerable, and becoming weak thus as game, match each begin “cores”, fewr ae nbgdt ntosnsmlingmsrte hnol rfsinltournaments. professional completed only be than can rather update games balanced million better enemy). thousands every A limit on of or system. data balance evaluation team big the same support way, on This the or based damage in afterward purpose. (deal quantified main its do be with to can compared supposed hero important is single capabil- that it important not most what are the on abilities so based other duty, is The specific hero its single has heroes a of for type ity Each principle: following the used We 2. 1. 3. sfol- as (1) Equation in abilities heroes’ our for weights the refine we analysis, cluster the on Based Core, Functional represent 2 1, 0, Clusters analysis. clustering our of summary the shows 12 Figure upr heroes Support heroes Carry aelevel. same cores Functional iue1:Rsl fcutrn nlsso 7DT2hre data. heroes DOTA2 17 on analysis clustering of Result 12: Figure aaedealt damage : ieo tnadhex and stun of time : h egt fdmg el,haigadtm fsu n e r lota the at almost are hex and stun of time and healing dealt, damage of weights the : > healing > ≥ aaedealt damage ieo tnadhex and stun of time 14 ≥ healing (c) Department of Computer Science, Bishop’s University http://cs.ubishops.ca/research rps n ftefloigtomethods: two following the of one propose heal. and stun balance hero’s damage, for evaluation namely the data is follows: output of as the Value types defined Balance and “balanced”), three respectively) the extension on 3, the the based 2, but not) are (1, samples, or neuron inputs 11 (balanced a has The has type datum the as input immediate. paper Each is this 0.6. in types to heroes other 0.4 Carry from the for range consider a only considered, We have above will type. listed model each attributes ideal 7 The the precise. all more with and heroes smaller 113 function be are will linear there range a When this using level. same values the our at normalize evaluated then contains We cluster Support here. the ignored Since be Cores. Functional will 5 type ( the this for sample, 0.3 0.35, single 0.35, a are weights these that and Bruda D. S. Huang, C. Games Arena Battle Online Multiplayer in Balance Improved 2019-003: TR 14. Figure in shown as are neuron every for weights the samples, 11 with training Ember the Lycan, after are balanced. heroes not balanced are rough seven the update a other estimate latest the this for the while to in Tinker, assumption therefore According modifications and will following got not. Gyrocopter We just from are the Spirit, who others data collected). heroes using the the is collect while not that 2018 balanced, to suppose are are January we difficult which network: from it neural and data the makes the balanced of which training only are days, why heroes reason 30 which the for determine also kept is only (it are update replays last DOTA2 for logs The y ( = Wi o h etudt;hre ihmdfiain r sue ohv rniindfo unbal- from transitioned have to assumed are modifications with heroes update; unbalanced next was the before for Wait data the 2. then modified, were heroes some if update; previous the to Refer 1. ooti opeetann e oemto fdtriigteotu value output the determining of method some set training complete a obtain To for weight the determine to network BP-neural be a can used heroes then we of above, types estimate all rough values the on these Based on Based 0.76. to 0.107 from ranges value Balance The respectively, heal, and stun, damage, for 0.2 0.3, 0.5, are heroes Carry 11 the of weight the Suppose ihtetretpso aaa nu,3nuosi h idnlyradiiilwih s05 .,0.2, 0.3, 0.5, as weight initial and layer hidden the in neurons 3 input, as data of types three the With x ne obalanced. to anced balanced. is modifications after data the and − min )( max − iue1:Ruhblnevle o ar n ucinlcores. functional and carry for values balance Rough 13: Figure min ) 13. Figure in shown then are types two these for values Balance The ). O =  otherwise 0 1 for 0 M h imi ciainfnto is function activation Sigmoid The . 15 . 4 ≤ M ≤ 0 . 6 O O wihsad for stands (which snee.We needed. is (c) Department of Computer Science, Bishop’s University http://cs.ubishops.ca/research ntehde ae,wt 1 with layer, hidden the in Bruda D. S. Huang, C. Games Arena Battle Online Multiplayer in Balance Improved 2019-003: TR ytmi ohfail n cuaei ti e ihacrt n opeebgdt.Orsse a the has system Our data. our big that complete believe and accurate we with said, fed being is This it persis- updates. if advantages: and several accurate following more next and requires covering feasible model both time, ideal updates), is long The other system a from heroes. data for more collect collection validating to for data impossible utility tent it reduced makes of which it more days, makes 30 with it which for making sessions kept only system, training are the logs several mentioned retrain after can established we be version should new can system a sets version (“production”) new for These updates. the different available final and set. is unbalanced The version is data new set Once the version accurate. month. old and the latest balanced. set where the version is network, heroes for old BP-neural set the the hero the pick training every into can for for we them used above), data separate be mentioned the and methods traditional all modified the keep were (with always that released is to update is new method the After accurate ideal The earlier. listed method. data of types the all require will system evaluation complete A [4]: Sun and Wang of method R the by given are ecnetbiharltvl opeeeauto ytmfrCryhre by heroes 0 Carry if for only system and if evaluation complete relatively with (1), a normalized Equation the establish into can weights We these in 15. plugging Figure in shown as neuron neuron input the to j i Tenwgm hne lk e eosadnwsrtge)cnb aacdtruhtereeval- the through balanced be can strategies) new and heroes new (like changes game new The around 2. player all instead tournaments; professional from data limited the on rely longer no Updates 1. = erfrt h ern sn h indices the using neurons the to refer We nal h apeeprmn ecie bv sbsdo niacrt supin(eas as (because assumption inaccurate an on based is above described experiment sample the all, In inaccurate an likely is which balanced, are heroes updated latest the considered. that are assumes data above of process types The three only calculation the simplify to that again emphasized be should It ae nti ehdadtedt olce,tewihsfreeytp fdt eecalculated were data of type every for weights the collected, data the and method this on Based | aino h eae eosi eltm;aynwtann a efiihdi hr ie with time, short a in finished be can training new any update. next time; the real for available in readily heroes assessment related the of uation it. of part be can world the ( k 1 h boueiflec ofceti then is coefficient influence absolute The . − e − idnlyrneurons layer Hidden x . ) F 4 / i ( ≤ iue1:Wih ofcet feeytp fdt o ar heroes. carry for data of type every of coefficients Weight 15: Figure [ = 1 i + M and , AverageDamage e iue1:Wih ofcet ewe vr w neurons. two every between coefficients Weight 14: Figure ≤ − 3 2 1 y 0 ) w | . 6. ≤ jk with stewih ofcet ewe h uptneuron output the between coefficients weight the is i ≤ y m = 1 , r , j i 0.980589 0.672780 0.205612 AverageStunTime ≤ aaType Data . Damage W Heal Stun j 1 ki ≤ stewih ofcet ewe h idnlyrneuron layer hidden the between coefficients weight the is i n o nu neurons, input for n 1 and , nu neurons Input ( r 0.462451 0.207483 0.102755 16 W j i S 0.240285127 0.446598302 0.31311657 i = egt(S) Weight j [ = ) 2 = ≤ ∑ , R k AverageHeal k P 0 − j i ≤ . 1 / 446598302 W ∑ P 0.016968 0.344029 0.768041 ki h eain ewe vr neurons 2 every between relations The . i m = ( 1 1 j 3 R o uptnuos and neurons, output for − j i e hc sterqie weight. required the is which , − ] , T x 0 hnaCryhr sbalanced is hero Carry a Then . ) . / 240285127 uptneurons Output ( 1 0.5719874 -0.263680 0.585587 + e − j x ) n h idnlayer hidden the and , with 0 . 31311657 k x o neurons for = w jk ] and , and , k (c) Department of Computer Science, Bishop’s University http://cs.ubishops.ca/research R21-0:Ipoe aac nMlilyrOln ateAeaGmsC un,S .Bruda D. S. Huang, C. Games Arena Battle Online Multiplayer in Balance Improved 2019-003: TR oictosaeteeoencsayi h etudt.Alti nlsscnb nse nasottime short a in ( finished level be average released). can were the analysis heroes than this new weaker All the bit update. after a next weeks are the (2 in heroes necessary new therefore 2 are these modifications that say can we weight then with value Lord. Balance Troll for their 0.293009308 calculate Carry and as to Sven classified (1) for are 0.356003529 Equation they are use classification, we our others, With with heroes. coefficients them new compare two To the for hero. data of worth damage 2-weeks pure first are they since examples, as Lord Troll experience. and to Sven according use We Carry dealer months). 4 last the during released players the seize Example to important be would time short a one, new in a range Com- on ideal effectively market. an hero. more the in even single and work balance every can the of it keeping DOTA2, balance which game data MOBA for dynamic mature the relatively of the with reflection tournaments. pared real-time the a of results and the comprehensive, for and waiting than bal- rather the update beyond next this go the If will in hero considered rapidly. this be rose of can heroes value and pushing Balance new of pop- the data ( increasing then few of range With conditions, a types anced most Undying. Only all in and strategies, strong game. too other Prophet the is than Nature strategy in rate Pugna, early win as This towers higher such Strategy. enemy’s and Pushing strategy destroys ularity the this and named for group 2014 suitable mid a are in as strategy heroes heroes popular five a all be time. requires to short used strategy very there a example, in For system, them. evaluation of an our After also with can changed Naga which has Carry. necessary, and data as are Carry the evaluation Siren as became balance soon Naga King and as Monkey analysis and finished clustering stun), new Support, be of case, a time this and as In damage known Support. (mostly Siren be values ability to their used on King update Monkey tournaments. professional Hero from to the data respect or example, in feedback time, for short waiting a than in rather clustered update, and kind quick analyzed another a be create for freshness. can effect balance heroes maintain in their reconstructed) to which (or abilities, year New new every heroes. brand heroes new with new of reconstructed releasing also are and heroes designing the existing still Some elaborate is only Corporation we Valve future, fact, the In in test and training for data advantages: more second of and lots first requires point third the Since Wt oetann,ti vlainsse ilbcm nraigyacrt n stable. and accurate increasingly become will system evaluation this training, more With 3. suigta h egtcefiinsaeacrt nuh(hc ilhpe iheog training), enough with happen will (which enough accurate are coefficients weight the the that Assuming is this that Assume sample. players 10 the from days 15 last the in data the shows 17 Figure accurate more be can world the over all games daily from data big on based system evaluation This advantage unexpected) (and full take can who heroes some be may there appear, strategies new When For change. may hero certain a of position the abilities, its of values the on modifications some With game. MOBA energetic an for true actually not is this enough, be to seem heroes unique 113 While ups httonwhre r eesdi nudt sneeg,teewr onwheroes new no were there e.g., (since update an in released are heroes new two that Suppose ( W > i [ = ) 0 . rl Lord Troll ) fs,te efo hshr ncmiainwt hssrtg utb considered, be must strategy this with combination in hero this on nerf a then so, If 6). Sven 0 . 446598302 vrg Damage Average iue1:Aeaesaitc f2heroes. 2 of statistics Average 16: Figure , 0 14982.3 16187.5 . 240285127 , 0 . vrg Stun(s) Average 17 31311657 13.2 29.8 ] h ucm sta h aac values Balance the that is outcome The . vrg Healing Average 1195.2 0 < 0 . ) oepositive Some 4). (c) Department of Computer Science, Bishop’s University http://cs.ubishops.ca/research isti ae r0(lyrlssti ae.Bsdo OA akmthn ytm hr r two are there system, rank/matching DOTA2 on Based game). this loses (player 0 Teams or game) this wins follows: as system rating Elo the follows system matching ideal The System Matching Ideal An on based system matching 5.3 ideal an system from matching start DOTA2 we the Therefore that available. Notice system not rules. rating experience. so matching Elo better players’ and a the game open-sourced, provides on MOBA not that the based system, is comprehensive of system more support matching a in achieve described ideal to system balance an improvements evaluation introduces other the some part and with system this together rank section, and previous matching DOTA2 System the the Rating in of Elo principle the the on by Based Inspired Design System Bruda Matching D. Ideal S. Huang, C. 5.2 Games Arena Battle Online Multiplayer in Balance Improved 2019-003: TR ie With side. ac aigta sand,adeeymthi uu ihmxmm1 lyr.Ata a ea be can Then: team MMR. A party average players. their 10 with players maximum party with 2-5 queue a a or is MMR, match solo every his with and player node, solo a is team making match Team Team if hand, Team in player have We 3700. difference the the of simplify median to the 2. while appendix Table 1 Table in the in shown in shown is are provided range differences [6] sores Table that Expectancy Notice Percentage process. calculation the use we convenience For Oc e oei de oaqee hc fti uu sfull. is queue this if check queue, a Elo to added the is on node based new parameters a Once matching new 4. the with queue, empty a to node difference. score this minimal add with Otherwise, queue the is 3. to there node range, the in add is then MMR yes, (the If it for queue 2. eligible an is there if detect in, comes node new a Once 1. possible. as fast as matching the Complete players. 6. solo/party of number similar have sides Both similar. are 5. sides both on both players on highest players of for Scores games played 4. of number similar a is, that experience small. similar is a score have lowest sides the Both and highest 3. the with players the between gap The 2. score. average similar a have sides Both 1. Let ihteaoerlsi id epooetefloigpoesfrteielmthn ytm Every system. matching ideal the for process following the propose we mind, in rules above the With follows: as up set be can rules matching system, rating Elo the on Based Team suppose example, an As B aigsse hnwait. then system rating etc.), node, the for available space sides. A K ilgi 75points. 47.5 gain will and = D 0(tnadpit lyrmyer rls fe OA ae and game) DOTA2 a after lose or earn may player a points (standard 50 = B A D A R ihdfeetaeaern crs( scores rank average different with oe h aete vr lyri Team in player every then game the loses B = ilgi 25pit n vr lyri Team in player every and points 12.5 gain will − 9 n so and 190 R A ehave we , E A E = A A a naeaern cr f39,adTeam and 3890, of score rank average an has 0 = . 5and 75 P ( D = ) E B 1 = / 18 ( 0 1 R . + 5 hrfr fTeam if Therefore 25. A 10 and D / A 400 R ills 75pit n vr lyrin player every and points 47.5 lose will B ) ntesm ae lyr neach on players 5 game, same the in ) and B ills 25pit.O h other the On points. 12.5 lose will E B = P A ( − istegm hnevery then game the wins D = ) B naeaern of rank average an 1 / ( S 1 A + = 10 (player 1 − D / 400 ) . (c) Department of Computer Science, Bishop’s University http://cs.ubishops.ca/research au nycniesapae’ ihs o 0t 0uiu eos ak hc norgspaesto Hero-Pool players the encourages that which means rank, which heroes’ 50, unique can. and 50 reasonably they 30 to as between 30 heroes top set many as highest be play player’s shuld a n considers so only hero, value single every operate can and hero, certain this with played DOTA2 heroes. to the different enough of use familiar calibration to the is as player rule the same sure the make follows This to evaluation. 10), stable system. as and rank (such precise number a for a hero small number this too and The not hero), but can certain hero. small types, a respective relatively heroes’ for the between (differences is with (6) ability played Equation this has in important weights how the as reflect etc, concepts truly Taken, same the Damage is K/D/A, which Time, data, Stun/Slow dealt, Damage rate, player, hl h omrfcsdon focused former among the balance While hero’s follows: individual (1. as an Equation rank concerns this in latter establish heroes the We of others’, all. to assessment compared the level to player’s similar individual an is and hero, certain a to the order on In improvement variety. an lack propose we will of environment, earlier. others; game diverse experience discussed most the a method than the then for scoring started them, heroes with get different with together to play start harder to destroyed, to be players be players encourage to encourage will meant doesn’t are game designer heroes the the some view, of if of balance point the another From situation players. this In why also time? is which the others, than stronger are that complicated heroes required. this some is a in balance of be balance outcome data perfect must the the dynamic there on since achieved, focuses Also, be only e-sports. use. never system players can in rating heroes game Elo as what The about well game. concern heroes, as this no different in with life 113 seat game, With real a factor. have in important to most games, supposed the Elo is competitive is the everyone balance most on DOTA2, based like for games is suitable MOBA system for indeed rank However The is rank/matching. which DOTA2 the system, System on rating Matching based ideal is above the system for matching Method The Scoring on Improvement An 5.4 17. Figure in shown is chart flow corresponding The Bruda D. S. Huang, C. Games Arena Battle Online Multiplayer in Balance Improved 2019-003: TR I uu a atdfr5mnts eoealtends eetfo o6 n mt h queue. the empty and 6, to 1 from repeat nodes, the all remove minutes, 5 for waited has queue a If 10. Ohrie xadtecniint agracpal cr ifrnebsdo h l rating Elo the 7. from on Repeat based difference 9. score acceptable larger a to condition the expand Otherwise, 8. waiting. queue. keep waiting then the yes, into If added nodes 7. new waiting. are keep there otherwise, if queue, check the seconds, empty 30 and Every game this 6. start to sever a find then yes, If 5. oieta vni h oa oli 1 eos ti o elsi ospoeta vr igeplayer single every that suppose to realistic not is it heroes, 113 is pool total the if even that Notice value Hero-Pool the compute then We is,w nrdc e ocp aldhr ak hsrn eet h lyr’lvlwieplaying while level players’ the reflects rank This rank. hero called concept new a introduce we First, all play to heroes strong certain several pick only players the all patch, certain a within if What system. E i agsoe h aafo l h ae ihti lyruigtegvnhr,icuigWin including hero, given the using player this with games the all from data the over ranges H i steHr akfracranhero, certain a for rank Hero the is n stenme fhre hspae a used. has player this heroes of number the is H ( = T ( = ∑ i n = ∑ 1 i n = K 19 1 n i × H sefcieol hni sgetrta certain, a than greater is it when only effective is i E × i ) U / i n ) . / ∑ H U i n i = stern cr o eti eoo a of hero certain a for score rank the is stenme fgmsti lyrhas player this games of number the is 1 n U K i stenme fgmsteplayer the games of number the is i oeaut igepae’ ability player’s single a evaluate to r h egt o ahtp of type each for weights the are (c) Department of Computer Science, Bishop’s University http://cs.ubishops.ca/research R21-0:Ipoe aac nMlilyrOln ateAeaGmsC un,S .Bruda D. S. Huang, C. Games Arena Battle Online Multiplayer in Balance Improved 2019-003: TR iue1:Fo hr o h da acigsystem. matching ideal the for chart Flow 17: Figure 20 (c) Department of Computer Science, Bishop’s University http://cs.ubishops.ca/research e paei eesd(ihtetaiinlmtosmnindaoe,oecnpc h eoswith heroes the the pick After can month. one last the above), for mentioned hero methods every for traditional latest data the the the (with all that released keep network. assume always neural is to the to update strategy training is the new of method results used accurate the paper and of This accuracy ideal the An data. diminishes which of balanced, type are each heroes updated for (1) data Equation more from and weights environment balanced paper. this better of a contribution for second system the evaluation is This hero more supply. DOTA2. the and as on such better based balanced a already improvement is play an that also game would mature a method in This than games MOBA support. newborn data and in feasible and role still important time is evaluation more this with assumptions), especially inaccurate effective, some computing, simplify updates to further collected this being on is Based value not. Balance or A balanced and data. is features of hero factors. piece their certain unbalanced every a the on if for target based measure weights can to the types standard determine three a to as into used computed original then clustered then With is are network balance. heroes neural measure A to API, DOTA2 and data. DOTA2, it the in makes heroes from unique turn collected 113 data in the quantify which to developed method, been traditional has enough. comprehensive this or in accurate patch not considered next also the not and in analysis are real-time modified Thousands data for be tournaments. unsuitable professional game to in needs players’ behaviour data the millions and on what reports of life determining both players’ even of on balance, and relies method its outstanding playability basically traditional DOTA2 diversity, improving an in the the of As and determines MOBA. ways game, directly mechanics. in study balance a game it and The of DOTA2 achieve and system. on to history rank/matching focus way and development we the data its games, and with balance such game of games, representative of of importance type the MOBA analyzed We the discusses paper This Conclusions and analysis 6 clustering accurate circle. an virtuous a for all supply is data use This to more heroes. players the and all encourage environment bad to directly balanced a evaluation will the has a Therefore system gap for system. matching/rank this evaluation the heroes our and on more of ones, statistics (2) analysis popular to data Equation least the by according on the given time, and than improvement environment same more game the times the on At assess 20 both to played influence (1). possible are Equation heroes it on makes popular based most system evaluation some heroes the different indeed using for ability paper), players’ this of player. contribution single important every available, entertaining most for become The elements will fresh environment. data with balanced more increase, better play, also overall will every an game in for combi- the find, used more of to with be value easier heroes will more are heroes try imbalance more to and Therefore encouraged problems be team. will a Players in system. nations rank DOTA2 the in score rank and value, O R21-0:Ipoe aac nMlilyrOln ateAeaGmsC un,S .Bruda D. S. Huang, C. Games Arena Battle Online Multiplayer in Balance Improved 2019-003: TR stefia akscore, rank final the is nimdaecniuto fti okwudb oivsiaehwt cuaeycluaealthe all calculate accurately to how investigate to be would with work this together of designed, continuation is immediate DOTA2 An for system matching ideal an system, rating Elo the data on of Based types representative three only logs, of worth days (30 data limited on applied Although classification network neural and analysis cluster collection, data of consists which method new A (the system evaluation the of top in bonus a like is above developed system matching improved The players’ a affects that element only the longer no is game the of outcome the improvement, this With ihti au,tgte ihteodfrua ecmueteipoe nlRn sfollows: as Rank final improved the compute we formula, old the with together value, this With k sacntn ofcetgvnb ttsia calculations. statistical by given coefficient constant a is S steodvrinrn cr ae nteEortn system, rating Elo the on based score rank old-version the is O = T 21 × k + S T steHero-Pool the is (2) (c) Department of Computer Science, Bishop’s University http://cs.ubishops.ca/research ait fhre n tm,alo hma h aelvlbtwt ifrn fet.Ol following great Only a References offer ones effects. existing different developed with relatively a the but things as level other well same between as the requires games This MOBA at new them experience. choices. the of both play all can multiple rule items, with this so and do heroes and of plus game buff, variety a stun, damage, wining as of such chance abilities heroes’ to considered. be data to of factor types more same one the as have price Items a and become well. training can as enough system balance With this that believe collection. we It data patches), and “balanced”. 3–4 as thought time set (ideally more standard. version weights train requires new the then method and of can We adjustment “unbalanced” this our as set). that set version noted new version be and old set should the version with (old network sets BP-neural Bruda two D. the into S. them Huang, separate C. and modifications, Games Arena Battle Online Multiplayer in Balance Improved 2019-003: TR M. [17] [16] V [15] D .R E. D. [14] R A. [13] R [12] P D. [11] M L. R. [10] M M M. [9] M B. J. [8] K P. [6] J F. [5] H S. [4] G M. [3] F J. [2] C K. [1] H .K P. H. [7] nal h ups fblnei OAi olteeypae tsmlrsillvlhv similar a have level skill similar at player every let to is MOBA in balance of data for purpose factor the a all, as In considered be should and can items on Data heroes. on focuses only paper This international/overview/. eklySmoimo ahmtclSaitc n rbblt,Uiest fClfri rs,20,p 93. p. 2008, Press, California of University Probability, and Statistics Mathematical on Symposium Berkeley method work errors Science, Computer in Notes Lecture of 6849 vol. 2011), (SSTD 2011. Databases Springer, Temporal and Spatial in vances 2015. Computing, of Faculty Technology, of Institute https://www.polygon.com/2013/9/2/4672920/moba-dota-arts-a-brief-introduction-to-gamings-biggest-most. 2013. December gon, 2013. University, Stanford rep., tech. /board/showthread.php?t=12029. extensions and basics abu nvriy imgn ehrad.https://www.frontiersin.org/research-topics/4817/artificial- Netherlands. Nijmegen, neural-networks-as-models-of-neural-information-processing. University, Radboud 2017. Croatia, Computing, and Engineering Electrical of Faculty 2002. January Minnesota, Minneapolis, Systems, Computing in Factors Human on ence ALVE OIT VAN HNSNAND OHANSSON UNK ANNAN IU AND UIJUN LIG AND OLLINGS NE AND ONLEY OLANCEC RIFFITHS , aue 2 18) p 533–536. pp. (1986), 323 Nature, , AECHLER G h oreegn documentation engine source The RIEGEL UMELHART AC C AMES NRKAND ANDRYK G , ORPORATION ERVEN oa oa rs re nrdcint aigsbget otipntal genre impenetrable most biggest, gaming’s to introduction brief A arts: dota, Moba, Q , ora fSadn nvriyo cec n ehooy 0(01,p 84. p. (2001), 20 Technology, and Science of University Shandong of Journal , UEEN l ecnaeepcac table expectancy percentage Elo , , , .S M. , h dctoa eet fvdogames video of benefits educational The egeo eed acmkn explained matchmaking legends of League .R P. , eeoigmb ae sn h nt aeengine game unity the using games moba Developing .X W. , .P D. , opttoa onain fntrlintelligence natural of foundations Computational .E H E. G. , oemtosfrcasfiainadaayi fmliait observations multivariate of analysis and classification for methods Some .M D. 04 akg eso 1.15.2. version package R 2014. , .W J. OUSSEEUW CHUBERT INHUA ERRY , .S M S. D. h nentoa oa hminhp fca website official championships dota2 international The ORRIS IKSTROM , INTON , o osh a e eomnainegn o ikn eosi oa2 dota in heroes picking for engine recommendation a me? saw he does How eemnto ftewih feauto nee ihatfiilnua net- neural artificial with indexes evaluation of weight the of Determination , ARANAN , aeAcietr n Design and Architecture Game .S A. , AND , , eutpeito ymnn ely ndota2 in replays mining by prediction Result AND .Z A. TRUYF 04 https://developer.valvesoftware.com/wiki/SDK 2014. , , as rpes xlrn yrdbadvdogames board/video hybrid Exploring prophets: False .J W J. R. UFLE ¨ http://www.pradu.us/old/Nov27 . .H M. , 22 , ILLIAMS aaigadmnn utpae niegames online multiplayer mining and Managing UBERT dcto n elh 0(02,p 47. p. (2002), 20 Health, and Education , , 09 http://forums.na.leagueoflegends.com 2009. , erigrpeettosb back-propagating by representations Learning , AND e iesPbihn,2004. Publishing, Riders New , .H K. eateto rica Intelligence, Artificial of Department . eh e. nvriyo Zagreb, of University rep., tech. , ORNIK 2008/Buzz/elotable.html. , atrstei,Blekinge thesis, Master’s , http://www.dota2.com/ . lse:Cutranalysis Cluster Cluster: nPo.5th Proc. in , Docs. nConfer- in , Poly- . nAd- in , , (c) Department of Computer Science, Bishop’s University http://cs.ubishops.ca/research R21-0:Ipoe aac nMlilyrOln ateAeaGmsC un,S .Bruda W D. S. G. Huang, C. B. [18] Games Arena Battle Online Multiplayer in Balance Improved 2019-003: TR nelgneadGms 09 p 140–147. pp. 2009, Games, and Intelligence BRAND EBER .M M. ATEAS , aamnn praht taeyprediction strategy to approach mining data A 23 nPo.Computational Proc. in , (c) Department of Computer Science, Bishop’s University http://cs.ubishops.ca/research ae nteEortn n on and rating Elo the on Based Table Expectancy Percentage Bruda Elo D. S. Huang, C. A Games Arena Battle Online Multiplayer in Balance Improved 2019-003: TR wt h results the with 2 Table from obtained median. be the can as differences 1 score Table Further in 1). (Table [6] Table Expectancy 84-91 77-83 69-76 62-68 54-61 47-53 40-46 33-39 26-32 18-25 11-17 scorers low scorers, for high rate for score rate Expected score = Expected EL = EH difference, Score = SD 4-10 0-3 SD P(D) 0.84 0.85 0.86 0.87 0.88 0.89 0.90 0.91 0.92 0.93 0.94 0.95 0.96 0.97 0.98 0.99 1.00 0.53 0.52 0.51 0.50 0.62 0.61 0.60 0.59 0.58 0.57 0.56 0.55 0.54 EH al :Crepnigepce cr aebsdo crsdifference scores on based rate score expected Corresponding 2: Table al :PD al codn oteEopretg xetnytable. expectancy percentage Elo the to according Table P(D) 1: Table 284 296 309 322 336 351 366 383 401 422 444 470 501 538 589 677 D * 0.38 0.39 0.40 0.41 0.42 0.43 0.44 0.45 0.46 0.47 0.48 0.49 0.50 EL P(D) 0.67 0.68 0.69 0.70 0.71 0.72 0.73 0.74 0.75 0.76 0.77 0.78 0.79 0.80 0.81 0.82 0.83 114-121 107-113 189-197 180-188 171-179 163-170 154-162 146-153 138-145 139-137 122-129 99-106 92-98 SD 125 133 141 149 158 166 175 184 193 202 211 220 230 240 251 262 273 D D = R 0.75 0.74 0.73 0.72 0.71 0.70 0.69 0.68 0.67 0.66 0.65 0.64 0.63 P(D) 0.50 0.51 0.52 0.53 0.54 0.55 0.56 0.57 0.58 0.59 0.60 0.61 0.62 0.63 0.64 0.65 0.66 EH B − R A 0.25 0.26 0.27 0.28 0.29 0.30 0.31 0.32 0.33 0.34 0.35 0.36 0.37 102 110 117 EL , 50 57 65 72 80 87 95 14 21 29 36 43 D 0 7 E A and 24 329-344 316-328 303-315 291-302 279-290 268-278 257-267 246-256 236-245 226-235 216-225 207-215 198-206 P(D) 0.40 0.41 0.42 0.43 0.44 0.45 0.46 0.47 0.48 0.49 0.33 0.34 0.35 0.36 0.37 0.38 0.39 SD E B a eesl opee rmtePercentage the from completed easily be can -125 -117 -110 -102 -72 -65 -57 -50 -43 -36 -29 -21 -14 -95 -87 -80 -7 D 0.88 0.87 0.86 0.85 0.84 0.83 0.82 0.81 0.80 0.79 0.78 0.77 0.76 EH P(D) 0.23 0.24 0.25 0.26 0.27 0.28 0.29 0.30 0.31 0.32 0.16 0.17 0.18 0.19 0.20 0.21 0.22 0.12 0.13 0.14 0.15 0.16 0.17 0.18 0.19 0.20 0.21 0.22 0.23 0.24 EL -211 -202 -193 -184 -175 -166 -158 -149 -141 -133 -284 -273 -262 -251 -240 -230 -220 D 620-735 560-619 518-559 485-517 457-484 433-456 412-432 392-411 375-391 358-374 345-357 735 SD P(D) 0.06 0.07 0.08 0.09 0.10 0.11 0.12 0.13 0.14 0.15 0.00 0.01 0.02 0.03 0.04 0.05 1.00 0.99 0.98 0.97 0.96 0.95 0.94 0.93 0.92 0.91 0.90 0.89 EH -444 -422 -401 -383 -366 -351 -336 -322 -309 -296 -677 -589 -538 -501 -470 D * 0.00 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 0.10 0.11 EL