SAIL race balance tables
SAIL is still down. I decided to analyze the game data anyway. I grabbed their file of the last 20,000 game results and modified my tournament result analyzer to handle it.
Here is the overall race balance. It’s nice and even. Terran has a little trouble against zerg, and random has a little trouble against protoss, but it’s all within expectations. Of course this averages together bots of all skill levels (at first I typed “kill levels,” which I guess means the same thing). We know that there’s a good mix of participants of each race, so these numbers mean that none of the races is finding its job much easier or harder than the others.
| vT | vP | vZ | vR | |
|---|---|---|---|---|
| terran | 51% | 45% | 52% | |
| protoss | 49% | 49% | 54% | |
| zerg | 55% | 51% | 50% | |
| random | 48% | 46% | 50% |
The table of how each bot performs against the different races is more interesting. This is in alphabetical order, so the number of the left is just to show how many there are. There are few random players, so that column is less informative. (Of course on SAIL, “random” only means that both players learn the bot’s race when the game starts.)
| # | bot | race | games | overall | vT | vP | vZ | vR |
|---|---|---|---|---|---|---|---|---|
| 1 | 100382319 | terran | 40 | 0.00% | 0% | 0% | 0% | 0% |
| 2 | AILien | zerg | 484 | 66.32% | 64% | 65% | 66% | 80% |
| 3 | Alice | zerg | 233 | 19.31% | 18% | 22% | 14% | 32% |
| 4 | AndrewSmith | protoss | 479 | 66.81% | 65% | 72% | 63% | 71% |
| 5 | AndreyKurdiumov | random | 464 | 69.83% | 65% | 70% | 74% | 69% |
| 6 | Antiga | protoss | 472 | 70.97% | 60% | 62% | 83% | 79% |
| 7 | Arrakhammer | zerg | 467 | 65.31% | 69% | 59% | 71% | 53% |
| 8 | AurelienLermant | zerg | 472 | 31.36% | 36% | 38% | 16% | 48% |
| 9 | BananaBrain | protoss | 469 | 73.99% | 69% | 68% | 82% | 80% |
| 10 | Bereaver | protoss | 501 | 71.06% | 73% | 77% | 64% | 72% |
| 11 | BlackCrow | zerg | 459 | 62.09% | 59% | 61% | 68% | 55% |
| 12 | BryanWeber | zerg | 460 | 13.48% | 19% | 14% | 9% | 14% |
| 13 | CarstenNielsen | protoss | 467 | 56.32% | 50% | 57% | 58% | 65% |
| 14 | CasiaBot | zerg | 458 | 51.31% | 62% | 39% | 61% | 24% |
| 15 | CherryPi | zerg | 482 | 76.56% | 75% | 74% | 85% | 57% |
| 16 | ChrisCoxe | zerg | 476 | 70.38% | 79% | 69% | 64% | 79% |
| 17 | Cimex | zerg | 41 | 17.07% | 8% | 21% | 17% | 33% |
| 18 | cpac | zerg | 6 | 66.67% | 100% | 33% | - | - |
| 19 | CruzBot | protoss | 476 | 19.12% | 24% | 26% | 8% | 18% |
| 20 | DAIDOES | protoss | 477 | 27.25% | 17% | 29% | 33% | 25% |
| 21 | DaveChurchill | random | 474 | 60.97% | 57% | 54% | 67% | 76% |
| 22 | DawidLoranc | zerg | 458 | 43.01% | 46% | 43% | 39% | 46% |
| 23 | Ecgberht | terran | 472 | 61.23% | 59% | 68% | 55% | 68% |
| 24 | Flash | protoss | 492 | 60.37% | 45% | 64% | 67% | 61% |
| 25 | FlorianRichoux | protoss | 462 | 36.36% | 43% | 38% | 26% | 54% |
| 26 | ForceBot | zerg | 403 | 48.88% | 44% | 52% | 50% | 46% |
| 27 | GaoyuanChen | protoss | 481 | 44.49% | 50% | 46% | 39% | 45% |
| 28 | Goliat | terran | 43 | 11.63% | 12% | 18% | 0% | 0% |
| 29 | GuiBot | protoss | 50 | 32.00% | 36% | 28% | 45% | 0% |
| 30 | HannesBredberg | terran | 443 | 31.15% | 37% | 31% | 21% | 53% |
| 31 | HOLDZ | zerg | 340 | 20.00% | 33% | 22% | 7% | 26% |
| 32 | ICELab | terran | 481 | 64.03% | 73% | 79% | 43% | 71% |
| 33 | Ironbot | terran | 485 | 89.48% | 88% | 96% | 85% | 88% |
| 34 | JakubTrancik | protoss | 481 | 34.93% | 43% | 41% | 22% | 46% |
| 35 | JohanKayser | terran | 486 | 17.28% | 12% | 23% | 17% | 12% |
| 36 | Juno | protoss | 4 | 50.00% | - | 100% | 0% | 100% |
| 37 | KaonBot | terran | 460 | 31.30% | 37% | 38% | 22% | 32% |
| 38 | KillAlll | zerg | 481 | 53.01% | 59% | 64% | 37% | 54% |
| 39 | Korean | zerg | 478 | 20.50% | 25% | 30% | 7% | 29% |
| 40 | krasi0 | terran | 495 | 94.34% | 95% | 98% | 91% | 91% |
| 41 | Kruecke | terran | 41 | 24.39% | 43% | 31% | 0% | 0% |
| 42 | Locutus | protoss | 321 | 73.21% | 79% | 66% | 77% | 73% |
| 43 | LukasMoravec | protoss | 472 | 31.99% | 40% | 29% | 29% | 40% |
| 44 | MadMixP | protoss | 484 | 48.35% | 50% | 46% | 47% | 62% |
| 45 | MadMixT | terran | 452 | 30.75% | 46% | 28% | 22% | 29% |
| 46 | MadMixZ | zerg | 471 | 32.06% | 36% | 32% | 31% | 24% |
| 47 | MarekKadek | terran | 472 | 20.13% | 12% | 17% | 29% | 22% |
| 48 | MarianDevecka | zerg | 463 | 83.59% | 87% | 85% | 85% | 69% |
| 49 | MarineHell | terran | 483 | 23.60% | 13% | 29% | 22% | 29% |
| 50 | MartinRooijackers | terran | 455 | 67.91% | 52% | 81% | 69% | 61% |
| 51 | MatejIstenik | terran | 465 | 31.61% | 33% | 31% | 29% | 41% |
| 52 | MegaBot2017 | protoss | 442 | 49.32% | 60% | 53% | 38% | 47% |
| 53 | Microwave | zerg | 466 | 76.82% | 76% | 77% | 76% | 84% |
| 54 | MiddleSchoolStrats | zerg | 288 | 48.96% | 62% | 42% | 47% | 56% |
| 55 | Myscbot | protoss | 473 | 34.04% | 22% | 31% | 44% | 34% |
| 56 | NeoEdmundZerg | zerg | 475 | 73.05% | 74% | 68% | 74% | 83% |
| 57 | NielsJustesen | protoss | 315 | 31.43% | 35% | 30% | 29% | 34% |
| 58 | NiteKatP | protoss | 458 | 33.84% | 33% | 19% | 49% | 34% |
| 59 | NiteKatT | terran | 458 | 56.11% | 63% | 56% | 51% | 62% |
| 60 | NLPRbot | zerg | 460 | 62.83% | 82% | 45% | 61% | 70% |
| 61 | NUSBot | protoss | 500 | 23.60% | 40% | 18% | 16% | 25% |
| 62 | OpprimoBot | random | 308 | 13.31% | 14% | 18% | 7% | 13% |
| 63 | PeregrineBot | zerg | 471 | 45.01% | 55% | 48% | 39% | 28% |
| 64 | PineappleCactus | zerg | 490 | 38.78% | 40% | 34% | 41% | 42% |
| 65 | PurpleSpirit | terran | 441 | 50.34% | 58% | 47% | 50% | 46% |
| 66 | PurpleSwarm | zerg | 451 | 69.84% | 60% | 69% | 79% | 61% |
| 67 | PurpleWave | protoss | 456 | 80.04% | 73% | 84% | 82% | 74% |
| 68 | Randomhammer | random | 496 | 55.65% | 62% | 42% | 66% | 33% |
| 69 | RomanDanielis | protoss | 489 | 32.92% | 27% | 33% | 34% | 42% |
| 70 | SijiaXu | zerg | 479 | 57.83% | 56% | 59% | 60% | 49% |
| 71 | SimonPrins | terran | 446 | 72.20% | 61% | 79% | 74% | 74% |
| 72 | Sling | zerg | 509 | 26.52% | 15% | 34% | 25% | 37% |
| 73 | SoerenKlett | terran | 455 | 49.01% | 58% | 55% | 36% | 56% |
| 74 | Sparks | terran | 474 | 35.23% | 42% | 38% | 28% | 38% |
| 75 | SRbotOne | terran | 4 | 25.00% | 100% | 0% | 0% | - |
| 76 | Steamhammer | zerg | 466 | 76.18% | 85% | 70% | 80% | 58% |
| 77 | Stone | terran | 481 | 53.22% | 34% | 65% | 55% | 53% |
| 78 | SunggukCha | terran | 463 | 35.42% | 54% | 31% | 25% | 42% |
| 79 | TomasCere | protoss | 485 | 36.91% | 47% | 38% | 29% | 37% |
| 80 | TomasVajda | protoss | 459 | 72.11% | 62% | 81% | 72% | 74% |
| 81 | TravisShelton | random | 536 | 12.50% | 13% | 11% | 13% | 10% |
| 82 | tscmoo | terran | 489 | 72.39% | 83% | 58% | 80% | 72% |
| 83 | tscmoop | protoss | 468 | 75.64% | 78% | 76% | 73% | 78% |
| 84 | tscmoor | random | 485 | 74.85% | 81% | 74% | 68% | 91% |
| 85 | tscmooz | zerg | 446 | 54.48% | 71% | 53% | 42% | 61% |
| 86 | TyrProtoss | protoss | 477 | 67.51% | 53% | 63% | 78% | 97% |
| 87 | UC3ManoloBot | terran | 36 | 2.78% | 10% | 0% | 0% | 0% |
| 88 | UPStarCraftAI2016 | zerg | 451 | 39.25% | 49% | 46% | 27% | 34% |
| 89 | WillBot | random | 521 | 44.53% | 39% | 50% | 45% | 38% |
| 90 | WillyT | terran | 140 | 42.86% | 37% | 44% | 48% | 33% |
| 91 | WuliBot | protoss | 486 | 72.02% | 58% | 77% | 76% | 78% |
| 92 | Xelnaga | protoss | 456 | 32.24% | 38% | 36% | 25% | 30% |
| 93 | YuanhengZhu | protoss | 488 | 37.91% | 44% | 41% | 28% | 51% |
| 94 | Zercgberht | zerg | 471 | 35.03% | 37% | 39% | 31% | 30% |
| 95 | Ziabot | zerg | 478 | 53.97% | 51% | 51% | 60% | 50% |
| 96 | ZurZurZur | zerg | 483 | 61.08% | 63% | 53% | 68% | 59% |
A lot of interesting details can be seen in which bot is better against which race. Iron does well against all races, but smashes protoss into the ground. I find it surprising that MarineHell scores better against protoss. Zerg KillAlll has a striking pattern in that it does well against terran and protoss, and can’t cope with another zerg. Zerg NLPRbot does much better against terran.
I’m pleased with Steamhammer’s numbers. In the last AIIDE tournament, Steamhammer played well against zerg, but unconvincingly against terran and protoss. This version looks good against all races, though still weaker against protoss.
Next: Data broken down by map.
Trackbacks
No Trackbacks
Comments
MicroDK on :