SAIL bots and maps
More SAIL data: How well each bot performed on each map.
| games | overall | Benzen | Destin | Heartb | NeoMoo | TauCro | Androm | Circui | Empire | Fighti | Icarus | Jade | LaManc | Python | Roadru | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 100382319 | 40 | 0.00% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | - | 0% | 0% |
| AILien | 484 | 66.32% | 50% | 52% | 66% | 70% | 64% | 69% | 76% | 62% | 76% | 61% | 73% | 69% | 64% | 71% |
| Alice | 233 | 19.31% | 20% | 7% | 16% | 24% | 24% | 40% | 9% | 24% | 19% | 14% | 23% | 13% | 15% | 28% |
| AndrewSmith | 479 | 66.81% | 56% | 67% | 74% | 62% | 69% | 68% | 77% | 79% | 51% | 79% | 61% | 59% | 64% | 71% |
| AndreyKurdiumov | 464 | 69.83% | 61% | 54% | 71% | 79% | 75% | 67% | 69% | 71% | 67% | 71% | 74% | 76% | 77% | 70% |
| Antiga | 472 | 70.97% | 73% | 74% | 69% | 70% | 66% | 60% | 72% | 86% | 74% | 69% | 57% | 62% | 78% | 86% |
| Arrakhammer | 467 | 65.31% | 62% | 56% | 68% | 70% | 73% | 59% | 64% | 64% | 61% | 62% | 75% | 65% | 66% | 73% |
| AurelienLermant | 472 | 31.36% | 38% | 45% | 35% | 18% | 35% | 24% | 18% | 25% | 32% | 37% | 31% | 32% | 38% | 36% |
| BananaBrain | 469 | 73.99% | 61% | 66% | 71% | 67% | 85% | 70% | 79% | 78% | 76% | 78% | 70% | 78% | 81% | 70% |
| Bereaver | 501 | 71.06% | 88% | 75% | 66% | 85% | 62% | 74% | 79% | 63% | 78% | 80% | 56% | 51% | 56% | 80% |
| BlackCrow | 459 | 62.09% | 62% | 45% | 63% | 75% | 52% | 56% | 59% | 74% | 56% | 63% | 73% | 62% | 55% | 73% |
| BryanWeber | 460 | 13.48% | 19% | 3% | 18% | 14% | 8% | 16% | 17% | 8% | 12% | 19% | 17% | 30% | 8% | 7% |
| CarstenNielsen | 467 | 56.32% | 37% | 55% | 58% | 44% | 63% | 58% | 50% | 70% | 56% | 51% | 50% | 56% | 70% | 68% |
| CasiaBot | 458 | 51.31% | 55% | 58% | 52% | 50% | 48% | 48% | 41% | 55% | 51% | 48% | 62% | 52% | 50% | 46% |
| CherryPi | 482 | 76.56% | 84% | 88% | 74% | 73% | 83% | 82% | 67% | 85% | 78% | 76% | 69% | 83% | 70% | 67% |
| ChrisCoxe | 476 | 70.38% | 56% | 64% | 80% | 83% | 62% | 67% | 66% | 55% | 61% | 80% | 79% | 69% | 88% | 72% |
| Cimex | 41 | 17.07% | 0% | 20% | 0% | - | 50% | 0% | 0% | 0% | 50% | 0% | 33% | 33% | 0% | 33% |
| cpac | 6 | 66.67% | 100% | - | 67% | - | - | - | - | 100% | - | - | 0% | - | - | - |
| CruzBot | 476 | 19.12% | 18% | 26% | 18% | 26% | 18% | 26% | 14% | 19% | 11% | 26% | 10% | 12% | 17% | 24% |
| DAIDOES | 477 | 27.25% | 21% | 26% | 12% | 8% | 32% | 37% | 33% | 27% | 40% | 26% | 29% | 26% | 30% | 37% |
| DaveChurchill | 474 | 60.97% | 63% | 59% | 64% | 69% | 59% | 65% | 58% | 65% | 63% | 63% | 63% | 49% | 48% | 63% |
| DawidLoranc | 458 | 43.01% | 49% | 57% | 34% | 57% | 33% | 54% | 27% | 57% | 39% | 44% | 42% | 38% | 44% | 32% |
| Ecgberht | 472 | 61.23% | 57% | 66% | 52% | 64% | 56% | 65% | 62% | 60% | 74% | 55% | 65% | 71% | 48% | 67% |
| Flash | 492 | 60.37% | 63% | 61% | 48% | 63% | 68% | 78% | 50% | 50% | 70% | 62% | 53% | 53% | 61% | 61% |
| FlorianRichoux | 462 | 36.36% | 58% | 25% | 43% | 31% | 26% | 41% | 36% | 31% | 32% | 34% | 45% | 30% | 41% | 40% |
| ForceBot | 403 | 48.88% | 55% | 57% | 40% | 41% | 43% | 52% | 45% | 56% | 49% | 37% | 58% | 55% | 42% | 55% |
| GaoyuanChen | 481 | 44.49% | 29% | 46% | 40% | 51% | 42% | 45% | 50% | 53% | 51% | 48% | 41% | 39% | 44% | 39% |
| Goliat | 43 | 11.63% | 0% | 0% | 0% | 25% | 20% | 0% | 33% | 0% | 0% | 14% | 0% | 0% | 100% | 0% |
| GuiBot | 50 | 32.00% | 0% | 0% | 50% | 50% | 33% | 33% | 20% | 43% | 100% | 20% | 40% | 67% | 0% | 50% |
| HannesBredberg | 443 | 31.15% | 32% | 40% | 44% | 37% | 22% | 33% | 32% | 23% | 28% | 29% | 35% | 45% | 21% | 19% |
| HOLDZ | 340 | 20.00% | 6% | 12% | 18% | 30% | 20% | 9% | 33% | 17% | 24% | 24% | 24% | 15% | 35% | 14% |
| ICELab | 481 | 64.03% | 52% | 67% | 56% | 59% | 57% | 78% | 57% | 71% | 65% | 72% | 76% | 73% | 53% | 61% |
| Ironbot | 485 | 89.48% | 94% | 81% | 92% | 91% | 91% | 95% | 88% | 95% | 81% | 90% | 87% | 84% | 94% | 89% |
| JakubTrancik | 481 | 34.93% | 54% | 35% | 37% | 38% | 35% | 48% | 38% | 9% | 21% | 39% | 40% | 42% | 25% | 26% |
| JohanKayser | 486 | 17.28% | 14% | 14% | 10% | 36% | 21% | 29% | 21% | 15% | 11% | 14% | 16% | 4% | 24% | 6% |
| Juno | 4 | 50.00% | - | - | - | - | 50% | 0% | 100% | - | - | - | - | - | - | - |
| KaonBot | 460 | 31.30% | 39% | 28% | 34% | 32% | 44% | 15% | 29% | 33% | 40% | 24% | 30% | 38% | 22% | 31% |
| KillAlll | 481 | 53.01% | 45% | 63% | 55% | 57% | 52% | 44% | 56% | 64% | 59% | 45% | 56% | 59% | 39% | 45% |
| Korean | 478 | 20.50% | 22% | 18% | 32% | 27% | 25% | 0% | 31% | 0% | 26% | 33% | 21% | 21% | 0% | 31% |
| krasi0 | 495 | 94.34% | 95% | 94% | 94% | 89% | 95% | 90% | 90% | 97% | 97% | 94% | 97% | 100% | 93% | 97% |
| Kruecke | 41 | 24.39% | 0% | 0% | 0% | 33% | 0% | 33% | 67% | 50% | 0% | 33% | 0% | 50% | 0% | 50% |
| Locutus | 321 | 73.21% | 80% | 82% | 77% | 59% | 78% | 74% | 71% | 68% | 85% | 60% | 81% | 61% | 77% | 76% |
| LukasMoravec | 472 | 31.99% | 45% | 26% | 20% | 38% | 28% | 32% | 38% | 30% | 29% | 30% | 37% | 23% | 39% | 29% |
| MadMixP | 484 | 48.35% | 45% | 58% | 48% | 46% | 41% | 36% | 52% | 38% | 42% | 50% | 59% | 61% | 53% | 46% |
| MadMixT | 452 | 30.75% | 29% | 29% | 28% | 24% | 31% | 32% | 25% | 31% | 33% | 28% | 28% | 46% | 34% | 28% |
| MadMixZ | 471 | 32.06% | 40% | 23% | 26% | 27% | 38% | 39% | 46% | 26% | 41% | 33% | 19% | 19% | 31% | 29% |
| MarekKadek | 472 | 20.13% | 12% | 21% | 17% | 12% | 25% | 21% | 26% | 29% | 10% | 24% | 26% | 15% | 19% | 30% |
| MarianDevecka | 463 | 83.59% | 85% | 85% | 82% | 91% | 77% | 78% | 77% | 84% | 87% | 89% | 93% | 86% | 76% | 84% |
| MarineHell | 483 | 23.60% | 25% | 15% | 25% | 21% | 23% | 35% | 19% | 21% | 28% | 16% | 14% | 31% | 33% | 21% |
| MartinRooijackers | 455 | 67.91% | 67% | 70% | 71% | 69% | 72% | 77% | 64% | 66% | 64% | 66% | 69% | 72% | 68% | 59% |
| MatejIstenik | 465 | 31.61% | 32% | 39% | 29% | 31% | 50% | 33% | 25% | 38% | 23% | 42% | 16% | 25% | 36% | 26% |
| MegaBot2017 | 442 | 49.32% | 42% | 58% | 41% | 47% | 56% | 53% | 45% | 63% | 61% | 45% | 26% | 57% | 43% | 57% |
| Microwave | 466 | 76.82% | 86% | 72% | 69% | 78% | 78% | 87% | 88% | 68% | 80% | 66% | 79% | 84% | 71% | 70% |
| MiddleSchoolStrats | 288 | 48.96% | 39% | 67% | 67% | 50% | 55% | 43% | 54% | 39% | 39% | 41% | 43% | 43% | 59% | 38% |
| Myscbot | 473 | 34.04% | 57% | 60% | 31% | 25% | 27% | 24% | 34% | 36% | 46% | 6% | 35% | 29% | 27% | 44% |
| NeoEdmundZerg | 475 | 73.05% | 80% | 74% | 64% | 76% | 69% | 81% | 66% | 70% | 69% | 75% | 78% | 81% | 80% | 57% |
| NielsJustesen | 315 | 31.43% | 19% | 22% | 22% | 50% | 24% | 46% | 32% | 30% | 32% | 30% | 39% | 36% | 25% | 40% |
| NiteKatP | 458 | 33.84% | 29% | 36% | 41% | 27% | 45% | 24% | 34% | 41% | 36% | 18% | 27% | 55% | 28% | 29% |
| NiteKatT | 458 | 56.11% | 50% | 80% | 55% | 45% | 62% | 53% | 58% | 48% | 58% | 60% | 61% | 35% | 62% | 63% |
| NLPRbot | 460 | 62.83% | 66% | 70% | 63% | 56% | 65% | 57% | 85% | 70% | 54% | 63% | 67% | 48% | 63% | 59% |
| NUSBot | 500 | 23.60% | 23% | 34% | 0% | 34% | 27% | 31% | 21% | 22% | 31% | 11% | 37% | 23% | 29% | 8% |
| OpprimoBot | 308 | 13.31% | 12% | 6% | 11% | 9% | 12% | 8% | 22% | 13% | 21% | 19% | 10% | 19% | 13% | 14% |
| PeregrineBot | 471 | 45.01% | 39% | 48% | 34% | 48% | 52% | 52% | 47% | 50% | 35% | 50% | 47% | 36% | 49% | 45% |
| PineappleCactus | 490 | 38.78% | 21% | 27% | 46% | 31% | 45% | 40% | 39% | 45% | 27% | 40% | 43% | 55% | 36% | 48% |
| PurpleSpirit | 441 | 50.34% | 48% | 48% | 53% | 50% | 47% | 51% | 44% | 60% | 41% | 61% | 35% | 57% | 68% | 44% |
| PurpleSwarm | 451 | 69.84% | 79% | 59% | 70% | 65% | 67% | 69% | 84% | 70% | 74% | 76% | 69% | 60% | 76% | 57% |
| PurpleWave | 456 | 80.04% | 69% | 78% | 75% | 85% | 87% | 82% | 82% | 74% | 82% | 85% | 81% | 80% | 82% | 74% |
| Randomhammer | 496 | 55.65% | 59% | 68% | 64% | 69% | 53% | 57% | 45% | 56% | 50% | 59% | 50% | 42% | 74% | 42% |
| RomanDanielis | 489 | 32.92% | 24% | 29% | 17% | 33% | 39% | 42% | 30% | 25% | 38% | 32% | 42% | 21% | 47% | 36% |
| SijiaXu | 479 | 57.83% | 57% | 51% | 56% | 61% | 59% | 54% | 53% | 60% | 57% | 53% | 61% | 54% | 64% | 68% |
| SimonPrins | 446 | 72.20% | 79% | 79% | 61% | 69% | 57% | 70% | 82% | 64% | 74% | 63% | 76% | 73% | 73% | 84% |
| Sling | 509 | 26.52% | 32% | 22% | 29% | 28% | 17% | 33% | 25% | 22% | 40% | 11% | 22% | 30% | 25% | 33% |
| SoerenKlett | 455 | 49.01% | 55% | 38% | 49% | 39% | 44% | 47% | 55% | 50% | 42% | 61% | 53% | 27% | 56% | 58% |
| Sparks | 474 | 35.23% | 35% | 28% | 37% | 45% | 42% | 38% | 33% | 41% | 32% | 26% | 31% | 33% | 32% | 42% |
| SRbotOne | 4 | 25.00% | - | 0% | - | 0% | 0% | - | - | - | - | - | - | - | 100% | - |
| Steamhammer | 466 | 76.18% | 84% | 72% | 81% | 65% | 70% | 86% | 67% | 81% | 81% | 82% | 73% | 71% | 76% | 78% |
| Stone | 481 | 53.22% | 68% | 64% | 69% | 40% | 44% | 39% | 45% | 57% | 55% | 59% | 56% | 48% | 63% | 51% |
| SunggukCha | 463 | 35.42% | 38% | 31% | 37% | 35% | 28% | 36% | 31% | 38% | 41% | 36% | 38% | 39% | 29% | 38% |
| TomasCere | 485 | 36.91% | 38% | 30% | 19% | 31% | 28% | 34% | 53% | 39% | 30% | 34% | 56% | 45% | 44% | 31% |
| TomasVajda | 459 | 72.11% | 55% | 90% | 74% | 71% | 65% | 72% | 78% | 79% | 69% | 74% | 73% | 73% | 73% | 63% |
| TravisShelton | 536 | 12.50% | 19% | 10% | 5% | 13% | 9% | 17% | 12% | 17% | 5% | 18% | 14% | 18% | 16% | 7% |
| tscmoo | 489 | 72.39% | 80% | 77% | 74% | 63% | 77% | 69% | 73% | 68% | 82% | 76% | 63% | 79% | 68% | 67% |
| tscmoop | 468 | 75.64% | 82% | 73% | 76% | 79% | 81% | 73% | 83% | 66% | 78% | 75% | 57% | 76% | 69% | 86% |
| tscmoor | 485 | 74.85% | 84% | 77% | 76% | 80% | 72% | 71% | 78% | 76% | 84% | 67% | 68% | 66% | 87% | 61% |
| tscmooz | 446 | 54.48% | 46% | 57% | 53% | 45% | 61% | 61% | 62% | 59% | 52% | 59% | 50% | 57% | 48% | 54% |
| TyrProtoss | 477 | 67.51% | 82% | 43% | 57% | 62% | 75% | 67% | 72% | 86% | 72% | 71% | 68% | 63% | 57% | 70% |
| UC3ManoloBot | 36 | 2.78% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 50% | 0% | 0% | 0% | 0% | 0% | 0% |
| UPStarCraftAI2016 | 451 | 39.25% | 35% | 37% | 52% | 39% | 54% | 33% | 31% | 33% | 50% | 50% | 30% | 36% | 32% | 45% |
| WillBot | 521 | 44.53% | 49% | 43% | 39% | 50% | 40% | 38% | 57% | 43% | 52% | 49% | 38% | 45% | 33% | 50% |
| WillyT | 140 | 42.86% | 60% | 45% | 29% | 60% | 100% | 43% | 0% | 22% | 21% | 50% | 50% | 78% | 31% | 50% |
| WuliBot | 486 | 72.02% | 65% | 72% | 79% | 78% | 76% | 79% | 67% | 57% | 73% | 66% | 74% | 78% | 66% | 74% |
| Xelnaga | 456 | 32.24% | 26% | 43% | 40% | 31% | 32% | 18% | 24% | 38% | 42% | 25% | 33% | 28% | 44% | 20% |
| YuanhengZhu | 488 | 37.91% | 28% | 24% | 28% | 40% | 38% | 36% | 46% | 37% | 41% | 60% | 46% | 24% | 36% | 46% |
| Zercgberht | 471 | 35.03% | 32% | 48% | 32% | 40% | 31% | 29% | 23% | 37% | 31% | 28% | 28% | 49% | 40% | 39% |
| Ziabot | 478 | 53.97% | 50% | 46% | 70% | 39% | 65% | 53% | 57% | 51% | 57% | 50% | 52% | 48% | 62% | 65% |
| ZurZurZur | 483 | 61.08% | 61% | 60% | 73% | 73% | 58% | 61% | 55% | 61% | 62% | 67% | 67% | 53% | 58% | 52% |
Many bots show dramatic performance differences between maps. The differences definitely mean something, even though I often find it hard to say what. What in your bot’s play interacts well or poorly with the map features? If your bot performs poorly on a given map, maybe it should choose a different strategy there. But it’s possible that the reason has to do with specific opponents, and you have to dig into details to find the answer.
Steamhammer’s results surprised me. I think of Heartbreak Ridge as Steamhammer’s worst map, but these numbers say it is a good map. After I fix the map block issues on the map, which will probably be in the version after next, maybe Heartbreak Ridge will become Steamhammer’s best map. In any case, the next version will try to adjust its play for each opponent according to the map, once it accumulates enough data from experience. It will be interesting to see whether that successfully evens out the performance across maps.
Next: Map balance.
Trackbacks
No Trackbacks
Comments
WillBotSC on :
i fear the sample size still isn't enough to draw too many conclusions. I compared the values with the SSCAIT values (bot statistic) for my original random bot. Best map on sail CB 57 %, on sscait 52 % (-> would be OK). Best map on sscait HBR with 60 %, on sail only 39 % (-> not OK). Worst map here Python with 33 %, on sscait with 42 % and not the worst (-> not OK).
Jay Scott on :
WillBotSC on :
krasi0 on :