AIIDE 2022 - maps and game durations
First, win rates for bots x maps. This is identical to the third table in the official results, except for the presentation.
| # | bot | overall | Destin | Heartb | Polari | Aztec | Longin | Circui | Empire | Fighti | Python | Roadki |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | bananabrain | 85.53% | 87% | 87% | 84% | 85% | 90% | 85% | 81% | 85% | 85% | 86% |
| 2 | stardust | 81.48% | 86% | 82% | 86% | 91% | 79% | 88% | 64% | 80% | 80% | 78% |
| 3 | dragon | 66.46% | 67% | 65% | 67% | 65% | 66% | 69% | 69% | 66% | 67% | 64% |
| 4 | steamhammer | 62.71% | 61% | 62% | 66% | 65% | 59% | 65% | 66% | 62% | 60% | 61% |
| 5 | purplewave | 61.17% | 52% | 53% | 62% | 61% | 63% | 62% | 70% | 67% | 63% | 59% |
| 6 | mcrave | 46.79% | 60% | 49% | 45% | 45% | 46% | 42% | 44% | 45% | 46% | 45% |
| 7 | microwave | 46.62% | 47% | 52% | 55% | 43% | 41% | 46% | 46% | 45% | 45% | 45% |
| 8 | ualbertabot | 45.74% | 39% | 45% | 41% | 49% | 47% | 44% | 45% | 48% | 45% | 54% |
| 9 | pylonpuller | 28.91% | 33% | 33% | 12% | 25% | 32% | 28% | 34% | 31% | 31% | 29% |
| 10 | styx | 13.92% | 9% | 10% | 19% | 13% | 13% | 11% | 17% | 10% | 20% | 17% |
| 11 | cunybot | 10.69% | 10% | 11% | 13% | 7% | 13% | 10% | 14% | 10% | 8% | 11% |
Stardust had some trouble on Empire of the Sun, and McRave liked Destination. For the most part, maps did not make a big difference when averaged out over opponents.
game durations
Game durations for bots x maps. The top number in each cell is the median duration of winning games, and the bottom number is for losing games. The overall numbers in the bottom row are the median duration of all games played on each map. The cell coloring is the same as in the table above—it reflects the winning rate, so you can judge by eye the balance of games in the top and bottom numbers.
As a general guideline, if winning games are shorter than losing games then the bot likes to win by early pressure and loses by getting outplayed later. Early pressure costs economy and tech. In the opposite case, the bot defends any early pressure and has stronger play in the long run (it shows any or all of macro, micro, and tech advantage). #8 UAlbertaBot is the most determined rushbot. #3 Dragon is the most prominent defensive bot. #7 Microwave is well-balanced. Note: Adding up the overall median winning times across opponents does not give the same result as adding up the losing times. The median is insensitive to outliers.
| # | bot | overall | Destin | Heartb | Polari | Aztec | Longin | Circui | Empire | Fighti | Python | Roadki |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | bananabrain | 11:25 15:22 | 12:11 15:55 | 11:27 16:21 | 11:21 15:24 | 11:46 19:56 | 11:22 12:48 | 11:20 16:57 | 11:13 13:49 | 11:16 14:38 | 11:11 13:41 | 11:35 14:42 |
| 2 | stardust | 10:34 15:16 | 10:56 16:23 | 10:07 17:05 | 10:54 17:55 | 10:42 18:14 | 10:34 15:13 | 10:51 18:56 | 10:51 0:01 | 10:47 12:51 | 10:03 0:01 | 10:14 14:59 |
| 3 | dragon | 13:57 11:35 | 14:53 12:53 | 14:28 10:22 | 12:52 13:32 | 14:10 12:04 | 13:39 10:13 | 13:57 12:00 | 13:41 12:09 | 13:46 12:37 | 13:23 9:59 | 14:26 10:47 |
| 4 | steamhammer | 8:18 11:23 | 8:47 10:54 | 7:53 11:55 | 7:28 11:45 | 10:12 10:47 | 7:47 11:31 | 9:34 11:43 | 7:50 11:48 | 7:23 11:25 | 8:00 10:49 | 9:17 10:12 |
| 5 | purplewave | 12:09 17:50 | 13:20 17:45 | 13:07 16:45 | 12:31 19:14 | 12:08 20:51 | 12:34 15:48 | 12:09 18:54 | 12:09 16:38 | 11:47 18:24 | 11:53 18:18 | 11:38 17:08 |
| 6 | mcrave | 8:34 12:02 | 9:51 13:06 | 10:30 12:40 | 8:07 13:01 | 7:58 12:11 | 7:39 12:30 | 9:17 11:32 | 8:26 11:40 | 8:53 11:50 | 7:52 11:35 | 8:04 11:41 |
| 7 | microwave | 9:36 9:24 | 10:12 10:02 | 8:51 10:22 | 9:52 10:03 | 10:48 9:18 | 7:15 8:12 | 11:41 11:40 | 10:54 10:22 | 8:53 10:06 | 10:04 8:27 | 9:43 8:27 |
| 8 | ualbertabot | 6:28 10:33 | 8:00 11:18 | 6:39 10:09 | 5:24 10:30 | 6:22 10:48 | 6:18 10:21 | 6:55 10:00 | 6:38 10:26 | 6:28 10:34 | 6:19 10:52 | 6:50 10:41 |
| 9 | pylonpuller | 10:31 11:38 | 10:04 12:13 | 10:51 12:29 | 10:38 6:30 | 10:34 12:03 | 9:47 11:49 | 10:17 11:56 | 10:54 11:55 | 10:30 11:20 | 10:52 11:51 | 10:33 11:21 |
| 10 | styx | 8:28 8:14 | 11:32 8:39 | 9:07 7:38 | 9:10 8:16 | 8:29 8:38 | 8:32 8:03 | 9:21 8:45 | 8:54 8:25 | 7:16 8:09 | 6:44 8:04 | 8:38 8:08 |
| 11 | cunybot | 8:16 9:21 | 9:16 9:33 | 8:05 9:15 | 7:51 8:35 | 7:10 9:56 | 8:13 8:53 | 9:33 9:46 | 8:34 10:05 | 9:46 9:15 | 6:03 10:01 | 8:48 9:00 |
| overall | 10:47 | 11:21 | 10:49 | 10:30 | 10:58 | 10:28 | 11:06 | 10:45 | 10:38 | 10:34 | 10:30 |
The top three bots have consistent winning times across maps. BananaBrain in particular is highly consistent. It seems to indicate a strong and well-executed strategy that wins on schedule. Losing times vary because they depend on what the opponent does after surviving.
The map with the longest game times is Destination. That probably reflects the difficulty of attacking across the twin bridges into the natural. The losing side can often defend until it runs out of resources.
Stardust
The most striking cells in the table are Stardust’s losing times on Empire of the Sun and Python. The time rendered as 0:01 is 33 frames, which is always the point when Stardust crashes, when it does (I checked). Over half the losses on those maps were crashes, so that the median loss was a crash. There were still plenty of wins. Is it due to Stardust crashing on those maps, or to winning so often that the median losing game was a crash? I made a little table of Stardust games which are exactly 33 frames long.
| # | bot | Destin | Heartb | Polari | Aztec | Longin | Circui | Empire | Fighti | Python | Roadki |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 2 | stardust | losses 33 crashes 4 | losses 40 crashes 0 | losses 30 crashes 0 | losses 19 crashes 1 | losses 46 crashes 1 | losses 27 crashes 0 | losses 79 crashes 46 | losses 44 crashes 17 | losses 44 crashes 23 | losses 48 crashes 11 |
Answer: It’s due to Stardust crashing on those maps. The rate of 33-frame games varies extremely by map, though if you ran enough games I imagine it would be non-zero for every map. Four-player maps other than Circuit Breakers have a high crash rate.
Next: Breaking down results by map and opponent.
Trackbacks
No Trackbacks
Comments