CoG 2022 results by map
I excluded BetaStar from the analysis, since it contributed no information. Everybody else’s winning rate is reduced compared to the official results, because they don’t have all the meaningless free wins.
The map pool is: (2)Benzene, (2)Eclipse, (2)Match Point, (3)Neo Aztec, (3)Neo Sylphid, (3)Outsider, (4)Circuit Breakers, (4)Fighting Spirit, (4)Polypoid. That’s three maps of each size.
| overall | Benzen | Eclips | MatchP | NeoAzt | NeoSyl | Outsid | Circui | Fighti | Polypo | |
|---|---|---|---|---|---|---|---|---|---|---|
| #1 BananaBrain | 82.96% | 77% | 87% | 86% | 88% | 86% | 83% | 81% | 77% | 80% |
| #2 PurpleWave | 71.11% | 69% | 73% | 70% | 65% | 72% | 72% | 71% | 75% | 73% |
| #3 Stardust | 68.89% | 76% | 65% | 65% | 65% | 65% | 70% | 74% | 67% | 72% |
| #4 McRave | 63.37% | 68% | 64% | 68% | 64% | 62% | 57% | 58% | 67% | 61% |
| #5 Microwave | 37.63% | 38% | 39% | 40% | 40% | 38% | 40% | 37% | 32% | 34% |
| #6 XIAOYI | 24.63% | 21% | 20% | 21% | 26% | 25% | 27% | 28% | 28% | 26% |
| #7 CUNYBot | 1.41% | 1% | 3% | 0% | 2% | 1% | 1% | 1% | 3% | 2% |
Results are nice and even for every bot. Averaged out over all opponents, the map did not make a great difference for any bot.
Against specific opponents, the map did matter. I included the count of wins/games in each cell so you can see how much data there is. CoG ran far more games this year than last, so it’s much easier to trust the results at the level of individual cells in the tables.
| BananaBrain | overall | Benzen | Eclips | MatchP | NeoAzt | NeoSyl | Outsid | Circui | Fighti | Polypo |
|---|---|---|---|---|---|---|---|---|---|---|
| PurpleWave | 357/450 79% | 35/50 70% | 42/50 84% | 43/50 86% | 47/50 94% | 44/50 88% | 44/50 88% | 31/50 62% | 35/50 70% | 36/50 72% |
| Stardust | 269/450 60% | 16/50 32% | 44/50 88% | 34/50 68% | 33/50 66% | 32/50 64% | 27/50 54% | 37/50 74% | 22/50 44% | 24/50 48% |
| McRave | 312/450 69% | 37/50 74% | 33/50 66% | 35/50 70% | 39/50 78% | 41/50 82% | 29/50 58% | 34/50 68% | 29/50 58% | 35/50 70% |
| Microwave | 404/450 90% | 43/50 86% | 42/50 84% | 47/50 94% | 45/50 90% | 42/50 84% | 49/50 98% | 42/50 84% | 48/50 96% | 46/50 92% |
| XIAOYI | 450/450 100% | 50/50 100% | 50/50 100% | 50/50 100% | 50/50 100% | 50/50 100% | 50/50 100% | 50/50 100% | 50/50 100% | 50/50 100% |
| CUNYBot | 448/450 100% | 50/50 100% | 50/50 100% | 50/50 100% | 50/50 100% | 50/50 100% | 50/50 100% | 50/50 100% | 48/50 96% | 50/50 100% |
| overall | 82.96% | 77% | 87% | 86% | 88% | 86% | 83% | 81% | 77% | 80% |
BananaBrain’s skill against Stardust depends strongly on the map.
| PurpleWave | overall | Benzen | Eclips | MatchP | NeoAzt | NeoSyl | Outsid | Circui | Fighti | Polypo |
|---|---|---|---|---|---|---|---|---|---|---|
| BananaBrain | 93/450 21% | 15/50 30% | 8/50 16% | 7/50 14% | 3/50 6% | 6/50 12% | 6/50 12% | 19/50 38% | 15/50 30% | 14/50 28% |
| Stardust | 376/450 84% | 31/50 62% | 47/50 94% | 40/50 80% | 47/50 94% | 46/50 92% | 48/50 96% | 31/50 62% | 44/50 88% | 42/50 84% |
| McRave | 247/450 55% | 20/50 40% | 23/50 46% | 26/50 52% | 26/50 52% | 34/50 68% | 35/50 70% | 25/50 50% | 31/50 62% | 27/50 54% |
| Microwave | 331/450 74% | 42/50 84% | 44/50 88% | 41/50 82% | 24/50 48% | 31/50 62% | 29/50 58% | 40/50 80% | 40/50 80% | 40/50 80% |
| XIAOYI | 438/450 97% | 49/50 98% | 50/50 100% | 45/50 90% | 49/50 98% | 50/50 100% | 49/50 98% | 48/50 96% | 49/50 98% | 49/50 98% |
| CUNYBot | 435/450 97% | 49/50 98% | 47/50 94% | 50/50 100% | 47/50 94% | 49/50 98% | 49/50 98% | 49/50 98% | 47/50 94% | 48/50 96% |
| overall | 71.11% | 69% | 73% | 70% | 65% | 72% | 72% | 71% | 75% | 73% |
PurpleWave’s results against Stardust also vary strongly by map. The cause is presumably Stardust: In PvP games, its strategy is much better suited for some maps than others. But BananaBrain and PurpleWave differ in their ability to exploit the weaknesses.
| Stardust | overall | Benzen | Eclips | MatchP | NeoAzt | NeoSyl | Outsid | Circui | Fighti | Polypo |
|---|---|---|---|---|---|---|---|---|---|---|
| BananaBrain | 181/450 40% | 34/50 68% | 6/50 12% | 16/50 32% | 17/50 34% | 18/50 36% | 23/50 46% | 13/50 26% | 28/50 56% | 26/50 52% |
| PurpleWave | 74/450 16% | 19/50 38% | 3/50 6% | 10/50 20% | 3/50 6% | 4/50 8% | 2/50 4% | 19/50 38% | 6/50 12% | 8/50 16% |
| McRave | 311/450 69% | 25/50 50% | 43/50 86% | 29/50 58% | 35/50 70% | 29/50 58% | 45/50 90% | 41/50 82% | 27/50 54% | 37/50 74% |
| Microwave | 404/450 90% | 50/50 100% | 43/50 86% | 41/50 82% | 44/50 88% | 47/50 94% | 41/50 82% | 48/50 96% | 44/50 88% | 46/50 92% |
| XIAOYI | 442/450 98% | 50/50 100% | 50/50 100% | 50/50 100% | 47/50 94% | 48/50 96% | 50/50 100% | 50/50 100% | 47/50 94% | 50/50 100% |
| CUNYBot | 448/450 100% | 50/50 100% | 50/50 100% | 50/50 100% | 49/50 98% | 49/50 98% | 50/50 100% | 50/50 100% | 50/50 100% | 50/50 100% |
| overall | 68.89% | 76% | 65% | 65% | 65% | 65% | 70% | 74% | 67% | 72% |
And again, Stardust varies strongly versus McRave with its mutalisks. It may have to do with hard-to-see details like Stardust’s building placement on each map, or the timing of Stardust’s fixed strategy. The remaining opponents are not strong enough to stress Stardust, so results don’t vary as much.
| McRave | overall | Benzen | Eclips | MatchP | NeoAzt | NeoSyl | Outsid | Circui | Fighti | Polypo |
|---|---|---|---|---|---|---|---|---|---|---|
| BananaBrain | 138/450 31% | 13/50 26% | 17/50 34% | 15/50 30% | 11/50 22% | 9/50 18% | 21/50 42% | 16/50 32% | 21/50 42% | 15/50 30% |
| PurpleWave | 203/450 45% | 30/50 60% | 27/50 54% | 24/50 48% | 24/50 48% | 16/50 32% | 15/50 30% | 25/50 50% | 19/50 38% | 23/50 46% |
| Stardust | 139/450 31% | 25/50 50% | 7/50 14% | 21/50 42% | 15/50 30% | 21/50 42% | 5/50 10% | 9/50 18% | 23/50 46% | 13/50 26% |
| Microwave | 418/450 93% | 45/50 90% | 49/50 98% | 45/50 90% | 48/50 96% | 48/50 96% | 50/50 100% | 44/50 88% | 45/50 90% | 44/50 88% |
| XIAOYI | 364/450 81% | 41/50 82% | 41/50 82% | 49/50 98% | 45/50 90% | 43/50 86% | 31/50 62% | 32/50 64% | 44/50 88% | 38/50 76% |
| CUNYBot | 449/450 100% | 50/50 100% | 50/50 100% | 50/50 100% | 50/50 100% | 50/50 100% | 50/50 100% | 49/50 98% | 50/50 100% | 50/50 100% |
| overall | 63.37% | 68% | 64% | 68% | 64% | 62% | 57% | 58% | 67% | 61% |
| Microwave | overall | Benzen | Eclips | MatchP | NeoAzt | NeoSyl | Outsid | Circui | Fighti | Polypo |
|---|---|---|---|---|---|---|---|---|---|---|
| BananaBrain | 46/450 10% | 7/50 14% | 8/50 16% | 3/50 6% | 5/50 10% | 8/50 16% | 1/50 2% | 8/50 16% | 2/50 4% | 4/50 8% |
| PurpleWave | 119/450 26% | 8/50 16% | 6/50 12% | 9/50 18% | 26/50 52% | 19/50 38% | 21/50 42% | 10/50 20% | 10/50 20% | 10/50 20% |
| Stardust | 46/450 10% | 0/50 0% | 7/50 14% | 9/50 18% | 6/50 12% | 3/50 6% | 9/50 18% | 2/50 4% | 6/50 12% | 4/50 8% |
| McRave | 32/450 7% | 5/50 10% | 1/50 2% | 5/50 10% | 2/50 4% | 2/50 4% | 0/50 0% | 6/50 12% | 5/50 10% | 6/50 12% |
| XIAOYI | 332/450 74% | 45/50 90% | 45/50 90% | 44/50 88% | 31/50 62% | 33/50 66% | 39/50 78% | 36/50 72% | 26/50 52% | 33/50 66% |
| CUNYBot | 441/450 98% | 50/50 100% | 49/50 98% | 50/50 100% | 50/50 100% | 50/50 100% | 49/50 98% | 50/50 100% | 47/50 94% | 46/50 92% |
| overall | 37.63% | 38% | 39% | 40% | 40% | 38% | 40% | 37% | 32% | 34% |
Ooh, Microwave upset PurpleWave only on the three-player map Neo Aztec. Compare the Match Point column with the Neo Aztec column: They have the same overall win rate, but Microwave played Match Point consistently against each opponent, and played Neo Aztec sometimes better and sometimes worse. It must mean something!
| XIAOYI | overall | Benzen | Eclips | MatchP | NeoAzt | NeoSyl | Outsid | Circui | Fighti | Polypo |
|---|---|---|---|---|---|---|---|---|---|---|
| BananaBrain | 0/450 0% | 0/50 0% | 0/50 0% | 0/50 0% | 0/50 0% | 0/50 0% | 0/50 0% | 0/50 0% | 0/50 0% | 0/50 0% |
| PurpleWave | 12/450 3% | 1/50 2% | 0/50 0% | 5/50 10% | 1/50 2% | 0/50 0% | 1/50 2% | 2/50 4% | 1/50 2% | 1/50 2% |
| Stardust | 8/450 2% | 0/50 0% | 0/50 0% | 0/50 0% | 3/50 6% | 2/50 4% | 0/50 0% | 0/50 0% | 3/50 6% | 0/50 0% |
| McRave | 86/450 19% | 9/50 18% | 9/50 18% | 1/50 2% | 5/50 10% | 7/50 14% | 19/50 38% | 18/50 36% | 6/50 12% | 12/50 24% |
| Microwave | 118/450 26% | 5/50 10% | 5/50 10% | 6/50 12% | 19/50 38% | 17/50 34% | 11/50 22% | 14/50 28% | 24/50 48% | 17/50 34% |
| CUNYBot | 441/450 98% | 49/50 98% | 45/50 90% | 50/50 100% | 49/50 98% | 50/50 100% | 50/50 100% | 50/50 100% | 49/50 98% | 49/50 98% |
| overall | 24.63% | 21% | 20% | 21% | 26% | 25% | 27% | 28% | 28% | 26% |
| CUNYBot | overall | Benzen | Eclips | MatchP | NeoAzt | NeoSyl | Outsid | Circui | Fighti | Polypo |
|---|---|---|---|---|---|---|---|---|---|---|
| BananaBrain | 2/450 0% | 0/50 0% | 0/50 0% | 0/50 0% | 0/50 0% | 0/50 0% | 0/50 0% | 0/50 0% | 2/50 4% | 0/50 0% |
| PurpleWave | 15/450 3% | 1/50 2% | 3/50 6% | 0/50 0% | 3/50 6% | 1/50 2% | 1/50 2% | 1/50 2% | 3/50 6% | 2/50 4% |
| Stardust | 2/450 0% | 0/50 0% | 0/50 0% | 0/50 0% | 1/50 2% | 1/50 2% | 0/50 0% | 0/50 0% | 0/50 0% | 0/50 0% |
| McRave | 1/450 0% | 0/50 0% | 0/50 0% | 0/50 0% | 0/50 0% | 0/50 0% | 0/50 0% | 1/50 2% | 0/50 0% | 0/50 0% |
| Microwave | 9/450 2% | 0/50 0% | 1/50 2% | 0/50 0% | 0/50 0% | 0/50 0% | 1/50 2% | 0/50 0% | 3/50 6% | 4/50 8% |
| XIAOYI | 9/450 2% | 1/50 2% | 5/50 10% | 0/50 0% | 1/50 2% | 0/50 0% | 0/50 0% | 0/50 0% | 1/50 2% | 1/50 2% |
| overall | 1.41% | 1% | 3% | 0% | 2% | 1% | 1% | 1% | 3% | 2% |
Trackbacks
No Trackbacks
Comments
Dan on :
In testing I observed PurpleWave struggling in PvP on maps whose naturals had narrow exits facing the enemy base: Aztec, Match Point, Benzene, and Circuit Breakers, especially the first two.
Reason 1: PurpleWave's PvP style and strength lie in being able to safely expand faster than other Protoss, at the cost of map control. But with PurpleWave unwilling to send armies the long way on those maps for more favorable engagements, it gets contained and can't convert its economic advantage into a win. It's a significant enough issue that I came close to attempting army flanks prior to the deadline. Given that AIIDE features both Destination and Aztec I might have to implement it this time around.
Reason 2: A bug in PurpleWave's micro causes it to engage with Dragoons through narrow chokes when it otherwise deems them too punishing. The bug has since been fixed but caused undue suicides especially on Aztec and Match Point.
Reason 3: PurpleWave has a bug causing it to excessively prefer expansions towards the middle of the map. I rewrote the expansion-scoring logic to be player-agnostic (so PurpleWave can anticipate likely enemy expansions) but in the process botched PurpleWave's own scoring. This is particularly fatal on Aztec where the central downhill expansions are incredibly hard to both take and defend. This bug is fixed locally but still shows up in a lot of BASIL games.
Reason 4: PurpleWave has a bug (noticing a trend?) where in some circumstances the worker assigned to build an expansion gets perpetually swapped out, and the bot fails to take a third base until very late if ever. The bug appears to be map-dependent, and I suspect Aztec is worse than others.
I would have bet on McRave to do better on maps that either have long rush distance (requiring fewer sunkens for early defense) or have mains surrounded by walls (thus reducing ground unit vision of escaping Mutalisks). That'd mean Benzene (long) Aztec/Sylphid (walls), and Match Point (both). In practice that proved to be the case overall, but with a lot of noise on a per-matchup basis.
MicroDK on :
I have not analyzed it further so this is just speculations. Maybe Dan knows more... :-)