CoG 2021 tables
The CoG 2021 result tables. First, the crosstable. This is identical to the official crosstable, only presented differently. If every game in the tournament had completed successfully, there would be 7200 games. In fact 10 games were counted as uncompleted, so there are 7190 games in the table. An edge case was game 377, PurpleWave versus McRave on Ride of Valkyries, which was recorded as GAME_STATE_NEVER_DETECTED but also said that McRave crashed, a curious result. The official table counted it as a successfully completed game despite the fact that it never started, and a win for PurpleWave. So I followed suit.
If all games had completed, each bot would have played 400 games total, 50 games against each opponent. Old MetaBot was the cause; it accounted for all 10 uncompleted games, distributed more or less randomly among its opponents. Of the 9 * 8 / 2 = 36 pairings, only 3 were upsets: #3 McRave > #1 Stardust, #6 XiaoYi > #3 McRave, and #7 BetaStar > #4 Microwave.
| overall | Star | Bana | McRa | Micr | Purp | XIAO | Beta | Meta | CUNY | |
|---|---|---|---|---|---|---|---|---|---|---|
| #1 Stardust | 361/400 90.25% | 46/50 92% | 21/50 42% | 50/50 100% | 46/50 92% | 50/50 100% | 48/50 96% | 50/50 100% | 50/50 100% | |
| #2 BananaBrain | 298/399 74.69% | 4/50 8% | 37/50 74% | 32/50 64% | 35/50 70% | 49/50 98% | 44/50 88% | 48/49 98% | 49/50 98% | |
| #3 McRave | 272/399 68.17% | 29/50 58% | 13/50 26% | 39/50 78% | 35/50 70% | 19/50 38% | 42/50 84% | 45/49 92% | 50/50 100% | |
| #4 Microwave | 216/399 54.14% | 0/50 0% | 18/50 36% | 11/50 22% | 39/50 78% | 40/50 80% | 22/50 44% | 40/49 82% | 46/50 92% | |
| #5 PurpleWave | 207/397 52.14% | 4/50 8% | 15/50 30% | 15/50 30% | 11/50 22% | 45/50 90% | 29/50 58% | 45/47 96% | 43/50 86% | |
| #6 XIAOYI | 160/399 40.10% | 0/50 0% | 1/50 2% | 31/50 62% | 10/50 20% | 5/50 10% | 32/50 64% | 32/49 65% | 49/50 98% | |
| #7 BetaStar | 156/397 39.29% | 2/50 4% | 6/50 12% | 8/50 16% | 28/50 56% | 21/50 42% | 18/50 36% | 33/47 70% | 40/50 80% | |
| #8 MetaBot | 90/390 23.08% | 0/50 0% | 1/49 2% | 4/49 8% | 9/49 18% | 2/47 4% | 17/49 35% | 14/47 30% | 43/50 86% | |
| #9 CUNYbot | 30/400 7.50% | 0/50 0% | 1/50 2% | 0/50 0% | 4/50 8% | 7/50 14% | 1/50 2% | 10/50 20% | 7/50 14% |
The table of bot performance on each map is also identical to the official table, except that it shows win rates instead of win counts. When no games were missed, each bot played 80 games on each map.
| overall | Rideof | GreatB | NeoAzt | NeoSni | Python | |
|---|---|---|---|---|---|---|
| #1 Stardust | 90.25% | 88% | 94% | 86% | 90% | 94% |
| #2 BananaBrain | 74.69% | 69% | 80% | 78% | 78% | 70% |
| #3 McRave | 68.17% | 65% | 72% | 71% | 69% | 64% |
| #4 Microwave | 54.14% | 69% | 56% | 51% | 40% | 55% |
| #5 PurpleWave | 52.14% | 57% | 53% | 52% | 51% | 48% |
| #6 XIAOYI | 40.10% | 40% | 29% | 36% | 53% | 42% |
| #7 BetaStar | 39.29% | 35% | 39% | 42% | 32% | 48% |
| #8 MetaBot | 23.08% | 23% | 23% | 25% | 24% | 21% |
| #9 CUNYbot | 7.50% | 5% | 2% | 9% | 12% | 9% |
And one table that is not in the official results, bot performance against each opponent race. There is only one terran bot, #6 XiaoYi, so the vT column is not very interesting. #5 PurpleWave was the only bot to perform equally against protoss and zerg. Since there are so few opponents, it’s not clear whether that’s meaningful.
| bot | race | overall | vT | vP | vZ |
|---|---|---|---|---|---|
| Stardust | protoss | 90.25% | 100% | 95% | 81% |
| BananaBrain | protoss | 74.69% | 98% | 66% | 79% |
| McRave | zerg | 68.17% | 38% | 66% | 89% |
| Microwave | zerg | 54.14% | 80% | 48% | 57% |
| PurpleWave | protoss | 52.14% | 90% | 47% | 46% |
| XIAOYI | terran | 40.10% | - | 28% | 60% |
| BetaStar | protoss | 39.29% | 36% | 31% | 51% |
| MetaBot | protoss | 23.08% | 35% | 9% | 38% |
| CUNYbot | zerg | 7.50% | 2% | 10% | 4% |
Next: The per-bot map tables.
Trackbacks
No Trackbacks
Comments