CoG 2023 first look
In an astonishing break with tradition, my analysis program’s results exactly matched the official results on the first try. There was no need to cope with arbitrary changes to the format of the results file, or search for special cases that were handled differently this year, or exclude broken bots. How did they do it?????
Except for the naming issue, everything seems to have run cleanly, as far as I can tell from here. New bot ProtossPleb crashed 30% of the time, but the crash rate for the others was flat zero. There were 22 frame timeouts total, a negligible number. All bots played all games, which suggests that they silently replayed games which did not start. 360 rounds were played, fewer than the 450 last year.
Well, there is one error. The HTML version of the detailed results links to individual game replay files, but I can’t download them. The web server gives a 400 Bad Request error, not what you expect if the file is simply missing. I imagine the replay files are meant to be served through a relay behind the scenes, and it’s not set up properly.
| overall | Star | Purp | Bana | McRa | Micr | XIAO | CUNY | Prot | Stardust | 91.31% | 81% | 77% | 97% | 91% | 98% | 99% | 96% | PurpleWave | 80.87% | 19% | 68% | 97% | 89% | 98% | 96% | 99% | BananaBrain | 75.52% | 23% | 32% | 81% | 92% | 100% | 100% | 100% | McRave2022 | 56.23% | 3% | 3% | 19% | 98% | 82% | 100% | 89% | MicroWave | 42.30% | 9% | 11% | 8% | 2% | 69% | 98% | 99% | XIAOYI2019 | 35.75% | 2% | 2% | 0% | 18% | 31% | 98% | 99% | CUNYBot2021 | 9.56% | 1% | 4% | 0% | 0% | 2% | 2% | 59% | ProtossPleb | 8.45% | 4% | 1% | 0% | 11% | 1% | 1% | 41% |
|---|
Like last year, the crosstable is very smooth, with no upsets. In fact, it’s even smoother; the palest cell off the diagonal is BananaBrain-Stardust, where BananaBrain scored only 23%. The ranking is as clean as can be. The closest thing to an upset was that ProtossPleb was able to fight CUNYBot nearly even.
| overall | Benzen | Eclips | MatchP | NeoAzt | NeoSyl | Outsid | Circui | Fighti | Polypo | |
|---|---|---|---|---|---|---|---|---|---|---|
| #1 Stardust | 91.31% | 94% | 92% | 89% | 92% | 90% | 88% | 90% | 90% | 95% |
| #2 PurpleWave | 80.87% | 79% | 83% | 83% | 80% | 80% | 79% | 81% | 81% | 81% |
| #3 BananaBrain | 75.52% | 75% | 75% | 78% | 78% | 77% | 73% | 76% | 74% | 74% |
| #4 McRave2022 | 56.23% | 60% | 55% | 58% | 55% | 56% | 52% | 55% | 60% | 55% |
| #5 MicroWave | 42.30% | 44% | 44% | 45% | 41% | 42% | 44% | 41% | 39% | 40% |
| #6 XIAOYI2019 | 35.75% | 31% | 32% | 31% | 35% | 35% | 41% | 39% | 37% | 40% |
| #7 CUNYBot2021 | 9.56% | 8% | 5% | 14% | 10% | 9% | 6% | 12% | 12% | 11% |
| #8 ProtossPleb | 8.45% | 9% | 14% | 2% | 8% | 10% | 16% | 5% | 7% | 5% |
The map table is smooth too. Averaged across opponents, the maps made little difference. That’s never true against specific opponents; I’ll post that data tomorrow.
| race | score |
|---|---|
| terran | 36% |
| protoss | 64% |
| zerg | 36% |
I like to include the race statistics, though all they say is “Yeah, protoss is still ahead, and there is still only one terran.”
| bot | race | overall | vT | vP | vZ |
|---|---|---|---|---|---|
| Stardust | protoss | 91.31% | 98% | 85% | 96% |
| PurpleWave | protoss | 80.87% | 98% | 62% | 94% |
| BananaBrain | protoss | 75.52% | 100% | 52% | 91% |
| McRave2022 | zerg | 56.23% | 82% | 29% | 99% |
| MicroWave | zerg | 42.30% | 69% | 32% | 50% |
| XIAOYI2019 | terran | 35.75% | - | 26% | 49% |
| CUNYBot2021 | zerg | 9.56% | 2% | 16% | 1% |
| ProtossPleb | protoss | 8.45% | 1% | 2% | 18% |
Next: The map tables.
Trackbacks
No Trackbacks
Comments