AIIDE 2021 - summary tables
This year, for the first time ever, I did not have to update my parser to get results that exactly match the official results. Go stable tooling!
Here’s my version of the crosstable, identical to the official one except for the presentation. I have to produce the table to verify that I got it right, so I might as well show it. Also, for some people and some purposes, it’s easier to read than the original. For official results, it’s correct to use exact numbers, as is done. For general use, percentages are easier to interpret.
| # | bot | overall | star | bana | drag | stea | mcra | will | micr | daqi | fres | ualb |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | stardust | 95.63% | 84% | 98% | 100% | 95% | 95% | 100% | 91% | 99% | 99% | |
| 2 | bananabrain | 79.70% | 16% | 76% | 83% | 83% | 93% | 86% | 90% | 96% | 95% | |
| 3 | dragon | 51.19% | 2% | 24% | 37% | 67% | 96% | 66% | 47% | 39% | 83% | |
| 4 | steamhammer | 49.78% | 0% | 17% | 63% | 54% | 56% | 73% | 27% | 68% | 92% | |
| 5 | mcrave | 41.70% | 5% | 17% | 33% | 46% | 32% | 60% | 79% | 65% | 37% | |
| 6 | willyt | 41.05% | 5% | 7% | 4% | 44% | 68% | 67% | 38% | 68% | 69% | |
| 7 | microwave | 40.70% | 0% | 14% | 34% | 27% | 40% | 33% | 81% | 83% | 55% | |
| 8 | daqin | 39.63% | 9% | 10% | 53% | 73% | 21% | 62% | 19% | 31% | 78% | |
| 9 | freshmeat | 33.61% | 1% | 4% | 61% | 32% | 35% | 32% | 17% | 69% | 52% | |
| 10 | ualbertabot | 26.70% | 1% | 5% | 17% | 8% | 63% | 31% | 45% | 22% | 48% |
And here’s my version of the bot performance per map table. I use red and blue colors, which means less trouble for people who are red-green colorblind (supposed to be 8% of men plus a few women). The official tables have a sharp color shift between red at 49% and green at 51%, which is good if you want to distinguish ahead from behind. I didn’t go to any special trouble to make perceptually accurate colors, but my color shift is pretty smooth anyway, good if you want to accentuate big differences. 49% is very pale red and 51% is very pale blue; they look nearly the same because the numbers are nearly the same. If you’re interested, compare Steamhammer’s rows in the two tables, all close to 50%.
| # | bot | overall | Destin | Heartb | Polari | Aztec | Longin | Circui | Empire | Fighti | Python | Roadki |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | stardust | 95.63% | 96% | 97% | 97% | 98% | 90% | 94% | 98% | 97% | 94% | 96% |
| 2 | bananabrain | 79.70% | 79% | 81% | 81% | 80% | 83% | 79% | 74% | 81% | 80% | 79% |
| 3 | dragon | 51.19% | 50% | 47% | 52% | 50% | 50% | 55% | 56% | 50% | 50% | 51% |
| 4 | steamhammer | 49.78% | 51% | 56% | 49% | 50% | 44% | 51% | 48% | 49% | 50% | 49% |
| 5 | mcrave | 41.70% | 45% | 47% | 41% | 41% | 38% | 35% | 42% | 41% | 44% | 41% |
| 6 | willyt | 41.05% | 38% | 39% | 42% | 36% | 36% | 51% | 38% | 43% | 49% | 40% |
| 7 | microwave | 40.70% | 46% | 41% | 41% | 36% | 40% | 41% | 38% | 39% | 40% | 45% |
| 8 | daqin | 39.63% | 41% | 36% | 42% | 42% | 45% | 44% | 39% | 41% | 31% | 35% |
| 9 | freshmeat | 33.61% | 31% | 36% | 33% | 34% | 37% | 32% | 37% | 31% | 35% | 31% |
| 10 | ualbertabot | 26.70% | 22% | 19% | 22% | 31% | 38% | 17% | 31% | 27% | 28% | 32% |
Least but not last, the overall race balance. There is only one random bot, UAlbertaBot, and two terran bots, so the data is more sparse than usual. This table mainly tells us that the protoss participants were strong.
| overall | vT | vP | vZ | vR | |
|---|---|---|---|---|---|
| terran | 46% | 20% | 57% | 76% | |
| protoss | 72% | 80% | 74% | 90% | |
| zerg | 41% | 43% | 26% | 59% | |
| random | 27% | 24% | 10% | 41% |
Finally, how each bot did against each race.
| # | bot | overall | vT | vP | vZ | vR |
|---|---|---|---|---|---|---|
| 1 | stardust | 95.63% | 97% | 87% | 98% | 99% |
| 2 | bananabrain | 79.70% | 84% | 53% | 87% | 95% |
| 3 | dragon | 51.19% | 96% | 24% | 52% | 83% |
| 4 | steamhammer | 49.78% | 59% | 14% | 65% | 92% |
| 5 | mcrave | 41.70% | 32% | 34% | 57% | 37% |
| 6 | willyt | 41.05% | 4% | 17% | 62% | 69% |
| 7 | microwave | 40.70% | 33% | 32% | 50% | 55% |
| 8 | daqin | 39.63% | 58% | 10% | 36% | 78% |
| 9 | freshmeat | 33.61% | 47% | 25% | 28% | 52% |
| 10 | ualbertabot | 26.70% | 24% | 10% | 41% | - |
Next: Map tables for each bot.
Trackbacks
No Trackbacks
Comments