archive by month
Skip to content

CIG 2017 crosstables per map

CIG 2017 was played on only 5 maps. In my view, that’s not enough maps for fairness, but the advantage is that each map is played enough times that the crosstables have ample data. Each cell in these tables represents 25 games (minus the missing games, of course).

(2)Hitchhiker

overallZZZKtscmPurpLetaUAlbMegaOverCasiZiabIronAIURMcRaTyrSRboTerrBonjBigeOpprSlinSals
ZZZKBot80.80%76%0%96%88%68%92%40%68%92%100%96%92%92%84%92%84%92%96%88%
tscmoo78.27%24%96%80%56%76%64%48%52%100%71%96%76%92%96%92%96%88%92%92%
PurpleWave82.07%100%4%52%80%96%88%84%60%100%96%100%96%84%88%68%80%92%96%96%
LetaBot62.37%4%20%48%60%32%88%88%72%96%33%92%52%12%76%84%96%44%92%96%
UAlbertaBot63.08%12%44%20%40%28%56%40%68%92%62%100%52%68%96%92%60%100%80%88%
MegaBot54.97%32%24%4%68%72%72%28%72%100%42%100%32%88%88%12%17%96%16%80%
Overkill66.03%8%36%12%12%44%28%68%80%96%96%92%36%80%92%96%92%96%92%100%
CasiaBot61.95%60%52%16%12%60%72%32%32%96%67%92%64%16%44%92%96%84%92%100%
Ziabot65.61%32%48%40%28%32%28%20%68%96%71%96%68%76%76%92%92%96%88%100%
Iron4.65%8%0%0%4%8%0%4%4%4%0%32%4%0%4%4%0%4%4%4%
AIUR60.88%0%29%4%67%38%58%4%33%29%100%92%75%83%88%92%91%96%88%92%
McRave8.88%4%4%0%8%0%0%8%8%4%68%8%12%0%12%20%0%8%0%4%
Tyr51.90%8%24%4%48%48%68%64%36%32%96%25%88%16%44%64%72%64%88%96%
SRbotOne54.22%8%8%16%88%32%12%20%84%24%100%17%100%84%28%48%92%76%100%92%
TerranUAB47.47%16%4%12%24%4%12%8%56%24%96%12%88%56%72%76%88%56%96%100%
Bonjwa43.76%8%8%32%16%8%88%4%8%8%96%8%80%36%52%24%83%76%96%100%
Bigeyes34.76%16%4%20%4%40%83%8%4%8%100%9%100%28%8%12%17%17%88%96%
OpprimoBot37.21%8%12%8%56%0%4%4%16%4%96%4%92%36%24%44%24%83%92%100%
Sling22.57%4%8%4%8%20%84%8%8%12%96%12%100%12%0%4%4%12%8%24%
Salsa18.57%12%8%4%4%12%20%0%0%0%96%8%96%4%8%0%0%4%0%76%

(3)Alchemist

overallZZZKtscmPurpLetaUAlbMegaOverCasiZiabIronAIURMcRaTyrSRboTerrBonjBigeOpprSlinSals
ZZZKBot76.00%48%44%44%88%84%80%28%76%100%92%68%84%72%84%88%92%96%84%92%
tscmoo69.26%52%92%84%48%52%68%24%64%64%40%68%64%76%96%84%68%92%84%96%
PurpleWave70.32%56%8%40%72%76%88%56%40%64%88%80%96%72%84%56%96%92%76%96%
LetaBot57.89%56%16%60%36%32%48%68%56%64%32%96%48%72%64%60%64%40%92%96%
UAlbertaBot65.05%12%52%28%64%44%80%72%72%56%76%56%44%56%76%92%80%88%96%92%
MegaBot66.11%16%48%24%68%56%52%36%56%60%72%44%44%92%96%100%96%96%100%100%
Overkill58.53%20%32%12%52%20%48%72%44%76%44%32%44%88%92%92%92%80%84%88%
CasiaBot60.84%72%76%44%32%28%64%28%32%88%64%52%68%32%40%92%84%88%72%100%
Ziabot58.74%24%36%60%44%28%44%56%68%72%52%16%60%72%76%80%84%80%68%96%
Iron59.58%0%36%36%36%44%40%24%12%28%92%96%56%88%96%84%92%92%88%92%
AIUR55.79%8%60%12%68%24%28%56%36%48%8%32%84%88%92%88%60%88%88%92%
McRave48.63%32%32%20%4%44%56%68%48%84%4%68%84%60%12%24%96%4%92%92%
Tyr41.89%16%36%4%52%56%56%56%32%40%44%16%16%20%44%52%64%56%56%80%
SRbotOne41.05%28%24%28%28%44%8%12%68%28%12%12%40%80%32%80%92%12%60%92%
TerranUAB40.21%16%4%16%36%24%4%8%60%24%4%8%88%56%68%76%56%60%64%92%
Bonjwa33.05%12%16%44%40%8%0%8%8%20%16%12%76%48%20%24%44%80%56%96%
Bigeyes29.89%8%32%4%36%20%4%8%16%16%8%40%4%36%8%44%56%76%56%96%
OpprimoBot33.26%4%8%8%60%12%4%20%12%20%8%12%96%44%88%40%20%24%64%88%
Sling26.53%16%16%24%8%4%0%16%28%32%12%12%8%44%40%36%44%44%36%84%
Salsa7.37%8%4%4%4%8%0%12%0%4%8%8%8%20%8%8%4%4%12%16%

(3)Tau Cross

overallZZZKtscmPurpLetaUAlbMegaOverCasiZiabIronAIURMcRaTyrSRboTerrBonjBigeOpprSlinSals
ZZZKBot72.84%28%60%28%84%80%96%12%72%28%84%92%92%92%92%92%88%92%88%84%
tscmoo72.84%72%88%88%64%64%52%64%68%40%60%60%60%76%80%92%80%100%88%88%
PurpleWave56.21%40%12%40%48%56%88%36%36%36%88%12%92%56%80%52%100%56%48%92%
LetaBot63.16%72%12%60%72%56%72%88%76%68%56%28%52%56%72%64%68%44%88%96%
UAlbertaBot59.79%16%36%52%28%32%52%68%84%8%56%76%40%64%96%88%72%80%88%100%
MegaBot63.58%20%36%44%44%68%64%40%60%20%48%48%60%72%96%100%88%100%100%100%
Overkill59.37%4%48%12%28%48%36%36%92%12%48%84%44%80%100%88%92%96%84%96%
CasiaBot58.95%88%36%64%12%32%60%64%36%4%64%52%84%24%76%76%92%64%92%100%
Ziabot54.95%28%32%64%24%16%40%8%64%8%52%24%52%84%80%96%80%100%92%100%
Iron77.47%72%60%64%32%92%80%88%96%92%84%28%48%84%92%88%96%96%92%88%
AIUR57.26%16%40%12%44%44%52%52%36%48%16%76%72%80%80%92%60%88%88%92%
McRave62.32%8%40%88%72%24%52%16%48%76%72%24%48%92%96%88%56%88%100%96%
Tyr44.42%8%40%8%48%60%40%56%16%48%52%28%52%20%56%56%48%60%52%96%
SRbotOne42.95%8%24%44%44%36%28%20%76%16%16%20%8%80%32%64%100%48%56%96%
TerranUAB33.05%8%20%20%28%4%4%0%24%20%8%20%4%44%68%72%52%84%56%92%
Bonjwa31.79%8%8%48%36%12%0%12%24%4%12%8%12%44%36%28%64%76%72%100%
Bigeyes29.26%12%20%0%32%28%12%8%8%20%4%40%44%52%0%48%36%44%60%88%
OpprimoBot29.68%8%0%44%56%20%0%4%36%0%4%12%12%40%52%16%24%56%84%96%
Sling24.21%12%12%52%12%12%0%16%8%8%8%12%0%48%44%44%28%40%16%88%
Salsa5.89%16%12%8%4%0%0%4%0%0%12%8%4%4%4%8%0%12%4%12%

(4)Andromeda

overallZZZKtscmPurpLetaUAlbMegaOverCasiZiabIronAIURMcRaTyrSRboTerrBonjBigeOpprSlinSals
ZZZKBot72.84%44%64%20%84%72%92%36%56%60%92%68%76%76%92%84%84%96%92%96%
tscmoo74.32%56%84%84%60%72%64%44%76%44%88%68%68%68%92%92%76%92%88%96%
PurpleWave56.63%36%16%32%40%72%88%40%28%12%60%20%72%80%88%68%92%60%84%88%
LetaBot68.42%80%16%68%84%72%92%84%68%76%64%56%48%44%68%84%80%32%84%100%
UAlbertaBot61.47%16%40%60%16%20%60%72%76%28%48%88%56%80%84%88%76%92%76%92%
MegaBot60.00%28%28%28%28%80%48%36%48%20%36%52%60%72%80%100%100%96%100%100%
Overkill57.47%8%36%12%8%40%52%48%88%24%72%48%40%84%92%88%96%88%84%84%
CasiaBot54.53%64%56%60%16%28%64%52%40%20%36%36%64%44%36%80%96%84%80%80%
Ziabot57.26%44%24%72%32%24%52%12%60%36%68%32%52%64%88%92%80%88%76%92%
Iron74.74%40%56%88%24%72%80%76%80%64%76%56%60%88%88%88%96%92%96%100%
AIUR54.95%8%12%40%36%52%64%28%64%32%24%48%64%76%72%96%80%84%68%96%
McRave62.11%32%32%80%44%12%48%52%64%68%44%52%40%88%96%80%68%92%96%92%
Tyr45.68%24%32%28%52%44%40%60%36%48%40%36%60%28%28%48%44%72%52%96%
SRbotOne43.79%24%32%20%56%20%28%16%56%36%12%24%12%72%40%64%100%44%84%92%
TerranUAB38.74%8%8%12%32%16%20%8%64%12%12%28%4%72%60%76%68%72%72%92%
Bonjwa26.95%16%8%32%16%12%0%12%20%8%12%4%20%52%36%24%52%44%56%88%
Bigeyes27.79%16%24%8%20%24%0%4%4%20%4%20%32%56%0%32%48%76%56%84%
OpprimoBot30.32%4%8%40%68%8%4%12%16%12%8%16%8%28%56%28%56%24%88%92%
Sling24.63%8%12%16%16%24%0%16%20%24%4%32%4%48%16%28%44%44%12%100%
Salsa7.37%4%4%12%0%8%0%16%20%8%0%4%8%4%8%8%12%16%8%0%

(4)Python

overallZZZKtscmPurpLetaUAlbMegaOverCasiZiabIronAIURMcRaTyrSRboTerrBonjBigeOpprSlinSals
ZZZKBot74.68%64%16%76%68%80%92%40%62%48%96%92%76%76%88%88%80%96%88%92%
tscmoo72.84%36%92%76%40%72%76%52%68%44%84%80%76%64%96%84%76%96%72%100%
PurpleWave67.37%84%8%48%68%68%92%56%40%64%80%44%88%76%92%60%84%72%60%96%
LetaBot61.89%24%24%52%56%52%80%84%76%72%68%56%72%28%68%68%84%44%80%88%
UAlbertaBot58.95%32%60%32%44%24%60%48%48%24%60%76%36%68%88%92%76%76%88%88%
MegaBot60.63%20%28%32%48%76%40%44%68%20%24%56%52%80%92%100%84%96%92%100%
Overkill56.84%8%24%8%20%40%60%52%76%8%64%52%44%88%92%92%92%96%72%92%
CasiaBot55.37%60%48%44%16%52%56%48%28%24%80%64%72%28%40%68%96%56%84%88%
Ziabot55.91%38%32%60%24%52%32%24%72%24%48%28%68%68%76%84%76%84%80%92%
Iron73.89%52%56%36%28%76%80%92%76%76%92%68%56%84%92%84%92%96%84%84%
AIUR54.95%4%16%20%32%40%76%36%20%52%8%72%76%80%80%92%68%96%84%92%
McRave53.89%8%20%56%44%24%44%48%36%72%32%28%36%84%88%84%40%88%96%96%
Tyr42.74%24%24%12%28%64%48%56%28%32%44%24%64%36%52%68%16%64%40%88%
SRbotOne44.21%24%36%24%72%32%20%12%72%32%16%20%16%64%44%48%100%36%76%96%
TerranUAB33.47%12%4%8%32%12%8%8%60%24%8%20%12%48%56%84%52%64%36%88%
Bonjwa29.68%12%16%40%32%8%0%8%32%16%16%8%16%32%52%16%64%60%44%92%
Bigeyes32.84%20%24%16%16%24%16%8%4%24%8%32%60%84%0%48%36%84%28%92%
OpprimoBot29.05%4%4%28%56%24%4%4%44%16%4%4%12%36%64%36%40%16%68%88%
Sling32.42%12%28%40%20%12%8%28%16%20%16%16%4%60%24%64%56%72%32%88%
Salsa8.42%8%0%4%12%12%0%8%12%8%16%8%4%12%4%12%8%8%12%12%

observations

The difficult maps are Hitchhiker, which has complex map features that bots are not ready for and which BWEM apparently does not support, and Alchemist, which has 2 entrances into each base, a nonstandard strategic feature. Sure enough, on Hitchhiker we see that BWEM users #10 Iron and #12 McRave were virtually helpless. #6 MegaBot suffered to a lesser extent. Other extreme results on Hitchhiker: #3 PurpleWave blanked #1 ZZZKBot with 100% wins, a surprise since Hitchhiker is a 2 player map with a short rush distance which should favor the 4 pool. I guess the defensible narrow path between bases made up for that. Then PurpleWave got smashed by #2 tscmoo with 4% wins. The map also brought #20 Salsa most of its wins, with plus scores versus #10 Iron and #12 McRave and, in a surprise, #19 Sling; on every other map, Salsa lost heavily in all matchups. It’s not the same syndrome as the BWEM users, though.

Alchemist is a 3 player map with a circular path all the way around the map which passes through each base. Out one of your base entrances is the short path to your enemy’s base, and out the other entrance is the long path. You get a natural expansion outside each entrance. It’s bad for bots which want to set up one defensive line, whether by walling the ramp or cannoning the natural, because the enemy can bypass the defenses. It favors bots which reason about map topology and distances—if there are any. Comparing across maps, we see that the map cost Iron (which makes a wall at the ramp or at the natural) over 20% win rate and cost #12 McRave perhaps half as much. #3 PurpleWave, #5 UAlbertaBot, and #6 MegaBot did well on the map. I’m not sure why PurpleWave liked the map. I don’t think any of the bots does much map analysis; most bots were not much affected by the nonstandard map, probably because they are blind to its possibilities.

Curiously, #3 PurpleWave had some trouble on Tau Cross and Andromeda. Those maps are also played on SSCAIT, so I expected PurpleWave would be well tuned for them.

There’s a lot more in these crosstables, but that’s enough for now.

Next: What would have happened without Hitchhiker and Alchemist?

Trackbacks

No Trackbacks

Comments

McRave on :

Thanks for all these crosstables Jay! Nice to see it by maps too. I'm not sure what causes Hitchhiker to freeze on loading with BWEM. Igor if you're reading this, could you comment on it? I'd like to help if it's possible.

PurpleWaveJadien on :

I think he mentioned a bug with multiple neutral buildings being stacked on the same tile, as with Hitchhiker.

Jay Scott on :

I believe BWEM also fails on Electric Circuit, which has stacked temples at the back door to each base.

Igor Dimitrijevic on :

BWEM works fine on Electric Circuit. The library just assume static neutrals don'y overlap partially. There is an assert in the code that tells that. Hitchhiker is the first map I am aware with such a "feature". I'll add support for this before next CIG, but anyone can send me fixes of course.

Add Comment

E-Mail addresses will not be displayed and will only be used for E-Mail notifications.

To prevent automated Bots from commentspamming, please enter the string you see in the image below in the appropriate input box. Your comment will only be submitted if the strings match. Please ensure that your browser supports and accepts cookies, or your comment cannot be verified correctly.
CAPTCHA

Form options

Submitted comments will be subject to moderation before being displayed.