archive by month
Skip to content

CIG 2017 without the problem maps

What if CIG 2017 had included only maps that Iron plays properly on? Then Iron would have won, at least according to its results on the remaining maps. Leaving out Hitchhiker and Alchemist leaves only 3 other maps, Andromeda, Python, and Tau Cross. A tournament with only 3 maps is hardly satisfying, but it’s the best estimate of how Iron might have done if it had been prepared for the map pool.

overallIronZZZKtscmLetaMegaPurpUAlbMcRaOverCasiZiabAIURTyrSRboTerrBigeOpprBonjSlinSals
Iron75.37%55%57%28%80%63%80%51%85%84%77%84%55%85%91%95%95%87%91%91%
ZZZKBot73.46%45%45%41%77%47%79%84%93%29%64%91%81%81%91%84%95%88%89%91%
tscmoo73.33%43%55%83%69%88%55%69%64%53%71%77%68%69%89%77%96%89%83%95%
LetaBot64.49%72%59%17%60%60%71%47%81%85%73%63%57%43%69%77%40%72%84%95%
MegaBot61.40%20%23%31%40%35%75%52%51%40%59%36%57%75%89%91%97%100%97%100%
PurpleWave60.07%37%53%12%40%65%52%25%89%44%35%76%84%71%87%92%63%60%64%92%
UAlbertaBot60.07%20%21%45%29%25%48%80%57%63%69%55%44%71%89%75%83%89%84%93%
McRave59.44%49%16%31%53%48%75%20%39%49%72%35%41%88%93%55%89%84%97%95%
Overkill57.89%15%7%36%19%49%11%43%61%45%85%61%43%84%95%93%93%89%80%91%
CasiaBot56.28%16%71%47%15%60%56%37%51%55%35%60%73%32%51%95%68%75%85%89%
Ziabot56.04%23%36%29%27%41%65%31%28%15%65%56%57%72%81%79%91%91%83%95%
AIUR55.72%16%9%23%37%64%24%45%65%39%40%44%71%79%77%69%89%93%80%93%
Tyr44.28%45%19%32%43%43%16%56%59%57%27%43%29%28%45%36%65%57%48%93%
SRbotOne43.65%15%19%31%57%25%29%29%12%16%68%28%21%72%39%100%43%59%72%95%
TerranUAB35.09%9%9%11%31%11%13%11%7%5%49%19%23%55%61%57%73%77%55%91%
Bigeyes29.96%5%16%23%23%9%8%25%45%7%5%21%31%64%0%43%68%40%48%88%
OpprimoBot29.68%5%5%4%60%3%37%17%11%7%32%9%11%35%57%27%32%40%80%92%
Bonjwa29.47%13%12%11%28%0%40%11%16%11%25%9%7%43%41%23%60%60%57%93%
Sling27.09%9%11%17%16%3%36%16%3%20%15%17%20%52%28%45%52%20%43%92%
Salsa7.23%9%9%5%5%0%8%7%5%9%11%5%7%7%5%9%12%8%7%8%

Iron narrowly edges out ZZZKBot and Tscmoo. PurpleWave falls back and MegaBot, which also did poorly on Hitchhiker, jumps upward. McRave moves from the lower half to the upper half but does not break into the top ranks.

Here is another version of the same chart, with bots in the official finishing order. It makes some comparisons easier.

overallZZZKtscmPurpLetaUAlbMegaOverCasiZiabIronAIURMcRaTyrSRboTerrBonjBigeOpprSlinSals
ZZZKBot73.46%45%47%41%79%77%93%29%64%45%91%84%81%81%91%88%84%95%89%91%
tscmoo73.33%55%88%83%55%69%64%53%71%43%77%69%68%69%89%89%77%96%83%95%
PurpleWave60.07%53%12%40%52%65%89%44%35%37%76%25%84%71%87%60%92%63%64%92%
LetaBot64.49%59%17%60%71%60%81%85%73%72%63%47%57%43%69%72%77%40%84%95%
UAlbertaBot60.07%21%45%48%29%25%57%63%69%20%55%80%44%71%89%89%75%83%84%93%
MegaBot61.40%23%31%35%40%75%51%40%59%20%36%52%57%75%89%100%91%97%97%100%
Overkill57.89%7%36%11%19%43%49%45%85%15%61%61%43%84%95%89%93%93%80%91%
CasiaBot56.28%71%47%56%15%37%60%55%35%16%60%51%73%32%51%75%95%68%85%89%
Ziabot56.04%36%29%65%27%31%41%15%65%23%56%28%57%72%81%91%79%91%83%95%
Iron75.37%55%57%63%28%80%80%85%84%77%84%51%55%85%91%87%95%95%91%91%
AIUR55.72%9%23%24%37%45%64%39%40%44%16%65%71%79%77%93%69%89%80%93%
McRave59.44%16%31%75%53%20%48%39%49%72%49%35%41%88%93%84%55%89%97%95%
Tyr44.28%19%32%16%43%56%43%57%27%43%45%29%59%28%45%57%36%65%48%93%
SRbotOne43.65%19%31%29%57%29%25%16%68%28%15%21%12%72%39%59%100%43%72%95%
TerranUAB35.09%9%11%13%31%11%11%5%49%19%9%23%7%55%61%77%57%73%55%91%
Bonjwa29.47%12%11%40%28%11%0%11%25%9%13%7%16%43%41%23%60%60%57%93%
Bigeyes29.96%16%23%8%23%25%9%7%5%21%5%31%45%64%0%43%40%68%48%88%
OpprimoBot29.68%5%4%37%60%17%3%7%32%9%5%11%11%35%57%27%40%32%80%92%
Sling27.09%11%17%36%16%16%3%20%15%17%9%20%3%52%28%45%43%52%20%92%
Salsa7.23%9%5%8%5%7%0%9%11%5%9%7%5%7%5%9%7%12%8%8%

Next: The chart of bot x map.

Trackbacks

No Trackbacks

Comments

LetaBot on :

Looks like my anti-mass culture build from the CIG did well regardless of the map, Good to see.

Doesn't do well vs oprimobot though.

Joseph Huang on :

Opprimo gets a bunker i thought?

tscmoo on :

Just a quick comment that leaving those maps out changes learning quite a bit, since my bot also struggles on those maps and I don't do any per-map learning (so losses on those maps with good build orders makes it more likely to use worse build orders on the other maps too).

Also looking at some replays, it seems CIG had quite some issues with bots not starting client/java bots (this includes mine and purplewave). I might go through the replays and see the percentage of games where a bot didn't start. This is probably an issue with the tournament manager.

Jay Scott on :

It’s a good point. Leaving out the difficult maps gives our best estimate of how the tournament would have gone on bot-friendly maps, but our best estimate is not necessarily an accurate one.

Jay Scott on :

I was also struck by how often bots failed to start. The game length should be recorded in the results file. A little more deciphering of the results file will probably save us from having to parse all the replays.

Add Comment

E-Mail addresses will not be displayed and will only be used for E-Mail notifications.

To prevent automated Bots from commentspamming, please enter the string you see in the image below in the appropriate input box. Your comment will only be submitted if the strings match. Please ensure that your browser supports and accepts cookies, or your comment cannot be verified correctly.
CAPTCHA

Form options

Submitted comments will be subject to moderation before being displayed.