archive by month
Skip to content

AIIDE 2020 - results by map

I’ve found that the bland average “how well did I do on this map?” often obscures big variations in “how well did I do versus each opponent on this map?” The variations mean something about strategy execution or strategy selection. Unfortunately, with only this information it’s usually impossible to guess what the meaning is, so I don’t have many comments. In general, I think you have to look at games to see how two bots’ strategies interact on a given map. These tables can help you choose which games to look at.

First, here’s the overall table with the averages. It’s identical in content to the third table in the official results. With 1800 games per player and 10 maps, each cell represents 180 games (sometimes slightly fewer due to missing games). I also have a writeup of the maps.

overallDestinHeartbPolariAztecLonginCircuiEmpireFightiPythonRoadki
stardust93.22%96%92%96%93%88%94%92%94%94%92%
purplewave79.44%79%82%76%80%81%76%79%82%80%81%
bananabrain69.61%65%73%69%75%71%71%68%71%65%69%
dragon62.38%58%63%67%63%57%69%65%59%61%60%
mcrave57.22%62%54%57%59%58%54%55%61%56%56%
microwave54.47%58%59%47%54%54%52%52%54%61%53%
steamhammer54.00%55%53%58%52%56%50%60%53%52%51%
daqin50.14%53%48%51%51%51%56%51%49%42%49%
zzzkbot39.89%35%37%32%40%39%41%39%38%53%45%
ualbertabot31.14%33%30%35%32%37%24%28%34%23%34%
willyt29.44%19%26%32%22%29%35%38%33%33%28%
ecgberht24.28%28%28%27%21%24%23%21%18%23%29%
eggbot4.72%9%4%4%7%5%4%2%4%4%3%

Now the breakdown tables. For example, in the next table, Stardust scored 80% against PurpleWave on the map Destination. Each of these cells represents only 15 games (minus missing games), so small differences are not significant.

stardustoverallDestinHeartbPolariAztecLonginCircuiEmpireFightiPythonRoadki
purplewave83%80%80%93%93%73%100%80%87%73%73%
bananabrain62%87%53%73%33%47%67%60%53%87%60%
dragon93%100%80%93%100%93%87%93%93%100%87%
mcrave98%93%100%93%100%100%93%100%100%100%100%
microwave99%100%100%100%100%93%100%100%100%100%100%
steamhammer98%100%100%100%100%87%100%93%100%100%100%
daqin93%87%100%100%93%87%93%87%100%87%93%
zzzkbot99%100%100%100%100%100%100%93%100%100%100%
ualbertabot98%100%100%100%100%80%100%100%100%100%100%
willyt99%100%100%100%100%100%100%100%100%93%100%
ecgberht99%100%100%100%100%100%100%100%100%93%93%
eggbot97%100%87%100%100%100%93%100%100%93%100%
overall93.22%96%92%96%93%88%94%92%94%94%92%

Stardust did about equally well on every map against PurpleWave, but not so against BananaBrain. It looks as though it’s due to BananaBrain’s play—see the BananaBrain table below. Stardust thoroughly suppressed other players, so that’s as much as we can say.

purplewaveoverallDestinHeartbPolariAztecLonginCircuiEmpireFightiPythonRoadki
stardust17%20%20%7%7%27%0%20%13%27%27%
bananabrain63%60%87%47%60%60%73%67%60%67%47%
dragon45%53%47%47%40%53%7%27%80%40%53%
mcrave95%100%87%87%100%100%100%100%80%93%100%
microwave71%53%67%67%80%67%73%67%87%67%80%
steamhammer95%93%100%93%93%100%93%100%87%93%100%
daqin87%80%87%87%80%87%93%73%100%93%93%
zzzkbot91%93%93%100%100%73%87%100%93%93%73%
ualbertabot93%93%93%80%100%100%93%100%93%87%93%
willyt98%100%100%93%100%100%93%100%93%100%100%
ecgberht99%100%100%100%100%100%93%100%100%100%100%
eggbot100%100%100%100%100%100%100%100%100%100%100%
overall79.44%79%82%76%80%81%76%79%82%80%81%

bananabrainoverallDestinHeartbPolariAztecLonginCircuiEmpireFightiPythonRoadki
stardust38%13%47%27%67%53%33%40%47%13%40%
purplewave37%40%13%53%40%40%27%33%40%33%53%
dragon45%40%47%40%40%60%47%27%33%60%53%
mcrave55%47%73%40%60%53%60%40%53%60%60%
microwave61%60%87%60%67%53%53%67%67%33%67%
steamhammer71%60%80%60%87%53%80%73%73%67%73%
daqin66%60%67%53%67%67%53%67%80%80%67%
zzzkbot94%100%100%100%100%87%100%100%93%87%73%
ualbertabot88%93%80%100%80%87%100%87%80%100%73%
willyt84%73%100%93%93%93%93%80%80%60%73%
ecgberht99%93%93%100%100%100%100%100%100%100%100%
eggbot98%100%93%100%100%100%100%100%100%87%100%
overall69.61%65%73%69%75%71%71%68%71%65%69%

BananaBrain shows an irregular pattern against its strongest opposition, but seems to have more consistent map preferences against the middle ranks. I don’t know what it means, but it’s interesting.

dragonoverallDestinHeartbPolariAztecLonginCircuiEmpireFightiPythonRoadki
stardust7%0%20%7%0%7%13%7%7%0%13%
purplewave55%47%53%53%60%47%93%73%20%60%47%
bananabrain55%60%53%60%60%40%53%73%67%40%47%
mcrave79%80%73%93%73%80%80%73%47%93%93%
microwave57%27%40%80%53%47%80%60%60%60%60%
steamhammer30%20%27%33%33%20%47%20%40%20%40%
daqin53%40%53%27%33%60%53%80%53%60%73%
zzzkbot47%47%67%73%67%40%40%33%67%20%20%
ualbertabot80%80%92%87%80%60%87%80%71%87%80%
willyt93%100%93%100%100%93%93%87%93%93%80%
ecgberht94%100%100%100%100%100%100%93%80%100%67%
eggbot97%100%93%93%100%93%93%100%100%100%100%
overall62.38%58%63%67%63%57%69%65%59%61%60%

Dragon is strangely inconsistent. Does it learn strategy independently for each map? Does it do map analysis to adapt its play to the map, but there are flaws? Look at the PurpleWave row: Dragon crushed it on Circuit Breaker and fell down on Fighting Spirit.

mcraveoverallDestinHeartbPolariAztecLonginCircuiEmpireFightiPythonRoadki
stardust2%7%0%7%0%0%7%0%0%0%0%
purplewave5%0%13%13%0%0%0%0%20%7%0%
bananabrain45%53%27%60%40%47%40%60%47%40%40%
dragon21%20%27%7%27%20%20%27%53%7%7%
microwave77%87%47%73%80%87%80%73%93%80%73%
steamhammer57%53%33%60%47%67%80%60%53%53%67%
daqin65%87%80%87%87%47%27%33%60%80%60%
zzzkbot83%93%87%87%87%93%73%73%87%60%87%
ualbertabot89%80%100%87%93%93%93%93%87%80%80%
willyt63%80%53%40%80%67%47%60%47%73%80%
ecgberht80%80%87%60%73%80%80%80%87%93%80%
eggbot99%100%100%100%93%100%100%100%100%100%100%
overall57.22%62%54%57%59%58%54%55%61%56%56%

microwaveoverallDestinHeartbPolariAztecLonginCircuiEmpireFightiPythonRoadki
stardust1%0%0%0%0%7%0%0%0%0%0%
purplewave29%47%33%33%20%33%27%33%13%33%20%
bananabrain39%40%13%40%33%47%47%33%33%67%33%
dragon43%73%60%20%47%53%20%40%40%40%40%
mcrave23%13%53%27%20%13%20%27%7%20%27%
steamhammer29%53%47%13%33%13%33%13%27%33%20%
daqin83%87%100%73%80%93%53%87%80%100%80%
zzzkbot93%93%93%100%93%93%93%100%100%73%93%
ualbertabot61%47%60%50%53%53%87%60%60%80%60%
willyt65%87%73%27%73%47%53%47%87%87%67%
ecgberht88%60%80%80%100%93%93%80%100%100%93%
eggbot100%100%100%100%100%100%100%100%100%100%100%
overall54.47%58%59%47%54%54%52%52%54%61%53%

steamhammeroverallDestinHeartbPolariAztecLonginCircuiEmpireFightiPythonRoadki
stardust2%0%0%0%0%13%0%7%0%0%0%
purplewave5%7%0%7%7%0%7%0%13%7%0%
bananabrain29%40%20%40%13%47%20%27%27%33%27%
dragon70%80%73%67%67%80%53%80%60%80%60%
mcrave43%47%67%40%53%33%20%40%47%47%33%
microwave71%47%53%87%67%87%67%87%73%67%80%
daqin22%40%20%20%13%13%27%40%7%20%20%
zzzkbot75%60%73%93%67%93%80%93%87%47%53%
ualbertabot95%80%100%93%100%93%87%100%100%100%100%
willyt55%60%67%60%60%53%60%60%40%33%60%
ecgberht83%100%60%87%87%60%93%93%87%93%73%
eggbot97%100%100%100%93%100%87%93%100%100%100%
overall54.00%55%53%58%52%56%50%60%53%52%51%

daqinoverallDestinHeartbPolariAztecLonginCircuiEmpireFightiPythonRoadki
stardust7%13%0%0%7%13%7%13%0%13%7%
purplewave13%20%13%13%20%13%7%27%0%7%7%
bananabrain34%40%33%47%33%33%47%33%20%20%33%
dragon47%60%47%73%67%40%47%20%47%40%27%
mcrave35%13%20%13%13%53%73%67%40%20%40%
microwave17%13%0%27%20%7%47%13%20%0%20%
steamhammer78%60%80%80%87%87%73%60%93%80%80%
zzzkbot9%40%7%20%7%7%0%0%0%0%13%
ualbertabot69%73%87%53%67%60%73%73%73%71%60%
willyt96%100%100%93%93%100%100%100%100%73%100%
ecgberht99%100%93%100%100%100%100%100%100%100%100%
eggbot97%100%100%87%100%100%100%100%100%87%100%
overall50.14%53%48%51%51%51%56%51%49%42%49%

zzzkbotoverallDestinHeartbPolariAztecLonginCircuiEmpireFightiPythonRoadki
stardust1%0%0%0%0%0%0%7%0%0%0%
purplewave9%7%7%0%0%27%13%0%7%7%27%
bananabrain6%0%0%0%0%13%0%0%7%13%27%
dragon53%53%33%27%33%60%60%67%33%80%80%
mcrave17%7%13%13%13%7%27%27%13%40%13%
microwave7%7%7%0%7%7%7%0%0%27%7%
steamhammer25%40%27%7%33%7%20%7%13%53%47%
daqin91%60%93%80%93%93%100%100%100%100%87%
ualbertabot49%33%47%20%67%33%53%67%40%87%40%
willyt92%100%100%100%100%93%80%67%80%100%100%
ecgberht29%13%13%33%33%27%33%33%60%33%13%
eggbot100%100%100%100%100%100%100%100%100%100%100%
overall39.89%35%37%32%40%39%41%39%38%53%45%

ualbertabotoverallDestinHeartbPolariAztecLonginCircuiEmpireFightiPythonRoadki
stardust2%0%0%0%0%20%0%0%0%0%0%
purplewave7%7%7%20%0%0%7%0%7%13%7%
bananabrain12%7%20%0%20%13%0%13%20%0%27%
dragon20%20%8%13%20%40%13%20%29%13%20%
mcrave11%20%0%13%7%7%7%7%13%20%20%
microwave39%53%40%50%47%47%13%40%40%20%40%
steamhammer5%20%0%7%0%7%13%0%0%0%0%
daqin31%27%13%47%33%40%27%27%27%29%40%
zzzkbot51%67%53%80%33%67%47%33%60%13%60%
willyt45%27%73%47%73%47%27%33%47%27%47%
ecgberht61%60%47%67%60%60%53%73%73%47%73%
eggbot90%93%93%80%93%100%87%87%87%100%80%
overall31.14%33%30%35%32%37%24%28%34%23%34%

willytoverallDestinHeartbPolariAztecLonginCircuiEmpireFightiPythonRoadki
stardust1%0%0%0%0%0%0%0%0%7%0%
purplewave2%0%0%7%0%0%7%0%7%0%0%
bananabrain16%27%0%7%7%7%7%20%20%40%27%
dragon7%0%7%0%0%7%7%13%7%7%20%
mcrave37%20%47%60%20%33%53%40%53%27%20%
microwave35%13%27%73%27%53%47%53%13%13%33%
steamhammer45%40%33%40%40%47%40%40%60%67%40%
daqin4%0%0%7%7%0%0%0%0%27%0%
zzzkbot8%0%0%0%0%7%20%33%20%0%0%
ualbertabot55%73%27%53%27%53%73%67%53%73%53%
ecgberht74%53%87%47%80%93%80%93%87%60%60%
eggbot69%0%80%93%53%47%87%100%73%80%80%
overall29.44%19%26%32%22%29%35%38%33%33%28%

ecgberhtoverallDestinHeartbPolariAztecLonginCircuiEmpireFightiPythonRoadki
stardust1%0%0%0%0%0%0%0%0%7%7%
purplewave1%0%0%0%0%0%7%0%0%0%0%
bananabrain1%7%7%0%0%0%0%0%0%0%0%
dragon6%0%0%0%0%0%0%7%20%0%33%
mcrave20%20%13%40%27%20%20%20%13%7%20%
microwave12%40%20%20%0%7%7%20%0%0%7%
steamhammer17%0%40%13%13%40%7%7%13%7%27%
daqin1%0%7%0%0%0%0%0%0%0%0%
zzzkbot71%87%87%67%67%73%67%67%40%67%87%
ualbertabot39%40%53%33%40%40%47%27%27%53%27%
willyt26%47%13%53%20%7%20%7%13%40%40%
eggbot97%93%100%100%87%100%100%100%93%100%100%
overall24.28%28%28%27%21%24%23%21%18%23%29%

eggbotoverallDestinHeartbPolariAztecLonginCircuiEmpireFightiPythonRoadki
stardust3%0%13%0%0%0%7%0%0%7%0%
purplewave0%0%0%0%0%0%0%0%0%0%0%
bananabrain2%0%7%0%0%0%0%0%0%13%0%
dragon3%0%7%7%0%7%7%0%0%0%0%
mcrave1%0%0%0%7%0%0%0%0%0%0%
microwave0%0%0%0%0%0%0%0%0%0%0%
steamhammer3%0%0%0%7%0%13%7%0%0%0%
daqin3%0%0%13%0%0%0%0%0%13%0%
zzzkbot0%0%0%0%0%0%0%0%0%0%0%
ualbertabot10%7%7%20%7%0%13%13%13%0%20%
willyt31%100%20%7%47%53%13%0%27%20%20%
ecgberht3%7%0%0%13%0%0%0%7%0%0%
overall4.72%9%4%4%7%5%4%2%4%4%3%

EggBot’s wins against WillyT—the majority of all its wins—seem to have come from very specific situations.

Trackbacks

No Trackbacks

Comments

No comments

Add Comment

E-Mail addresses will not be displayed and will only be used for E-Mail notifications.

To prevent automated Bots from commentspamming, please enter the string you see in the image below in the appropriate input box. Your comment will only be submitted if the strings match. Please ensure that your browser supports and accepts cookies, or your comment cannot be verified correctly.
CAPTCHA

Form options

Submitted comments will be subject to moderation before being displayed.