archive by month
Skip to content

CIG 2018 detailed results are out

As LetaBot mentioned in a comment, CIG 2018 detailed results are out. They include a result file that I can analyze with my software, so expect the usual colorful crosstables in the coming days. For today, a few notes:

#7 ZZZKBot, whose basic strategy is 4 pool though it has added other strategies in recent years, was the only player with a plus score over #1 Locutus. On the one hand, it shows how dominant Locutus was. On the other hand, what did ZZZKBot do to win? Was it a prepared strategy? I’ll be looking into it. There are a few other interesting upsets.

The win rate over time graph shows which bots benefited from learning during the tournament, or at least which benefited from changes in play by themselves or their opponents (you could gain win rate over time if your opponents mislearn about you). To my eye, there seems to be a higher rate of curving lines than I remember from past years. I’ll look into that too.

#17 Steamhammer, with about 35% win rate, was the bot with the most crashes at 1553 out of 3250 games. That’s a much higher rate than I expected, 47%. I still do not know why the crashes never showed up in my test environment. On the upside, Steamhammer scored 66% in games where it did not crash, which suggests that it did approximately keep up with general progress over the last year. In any case, it’s another reminder that reliability is a top priority. The second place crashing bot was #27 Salsa at 35% crashes, and Salsa finished dead last. The third place crasher at 30% crashes was #15 TitanIron, which also finished unexpectedly low after high expectations among watchers who guessed it was a fork of Iron. Every other bot had a crash rate under 10%.

And there is source. I will look into the code of some participants to see how they tick.

Trackbacks

No Trackbacks

Comments

Jay Scott on :

Another interesting point: Sort the result table by average game length. This groups the terran bots tightly together with the longest games.

Bruce on :

Chris has said on Discord that ZZZK was basically identical to the SSCAIT version but with some fixes to the opening learning, and specifically for Locutus he changed it to default to the speedling build instead of 4-pool. Unfortunately I had also introduced a bug in how I ramped up wall cannons against delayed pressure, so that build did very well.

Dilyan on :

Against locutus I am surprised no zerg (or maybe zzzkbot) did not do 9p speed with run by. Locutus does not do blocking with probes so run by with speed or even without speed zerglings is a win.
anyway I am very excited for IsAmind. It showed fantastic results and I expect even better results in Aiide.

McRave on :

CIG ISaMind is purely old Locutus with NN learning, wouldn't be surprised if there were very few changes into AIIDE.

Dilyan on :

How much NN has?

MicroDK on :

As far as I understand from users on Discord, IsaMind uses NN to find the opponent plan. Nothing else.

Dan on :

ISAMind wound up not submitting to AIIDE

MicroDK on :

Both DaQin and IsaMind are on the participants list and has been tested.... https://docs.google.com/spreadsheets/d/1MH0knEpg_zBIG-LSogJunyJUbeMaaz0gNHKSEmxmyCk/htmlview

MicroDK on :

Run bys are hard to code... IsaMind is a fork of Locutus... no wonder did good in CIG.

Dilyan on :

Well that was dissapointing to hear...

Dan on :

I'd like to point out the big area of the winrate curve where PW stayed ahead of Locutus. I attribute that to manually pre-"training" PW's learning. Wasting games on exploration makes a big difference, since competitions are often decided by less than a percent.

MicroDK on :

I did not add any pretrained data since my tests showed that Microwave would not find one single strategy against the most dominant bots like Locutus, McRave, PurpleWave and Iron. So I just let it play. ;)

Dan on :

Yeah, it's not the strong bots it matters against. It's the weak ones.

MicroDK on :

I am lookking forward to see why LetaBot had 3 upsets vs Iron, ZZZKBot and Microwave. When it is updated on SSCAIT I predict it will get into top 10.

Jay Scott on :

A comment from Martin Rooijackers said that LetaBot has bug fixes and little other change.

Sungguk Cha on :

Hi I am Zia bot author.
I haven t updated more than two years but what you mention me always as inspirses me. I will be back next year.
Thanks, I like your posts.

Add Comment

E-Mail addresses will not be displayed and will only be used for E-Mail notifications.

To prevent automated Bots from commentspamming, please enter the string you see in the image below in the appropriate input box. Your comment will only be submitted if the strings match. Please ensure that your browser supports and accepts cookies, or your comment cannot be verified correctly.
CAPTCHA

Form options

Submitted comments will be subject to moderation before being displayed.