Starcraft AI blog

AIIDE 2023 - what McRave learned

nospam@example.com (Jay Scott) — Fri, 20 Oct 2023 18:12:00 -0400

In 2020, I analyzed McRave’s three-part strategy representation. This version of McRave is the CoG 2022 version, and I think details have changed, but the basic structure is the same as in 2020.

With its deadly mutalisks, McRave apparently does not bother to learn what to play against zerg opponents. In ZvZ, it follows the same 9 pool into one hatch muta strategy every game. It went mutas in most games against terran and protoss, too. But it’s still interesting to see what it recognized in its opponents play.

#1 bananabrain

opening	games	wins	first	last
HatchPool,12Hatch,2HatchMuta	203	18%	0	286
PoolHatch,Overpool,2HatchMuta	85	5%	1	287
2 openings	288	14%

enemy	games	wins
1GateCore,2Zealot,Corsair	280	14%
1GateCore,2Zealot,Speedlot	5	0%
1GateCore,Unknown,Corsair	3	0%
3 openings	288	14%

#2 stardust

opening	games	wins	first	last
HatchPool,12Hatch,2HatchMuta	152	6%	0	287
PoolHatch,Overpool,2HatchMuta	69	7%	5	286
PoolHatch,Overpool,3HatchMuta	36	3%	3	283
PoolHatch,Overpool,6HatchHydra	32	0%	1	288
4 openings	289	5%

enemy	games	wins
1GateCore,2Zealot,4Gate	7	29%
1GateCore,2Zealot,Corsair	107	5%
2Gate,10/12,4Gate	1	0%
2Gate,10/12,Corsair	1	0%
2Gate,10/17,4Gate	5	20%
2Gate,10/17,Corsair	18	11%
2Gate,Proxy,ZealotRush	1	0%
FFE,Forge,CorsairGoon	85	1%
FFE,Forge,DoubleStargate	7	0%
FFE,Forge,Speedlot	17	0%
FFE,Forge,Unknown	5	20%
FFE,Gateway,CorsairGoon	20	5%
FFE,Gateway,Speedlot	4	0%
FFE,Nexus,CorsairGoon	4	0%
FFE,Nexus,DoubleStargate	1	0%
Unknown,Unknown,Unknown	6	33%
16 openings	289	5%

#3 purplewave

opening	games	wins	first	last
HatchPool,12Hatch,2HatchMuta	239	45%	0	289
PoolHatch,Overpool,2HatchMuta	51	20%	1	277
2 openings	290	40%

enemy	games	wins
1GateCore,2Zealot,4Gate	1	0%
1GateCore,2Zealot,Corsair	27	0%
1GateCore,2Zealot,Robo	1	100%
1GateCore,2Zealot,Speedlot	10	0%
1GateCore,Unknown,4Gate	1	100%
1GateCore,Unknown,Speedlot	1	100%
2Gate,10/12,Corsair	115	54%
2Gate,10/12,DT	1	0%
2Gate,10/12,Unknown	12	0%
2Gate,10/12,ZealotRush	74	50%
2Gate,10/17,Corsair	22	32%
2Gate,10/17,Unknown	5	0%
2Gate,10/17,ZealotRush	10	40%
2Gate,9/9,Corsair	3	0%
2Gate,9/9,Unknown	1	0%
2Gate,9/9,ZealotRush	1	100%
2Gate,Proxy,ZealotRush	1	100%
2Gate,Unknown,Corsair	1	100%
2Gate,Unknown,ZealotRush	3	33%
19 openings	290	40%

#4 steamhammer

opening	games	wins	first	last
PoolLair,9Pool,1HatchMuta	290	50%	0	289
1 opening	290	50%

enemy	games	wins
HatchPool,10Hatch,2HatchSpeedling	1	100%
PoolHatch,12Pool,2HatchHydra	1	100%
PoolHatch,12Pool,2HatchMuta	1	100%
PoolHatch,12Pool,2HatchSpeedling	11	100%
PoolHatch,12Pool,3HatchSpeedling	2	100%
PoolHatch,4Pool,LingRush	3	100%
PoolHatch,7Pool,2HatchSpeedling	2	100%
PoolHatch,9Pool,2HatchSpeedling	16	75%
PoolLair,12Pool,1HatchMuta	57	56%
PoolLair,4Pool,1HatchMuta	1	0%
PoolLair,7Pool,1HatchMuta	25	48%
PoolLair,9Pool,1HatchMuta	23	43%
PoolLair,Unknown,1HatchMuta	1	0%
Unknown,12Pool,1HatchHydra	2	100%
Unknown,12Pool,2HatchSpeedling	19	47%
Unknown,12Pool,Unknown	5	0%
Unknown,7Pool,2HatchSpeedling	63	49%
Unknown,7Pool,Unknown	1	0%
Unknown,9Pool,2HatchSpeedling	37	14%
Unknown,Unknown,1HatchHydra	3	67%
Unknown,Unknown,2HatchSpeedling	9	100%
Unknown,Unknown,3HatchMuta	2	50%
Unknown,Unknown,Unknown	5	0%
23 openings	290	50%

#6 microwave

opening	games	wins	first	last
PoolLair,9Pool,1HatchMuta	290	89%	0	289
1 opening	290	89%

enemy	games	wins
HatchPool,10Hatch,2HatchSpeedling	2	100%
PoolHatch,12Pool,2HatchSpeedling	22	100%
PoolHatch,12Pool,3HatchMuta	4	100%
PoolHatch,12Pool,3HatchSpeedling	1	0%
PoolHatch,12Pool,Unknown	23	100%
PoolHatch,4Pool,LingRush	14	100%
PoolHatch,7Pool,2HatchSpeedling	14	100%
PoolHatch,9Pool,2HatchSpeedling	45	100%
PoolHatch,Unknown,2HatchSpeedling	1	100%
PoolLair,12Pool,1HatchLurker	1	100%
PoolLair,9Pool,1HatchMuta	2	100%
PoolLair,9Pool,2HatchMuta	1	100%
Unknown,12Pool,1HatchHydra	2	100%
Unknown,4Pool,LingRush	22	100%
Unknown,7Pool,2HatchSpeedling	114	78%
Unknown,9Pool,2HatchSpeedling	9	33%
Unknown,Unknown,1HatchHydra	3	100%
Unknown,Unknown,2HatchSpeedling	8	88%
Unknown,Unknown,3HatchSpeedling	1	100%
Unknown,Unknown,Unknown	1	100%
20 openings	290	89%

#7 dragon

opening	games	wins	first	last
HatchPool,12Hatch,2HatchMuta	38	42%	0	271
HatchPool,12Hatch,2HatchSpeedling	3	0%	49	199
PoolHatch,12Pool,2HatchMuta	11	45%	44	274
PoolHatch,12Pool,2HatchSpeedling	6	0%	19	235
PoolHatch,12Pool,3HatchMuta	107	76%	1	289
PoolHatch,Overpool,2HatchMuta	27	48%	15	282
PoolHatch,Overpool,2HatchSpeedling	27	70%	2	286
PoolHatch,Overpool,3HatchMuta	71	76%	28	285
8 openings	290	65%

enemy	games	wins
2Rax,Expand,MarineRush	1	0%
2Rax,Main,1FactTanks	12	25%
2Rax,Main,5FactGoliath	38	58%
2Rax,Main,Academy	26	42%
2Rax,Main,MarineRush	13	8%
2Rax,Main,Unknown	61	56%
2Rax,Proxy,Unknown	1	0%
2Rax,Proxy,WorkerRush	3	67%
2Rax,Unknown,Unknown	1	100%
RaxCC,1RaxFE,1FactTanks	2	50%
RaxCC,1RaxFE,5FactGoliath	16	88%
RaxCC,1RaxFE,Unknown	2	100%
RaxFact,Unknown,2Fact	15	73%
RaxFact,Unknown,2PortWraith	4	75%
RaxFact,Unknown,5FactGoliath	18	94%
RaxFact,Unknown,Unknown	9	78%
Unknown,Unknown,5FactGoliath	20	90%
Unknown,Unknown,Unknown	30	83%
Unknown,Unknown,WorkerRush	18	89%
19 openings	290	65%

#8 ualbertabot

opening	games	wins	first	last
PoolHatch,Overpool,2HatchMuta	206	35%	0	289
PoolHatch,Overpool,2HatchSpeedling	84	32%	1	285
2 openings	290	34%

enemy	games	wins
2Gate,10/12,ZealotRush	52	50%
2Gate,10/17,Unknown	1	0%
2Gate,10/17,ZealotRush	5	0%
2Gate,9/9,ZealotRush	53	42%
2Rax,Main,+1 5Rax	1	100%
2Rax,Main,MarineRush	1	0%
2Rax,Main,Unknown	85	26%
2Rax,Proxy,Unknown	1	100%
Unknown,4Pool,LingRush	74	34%
Unknown,7Pool,2HatchSpeedling	2	50%
Unknown,Unknown,2HatchSpeedling	4	0%
Unknown,Unknown,Unknown	11	18%
12 openings	290	34%

#9 infestedartosis

opening	games	wins	first	last
PoolLair,9Pool,1HatchMuta	290	99%	0	289
1 opening	290	99%

enemy	games	wins
HatchPool,10Hatch,2HatchSpeedling	3	100%
PoolHatch,12Pool,2HatchMuta	5	100%
PoolHatch,12Pool,2HatchSpeedling	132	100%
PoolHatch,12Pool,3HatchMuta	13	100%
PoolHatch,12Pool,3HatchSpeedling	7	100%
PoolHatch,9Pool,2HatchMuta	4	100%
PoolHatch,9Pool,2HatchSpeedling	67	100%
PoolHatch,9Pool,3HatchMuta	16	100%
PoolLair,12Pool,1HatchMuta	2	100%
PoolLair,7Pool,1HatchMuta	3	100%
Unknown,12Pool,2HatchSpeedling	7	86%
Unknown,7Pool,2HatchSpeedling	9	100%
Unknown,9Pool,2HatchSpeedling	1	0%
Unknown,Unknown,2HatchSpeedling	10	100%
Unknown,Unknown,3HatchMuta	6	100%
Unknown,Unknown,3HatchSpeedling	2	100%
Unknown,Unknown,Unknown	3	100%
17 openings	290	99%

AIIDE 2023 - what Microwave learned

nospam@example.com (Jay Scott) — Thu, 19 Oct 2023 08:23:00 -0400

Microwave is configured to save only the most recent 200 game records. There were 290 rounds, so where all games were played, it dropped data for 90 games. (Steamhammer is configured the same way, though the data it stores is quite different.)

#1 bananabrain

opening	games	wins	first	last
10Hatch9Pool9gas	1	0%	187	187
10HatchMain9Pool9Gas	2	0%	150	152
10HatchTurtleHydra	2	0%	62	65
11Gas10PoolMuta	2	0%	131	155
11HatchTurtleHydra	1	0%	86	86
11HatchTurtleLurker	1	0%	113	113
11HatchTurtleMuta	2	0%	78	97
12Hatch	1	0%	67	67
12HatchTurtle	1	0%	130	130
12Pool	2	0%	28	87
12PoolMain	1	0%	85	85
1HatchMuta_Sparkle	5	0%	59	143
2HatchLurker	2	0%	51	53
2HatchLurkerAllIn	1	0%	172	172
2HatchMuta	17	18%	84	199
2HatchMuta_Sparkle	2	0%	55	128
3Hatch	2	0%	50	56
3HatchExpo	2	0%	122	190
3HatchHydraBust	7	0%	52	170
3HatchHydraExpo	1	0%	70	70
3HatchLingBust	5	0%	58	162
3HatchLurker	2	0%	72	144
3HatchMuta	18	6%	4	193
3HatchMutaExpo	4	0%	68	157
3HatchMuta_Sparkle	1	0%	95	95
3HatchPoolHydra	5	0%	57	197
4HatchBeforeGas	6	0%	34	154
4HatchPool	1	0%	139	139
4HatchPoolHydra	4	0%	115	198
4PoolHard	2	0%	48	69
4PoolSoft	1	0%	24	24
5HatchPool	1	0%	60	60
5HatchPoolHydra	3	0%	49	142
5Pool	15	7%	19	188
6Pool	2	0%	47	173
7Pool	2	0%	92	120
7PoolHydraLingRush7D	1	0%	123	123
8Pool	2	0%	117	118
8PoolHydraRush8D	1	0%	135	135
9Hatch9Pool9Gas	2	0%	22	108
9HatchMain8Pool8Gas	1	0%	76	76
9Pool	3	0%	88	126
9PoolExpo	2	0%	27	99
9PoolGasHatchSpeed8D	1	0%	71	71
9PoolHatch	3	0%	15	175
9PoolHatchGasSpeed8D	18	17%	0	186
9PoolSpeed	7	0%	12	183
9PoolSpeedLing	3	0%	13	125
9PoolSunkHatch	2	0%	111	182
9PoolSunken	2	0%	73	96
Overpool	3	0%	89	136
OverpoolSpeed	3	0%	31	176
OverpoolSunken	2	0%	64	151
OverpoolTurtle	2	0%	91	145
ZvP_10Hatch9Pool	6	0%	18	129
ZvP_11Hatch10Pool	3	0%	83	158
ZvZ_Overgas11Pool	1	0%	105	105
ZvZ_Overgas9Pool	1	0%	10	10
ZvZ_Overpool11Gas	3	0%	16	196
ZvZ_OverpoolTurtle	1	0%	23	23
60 openings	200	4%

enemy	games	wins
HeavyRush	26	0%
NakedExpand	10	0%
Proxy	2	0%
SafeExpand	125	2%
Turtle	16	12%
Unknown	21	19%
6 openings	200	4%

Mutalisks were good—relatively speaking—even though this version of BananaBrain goes heavy on the corsairs. Even the slow-starting 3 hatch muta was more successful than most builds. It’s curious that the highest win rate came when Microwave was unable to figure out what opening BananaBrain was playing. I doubt the cost of scouting is that high. I’m guessing it’s more likely that scouting failed more often when starting positions were distant. That gave Microwave more time to prepare.

#2 stardust

opening	games	wins	first	last
10Hatch9Pool9gas	2	0%	79	125
10HatchTurtleHydra	1	0%	147	147
11Gas10PoolMuta	1	0%	181	181
12HatchMain	1	0%	49	49
1HatchMuta_Sparkle	1	0%	105	105
2HatchHydra	1	0%	141	141
2HatchLurker	2	0%	130	171
2HatchMuta	3	0%	66	103
3HatchHydra	1	0%	80	80
3HatchHydraBust	4	0%	44	168
3HatchLingBust	2	0%	16	93
3HatchMuta	3	0%	62	170
3HatchMutaExpo	2	0%	17	104
3HatchMuta_Sparkle	1	0%	178	178
3HatchPoolExpo	2	0%	129	149
3HatchPoolHydra	1	0%	135	135
4HatchBeforeGas	4	0%	5	177
4HatchPool	1	0%	82	82
4PoolHard	2	0%	13	30
4PoolSoft	2	0%	45	195
5HatchPool	1	0%	111	111
5HatchPoolHydra	8	0%	9	119
5PoolSpeed	1	0%	118	118
7PoolHydraLingRush7D	1	0%	126	126
8Pool	1	0%	64	64
9HatchTurtleHydra	1	0%	35	35
9Pool	1	0%	139	139
9PoolExpo	1	0%	117	117
9PoolGasHatchSpeed7D	8	0%	2	172
9PoolGasHatchSpeed8D	1	0%	191	191
9PoolHatch	2	0%	120	179
9PoolSpeed	2	0%	102	157
9PoolSpeedLing	128	21%	0	199
OverpoolLurker	1	0%	121	121
OverpoolSpeed	1	0%	52	52
ZvP_10Hatch9Pool	4	0%	12	173
ZvP_2HatchHydra	1	0%	53	53
37 openings	200	14%

enemy	games	wins
HeavyRush	17	0%
NakedExpand	20	30%
SafeExpand	86	0%
Turtle	28	0%
Unknown	49	43%
5 openings	200	14%

But Stardust was (a little) vulnerable to zerglings. Again, the highest win rate came when Microwave did not know what Stardust was doing.

#3 purplewave

opening	games	wins	first	last
10Hatch9Pool9gas	21	57%	11	195
11HatchTurtleHydra	1	0%	6	6
2HatchLurker	1	0%	71	71
3HatchHydra	1	0%	165	165
4PoolSoft	1	0%	172	172
5Pool	3	33%	3	23
9PoolGasHatchSpeed8D	1	0%	39	39
9PoolHatchGasSpeed8D	167	84%	0	199
9PoolSpeed	1	0%	145	145
OverpoolTurtle	1	0%	95	95
ZvP_9Hatch9Pool	1	0%	1	1
ZvZ_Overpool9Gas	1	0%	180	180
12 openings	200	77%

enemy	games	wins
HeavyRush	92	74%
NakedExpand	2	0%
Unknown	106	81%
3 openings	200	77%

PurpleWave just fell over to Microwave’s zerglings. But even here, an Unknown enemy build was good news for Microwave.

Steamhammer was also successful with zerglings (I’ll post its data when I get to it), but nothing like this successful. I expect that, true to its name, Microwave has superior zergling micro. Though maybe it’s just more aggressive?

#4 steamhammer

opening	games	wins	first	last
10HatchMain9Pool9Gas	6	33%	141	153
10HatchTurtleHydra	3	33%	174	178
12Hatch	1	0%	145	145
12Pool	12	42%	91	180
12PoolMain	1	0%	72	72
1HatchMuta_Sparkle	16	44%	94	164
3Hatch	10	60%	183	198
3HatchExpo	2	0%	32	59
3HatchLingBust	1	0%	40	40
3HatchPoolHydra	1	0%	130	130
4PoolHard	4	25%	52	62
4PoolSoft	2	0%	67	165
5Pool	3	33%	97	136
5PoolSpeed	8	25%	43	83
6Pool	1	0%	10	10
7Pool	1	0%	195	195
9HatchMain8Pool8Gas	1	0%	73	73
9PoolHatchGasSpeed8D	22	59%	35	199
9PoolSpeed	29	41%	11	196
OverpoolSpeed	49	39%	0	187
ZvZ_Overgas11Pool	3	33%	57	103
ZvZ_Overpool11Gas	1	0%	8	8
ZvZ_Overpool9Gas	23	39%	1	182
23 openings	200	40%

enemy	games	wins
HeavyRush	125	34%
NakedExpand	10	70%
Turtle	41	32%
Unknown	24	67%
4 openings	200	40%

A lot of openings are roughly equal. I suspect that some of the ones that scored 0 would have also been roughly equal if they’d been tried more times.

#5 mcrave

opening	games	wins	first	last
10Hatch9Pool9gas	1	0%	157	157
11Gas10PoolMuta	1	0%	96	96
12Hatch	1	0%	179	179
12HatchMain	1	0%	164	164
12HatchTurtle	15	0%	1	121
12Pool	1	0%	150	150
2HatchHydra	1	0%	66	66
2HatchLurker	1	0%	69	69
2HatchLurkerAllIn	2	0%	15	119
2HatchMuta	1	0%	98	98
3Hatch	1	0%	78	78
3HatchExpo	1	0%	14	14
3HatchHydra	2	0%	171	188
3HatchHydra_BHG	1	0%	140	140
3HatchLingBust	1	0%	133	133
3HatchPoolHydra	2	0%	163	191
4HatchBeforeGas	1	0%	36	36
4HatchPoolHydra	1	0%	139	139
4PoolHard	8	0%	7	130
4PoolSoft	7	0%	43	168
5HatchPool	1	0%	183	183
5HatchPoolHydra	1	0%	3	3
5Pool	5	0%	56	149
6Pool	1	0%	156	156
7Pool	1	0%	103	103
7PoolHydraLingRush7D	2	0%	17	151
9PoolGasHatchSpeed7D	1	0%	193	193
9PoolHatchGasSpeed8D	126	18%	0	199
9PoolSunken	3	0%	88	147
OverpoolSpeed	1	0%	51	51
OverpoolSunken	1	0%	190	190
OverpoolTurtle	1	0%	59	59
ZvP_10Hatch9Pool	2	0%	115	181
ZvP_2HatchHydra	2	0%	57	153
ZvZ_Overgas9Pool	1	0%	87	87
ZvZ_Overpool11Gas	1	0%	60	60
36 openings	200	12%

enemy	games	wins
FastRush	3	0%
HeavyRush	171	11%
NakedExpand	2	0%
Turtle	15	27%
Unknown	9	0%
5 openings	200	12%

So: Good with zerglings, not so good with mutalisks. Microwave knows how to defend its bases with two spore colonies each, in the standard pro way, but apparently that’s not enough to survive against McRave.

#7 dragon

opening	games	wins	first	last
10HatchTurtleHydra	1	0%	82	82
11HatchTurtleMuta	4	25%	72	142
12Hatch	16	44%	45	158
1HatchMuta_Sparkle	1	0%	40	40
3HatchExpo	2	50%	178	179
3HatchHydraBust	1	0%	37	37
3HatchLurker	1	0%	123	123
3HatchMutaExpo	2	50%	187	188
3HatchMuta_Sparkle	24	75%	160	199
5HatchPool	37	51%	2	192
5HatchPoolHydra	96	57%	0	195
5PoolSpeed	1	0%	97	97
7PoolHydraLingRush7D	3	0%	43	100
7PoolHydraRush7D	2	0%	119	131
8Pool	1	0%	169	169
8PoolHydraRush8D	1	0%	24	24
9PoolExpo	1	0%	84	84
9PoolGasHatchSpeed8D	1	0%	108	108
9PoolSpeed	1	0%	7	7
9PoolSunken	1	0%	64	64
ZvP_9Hatch9Pool	1	0%	125	125
ZvZ_Overgas11Pool	1	0%	106	106
ZvZ_Overgas9Pool	1	0%	175	175
23 openings	200	51%

enemy	games	wins
Factory	178	48%
HeavyRush	2	50%
SafeExpand	7	86%
Unknown	9	89%
WorkerRush	4	25%
5 openings	200	51%

The two top builds are 5 hatcheries before spawning pool. Compare Dragon’s table for Microwave, which says that opening with mass vultures was best. The vultures must have often come before Microwave could defend itself.

#8 ualbertabot

opening	games	wins	first	last
11Gas10PoolLurker	4	50%	92	111
11HatchTurtleHydra	48	65%	0	191
12PoolMain	1	0%	181	181
3HatchPoolHydra	1	0%	109	109
5HatchPool	1	0%	94	94
6Pool	25	60%	142	197
7PoolHydraRush7D	2	50%	166	167
9Hatch9Pool9Gas	1	0%	188	188
9HatchTurtleHydra	1	0%	175	175
9Pool	41	61%	10	189
9PoolGasHatchSpeed7D	22	55%	12	169
9PoolGasHatchSpeed8D	22	77%	16	199
9PoolHatch	1	0%	58	58
9PoolSunken	1	0%	165	165
ZvP_2HatchHydra	26	58%	25	193
ZvZ_OverpoolTurtle	3	33%	45	133
16 openings	200	60%

enemy	games	wins
Factory	5	100%
FastRush	39	69%
HeavyRush	118	50%
NakedExpand	6	100%
Unknown	32	69%
5 openings	200	60%

#9 infestedartosis

opening	games	wins	first	last
5Pool	72	94%	0	199
9PoolSpeedLing	120	98%	3	198
9PoolSunken	8	88%	55	196
3 openings	200	96%

enemy	games	wins
HeavyRush	83	90%
NakedExpand	80	100%
Unknown	37	100%
3 openings	200	96%

AIIDE 2023 - what Dragon learned

nospam@example.com (Jay Scott) — Wed, 18 Oct 2023 13:09:00 -0400

Once the opening build is over, Dragon adapts to the opponent’s unit mix and many of its games start to look similar. Nevertheless, the opening makes a big difference in how the game comes out.

The “dirty worker rush” is a late rush with a lot of SCVs. You have to be ready for it, but if you are, it’s easy to beat.

#1 bananabrain

opening	games	wins	first	last
1rax fe	41	5%	2	271
2rax bio	27	0%	5	260
2rax mech	46	4%	0	279
bio	45	4%	1	282
dirty worker rush	26	0%	3	203
mass vulture	54	7%	6	281
siege expand	48	12%	4	286
7 openings	287	6%

#2 stardust

opening	games	wins	first	last
1rax fe	60	10%	6	271
2rax bio	28	7%	3	272
2rax mech	78	13%	0	288
bio	45	7%	2	266
dirty worker rush	25	0%	5	268
mass vulture	27	4%	4	253
siege expand	26	0%	1	276
7 openings	289	8%

It’s surprising that adding a second barracks was best against Stardust. I imagine the extra firepower was good against the first protoss attack.

#3 purplewave

opening	games	wins	first	last
1rax fe	8	25%	5	268
2rax bio	5	0%	1	201
2rax mech	5	0%	0	136
bio	202	56%	9	287
dirty worker rush	5	0%	8	263
mass vulture	58	53%	2	205
siege expand	5	0%	3	204
7 openings	288	51%

#4 steamhammer

opening	games	wins	first	last
1rax fe	8	0%	1	282
2rax bio	10	10%	0	149
2rax mech	25	16%	2	227
bio	40	25%	5	278
dirty worker rush	171	44%	4	287
mass vulture	24	21%	6	209
siege expand	10	10%	3	132
7 openings	288	34%

That SCV rush! Reading through Dragon’s game history file, you can practically see the two learning systems dueling. Dragon loses a string of games - it finds that the SCV rush works - before long Steamhammer switches builds to beat it - Dragon notices and searches for an opening to exploit weaknesses in Steamhammer’s answer - and so on. Steamhammer knows about fast worker rushes, but doesn’t have a special reaction to late worker rushes. It underestimates the danger of the SCVs. Dragon and WillyT are the only opponents that take advantage.

#5 mcrave

opening	games	wins	first	last
1rax fe	9	0%	7	279
2rax bio	69	54%	5	262
2rax mech	118	40%	10	288
bio	23	26%	6	178
dirty worker rush	21	14%	2	265
mass vulture	24	21%	1	169
siege expand	25	16%	0	276
7 openings	289	35%

McRave copes with the SCV rush, so Dragon settles on mainstream builds.

#6 microwave

opening	games	wins	first	last
1rax fe	10	30%	1	280
2rax bio	18	28%	10	161
2rax mech	8	12%	15	249
bio	6	0%	0	272
dirty worker rush	15	47%	8	285
mass vulture	224	50%	6	281
siege expand	5	0%	7	106
7 openings	286	44%

Microwave would likely have done much better if it coped with the vultures better.

#8 ualbertabot

opening	games	wins	first	last
1rax fe	43	86%	85	289
2rax bio	1	0%	0	0
2rax mech	6	50%	71	137
bio	76	84%	3	86
dirty worker rush	69	88%	58	286
mass vulture	69	86%	88	287
siege expand	26	65%	1	219
7 openings	290	83%

#9 infestedartosis

opening	games	wins	first	last
1rax fe	2	0%	109	225
2rax bio	12	50%	2	228
2rax mech	5	40%	80	223
bio	6	50%	108	288
dirty worker rush	25	68%	0	224
mass vulture	226	85%	6	289
siege expand	14	57%	112	209
7 openings	290	78%

AIIDE 2023 - what UAlbertaBot learned

nospam@example.com (Jay Scott) — Tue, 17 Oct 2023 15:57:00 -0400

opening	total	#1 bananab	#2 stardus	#3 purplew	#4 steamha	#5 mcrave	#6 microwa	#7 dragon	#9 infeste
total	- 31%	5-279 2%	25-263 9%	53-236 18%	9-274 3%	183-102 64%	112-170 40%	48-236 17%	263-26 91%
4RaxMarines	8-117 6%	0-19 0%	5-33 13%	0-11 0%	0-22 0%	-	3-16 16%	0-16 0%	-
MarineRush	181-240 43%	2-25 7%	1-18 5%	14-54 21%	1-28 3%	65-30 68%	18-45 29%	3-29 9%	77-11 88%
TankPush	1-89 1%	0-18 0%	1-16 6%	0-11 0%	0-21 0%	-	0-7 0%	0-16 0%	-
VultureRush	1-90 1%	0-18 0%	0-12 0%	0-11 0%	0-21 0%	-	0-7 0%	1-21 5%	-
DTRush	24-177 12%	1-40 2%	0-25 0%	3-41 7%	0-18 0%	-	-	20-53 27%	-
DragoonRush	2-119 2%	0-32 0%	2-39 5%	0-22 0%	0-18 0%	-	-	0-8 0%	-
ZealotRush	229-236 49%	0-32 0%	2-39 5%	0-22 0%	8-54 13%	62-46 57%	59-23 72%	3-18 14%	95-2 98%
2HatchHydra	44-143 24%	1-27 4%	0-10 0%	32-44 42%	0-23 0%	-	2-10 17%	9-29 24%	-
3HatchMuta	1-73 1%	0-21 0%	0-10 0%	0-4 0%	0-23 0%	-	0-5 0%	1-10 9%	-
3HatchScourge	1-73 1%	0-20 0%	1-14 7%	0-4 0%	0-23 0%	-	0-5 0%	0-7 0%	-
ZerglingRush	206-229 47%	1-27 4%	13-47 22%	4-12 25%	0-23 0%	56-26 68%	30-52 37%	11-29 28%	91-13 88%

UAlbertaBot’s primary builds are MarineRush, ZealotRush (9-9 gates), and ZerglingRush (5 pool). Against #5 McRave and #9 InfestedArtosis, it stuck with them. Against other opponents it experimented with alternatives to try to escape its losses. It found 4RaxMarines (barracks at 4 supply) against #2 Stardust, 2HatchHydra against #3 PurpleWave, and DTRush against #7 Dragon.

AIIDE 2023 - what InfestedArtosis learned

nospam@example.com (Jay Scott) — Mon, 16 Oct 2023 11:57:00 -0400

InfestedArtosis learns three things independently of each other: Opening build, unit mix, and whether to build a defensive sunken under certain circumstances. For some reason, every opponent has data for exactly 46 decisions of whether to build the defense. I didn’t look into why.

It enables different options against each race, so I made separate tables. It didn’t seem worthwhile to write code to extract the small amount of data from 8 short files (especially the clumsy way I first thought of doing it), so I made the tables by hand. There may be minor errors.

The tables simply repeat what’s in the learning files. The first number is wins, the second is losses.

protoss

item			PurpleWave
OverPool	73	73	14	54
NinePoolSpeed	73	73	1	33
FourPool	70	70	35	43
TwelveHatch	73	72	31	76
LingFlood	73	73	77	115
Mutalisk	72	72	3	33
Default	72	72	1	30
Hydra	72	71	0	28
sunken	46	46	13	33

InfestedArtosis seems to have lost information about one game versus #2 Stardust, though the official results say that all 290 games completed and that InfestedArtosis had zero crashes.

#3 PurpleWave was vulnerable to zerglings, especially with 4 pool but also after the economical 12 hatchery.

zerg

item	Steamhammer		McRave		Microwave
OverPool	0	55	1	59	3	58
TwelvePool	0	54	0	56	1	52
NinePoolSpeed	3	64	1	56	7	66
TwelveHatch	1	58	0	56	0	49
NineHatch	0	54	0	55	0	49
LingFlood	1	137	2	148	4	132
Mutalisk	3	148	0	137	7	142
sunken	1	45	0	46	2	44

terran

item	Dragon
TwelvePool	15	53
NinePoolSpeed	13	52
FourPool	0	30
TwelveHatch	35	81
LingFlood	1	33
Mutalisk	10	45
Default	38	84
Hydra	14	54
sunken	8	38

Rushes did not work against the slow-moving #7 Dragon, but countering with slow zerg play was fairly effective. TwelveHatch 35/81 is 43%, while TwelvePool 15/53 is only 28%.

random

item	UAlbertaBot
OverPool	1	61
NinePoolSpeed	0	58
FourPool	18	65
FivePool	6	77
LingFlood	21	100
Mutalisk	3	59
Default	1	53
Hydra	0	49
sunken	2	44

I’m surprised that 4 pool worked as well as it did against UAlbertaBot. UAlbertaBot’s protoss and zerg builds should both counter it.

AIIDE 2023 - the learning curves

nospam@example.com (Jay Scott) — Fri, 13 Oct 2023 20:59:00 -0400

No big analysis, but I do want to point out a couple features of the cumulative results over time.

#1 Stardust, #3 PurpleWave, and #8 UAlbertaBot largely declined over the tournament, or declined and leveled out. They were outlearned by the competition. Steamhammer is slow to learn but keeps learning for a long time, and its curve is fairly flat.

The two bots with the most impressive learning curves are #7 Dragon, a carryover from last year, and #9 InfestedArtosis, the tail ender. Dragon improved between round 25 and 100. Infested Artosis improved after round 100. Between round 100 and the end of the tournament, InfestedArtosis increased its score by 3.1% in absolute terms, more than any other bot improved after round 100. No other bot comes close over the same period. The weakest bot outdid all others in continuing to play better over the entire long tournament.

InfestedArtosis has a simple learning method. It independently learns three things, each from a short menu of choices: What opening build to play, what unit mix to follow up with, and whether to build static defense. Imagine how well it might learn if it, say, approximated the joint distribution and chose based on that!

AIIDE 2023 - map tables by bot

nospam@example.com (Jay Scott) — Thu, 12 Oct 2023 20:21:00 -0400

The first table is the same as yesterday’s, for reference. Except I didn’t mark old/new maps.

#	bot	overall	Destin	MatchP	Polari	Longin	NeoSyl	Arcadi	Coloss	Empire	NeoGro	Roadki
1	bananabrain	84.54%	91%	81%	81%	87%	87%	87%	84%	81%	83%	84%
2	stardust	83.43%	71%	87%	90%	89%	84%	84%	86%	74%	84%	85%
3	purplewave	57.70%	65%	59%	53%	44%	58%	60%	61%	61%	59%	57%
4	steamhammer	50.11%	53%	51%	54%	54%	47%	46%	53%	48%	48%	46%
5	mcrave	49.81%	53%	44%	35%	50%	44%	58%	45%	60%	61%	47%
6	microwave	43.44%	40%	47%	49%	41%	45%	33%	49%	51%	33%	46%
7	dragon	42.28%	44%	45%	43%	43%	46%	44%	32%	38%	44%	44%
8	ualbertabot	30.45%	22%	23%	32%	35%	34%	31%	36%	28%	29%	33%
9	infestedartosis	8.28%	10%	12%	12%	7%	5%	8%	4%	9%	8%	6%

One table for each bot, showing results on each map against each opponent. With 10 maps and 290 rounds, each cell shows the results for 29 games (some slightly fewer). It’s not a large number, there is plenty of statistical noise.

#	bananabrain	overall	Destin	MatchP	Polari	Longin	NeoSyl	Arcadi	Coloss	Empire	NeoGro	Roadki
2	stardust	48%	86%	31%	14%	45%	52%	69%	17%	72%	48%	45%
3	purplewave	58%	62%	45%	62%	69%	62%	57%	66%	52%	55%	48%
4	steamhammer	97%	100%	93%	100%	93%	100%	97%	100%	100%	97%	86%
5	mcrave	86%	97%	93%	79%	100%	97%	83%	100%	48%	66%	97%
6	microwave	95%	97%	100%	100%	97%	83%	100%	93%	86%	97%	100%
7	dragon	94%	93%	90%	97%	97%	100%	86%	93%	93%	100%	97%
8	ualbertabot	99%	97%	100%	100%	93%	100%	100%	100%	96%	100%	100%
9	infestedartosis	100%	100%	100%	100%	100%	100%	100%	100%	100%	100%	100%
	overall	84.54%	91%	81%	81%	87%	87%	87%	84%	81%	83%	84%

#5 McRave’s comparatively good results versus #1 BananaBrain are due to only a few maps. Interesting! For the most part, BananaBrain is consistent. It seems to have few weaknesses that other bots are able to exploit.

#	stardust	overall	Destin	MatchP	Polari	Longin	NeoSyl	Arcadi	Coloss	Empire	NeoGro	Roadki
1	bananabrain	52%	14%	69%	86%	55%	48%	31%	83%	28%	52%	55%
3	purplewave	55%	0%	55%	76%	79%	48%	76%	79%	21%	59%	55%
4	steamhammer	92%	100%	93%	90%	97%	100%	90%	72%	90%	97%	97%
5	mcrave	95%	86%	97%	100%	100%	100%	93%	90%	93%	93%	97%
6	microwave	90%	72%	93%	97%	97%	97%	93%	90%	66%	97%	97%
7	dragon	92%	97%	93%	72%	90%	97%	93%	93%	100%	93%	97%
8	ualbertabot	91%	100%	93%	97%	97%	86%	97%	79%	97%	86%	83%
9	infestedartosis	100%	100%	100%	100%	100%	100%	100%	100%	100%	100%	100%
	overall	83.43%	71%	87%	90%	89%	84%	84%	86%	74%	84%	85%

#2 Stardust is very inconsistent against its fellow top protoss. These are the results of a brittle bot, strong but not resilient. On Destination, I expect it’s because the twin bridges to the natural bases are easy to defend, so that Stardust’s attack fails. But Empire of the Sun and the other troublesome maps aren’t like that. I can’t guess the reason there.

#	purplewave	overall	Destin	MatchP	Polari	Longin	NeoSyl	Arcadi	Coloss	Empire	NeoGro	Roadki
1	bananabrain	42%	38%	55%	38%	31%	38%	43%	34%	48%	45%	52%
2	stardust	45%	100%	45%	24%	21%	52%	24%	21%	79%	41%	45%
4	steamhammer	84%	83%	97%	97%	59%	72%	100%	90%	79%	86%	79%
5	mcrave	60%	45%	79%	66%	52%	79%	38%	90%	48%	31%	69%
6	microwave	29%	62%	7%	41%	3%	17%	76%	3%	3%	72%	3%
7	dragon	49%	45%	48%	38%	41%	41%	31%	79%	71%	48%	52%
8	ualbertabot	82%	83%	86%	76%	76%	79%	79%	83%	90%	86%	79%
9	infestedartosis	70%	62%	55%	48%	72%	86%	86%	90%	66%	59%	79%
	overall	57.70%	65%	59%	53%	44%	58%	60%	61%	61%	59%	57%

And #3 PurpleWave is inconsistent against all opponents other than #8 UAlbertaBot—even the tail-ender #9 InfestedArtosis. Which is curious, because UAlbertaBot plays random and is hard to be consistent against!

#	steamhammer	overall	Destin	MatchP	Polari	Longin	NeoSyl	Arcadi	Coloss	Empire	NeoGro	Roadki
1	bananabrain	3%	0%	7%	0%	7%	0%	3%	0%	0%	3%	14%
2	stardust	8%	0%	7%	10%	3%	0%	10%	28%	10%	3%	3%
3	purplewave	16%	17%	3%	3%	41%	28%	0%	10%	21%	14%	21%
5	mcrave	50%	72%	79%	69%	52%	38%	24%	48%	45%	38%	31%
6	microwave	62%	69%	41%	72%	79%	45%	83%	66%	48%	66%	55%
7	dragon	67%	72%	76%	90%	55%	62%	52%	76%	66%	62%	55%
8	ualbertabot	97%	93%	97%	93%	97%	100%	97%	100%	100%	100%	93%
9	infestedartosis	99%	100%	97%	97%	100%	100%	97%	100%	97%	100%	100%
	overall	50.11%	53%	51%	54%	54%	47%	46%	53%	48%	48%	46%

This year’s improvements to #4 Steamhammer are particularly helpful against #8 UAlbertaBot, because of Steamhammer’s turtle strategy for surviving whichever rush UAlbertaBot ends up playing. The consistently excellent results against UAlbertaBot were key to squeaking past #5 McRave for the #4 spot.

#	mcrave	overall	Destin	MatchP	Polari	Longin	NeoSyl	Arcadi	Coloss	Empire	NeoGro	Roadki
1	bananabrain	14%	3%	7%	21%	0%	3%	17%	0%	52%	34%	3%
2	stardust	5%	14%	3%	0%	0%	0%	7%	10%	7%	7%	3%
3	purplewave	40%	55%	21%	34%	48%	21%	62%	10%	52%	69%	31%
4	steamhammer	50%	28%	21%	31%	48%	62%	76%	52%	55%	62%	69%
6	microwave	89%	100%	97%	7%	100%	100%	93%	97%	100%	97%	97%
7	dragon	65%	52%	48%	76%	69%	45%	76%	66%	76%	79%	62%
8	ualbertabot	35%	72%	55%	14%	34%	24%	31%	28%	38%	41%	14%
9	infestedartosis	99%	100%	100%	93%	100%	100%	100%	100%	100%	100%	100%
	overall	49.81%	53%	44%	35%	50%	44%	58%	45%	60%	61%	47%

Wow, look at #5 McRave vs #6 Microwave! Nearly all wins, except on Polaris Rhapsody where it was nearly all losses. The reason for it must be very specific.

#	microwave	overall	Destin	MatchP	Polari	Longin	NeoSyl	Arcadi	Coloss	Empire	NeoGro	Roadki
1	bananabrain	5%	3%	0%	0%	3%	17%	0%	7%	14%	3%	0%
2	stardust	10%	28%	7%	3%	3%	3%	7%	10%	34%	3%	3%
3	purplewave	71%	38%	93%	59%	97%	83%	24%	97%	97%	28%	97%
4	steamhammer	38%	31%	59%	28%	21%	55%	17%	34%	52%	34%	45%
5	mcrave	11%	0%	3%	93%	0%	0%	7%	3%	0%	3%	3%
7	dragon	56%	62%	55%	48%	59%	52%	62%	76%	52%	34%	55%
8	ualbertabot	61%	62%	66%	67%	41%	48%	55%	66%	62%	69%	72%
9	infestedartosis	96%	93%	97%	97%	100%	100%	93%	100%	97%	90%	96%
	overall	43.44%	40%	47%	49%	41%	45%	33%	49%	51%	33%	46%

The overall results make it look like #6 Microwave somehow has #3 PurpleWave’s number, but here we see it depends on the map. It is presumably part of PurpleWave’s general inconsistency, but we’ll have to look at the replays to see the specific reasons.

#	dragon	overall	Destin	MatchP	Polari	Longin	NeoSyl	Arcadi	Coloss	Empire	NeoGro	Roadki
1	bananabrain	6%	7%	10%	3%	3%	0%	14%	7%	7%	0%	3%
2	stardust	8%	3%	7%	28%	10%	3%	7%	7%	0%	7%	3%
3	purplewave	51%	55%	52%	62%	59%	59%	69%	21%	29%	52%	48%
4	steamhammer	33%	28%	24%	10%	45%	38%	48%	24%	34%	38%	45%
5	mcrave	35%	48%	52%	24%	31%	55%	24%	34%	24%	21%	38%
6	microwave	44%	38%	45%	52%	41%	48%	38%	24%	48%	66%	45%
8	ualbertabot	83%	86%	93%	86%	83%	90%	86%	59%	83%	79%	86%
9	infestedartosis	78%	90%	76%	79%	69%	76%	62%	76%	76%	93%	86%
	overall	42.28%	44%	45%	43%	43%	46%	44%	32%	38%	44%	44%

#	ualbertabot	overall	Destin	MatchP	Polari	Longin	NeoSyl	Arcadi	Coloss	Empire	NeoGro	Roadki
1	bananabrain	1%	3%	0%	0%	7%	0%	0%	0%	4%	0%	0%
2	stardust	9%	0%	7%	3%	3%	14%	3%	21%	3%	14%	17%
3	purplewave	18%	17%	14%	24%	24%	21%	21%	17%	10%	14%	21%
4	steamhammer	3%	7%	3%	7%	3%	0%	3%	0%	0%	0%	7%
5	mcrave	65%	28%	45%	86%	66%	76%	69%	72%	62%	59%	86%
6	microwave	39%	38%	34%	33%	59%	52%	45%	34%	38%	31%	28%
7	dragon	17%	14%	7%	14%	17%	10%	14%	41%	17%	21%	14%
9	infestedartosis	91%	72%	76%	90%	100%	97%	97%	100%	90%	97%	93%
	overall	30.45%	22%	23%	32%	35%	34%	31%	36%	28%	29%	33%

#	infestedartosis	overall	Destin	MatchP	Polari	Longin	NeoSyl	Arcadi	Coloss	Empire	NeoGro	Roadki
1	bananabrain	0%	0%	0%	0%	0%	0%	0%	0%	0%	0%	0%
2	stardust	0%	0%	0%	0%	0%	0%	0%	0%	0%	0%	0%
3	purplewave	30%	38%	45%	52%	28%	14%	14%	10%	34%	41%	21%
4	steamhammer	1%	0%	3%	3%	0%	0%	3%	0%	3%	0%	0%
5	mcrave	1%	0%	0%	7%	0%	0%	0%	0%	0%	0%	0%
6	microwave	4%	7%	3%	3%	0%	0%	7%	0%	3%	10%	4%
7	dragon	22%	10%	24%	21%	31%	24%	38%	24%	24%	7%	14%
8	ualbertabot	9%	28%	24%	10%	0%	3%	3%	0%	10%	3%	7%
	overall	8.28%	10%	12%	12%	7%	5%	8%	4%	9%	8%	6%

I like it that even the tail-end bot has an upset against the strong #3 PurpleWave on one map.

AIIDE 2023 - map results

nospam@example.com (Jay Scott) — Wed, 11 Oct 2023 19:03:00 -0400

Five maps were familiar ones used in past AIIDE tournaments, and five were chosen randomly from a large pool.

carryover maps	new maps
(2) Destination	(2) Match Point
(2) Polaris Rhapsody	(3) Neo Sylphid
(3) Longinus	(4) Arcadia II
(4) Empire of the Sun	(4) Neo Ground Zero
(4) Roadkill	(4) Colosseum II

That makes 3 2-player maps, 2 3-player maps, and 5 4-player maps. It’s a good mix.

Each cell in the two tables represents 232 games, or occasionally 1 or 2 fewer if not all games completed successfully. I marked the carryover maps with dark headers, so you can look for patterns between familiar and new maps.

#	bot	overall	Destin	MatchP	Polari	Longin	NeoSyl	Arcadi	Coloss	Empire	NeoGro	Roadki
1	bananabrain	84.54%	91%	81%	81%	87%	87%	87%	84%	81%	83%	84%
2	stardust	83.43%	71%	87%	90%	89%	84%	84%	86%	74%	84%	85%
3	purplewave	57.70%	65%	59%	53%	44%	58%	60%	61%	61%	59%	57%
4	steamhammer	50.11%	53%	51%	54%	54%	47%	46%	53%	48%	48%	46%
5	mcrave	49.81%	53%	44%	35%	50%	44%	58%	45%	60%	61%	47%
6	microwave	43.44%	40%	47%	49%	41%	45%	33%	49%	51%	33%	46%
7	dragon	42.28%	44%	45%	43%	43%	46%	44%	32%	38%	44%	44%
8	ualbertabot	30.45%	22%	23%	32%	35%	34%	31%	36%	28%	29%	33%
9	infestedartosis	8.28%	10%	12%	12%	7%	5%	8%	4%	9%	8%	6%

This table is the same as the map table in the official results except for the presentation. #5 McRave and #6 Microwave have clear likes and dislikes among the maps. The other mid-ranked zerg, #4 Steamhammer, shows more even results.

#	bot	overall	Destin	MatchP	Polari	Longin	NeoSyl	Arcadi	Coloss	Empire	NeoGro	Roadki
1	bananabrain	10:47 14:37	10:55 13:18	11:12 14:42	10:52 15:58	10:34 15:32	10:43 14:00	10:53 15:43	9:58 14:55	10:38 14:55	10:54 13:46	10:56 12:44
2	stardust	10:43 16:51	10:16 17:34	11:07 18:25	10:48 21:00	10:27 17:22	10:54 18:08	10:58 15:44	11:06 14:51	10:12 14:40	10:31 18:22	10:45 15:19
3	purplewave	10:26 12:02	11:02 12:12	10:56 13:32	10:21 12:38	10:22 11:05	10:16 12:02	10:31 12:43	10:11 9:53	10:24 11:46	10:13 13:18	10:42 11:23
4	steamhammer	7:02 10:45	6:35 10:53	6:54 11:14	6:30 10:42	8:05 10:12	6:11 11:08	9:05 10:36	8:23 11:19	5:52 10:16	5:50 10:31	9:50 10:31
5	mcrave	9:15 11:27	9:21 11:56	8:52 12:31	12:37 11:07	8:27 11:25	8:38 11:13	9:20 12:11	8:43 9:55	10:39 11:46	11:58 12:21	8:49 11:12
6	microwave	7:03 10:05	6:29 10:09	7:52 10:45	6:34 10:40	7:05 9:47	7:19 9:47	6:26 9:58	7:04 10:14	7:01 9:28	6:09 10:03	7:02 10:43
7	dragon	15:45 12:05	15:41 12:04	16:38 11:53	16:08 11:36	16:04 12:49	15:54 12:07	16:03 14:31	14:11 11:10	14:35 11:42	16:02 11:47	14:42 12:39
8	ualbertabot	6:54 10:08	8:19 9:27	7:32 10:42	7:11 9:50	6:25 9:59	6:48 9:32	7:05 10:31	6:32 10:42	6:25 10:15	6:42 9:47	6:34 10:06
9	infestedartosis	9:52 6:31	9:20 7:50	10:09 7:36	8:47 7:02	11:55 5:51	10:36 6:08	12:15 6:26	9:51 6:33	12:31 6:12	9:23 6:10	12:06 6:18
	overall	10:18	10:12	10:56	10:14	10:03	10:00	10:38	10:04	10:08	10:18	10:22

This is like yesterday’s game duration table, but by map instead of by opponent. The top number in each cell is the median duration of winning games; the bottom number is losing games.

On maps where #2 Stardust won the most quickly—it didn’t win as much. On Destination, I imagine it’s because the twin bridges to the natural bases are so easy to defend; if it doesn’t break through quickly, then it may struggle against its stronger opponents. That explanation doesn’t work for Empire of the Sun, though. #7 Dragon has a similar pattern. Compare #3 PurpleWave: On Longinus where it struggled, it lost more quickly.

#4 Steamhammer takes the map into account in its learning, which may make its performance more even between maps, and its game durations less even. Possibly.

AIIDE 2023 - results

nospam@example.com (Jay Scott) — Tue, 10 Oct 2023 17:47:00 -0400

This crosstable exactly matches the official results. I had to make two adjustments compared to last year to get it to match:

1. In some failure conditions, the game is recorded anyway, provided it started in the first place. If the game did not start, last year its duration was recorded as 0 frames in detailed_results.txt. This year it is recorded as -1. The HTML detailed results still gives the -1 as duration 00:00:00.

2. Game ID 979, between UAlbertaBot and BananaBrain, is recorded in detailed_results.txt with finishing status NORMAL. But it’s obviously not normal; it looks like BananaBrain’s Starcraft instance crashed. There is no replay saved for BananaBrain, and no final score is recorded either. The official results correctly recognize that the game did not finish, and the HTML detailed results give the finishing status NO_REPORT, which means the game is not counted. But it’s still NORMAL in detailed_results.txt, so I coded it as a one-game special case for this analysis.

#	bot	overall	bana	star	purp	stea	mcra	micr	drag	ualb	infe
1	bananabrain	84.54%		48%	58%	97%	86%	95%	94%	99%	100%
2	stardust	83.43%	52%		55%	92%	95%	90%	92%	91%	100%
3	purplewave	57.70%	42%	45%		84%	60%	29%	49%	82%	70%
4	steamhammer	50.11%	3%	8%	16%		50%	62%	67%	97%	99%
5	mcrave	49.81%	14%	5%	40%	50%		89%	65%	35%	99%
6	microwave	43.44%	5%	10%	71%	38%	11%		56%	61%	96%
7	dragon	42.28%	6%	8%	51%	33%	35%	44%		83%	78%
8	ualbertabot	30.45%	1%	9%	18%	3%	65%	39%	17%		91%
9	infestedartosis	8.28%	0%	0%	30%	1%	1%	4%	22%	9%

The same as the official crosstable except for the presentation. Microwave upset PurpleWave even more strongly than last year. And McRave and UAlbertaBot are both carryovers, so of course UAlbertaBot upset McRave like last year.

#	bot	overall	bana	star	purp	stea	mcra	micr	drag	ualb	infe
1	bananabrain	10:47 14:37		17:22 14:46	11:33 12:16	11:02 8:01	11:46 18:46	11:09 5:48	9:02 22:59	10:25 8:52	6:04 -
2	stardust	10:43 16:51	14:46 17:22		14:10 18:06	11:01 14:57	11:57 16:54	10:07 6:10	10:40 24:26	9:36 6:13	9:58 -
3	purplewave	10:26 12:02	12:16 11:33	18:06 14:10		10:14 9:19	11:10 13:18	9:28 7:20	10:06 16:15	10:08 10:47	9:34 8:55
4	steamhammer	7:02 10:45	8:01 11:02	14:57 11:01	9:19 10:14		8:14 8:50	13:42 11:23	12:26 19:05	8:56 11:36	5:09 12:25
5	mcrave	9:15 11:27	18:46 11:46	16:54 11:57	13:18 11:10	8:50 8:14		8:22 6:04	20:43 21:33	12:49 9:09	5:47 9:03
6	microwave	7:03 10:05	5:48 11:09	6:10 10:07	7:20 9:28	11:23 13:42	6:04 8:22		16:35 25:12	8:50 7:06	5:03 10:40
7	dragon	15:45 12:05	22:59 9:02	24:26 10:40	16:15 10:06	19:05 12:26	21:33 20:43	25:12 16:35		12:09 8:39	11:28 12:40
8	ualbertabot	6:54 10:08	8:52 10:25	6:13 9:36	10:47 10:08	11:36 8:56	9:09 12:49	7:06 8:50	8:39 12:09		6:28 8:37
9	infestedartosis	9:52 6:31	- 6:04	- 9:58	8:55 9:34	12:25 5:09	9:03 5:47	10:40 5:03	12:40 11:28	8:37 6:28

The top number in each cell is the median duration of winning games for the bot on the left, and the bottom number is the median duration of losses. Winning fast and losing slowly suggests rush strategies or timing attacks. The opposite suggests cautious play and winning by defense into strong macro, or by gradually outplaying the opponent.

For example, Stardust likes to win with one big attack, and often wins faster than it loses—though it depends on the opponent. UAlbertaBot rushes with every race, and it shows in the numbers. Dragon likes to win by slowly pushing its opponents over. PurpleWave is comparatively balanced.

	overall	vT	vP	vZ	vR
terran	42%		21%	48%	83%
protoss	75%	79%		83%	91%
zerg	38%	52%	17%		50%
random	30%	17%	9%	50%

Um, yeah, protoss came out on top. I think we knew that.

#	bot	overall	vT	vP	vZ	vR
1	bananabrain	84.54%	94%	53%	94%	99%
2	stardust	83.43%	92%	53%	94%	91%
3	purplewave	57.70%	49%	44%	61%	82%
4	steamhammer	50.11%	67%	9%	70%	97%
5	mcrave	49.81%	65%	20%	79%	35%
6	microwave	43.44%	56%	29%	48%	61%
7	dragon	42.28%	-	21%	48%	83%
8	ualbertabot	30.45%	17%	9%	50%	-
9	infestedartosis	8.28%	22%	10%	2%	9%

For me, the lesson of the per-race table is that Steamhammer is very bad against protoss. Also, if it weren’t for the relative performance against UAlbertaBot, McRave would have come out well ahead of Steamhammer.

AIIDE 2023 - results first look

nospam@example.com (Jay Scott) — Fri, 06 Oct 2023 20:40:00 -0400

The AIIDE 2023 tournament has been declared complete. Not all details of the results page are updated, but the basic info is there. In particular, the plain text detailed results file is not there yet, so I can’t run my analysis programs.

#1	BananaBrain	84.54%
#2	Stardust	83.43%
#3	PurpleWave	57.70%
#4	Steamhammer	50.11%
#5	McRave	49.81%
#6	Microwave	43.44%
#7	Dragon	42.28%
#8	UAlbertaBot	30.45%
#9	InfestedArtosis	8.28%

Participation was thin this year, with only 9 entrants. It remains unfortunate that #7 Dragon is the only terran.

Two surprises for me. #1 BananaBrain pulled ahead of #2 Stardust about round 145, and stayed ahead. Stardust does some learning, but after round 50 its performance gradually decreased. After Stardust’s great improvements, I felt pretty sure it would come out ahead. And Stardust did very well—it had a plus score against every opponent. BananaBrain looks impressive, though, with a bigger winning margin against all other opponents except McRave.

#3 PurpleWave became the best of the also-rans, rather than a contender. In the graph, it groups with the middle bots, #3 to #8.

The other surprise: #5 McRave was ahead of #4 Steamhammer for most of the tournament. The main cause was their head-to-head results, not performance against other bots. McRave is a carryover, and I thought my improvements would not have much effect in ZvZ, so I expected results like last year’s, when Steamhammer won head-to-head by a consistent 54%. Steamhammer should even do a little better, because I updated the preparation. As it happened, the head-to-head results varied over the tournament run. Steamhammer was ahead at first, then McRave figured out how to play against it and took the lead, both head-to-head and overall. Only late in the tournament did Steamhammer find an answer and reverse the trend. In the end, the head-to-head score was 49% for Steamhammer, enough to edge it into an overall lead.

Did I introduce a weakness, or was the surprise due to the vagaries of learning? So far, as I prepare the bugfix version, I haven’t found any bugs or weaknesses that seem serious enough to explain it. But data to find the real cause is not released yet.

#6 Microwave and #7 Dragon also had a close race, but in my eyes it doesn’t have the drama of the other two close races.

#8 UAlbertaBot continues to score better than I expected, though from the beginning I thought it was clear what place it would end up in. This year its overall score was 30.45% compared to 43.90% last year, but that’s mainly because there were fewer weak bots for it to beat up on.

Congratulation to #9 InfestedArtosis for participating! You got through with zero crashes, unlike some stronger bots, and scored wins against tough opponents, even if not many wins. Only #1 BananaBrain and #2 Stardust were able to shut you out. The signs say you have a solid foundation to build on.

Steamhammer 3.6 uploaded

nospam@example.com (Jay Scott) — Sat, 30 Sep 2023 22:24:00 -0400

I uploaded Steamhammer 3.6 to SSCAIT. It turns out that Steamhammer terran needs a bug fix, so no Randomhammer for now. It will have to wait for my traditional post-AIIDE bugfix version.

As I mentioned earlier, I’ll post the change list after I’ve fixed up the blog. First things first.

AIIDE 2023 running results

nospam@example.com (Jay Scott) — Sat, 30 Sep 2023 18:52:00 -0400

I was excited to learn that the AIIDE 2023 results are coming in live, this year. Though I see that the detailed results and win percentage over time are not updated as often as the overall results. My first impression is that the ranking so far is exactly what I expected it to be. Looking a little closer, McRave is doing substantially better versus Dragon than last year. (That is last year’s physical hardware version, to match this year.) Both are carryovers, so the difference may be due to the maps, or to the luck of learning. Well, the tournament is not far along. We’ll see how it goes with more data.

It looks like I was wrong about Steamhammer versus BananaBrain. Steamhammer is not as successful there as I expected. Either my tests were unrealistic in some way, or else I introduced a late bug. Or maybe BananaBrain was improved in a way that makes it harder for Steamhammer to do early damage. Steamhammer should put up a good fight in any game where it can kill some probes early on.

I will upload Steamhammer 3.6 to SSCAIT shortly.

AIIDE 2023 - Steamhammer is submitted

nospam@example.com (Jay Scott) — Wed, 27 Sep 2023 15:49:00 -0400

Steamhammer is submitted for AIIDE 2023. You bring the futile hopes, I’ll bring the lurker spines.

It was kind of a scramble this year, though. Yesterday when I did what was supposed to be the final round of major tests, I turned up 3 critical bugs, 2 in new features and 1 left over from who knows when, hidden from view because the opponent model learned to avoid playing into it. As I stayed up late last night frantically debugging, a cricket got into the house—into the same room—and started talking loudly with its friends outside. Not entirely relaxing! But I got up early in the morning and finished fixing everything, and ran more tests, and packed it up, and ran the did-I-pack-it-up-correctly checks and tests, and now it’s on its way.

Last year, Steamhammer scored about 8% against BananaBrain, which finished first. BananaBrain has improved since then, but I expect to score substantially higher against it this year. Well, I could have missed further bugs, but there was no sign of it in what I had time for. My very last test game was against BananaBrain. It was hard-fought and went to late game, and zerg lost narrowly. Steamhammer managed to parasite every shuttle, and plague a lot of armies.

Next: Fixing the blog comments is my first priority. Then I’ll release Steamhammer and write up its changes.

AIIDE 2023 participants

nospam@example.com (Jay Scott) — Tue, 19 Sep 2023 20:31:00 -0400

The AIIDE 2023 participants have been announced on a Google spreadsheet. They are the usual suspects and the carryovers plus Infested Artosis.

Infested Artosis by Brad Ewing is not high ranked, but I like it. It’s simple. You can read through the code on GitHub in a short time. It’s a far cry from the complex code of Steamhammer, which must be baffling to those who first look at it. At the same time, it has the nice feature that it independently learns what build to play and what unit mix to make. Both are straightforward picks from short lists. There’s provision for learning whether to make static defense too.

Enjoy the competition, Infested Artosis!

In other news, JyJ versus Soulkey in ASL 16 today was a dramatic TvZ best-of-five. The last two games were particularly hard-fought.

Dan’s AIIDE map pool analysis

nospam@example.com (Jay Scott) — Tue, 12 Sep 2023 20:06:00 -0400

Purple Dan Gant did some analysis of the AIIDE 2023 map pool and kindly e-mailed info to me. Here it is; I edited it slightly for clarity.

Ran games between PurpleWave and BananaBrain across all the AIIDE maps (based on what I think the legal maps are)
All the maps ran (they were 1.16.1-compatible)
Some of the maps in my zip appear to be observer maps which are unusable for bot play because they have extra start locations. All but Crossing Field have acceptable alternative versions in the pool
PurpleWave worked correctly on all maps. Its behavior on Katrina was dumb but explicable due to the backyard natural

He offers results on a google spreadsheet: AIIDE 2023 Map Info (you have to switch between the About and Data sheets). And he created a new version of the map pool which may better represent what we should actually get: Dan’s unofficial copy of AIIDE 2023 map pool version 2.

Thanks, Dan! You have done a public service.

Steamhammer can play on all the maps, but on the ICCup observer maps it feels a need to scout the observer “bases” to make sure nobody’s there. It knows better than to try to expand there. There are maps where it can correctly reject observer slots as non-bases, but it depends on how they are set up. Steamhammer also plays stupidly on Katrina, and I don’t intend to fix it yet because it’s too much time cost to pay down a small risk. At some point I’ll teach it to do the terrain connectivity analysis from first principles, and create a graph that it can reason about. Playing on Outsider is a goal, but one step at a time.

Steamhammer work is coming along nicely. The new feature I’m adding is coming up to the finish line, and it is passing its tests so far. It won’t be fully refined yet, but still a good improvement. I should have time to add one more important feature before the tournament. Between them they will make the bot sharper at taking advantage of opportunities and more resilient when under pressure. Can’t ask more than that in a short timeframe.

CherryPi - Stardust game

nospam@example.com (Jay Scott) — Tue, 05 Sep 2023 15:15:00 -0400

As you might guess from the CoG results, Stardust has gained strong new skills since last year. Against zerg in particular, one skill is that it uses corsairs heavily. Another is that it learned the forge expand opening. And yet it can still be defeated.

CherryPi is from 2017, but it shows how. The SSCAIT game Stardust v CherryPi is instructive (I kept the replay for when SSCAIT recycles it).

The recipe is:

1. Facing forge expand, play a greedy opening. CherryPi opened pool first (with a rare 13 pool) so that it could make zerglings if it needed to, but cannons were not going to walk across the map to attack, so it followed up with drones and hatcheries.

2. Fight efficiently in the middle game. CherryPi could not take any one-sided victories against such a tough opponent, but it traded well and cut the protoss army down to a safe size, where zerg could spawn enough defensive units in the time the protoss would take to cross the map.

3. With that breathing room, zerg could safely pull ahead in workers. Then it was just mass and smash.

See how easy it is? It’s a simple matter of being good at everything!

Of course it was only possible because Stardust showed weaknesses. One is that it was cautious and clumsy with its corsairs, and put on less counter-air pressure than it could have. First it kept them with the army, then it flew them over hydras.