tournaments - 14 | Starcraft AI blog

AIIDE 2018 - per-map crosstables

Crosstables for each map. I dropped the single special-case excluded game 11821, so these should exactly match the official results. There were 100 rounds and 10 maps, so each cell contains only 10 games, or fewer if games failed to start or were excluded. With only 10 games per pairing per map, the numbers are noisy—but still informative.

After this paragraph, the deluge.

Benzene

	overall	SAID	Cher	CSE	Blue	Locu	ISAM	DaQi	McRa	Iron	ZZZK	Stea	Micr	Last	Tyr	Meta	Leta	Arra	Ecgb	UAlb	Ximp	CDBo	Aiur	Kill	Will	AILi	CUNY	Hell
SAIDA	97.29%		90% 9/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	80% 8/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	88% 7/8	100% 10/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
CherryPi	91.51%	10% 1/10		100% 10/10	70% 7/10	80% 8/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	67% 6/9	90% 9/10	70% 7/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
CSE	86.10%	0% 0/10	0% 0/10		40% 4/10	90% 9/10	90% 9/10	80% 8/10	80% 8/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	80% 8/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	80% 8/10	100% 10/10	100% 10/10	100% 10/10	100% 9/9	100% 10/10
BlueBlueSky	86.72%	0% 0/10	30% 3/10	60% 6/10		80% 8/10	90% 9/10	80% 8/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	78% 7/9	100% 10/10	80% 8/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 7/7	100% 10/10
Locutus	78.91%	0% 0/10	20% 2/10	10% 1/10	20% 2/10		50% 5/10	60% 6/10	50% 5/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 9/9	80% 8/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	80% 8/10	100% 10/10	100% 10/10	100% 10/10	100% 7/7	100% 10/10
ISAMind	76.54%	10% 1/10	0% 0/10	10% 1/10	10% 1/10	50% 5/10		70% 7/10	50% 5/10	100% 10/10	100% 10/10	100% 10/10	80% 8/10	100% 10/10	80% 8/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	40% 4/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
DaQin	74.42%	0% 0/10	0% 0/10	20% 2/10	20% 2/10	40% 4/10	30% 3/10		50% 5/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	50% 5/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	80% 8/10	100% 10/10	70% 7/10	100% 10/10	100% 10/10	100% 10/10	88% 7/8	100% 10/10
McRave	65.38%	20% 2/10	10% 1/10	20% 2/10	0% 0/10	50% 5/10	50% 5/10	50% 5/10		40% 4/10	80% 8/10	50% 5/10	80% 8/10	90% 9/10	100% 10/10	60% 6/10	80% 8/10	100% 10/10	100% 10/10	70% 7/10	60% 6/10	100% 10/10	60% 6/10	70% 7/10	90% 9/10	80% 8/10	90% 9/10	100% 10/10
Iron	68.22%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	60% 6/10		90% 9/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 8/8	40% 4/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
ZZZKBot	42.08%	10% 1/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	10% 1/10		40% 4/10	50% 5/10	50% 5/10	20% 2/10	67% 6/9	20% 2/10	80% 8/10	0% 0/10	70% 7/10	100% 10/10	70% 7/10	60% 6/10	40% 4/10	90% 9/10	100% 10/10	90% 9/10	100% 10/10
Steamhammer	48.64%	0% 0/10	33% 3/9	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	50% 5/10	0% 0/10	60% 6/10		20% 2/10	30% 3/10	20% 2/10	56% 5/9	100% 10/10	50% 5/10	90% 9/10	90% 9/10	60% 6/10	90% 9/10	50% 5/10	90% 9/10	90% 9/10	100% 10/10	89% 8/9	100% 10/10
Microwave	49.81%	0% 0/10	10% 1/10	0% 0/10	10% 1/10	0% 0/10	20% 2/10	0% 0/10	20% 2/10	10% 1/10	50% 5/10	80% 8/10		50% 5/10	20% 2/10	90% 9/10	70% 7/10	60% 6/10	50% 5/10	70% 7/10	60% 6/10	100% 10/10	70% 7/10	80% 8/10	90% 9/10	90% 9/10	100% 9/9	100% 10/10
LastOrder	51.92%	0% 0/10	30% 3/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	50% 5/10	70% 7/10	50% 5/10		100% 10/10	90% 9/10	60% 6/10	90% 9/10	0% 0/10	100% 10/10	80% 8/10	100% 10/10	100% 10/10	100% 10/10	30% 3/10	100% 10/10	90% 9/10	100% 10/10
Tyr	44.23%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	0% 0/10	0% 0/10	0% 0/10	80% 8/10	80% 8/10	80% 8/10	0% 0/10		30% 3/10	30% 3/10	100% 10/10	20% 2/10	40% 4/10	100% 10/10	100% 10/10	30% 3/10	100% 10/10	70% 7/10	80% 8/10	90% 9/10	100% 10/10
MetaBot	42.50%	12% 1/8	0% 0/10	0% 0/10	22% 2/9	0% 0/9	0% 0/10	50% 5/10	40% 4/10	0% 0/8	33% 3/9	44% 4/9	10% 1/10	10% 1/10	70% 7/10		20% 1/5	67% 6/9	80% 8/10	80% 8/10	75% 6/8	56% 5/9	30% 3/10	22% 2/9	100% 9/9	70% 7/10	100% 9/9	100% 10/10
LetaBot	41.30%	0% 0/10	0% 0/10	20% 2/10	0% 0/10	20% 2/10	10% 1/10	0% 0/10	20% 2/10	60% 6/10	80% 8/10	0% 0/10	30% 3/10	40% 4/10	70% 7/10	80% 4/5		30% 3/10	100% 10/10	50% 5/10	80% 8/10	20% 2/10	40% 4/10	70% 7/10	20% 2/10	100% 10/10	100% 2/2	100% 10/10
Arrakhammer	37.21%	0% 0/10	0% 0/10	0% 0/10	20% 2/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	50% 5/10	40% 4/10	10% 1/10	0% 0/10	33% 3/9	70% 7/10		60% 6/10	30% 3/10	70% 7/10	80% 8/10	30% 3/10	70% 7/10	100% 10/10	90% 9/10	100% 9/9	100% 10/10
Ecgberht	40.31%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	100% 10/10	10% 1/10	50% 5/10	100% 10/10	80% 8/10	20% 2/10	0% 0/10	40% 4/10		40% 4/10	80% 8/10	50% 5/10	80% 8/10	70% 7/10	100% 10/10	80% 8/10	75% 6/8	80% 8/10
UAlbertaBot	32.95%	10% 1/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	30% 3/10	0% 0/10	30% 3/10	10% 1/10	30% 3/10	0% 0/10	60% 6/10	20% 2/10	50% 5/10	70% 7/10	60% 6/10		40% 4/10	30% 3/10	60% 6/10	80% 8/10	20% 2/10	70% 7/10	100% 8/8	100% 10/10
Ximp	25.60%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	20% 2/10	40% 4/10	0% 0/10	0% 0/10	40% 4/10	40% 4/10	20% 2/10	0% 0/10	25% 2/8	20% 2/10	30% 3/10	20% 2/10	60% 6/10		0% 0/10	0% 0/10	70% 7/10	100% 10/10	90% 9/10	100% 2/2	40% 4/10
CDBot	34.38%	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	30% 3/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	44% 4/9	80% 8/10	20% 2/10	50% 5/10	70% 7/10	100% 10/10		10% 1/10	80% 8/10	100% 10/10	100% 10/10	100% 7/7	100% 10/10
Aiur	42.91%	0% 0/10	0% 0/10	20% 2/10	10% 1/10	20% 2/10	60% 6/10	30% 3/10	40% 4/10	0% 0/10	40% 4/10	50% 5/10	30% 3/10	0% 0/10	70% 7/10	70% 7/10	60% 6/10	70% 7/10	20% 2/10	40% 4/10	100% 10/10	90% 9/10		20% 2/10	50% 5/10	70% 7/10	75% 3/4	100% 10/10
KillAll	27.13%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	30% 3/10	0% 0/10	60% 6/10	10% 1/10	20% 2/10	0% 0/10	0% 0/10	78% 7/9	30% 3/10	30% 3/10	30% 3/10	20% 2/10	30% 3/10	20% 2/10	80% 8/10		40% 4/10	60% 6/10	100% 9/9	80% 8/10
WillyT	24.51%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	10% 1/10	10% 1/10	10% 1/10	70% 7/10	30% 3/10	0% 0/9	80% 8/10	0% 0/10	0% 0/10	80% 8/10	0% 0/10	0% 0/10	50% 5/10	60% 6/10		60% 6/10	75% 6/8	100% 10/10
AILien	15.56%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	20% 2/10	30% 3/10	0% 0/10	10% 1/10	20% 2/10	30% 3/10	10% 1/10	0% 0/10	30% 3/10	40% 4/10	40% 4/10		57% 4/7	100% 10/10
CUNYBot	8.29%	0% 0/10	0% 0/10	0% 0/9	0% 0/7	0% 0/7	0% 0/10	12% 1/8	10% 1/10	0% 0/10	10% 1/10	11% 1/9	0% 0/9	10% 1/10	10% 1/10	0% 0/9	0% 0/2	0% 0/9	25% 2/8	0% 0/8	0% 0/2	0% 0/7	25% 1/4	0% 0/9	25% 2/8	43% 3/7		100% 3/3
Hellbot	3.95%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	0% 0/10	60% 6/10	0% 0/10	0% 0/10	20% 2/10	0% 0/10	0% 0/10	0% 0/3

Destination

	overall	SAID	Cher	CSE	Blue	Locu	ISAM	DaQi	McRa	Iron	ZZZK	Stea	Micr	Last	Tyr	Meta	Leta	Arra	Ecgb	UAlb	Ximp	CDBo	Aiur	Kill	Will	AILi	CUNY	Hell
SAIDA	94.62%		80% 8/10	90% 9/10	100% 10/10	100% 10/10	70% 7/10	80% 8/10	90% 9/10	100% 10/10	100% 10/10	80% 8/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	70% 7/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
CherryPi	89.19%	20% 2/10		60% 6/10	80% 8/10	90% 9/10	90% 9/10	100% 10/10	60% 6/10	100% 10/10	90% 9/10	90% 9/10	90% 9/10	70% 7/10	90% 9/10	100% 9/9	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
CSE	87.98%	10% 1/10	40% 4/10		60% 6/10	70% 7/10	90% 9/10	90% 9/10	44% 4/9	100% 10/10	80% 8/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 9/9	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
BlueBlueSky	81.85%	0% 0/10	20% 2/10	40% 4/10		60% 6/10	40% 4/10	100% 10/10	90% 9/10	100% 10/10	80% 8/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	56% 5/9	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	60% 6/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
Locutus	80.69%	0% 0/10	10% 1/10	30% 3/10	40% 4/10		50% 5/10	70% 7/10	60% 6/10	90% 9/10	80% 8/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	89% 8/9	100% 10/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
ISAMind	80.69%	30% 3/10	10% 1/10	10% 1/10	60% 6/10	50% 5/10		40% 4/10	50% 5/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 9/9	90% 9/10	100% 10/10	100% 10/10	90% 9/10	90% 9/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
DaQin	71.54%	20% 2/10	0% 0/10	10% 1/10	0% 0/10	30% 3/10	60% 6/10		70% 7/10	100% 10/10	60% 6/10	100% 10/10	100% 10/10	70% 7/10	100% 10/10	50% 5/10	90% 9/10	100% 10/10	100% 10/10	60% 6/10	50% 5/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10
McRave	65.89%	10% 1/10	40% 4/10	56% 5/9	10% 1/10	40% 4/10	50% 5/10	30% 3/10		70% 7/10	70% 7/10	80% 8/10	80% 8/10	90% 9/10	60% 6/10	40% 4/10	90% 9/10	100% 10/10	100% 10/10	78% 7/9	0% 0/10	100% 10/10	100% 10/10	50% 5/10	70% 7/10	100% 10/10	100% 10/10	100% 10/10
Iron	65.38%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	0% 0/10	30% 3/10		60% 6/10	60% 6/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	50% 5/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
ZZZKBot	50.00%	0% 0/10	10% 1/10	20% 2/10	20% 2/10	20% 2/10	0% 0/10	40% 4/10	30% 3/10	40% 4/10		60% 6/10	40% 4/10	60% 6/10	30% 3/10	83% 5/6	20% 2/10	90% 9/10	20% 2/10	80% 8/10	100% 10/10	90% 9/10	100% 10/10	40% 4/10	100% 10/10	50% 5/10	75% 6/8	100% 10/10
Steamhammer	53.49%	20% 2/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	20% 2/10	40% 4/10	40% 4/10		60% 6/10	30% 3/10	70% 7/10	50% 4/8	90% 9/10	50% 5/10	90% 9/10	90% 9/10	70% 7/10	90% 9/10	90% 9/10	90% 9/10	90% 9/10	100% 10/10	90% 9/10	100% 10/10
Microwave	48.06%	0% 0/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	0% 0/10	60% 6/10	40% 4/10		60% 6/10	80% 8/10	88% 7/8	90% 9/10	50% 5/10	80% 8/10	70% 7/10	50% 5/10	60% 6/10	100% 10/10	80% 8/10	100% 10/10	20% 2/10	100% 10/10	100% 10/10
LastOrder	51.15%	0% 0/10	30% 3/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	30% 3/10	10% 1/10	0% 0/10	40% 4/10	70% 7/10	40% 4/10		10% 1/10	100% 10/10	100% 10/10	70% 7/10	10% 1/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	80% 8/10	60% 6/10	80% 8/10	100% 10/10	100% 10/10
Tyr	41.92%	0% 0/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	40% 4/10	10% 1/10	70% 7/10	30% 3/10	20% 2/10	90% 9/10		0% 0/10	20% 2/10	100% 10/10	60% 6/10	60% 6/10	80% 8/10	100% 10/10	20% 2/10	100% 10/10	50% 5/10	40% 4/10	90% 9/10	100% 10/10
MetaBot	44.92%	0% 0/10	0% 0/9	0% 0/9	44% 4/9	11% 1/9	0% 0/9	50% 5/10	60% 6/10	0% 0/10	17% 1/6	50% 4/8	12% 1/8	0% 0/10	100% 10/10		62% 5/8	80% 8/10	80% 8/10	40% 4/10	30% 3/10	70% 7/10	100% 5/5	50% 5/10	89% 8/9	50% 5/10	89% 8/9	100% 8/8
LetaBot	39.53%	0% 0/10	10% 1/10	0% 0/10	10% 1/10	0% 0/10	10% 1/10	10% 1/10	10% 1/10	50% 5/10	80% 8/10	10% 1/10	10% 1/10	0% 0/10	80% 8/10	38% 3/8		70% 7/10	100% 10/10	50% 5/10	70% 7/10	0% 0/10	20% 2/10	60% 6/10	50% 5/10	100% 10/10	90% 9/10	100% 10/10
Arrakhammer	35.00%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	50% 5/10	50% 5/10	30% 3/10	0% 0/10	20% 2/10	30% 3/10		70% 7/10	40% 4/10	60% 6/10	70% 7/10	50% 5/10	70% 7/10	100% 10/10	60% 6/10	100% 10/10	100% 10/10
Ecgberht	32.69%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	80% 8/10	10% 1/10	20% 2/10	90% 9/10	40% 4/10	20% 2/10	0% 0/10	30% 3/10		50% 5/10	70% 7/10	20% 2/10	60% 6/10	90% 9/10	10% 1/10	70% 7/10	100% 10/10	90% 9/10
UAlbertaBot	36.29%	30% 3/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	10% 1/10	40% 4/10	22% 2/9	0% 0/10	20% 2/10	10% 1/10	30% 3/10	0% 0/10	40% 4/10	60% 6/10	50% 5/10	60% 6/10	50% 5/10		40% 4/10	40% 4/10	60% 6/10	90% 9/10	10% 1/10	80% 8/10	100% 10/10	90% 9/10
Ximp	39.23%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	50% 5/10	100% 10/10	0% 0/10	0% 0/10	30% 3/10	50% 5/10	0% 0/10	20% 2/10	70% 7/10	30% 3/10	40% 4/10	30% 3/10	60% 6/10		0% 0/10	100% 10/10	90% 9/10	100% 10/10	40% 4/10	100% 10/10	100% 10/10
CDBot	32.69%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	10% 1/10	40% 4/10	0% 0/10	0% 0/10	30% 3/10	100% 10/10	30% 3/10	80% 8/10	60% 6/10	100% 10/10		40% 4/10	20% 2/10	90% 9/10	60% 6/10	90% 9/10	90% 9/10
Aiur	24.31%	0% 0/10	0% 0/10	0% 0/10	40% 4/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	0% 0/10	80% 8/10	0% 0/5	80% 8/10	50% 5/10	40% 4/10	40% 4/10	0% 0/10	60% 6/10		10% 1/10	80% 8/10	10% 1/10	40% 4/10	70% 7/10
KillAll	31.15%	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	10% 1/10	0% 0/10	50% 5/10	0% 0/10	60% 6/10	10% 1/10	20% 2/10	20% 2/10	0% 0/10	50% 5/10	40% 4/10	30% 3/10	10% 1/10	10% 1/10	10% 1/10	80% 8/10	90% 9/10		40% 4/10	90% 9/10	90% 9/10	90% 9/10
WillyT	25.87%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	30% 3/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	40% 4/10	50% 5/10	11% 1/9	50% 5/10	0% 0/10	90% 9/10	90% 9/10	0% 0/10	10% 1/10	20% 2/10	60% 6/10		30% 3/10	80% 8/10	100% 10/10
AILien	31.54%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	50% 5/10	0% 0/10	80% 8/10	20% 2/10	60% 6/10	50% 5/10	0% 0/10	40% 4/10	30% 3/10	20% 2/10	60% 6/10	40% 4/10	90% 9/10	10% 1/10	70% 7/10		100% 10/10	100% 10/10
CUNYBot	10.51%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	0% 0/10	25% 2/8	10% 1/10	0% 0/10	0% 0/10	10% 1/10	11% 1/9	10% 1/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	60% 6/10	10% 1/10	20% 2/10	0% 0/10		100% 10/10
Hellbot	2.71%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/8	0% 0/10	0% 0/10	10% 1/10	10% 1/10	0% 0/10	10% 1/10	30% 3/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10

Heartbreak Ridge

	overall	SAID	Cher	CSE	Blue	Locu	ISAM	DaQi	McRa	Iron	ZZZK	Stea	Micr	Last	Tyr	Meta	Leta	Arra	Ecgb	UAlb	Ximp	CDBo	Aiur	Kill	Will	AILi	CUNY	Hell
SAIDA	96.88%		90% 9/10	70% 7/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 8/8	100% 10/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	88% 7/8	100% 10/10
CherryPi	89.96%	10% 1/10		70% 7/10	70% 7/10	80% 8/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	70% 7/10	80% 8/10	90% 9/10	100% 10/10	100% 9/9	90% 9/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
CSE	90.77%	30% 3/10	30% 3/10		60% 6/10	70% 7/10	100% 10/10	100% 10/10	80% 8/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
BlueBlueSky	82.88%	0% 0/10	30% 3/10	40% 4/10		80% 8/10	50% 5/10	100% 10/10	70% 7/10	100% 10/10	90% 9/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	50% 5/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	80% 8/10	100% 10/10	80% 8/10	100% 10/10	100% 10/10	100% 10/10	100% 7/7	100% 10/10
Locutus	81.01%	0% 0/10	20% 2/10	30% 3/10	20% 2/10		50% 5/10	90% 9/10	50% 5/10	90% 9/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 8/8	100% 10/10
ISAMind	75.19%	0% 0/10	0% 0/10	0% 0/10	50% 5/10	50% 5/10		40% 4/10	40% 4/10	100% 10/10	100% 10/10	90% 9/10	90% 9/10	100% 10/10	100% 10/10	88% 7/8	100% 10/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	20% 2/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
DaQin	73.83%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	60% 6/10		10% 1/10	80% 8/10	100% 10/10	100% 10/10	100% 9/9	100% 10/10	100% 10/10	67% 6/9	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 8/8	100% 10/10
McRave	63.04%	10% 1/10	10% 1/10	20% 2/10	30% 3/10	50% 5/10	60% 6/10	90% 9/10		70% 7/10	70% 7/10	50% 5/10	70% 7/10	90% 9/10	90% 9/10	30% 3/10	60% 6/10	100% 10/10	90% 9/10	70% 7/10	0% 0/10	100% 10/10	70% 7/10	70% 7/10	80% 8/10	80% 8/10	86% 6/7	100% 10/10
Iron	63.18%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	20% 2/10	30% 3/10		20% 2/10	70% 7/10	90% 9/10	100% 10/10	100% 10/10	100% 9/9	40% 4/10	100% 10/10	100% 10/10	90% 9/10	90% 9/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 9/9	100% 10/10
ZZZKBot	48.26%	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	30% 3/10	80% 8/10		50% 5/10	20% 2/10	40% 4/10	0% 0/10	89% 8/9	60% 6/10	70% 7/10	20% 2/10	100% 10/10	100% 10/10	80% 8/10	100% 10/10	30% 3/10	100% 10/10	90% 9/10	90% 9/10	100% 10/10
Steamhammer	54.26%	0% 0/10	30% 3/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	50% 5/10	30% 3/10	50% 5/10		0% 0/10	10% 1/10	80% 8/10	88% 7/8	70% 7/10	90% 9/10	90% 9/10	90% 9/10	60% 6/10	90% 9/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10
Microwave	56.03%	0% 0/10	20% 2/10	0% 0/10	10% 1/10	10% 1/10	10% 1/10	0% 0/9	30% 3/10	10% 1/10	80% 8/10	100% 10/10		70% 7/10	30% 3/10	70% 7/10	90% 9/10	70% 7/10	100% 10/10	70% 7/10	60% 6/10	90% 9/10	100% 10/10	100% 10/10	90% 9/10	50% 5/10	100% 8/8	100% 10/10
LastOrder	50.97%	0% 0/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	60% 6/10	90% 9/10	30% 3/10		100% 10/10	78% 7/9	80% 8/10	100% 10/10	0% 0/10	100% 10/10	70% 7/10	80% 8/10	100% 10/10	100% 10/10	20% 2/10	100% 10/10	100% 10/10	100% 10/10
Tyr	44.19%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	100% 10/10	20% 2/10	70% 7/10	0% 0/10		30% 3/10	40% 4/10	100% 10/10	70% 7/10	80% 8/10	100% 10/10	100% 10/10	40% 4/10	90% 9/10	30% 3/10	80% 8/10	100% 8/8	100% 10/10
MetaBot	45.69%	0% 0/8	0% 0/9	10% 1/10	50% 5/10	10% 1/10	12% 1/8	33% 3/9	70% 7/10	0% 0/9	11% 1/9	12% 1/8	30% 3/10	22% 2/9	70% 7/10		0% 0/3	60% 6/10	89% 8/9	67% 6/9	33% 2/6	80% 8/10	80% 8/10	50% 5/10	90% 9/10	70% 7/10	100% 7/7	89% 8/9
LetaBot	38.46%	0% 0/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	40% 4/10	60% 6/10	40% 4/10	30% 3/10	10% 1/10	20% 2/10	60% 6/10	100% 3/3		0% 0/10	100% 10/10	40% 4/10	60% 6/10	40% 4/10	20% 2/10	60% 6/10	100% 10/10	90% 9/10	100% 4/4	100% 10/10
Arrakhammer	37.45%	0% 0/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	30% 3/10	10% 1/10	30% 3/10	0% 0/10	0% 0/10	40% 4/10	100% 10/10		50% 5/10	60% 6/10	100% 10/10	80% 8/10	20% 2/10	100% 10/10	90% 9/10	60% 6/10	100% 9/9	100% 10/10
Ecgberht	36.08%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	80% 8/10	10% 1/10	0% 0/10	100% 10/10	30% 3/10	11% 1/9	0% 0/10	50% 5/10		60% 6/10	70% 7/10	30% 3/10	100% 10/10	60% 6/10	50% 5/10	100% 10/10	100% 6/6	100% 10/10
UAlbertaBot	31.66%	10% 1/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	30% 3/10	10% 1/10	0% 0/10	10% 1/10	30% 3/10	0% 0/10	20% 2/10	33% 3/9	60% 6/10	40% 4/10	40% 4/10		30% 3/10	70% 7/10	50% 5/10	90% 9/10	50% 5/10	70% 7/10	70% 7/10	100% 10/10
Ximp	37.35%	0% 0/10	0% 0/10	0% 0/10	20% 2/10	10% 1/10	0% 0/10	0% 0/10	100% 10/10	10% 1/10	0% 0/10	40% 4/10	40% 4/10	30% 3/10	0% 0/10	67% 4/6	40% 4/10	0% 0/10	30% 3/10	70% 7/10		0% 0/10	100% 10/10	100% 10/10	100% 10/10	80% 8/10	67% 2/3	100% 10/10
CDBot	31.66%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	10% 1/10	10% 1/10	20% 2/10	0% 0/10	20% 2/10	60% 6/10	20% 2/10	70% 7/10	30% 3/10	100% 10/10		20% 2/10	100% 10/10	80% 8/10	70% 7/10	100% 9/9	100% 10/10
Aiur	29.92%	10% 1/10	0% 0/10	0% 0/10	20% 2/10	10% 1/10	80% 8/10	0% 0/10	30% 3/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	60% 6/10	20% 2/10	80% 8/10	80% 8/10	0% 0/10	50% 5/10	0% 0/10	80% 8/10		20% 2/10	70% 7/10	10% 1/10	100% 4/4	100% 10/10
KillAll	23.94%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	30% 3/10	10% 1/10	70% 7/10	10% 1/10	0% 0/10	0% 0/10	10% 1/10	50% 5/10	40% 4/10	0% 0/10	40% 4/10	10% 1/10	0% 0/10	0% 0/10	80% 8/10		30% 3/10	60% 6/10	100% 9/9	90% 9/10
WillyT	25.77%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	80% 8/10	70% 7/10	10% 1/10	0% 0/10	10% 1/10	50% 5/10	50% 5/10	0% 0/10	20% 2/10	30% 3/10	70% 7/10		50% 5/10	100% 10/10	100% 10/10
AILien	23.74%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	0% 0/10	10% 1/10	0% 0/10	50% 5/10	0% 0/10	20% 2/10	30% 3/10	10% 1/10	40% 4/10	0% 0/10	30% 3/10	20% 2/10	30% 3/10	90% 9/10	40% 4/10	50% 5/10		100% 7/7	100% 10/10
CUNYBot	4.88%	12% 1/8	0% 0/10	0% 0/10	0% 0/7	0% 0/8	0% 0/10	0% 0/8	14% 1/7	0% 0/9	10% 1/10	10% 1/10	0% 0/8	0% 0/10	0% 0/8	0% 0/7	0% 0/4	0% 0/9	0% 0/6	30% 3/10	33% 1/3	0% 0/9	0% 0/4	0% 0/9	0% 0/10	0% 0/7		50% 2/4
Hellbot	1.58%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	11% 1/9	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	0% 0/10	50% 2/4

Aztec

	overall	SAID	Cher	CSE	Blue	Locu	ISAM	DaQi	McRa	Iron	ZZZK	Stea	Micr	Last	Tyr	Meta	Leta	Arra	Ecgb	UAlb	Ximp	CDBo	Aiur	Kill	Will	AILi	CUNY	Hell
SAIDA	97.31%		90% 9/10	90% 9/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	80% 8/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
CherryPi	90.31%	10% 1/10		50% 5/10	90% 9/10	100% 10/10	90% 9/10	100% 10/10	80% 8/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	80% 8/10	80% 8/10	100% 8/8	100% 10/10	90% 9/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
CSE	86.77%	10% 1/10	50% 5/10		70% 7/10	50% 5/10	80% 8/10	80% 8/10	50% 5/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	88% 7/8	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	80% 8/10	100% 10/10	100% 10/10	100% 9/9	100% 10/10	100% 10/10
BlueBlueSky	81.54%	0% 0/10	10% 1/10	30% 3/10		60% 6/10	80% 8/10	100% 10/10	60% 6/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	70% 7/10	100% 10/10	90% 9/10	100% 10/10	70% 7/10	100% 10/10	100% 10/10	50% 5/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
Locutus	82.31%	0% 0/10	0% 0/10	50% 5/10	40% 4/10		50% 5/10	90% 9/10	50% 5/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	80% 8/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
ISAMind	79.15%	10% 1/10	10% 1/10	20% 2/10	20% 2/10	50% 5/10		60% 6/10	60% 6/10	90% 9/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	80% 8/10	100% 9/9	100% 10/10	100% 10/10	100% 10/10	90% 9/10	80% 8/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
DaQin	73.75%	0% 0/10	0% 0/10	20% 2/10	0% 0/10	10% 1/10	40% 4/10		70% 7/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	44% 4/9	100% 10/10	100% 10/10	100% 10/10	90% 9/10	70% 7/10	100% 10/10	80% 8/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10
McRave	61.15%	0% 0/10	20% 2/10	50% 5/10	40% 4/10	50% 5/10	40% 4/10	30% 3/10		0% 0/10	60% 6/10	50% 5/10	80% 8/10	100% 10/10	80% 8/10	20% 2/10	60% 6/10	100% 10/10	100% 10/10	70% 7/10	40% 4/10	100% 10/10	80% 8/10	80% 8/10	50% 5/10	100% 10/10	90% 9/10	100% 10/10
Iron	64.98%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	100% 10/10		30% 3/10	60% 6/10	90% 9/10	100% 10/10	100% 10/10	100% 7/7	50% 5/10	90% 9/10	100% 10/10	90% 9/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10
ZZZKBot	50.97%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	40% 4/10	70% 7/10		60% 6/10	70% 7/10	70% 7/10	0% 0/10	100% 10/10	50% 5/10	80% 8/10	0% 0/10	80% 8/10	100% 10/10	70% 7/10	90% 9/10	80% 8/10	100% 10/10	80% 8/10	89% 8/9	100% 10/10
Steamhammer	52.12%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	0% 0/10	50% 5/10	40% 4/10	40% 4/10		20% 2/10	30% 3/10	30% 3/10	56% 5/9	90% 9/10	60% 6/10	100% 10/10	100% 10/10	70% 7/10	90% 9/10	100% 10/10	80% 8/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10
Microwave	47.10%	0% 0/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	20% 2/10	10% 1/10	30% 3/10	80% 8/10		30% 3/10	70% 7/10	67% 6/9	70% 7/10	50% 5/10	80% 8/10	70% 7/10	90% 9/10	70% 7/10	50% 5/10	90% 9/10	80% 8/10	50% 5/10	100% 10/10	100% 10/10
LastOrder	49.23%	0% 0/10	20% 2/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	30% 3/10	70% 7/10	70% 7/10		20% 2/10	100% 10/10	80% 8/10	70% 7/10	0% 0/10	100% 10/10	80% 8/10	70% 7/10	100% 10/10	90% 9/10	80% 8/10	100% 10/10	100% 10/10	100% 10/10
Tyr	52.12%	0% 0/10	20% 2/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	0% 0/10	20% 2/10	0% 0/10	100% 10/10	70% 7/10	30% 3/10	80% 8/10		33% 3/9	90% 9/10	100% 10/10	40% 4/10	40% 4/10	100% 10/10	100% 10/10	70% 7/10	90% 9/10	70% 7/10	90% 9/10	90% 9/10	100% 10/10
MetaBot	44.35%	10% 1/10	0% 0/8	12% 1/8	30% 3/10	0% 0/10	0% 0/9	56% 5/9	80% 8/10	0% 0/7	0% 0/10	44% 4/9	33% 3/9	0% 0/10	67% 6/9		40% 4/10	75% 6/8	90% 9/10	30% 3/10	40% 4/10	67% 6/9	75% 6/8	70% 7/10	75% 6/8	70% 7/10	90% 9/10	100% 8/8
LetaBot	37.31%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	40% 4/10	50% 5/10	50% 5/10	10% 1/10	30% 3/10	20% 2/10	10% 1/10	60% 6/10		50% 5/10	100% 10/10	20% 2/10	80% 8/10	20% 2/10	60% 6/10	40% 4/10	40% 4/10	100% 10/10	90% 9/10	100% 10/10
Arrakhammer	40.31%	0% 0/10	10% 1/10	0% 0/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	20% 2/10	40% 4/10	50% 5/10	30% 3/10	0% 0/10	25% 2/8	50% 5/10		70% 7/10	40% 4/10	80% 8/10	80% 8/10	70% 7/10	90% 9/10	100% 10/10	70% 7/10	100% 10/10	100% 10/10
Ecgberht	35.38%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	100% 10/10	0% 0/10	20% 2/10	100% 10/10	60% 6/10	10% 1/10	0% 0/10	30% 3/10		60% 6/10	90% 9/10	0% 0/10	40% 4/10	60% 6/10	70% 7/10	90% 9/10	90% 9/10	100% 10/10
UAlbertaBot	40.77%	20% 2/10	10% 1/10	0% 0/10	30% 3/10	10% 1/10	10% 1/10	10% 1/10	30% 3/10	10% 1/10	20% 2/10	0% 0/10	30% 3/10	0% 0/10	60% 6/10	70% 7/10	80% 8/10	60% 6/10	40% 4/10		60% 6/10	50% 5/10	60% 6/10	90% 9/10	40% 4/10	70% 7/10	100% 10/10	100% 10/10
Ximp	31.92%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	20% 2/10	30% 3/10	60% 6/10	0% 0/10	0% 0/10	30% 3/10	10% 1/10	20% 2/10	0% 0/10	60% 6/10	20% 2/10	20% 2/10	10% 1/10	40% 4/10		0% 0/10	40% 4/10	80% 8/10	100% 10/10	90% 9/10	80% 8/10	100% 10/10
CDBot	35.52%	10% 1/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	30% 3/10	10% 1/10	30% 3/10	30% 3/10	0% 0/10	33% 3/9	80% 8/10	20% 2/10	100% 10/10	50% 5/10	100% 10/10		20% 2/10	60% 6/10	100% 10/10	40% 4/10	100% 10/10	100% 10/10
Aiur	33.33%	0% 0/10	0% 0/10	20% 2/10	50% 5/10	0% 0/10	0% 0/10	20% 2/10	20% 2/10	0% 0/10	10% 1/10	0% 0/10	50% 5/10	0% 0/10	30% 3/10	25% 2/8	40% 4/10	30% 3/10	60% 6/10	40% 4/10	60% 6/10	80% 8/10		20% 2/10	50% 5/10	70% 7/10	90% 9/10	100% 10/10
KillAll	27.31%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	0% 0/10	20% 2/10	20% 2/10	10% 1/10	10% 1/10	10% 1/10	30% 3/10	60% 6/10	10% 1/10	40% 4/10	10% 1/10	20% 2/10	40% 4/10	80% 8/10		40% 4/10	90% 9/10	100% 10/10	100% 10/10
WillyT	25.58%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	50% 5/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	20% 2/10	30% 3/10	25% 2/8	60% 6/10	0% 0/10	30% 3/10	60% 6/10	0% 0/10	0% 0/10	50% 5/10	60% 6/10		70% 7/10	90% 9/10	100% 10/10
AILien	20.46%	0% 0/10	0% 0/10	0% 0/9	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	10% 1/10	50% 5/10	0% 0/10	10% 1/10	30% 3/10	0% 0/10	30% 3/10	10% 1/10	30% 3/10	10% 1/10	60% 6/10	30% 3/10	10% 1/10	30% 3/10		100% 10/10	100% 10/10
CUNYBot	8.49%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	10% 1/10	10% 1/10	11% 1/9	0% 0/10	0% 0/10	0% 0/10	10% 1/10	10% 1/10	10% 1/10	0% 0/10	10% 1/10	0% 0/10	20% 2/10	0% 0/10	10% 1/10	0% 0/10	10% 1/10	0% 0/10		100% 10/10
Hellbot	0.00%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/8	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10

Tau Cross

	overall	SAID	Cher	CSE	Blue	Locu	ISAM	DaQi	McRa	Iron	ZZZK	Stea	Micr	Last	Tyr	Meta	Leta	Arra	Ecgb	UAlb	Ximp	CDBo	Aiur	Kill	Will	AILi	CUNY	Hell
SAIDA	95.35%		60% 6/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	70% 7/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 9/9	100% 10/10	100% 10/10	100% 10/10	60% 6/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 9/9	100% 10/10
CherryPi	92.69%	40% 4/10		70% 7/10	90% 9/10	70% 7/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	90% 9/10	80% 8/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
CSE	88.42%	0% 0/10	30% 3/10		80% 8/10	80% 8/10	80% 8/10	90% 9/10	70% 7/10	100% 10/10	90% 9/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 9/9	100% 10/10
BlueBlueSky	80.23%	0% 0/10	10% 1/10	20% 2/10		40% 4/10	100% 10/10	80% 8/10	50% 5/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	67% 6/9	90% 9/10	100% 10/10	100% 10/10	80% 8/10	100% 10/10	90% 9/10	70% 7/10	100% 10/10	100% 10/10	100% 10/10	100% 9/9	100% 10/10
Locutus	85.33%	10% 1/10	30% 3/10	20% 2/10	60% 6/10		80% 8/10	80% 8/10	50% 5/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 9/9	100% 10/10
ISAMind	76.15%	0% 0/10	0% 0/10	20% 2/10	0% 0/10	20% 2/10		60% 6/10	50% 5/10	100% 10/10	100% 10/10	80% 8/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	80% 8/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
DaQin	73.08%	0% 0/10	0% 0/10	10% 1/10	20% 2/10	20% 2/10	40% 4/10		30% 3/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	60% 6/10	90% 9/10	100% 10/10	100% 10/10	90% 9/10	80% 8/10	100% 10/10	70% 7/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
McRave	70.00%	30% 3/10	10% 1/10	30% 3/10	50% 5/10	50% 5/10	50% 5/10	70% 7/10		80% 8/10	70% 7/10	70% 7/10	70% 7/10	100% 10/10	100% 10/10	40% 4/10	90% 9/10	90% 9/10	100% 10/10	70% 7/10	40% 4/10	100% 10/10	70% 7/10	90% 9/10	80% 8/10	80% 8/10	90% 9/10	100% 10/10
Iron	60.38%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	0% 0/10	20% 2/10		20% 2/10	40% 4/10	90% 9/10	70% 7/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	80% 8/10	80% 8/10	90% 9/10	100% 10/10	100% 10/10	80% 8/10	100% 10/10
ZZZKBot	49.42%	0% 0/10	10% 1/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	30% 3/10	80% 8/10		60% 6/10	70% 7/10	40% 4/10	80% 8/10	89% 8/9	30% 3/10	80% 8/10	0% 0/10	80% 8/10	100% 10/10	60% 6/10	80% 8/10	40% 4/10	100% 10/10	60% 6/10	80% 8/10	100% 10/10
Steamhammer	51.36%	0% 0/10	20% 2/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	0% 0/10	30% 3/10	60% 6/10	40% 4/10		20% 2/10	10% 1/10	50% 5/10	62% 5/8	60% 6/10	50% 5/10	100% 10/10	80% 8/10	80% 8/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	70% 7/10	100% 9/9	100% 10/10
Microwave	49.22%	0% 0/10	0% 0/10	10% 1/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	30% 3/10	10% 1/10	30% 3/10	80% 8/10		70% 7/10	30% 3/10	44% 4/9	90% 9/10	60% 6/10	80% 8/10	80% 8/10	50% 5/10	90% 9/10	90% 9/10	100% 10/10	70% 7/10	67% 6/9	100% 8/8	100% 10/10
LastOrder	54.23%	0% 0/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	30% 3/10	60% 6/10	90% 9/10	30% 3/10		100% 10/10	100% 10/10	100% 10/10	100% 10/10	0% 0/10	100% 10/10	100% 10/10	90% 9/10	90% 9/10	80% 8/10	40% 4/10	90% 9/10	100% 10/10	100% 10/10
Tyr	40.54%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	50% 5/10	70% 7/10	0% 0/10		10% 1/10	60% 6/10	90% 9/10	50% 5/10	60% 6/10	100% 10/10	100% 10/10	80% 8/10	90% 9/10	60% 6/10	30% 3/10	89% 8/9	100% 10/10
MetaBot	45.75%	0% 0/9	0% 0/10	0% 0/10	33% 3/9	0% 0/10	10% 1/10	40% 4/10	60% 6/10	0% 0/10	11% 1/9	38% 3/8	56% 5/9	0% 0/10	90% 9/10		38% 3/8	67% 6/9	100% 8/8	50% 5/10	30% 3/10	70% 7/10	70% 7/10	60% 6/10	89% 8/9	90% 9/10	100% 9/9	100% 10/10
LetaBot	38.74%	0% 0/10	0% 0/10	10% 1/10	10% 1/10	0% 0/10	10% 1/10	10% 1/10	10% 1/10	10% 1/10	70% 7/10	40% 4/10	10% 1/10	0% 0/10	40% 4/10	62% 5/8		40% 4/10	80% 8/10	50% 5/10	80% 8/10	60% 6/10	70% 7/10	80% 8/10	0% 0/10	100% 10/10	100% 5/5	100% 10/10
Arrakhammer	37.98%	0% 0/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	20% 2/10	50% 5/10	40% 4/10	0% 0/10	10% 1/10	33% 3/9	60% 6/10		60% 6/10	60% 6/10	30% 3/10	90% 9/10	80% 8/10	70% 7/10	80% 8/10	90% 9/10	100% 9/9	100% 10/10
Ecgberht	37.89%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	100% 10/10	0% 0/10	20% 2/10	100% 10/10	50% 5/10	0% 0/8	20% 2/10	40% 4/10		70% 7/10	90% 9/10	40% 4/10	60% 6/10	60% 6/10	60% 6/10	90% 9/10	88% 7/8	100% 10/10
UAlbertaBot	33.85%	40% 4/10	0% 0/10	0% 0/10	20% 2/10	0% 0/10	0% 0/10	10% 1/10	30% 3/10	0% 0/10	20% 2/10	20% 2/10	20% 2/10	0% 0/10	40% 4/10	50% 5/10	50% 5/10	40% 4/10	30% 3/10		50% 5/10	40% 4/10	50% 5/10	80% 8/10	50% 5/10	60% 6/10	80% 8/10	100% 10/10
Ximp	35.38%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	20% 2/10	60% 6/10	0% 0/10	0% 0/10	20% 2/10	50% 5/10	0% 0/10	0% 0/10	70% 7/10	20% 2/10	70% 7/10	10% 1/10	50% 5/10		0% 0/10	90% 9/10	90% 9/10	100% 10/10	60% 6/10	90% 9/10	100% 10/10
CDBot	31.25%	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	40% 4/10	0% 0/10	10% 1/10	10% 1/10	0% 0/10	30% 3/10	40% 4/10	10% 1/10	60% 6/10	60% 6/10	100% 10/10		30% 3/10	70% 7/10	100% 10/10	50% 5/10	100% 6/6	100% 10/10
Aiur	30.12%	0% 0/10	0% 0/10	0% 0/10	30% 3/10	0% 0/10	10% 1/10	30% 3/10	30% 3/10	20% 2/10	20% 2/10	0% 0/10	10% 1/10	10% 1/10	20% 2/10	30% 3/10	30% 3/10	20% 2/10	40% 4/10	50% 5/10	10% 1/10	70% 7/10		40% 4/10	60% 6/10	80% 8/10	78% 7/9	100% 10/10
KillAll	26.92%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	10% 1/10	60% 6/10	0% 0/10	0% 0/10	20% 2/10	10% 1/10	40% 4/10	20% 2/10	30% 3/10	40% 4/10	20% 2/10	10% 1/10	30% 3/10	60% 6/10		60% 6/10	90% 9/10	100% 10/10	90% 9/10
WillyT	24.31%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	0% 0/10	0% 0/10	10% 1/10	30% 3/10	60% 6/10	40% 4/10	11% 1/9	100% 10/10	20% 2/10	40% 4/10	50% 5/10	0% 0/10	0% 0/10	40% 4/10	40% 4/10		0% 0/10	100% 6/6	100% 10/10
AILien	26.36%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	0% 0/10	40% 4/10	30% 3/10	33% 3/9	10% 1/10	70% 7/10	10% 1/10	0% 0/10	10% 1/10	10% 1/10	40% 4/10	40% 4/10	50% 5/10	20% 2/10	10% 1/10	100% 10/10		100% 9/9	100% 10/10
CUNYBot	8.62%	0% 0/9	0% 0/10	0% 0/9	0% 0/9	0% 0/9	0% 0/10	0% 0/10	10% 1/10	20% 2/10	20% 2/10	0% 0/9	0% 0/8	0% 0/10	11% 1/9	0% 0/9	0% 0/5	0% 0/9	12% 1/8	20% 2/10	10% 1/10	0% 0/6	22% 2/9	0% 0/10	0% 0/6	0% 0/9		89% 8/9
Hellbot	0.77%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	0% 0/10	11% 1/9

Andromeda

	overall	SAID	Cher	CSE	Blue	Locu	ISAM	DaQi	McRa	Iron	ZZZK	Stea	Micr	Last	Tyr	Meta	Leta	Arra	Ecgb	UAlb	Ximp	CDBo	Aiur	Kill	Will	AILi	CUNY	Hell
SAIDA	98.08%		90% 9/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	80% 8/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
CherryPi	91.89%	10% 1/10		70% 7/10	80% 8/10	100% 10/10	100% 10/10	100% 10/10	70% 7/10	90% 9/10	90% 9/10	90% 9/10	100% 10/10	90% 9/10	100% 10/10	100% 9/9	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
CSE	86.92%	0% 0/10	30% 3/10		100% 10/10	60% 6/10	90% 9/10	70% 7/10	80% 8/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	50% 5/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
BlueBlueSky	80.77%	0% 0/10	20% 2/10	0% 0/10		50% 5/10	70% 7/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	60% 6/10	100% 10/10	80% 8/10	100% 10/10	80% 8/10	100% 10/10	90% 9/10	90% 9/10	80% 8/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
Locutus	79.54%	0% 0/10	0% 0/10	40% 4/10	50% 5/10		60% 6/10	60% 6/10	50% 5/10	80% 8/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	89% 8/9	90% 9/10	80% 8/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10
ISAMind	78.38%	10% 1/10	0% 0/10	10% 1/10	30% 3/10	40% 4/10		50% 5/10	50% 5/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	78% 7/9	90% 9/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
DaQin	72.59%	0% 0/10	0% 0/10	30% 3/10	0% 0/10	40% 4/10	50% 5/10		30% 3/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	56% 5/9	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	20% 2/10	100% 10/10	100% 10/10	80% 8/10	90% 9/10	100% 10/10
McRave	67.95%	20% 2/10	30% 3/10	20% 2/10	10% 1/10	50% 5/10	50% 5/10	70% 7/10		70% 7/10	60% 6/10	80% 8/10	80% 8/10	100% 10/10	100% 10/10	67% 6/9	80% 8/10	100% 10/10	100% 10/10	60% 6/10	60% 6/10	100% 10/10	80% 8/10	30% 3/10	80% 8/10	80% 8/10	90% 9/10	100% 10/10
Iron	59.30%	0% 0/10	10% 1/10	0% 0/10	0% 0/10	20% 2/10	10% 1/10	0% 0/10	30% 3/10		10% 1/10	60% 6/10	60% 6/10	70% 7/10	100% 10/10	100% 8/8	100% 10/10	90% 9/10	100% 10/10	90% 9/10	100% 10/10	90% 9/10	90% 9/10	70% 7/10	100% 10/10	70% 7/10	80% 8/10	100% 10/10
ZZZKBot	50.78%	0% 0/10	10% 1/10	10% 1/10	0% 0/10	10% 1/10	0% 0/10	0% 0/10	40% 4/10	90% 9/10		40% 4/10	70% 7/10	50% 5/10	40% 4/10	78% 7/9	10% 1/10	90% 9/10	50% 5/10	90% 9/10	100% 10/10	70% 7/10	100% 10/10	60% 6/10	70% 7/10	70% 7/10	78% 7/9	100% 10/10
Steamhammer	50.97%	0% 0/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	40% 4/10	60% 6/10		20% 2/10	40% 4/10	70% 7/10	56% 5/9	90% 9/10	40% 4/10	100% 10/10	100% 10/10	80% 8/10	90% 9/10	90% 9/10	80% 8/10	90% 9/10	50% 5/10	100% 10/10	100% 10/10
Microwave	51.15%	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	40% 4/10	30% 3/10	80% 8/10		50% 5/10	70% 7/10	60% 6/10	70% 7/10	90% 9/10	90% 9/10	80% 8/10	100% 10/10	60% 6/10	80% 8/10	80% 8/10	70% 7/10	60% 6/10	90% 9/10	100% 10/10
LastOrder	43.85%	0% 0/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	30% 3/10	50% 5/10	60% 6/10	50% 5/10		40% 4/10	70% 7/10	50% 5/10	50% 5/10	10% 1/10	90% 9/10	90% 9/10	100% 10/10	90% 9/10	80% 8/10	0% 0/10	90% 9/10	80% 8/10	100% 10/10
Tyr	41.15%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	60% 6/10	30% 3/10	30% 3/10	60% 6/10		20% 2/10	70% 7/10	100% 10/10	30% 3/10	50% 5/10	100% 10/10	100% 10/10	30% 3/10	90% 9/10	20% 2/10	70% 7/10	100% 10/10	100% 10/10
MetaBot	39.67%	0% 0/10	0% 0/9	0% 0/10	40% 4/10	11% 1/9	22% 2/9	44% 4/9	33% 3/9	0% 0/8	22% 2/9	44% 4/9	40% 4/10	30% 3/10	80% 8/10		30% 3/10	44% 4/9	80% 8/10	29% 2/7	30% 3/10	62% 5/8	67% 6/9	0% 0/10	100% 10/10	56% 5/9	56% 5/9	100% 10/10
LetaBot	41.15%	0% 0/10	0% 0/10	50% 5/10	0% 0/10	10% 1/10	10% 1/10	10% 1/10	20% 2/10	0% 0/10	90% 9/10	10% 1/10	30% 3/10	50% 5/10	30% 3/10	70% 7/10		60% 6/10	70% 7/10	40% 4/10	100% 10/10	100% 10/10	50% 5/10	30% 3/10	0% 0/10	60% 6/10	80% 8/10	100% 10/10
Arrakhammer	38.61%	0% 0/10	0% 0/10	0% 0/10	20% 2/10	20% 2/10	10% 1/10	0% 0/10	0% 0/10	10% 1/10	10% 1/10	60% 6/10	10% 1/10	50% 5/10	0% 0/10	56% 5/9	40% 4/10		60% 6/10	50% 5/10	60% 6/10	100% 10/10	70% 7/10	30% 3/10	100% 10/10	50% 5/10	100% 10/10	100% 10/10
Ecgberht	38.08%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	50% 5/10	0% 0/10	10% 1/10	90% 9/10	70% 7/10	20% 2/10	30% 3/10	40% 4/10		50% 5/10	80% 8/10	90% 9/10	60% 6/10	60% 6/10	60% 6/10	80% 8/10	100% 10/10	100% 10/10
UAlbertaBot	37.35%	0% 0/10	0% 0/10	10% 1/10	20% 2/10	0% 0/10	0% 0/10	0% 0/10	40% 4/10	10% 1/10	10% 1/10	0% 0/10	20% 2/10	10% 1/10	50% 5/10	71% 5/7	60% 6/10	50% 5/10	50% 5/10		80% 8/10	60% 6/10	80% 8/10	60% 6/10	70% 7/10	70% 7/10	60% 6/10	100% 10/10
Ximp	26.15%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	40% 4/10	0% 0/10	0% 0/10	20% 2/10	0% 0/10	10% 1/10	0% 0/10	70% 7/10	0% 0/10	40% 4/10	20% 2/10	20% 2/10		20% 2/10	40% 4/10	80% 8/10	90% 9/10	60% 6/10	70% 7/10	100% 10/10
CDBot	22.48%	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	30% 3/10	10% 1/10	40% 4/10	0% 0/10	0% 0/10	38% 3/8	0% 0/10	0% 0/10	10% 1/10	40% 4/10	80% 8/10		40% 4/10	50% 5/10	30% 3/10	60% 6/10	50% 5/10	90% 9/10
Aiur	30.12%	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	0% 0/10	80% 8/10	20% 2/10	10% 1/10	0% 0/10	10% 1/10	20% 2/10	10% 1/10	70% 7/10	33% 3/9	50% 5/10	30% 3/10	40% 4/10	20% 2/10	60% 6/10	60% 6/10		30% 3/10	60% 6/10	0% 0/10	80% 8/10	90% 9/10
KillAll	38.08%	10% 1/10	0% 0/10	0% 0/10	20% 2/10	0% 0/10	0% 0/10	0% 0/10	70% 7/10	30% 3/10	40% 4/10	20% 2/10	20% 2/10	20% 2/10	10% 1/10	100% 10/10	70% 7/10	70% 7/10	40% 4/10	40% 4/10	20% 2/10	50% 5/10	70% 7/10		40% 4/10	50% 5/10	100% 10/10	100% 10/10
WillyT	33.46%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	0% 0/10	30% 3/10	10% 1/10	30% 3/10	100% 10/10	80% 8/10	0% 0/10	100% 10/10	0% 0/10	40% 4/10	30% 3/10	10% 1/10	70% 7/10	40% 4/10	60% 6/10		50% 5/10	100% 10/10	100% 10/10
AILien	34.75%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	20% 2/10	20% 2/10	30% 3/10	30% 3/10	50% 5/10	40% 4/10	10% 1/10	30% 3/10	44% 4/9	40% 4/10	50% 5/10	20% 2/10	30% 3/10	40% 4/10	40% 4/10	100% 10/10	50% 5/10	50% 5/10		100% 10/10	100% 10/10
CUNYBot	15.12%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	10% 1/10	20% 2/10	22% 2/9	0% 0/10	10% 1/10	20% 2/10	0% 0/10	44% 4/9	20% 2/10	0% 0/10	0% 0/10	40% 4/10	30% 3/10	50% 5/10	20% 2/10	0% 0/10	0% 0/10	0% 0/10		100% 10/10
Hellbot	0.77%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10

Circuit Breaker

	overall	SAID	Cher	CSE	Blue	Locu	ISAM	DaQi	McRa	Iron	ZZZK	Stea	Micr	Last	Tyr	Meta	Leta	Arra	Ecgb	UAlb	Ximp	CDBo	Aiur	Kill	Will	AILi	CUNY	Hell
SAIDA	94.98%		90% 9/10	100% 10/10	100% 10/10	90% 9/10	90% 9/10	90% 9/10	90% 9/10	80% 8/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	80% 8/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	90% 9/10	90% 9/10	90% 9/10	100% 10/10	100% 9/9	100% 10/10
CherryPi	91.51%	10% 1/10		50% 5/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	90% 9/10	70% 7/10	100% 10/10	100% 9/9	100% 10/10	90% 9/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
CSE	89.62%	0% 0/10	50% 5/10		80% 8/10	70% 7/10	80% 8/10	80% 8/10	80% 8/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
BlueBlueSky	80.77%	0% 0/10	10% 1/10	20% 2/10		40% 4/10	60% 6/10	100% 10/10	70% 7/10	100% 10/10	90% 9/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	80% 8/10	90% 9/10	90% 9/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	70% 7/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
Locutus	82.56%	10% 1/10	0% 0/10	30% 3/10	60% 6/10		40% 4/10	90% 9/10	50% 5/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	100% 8/8	100% 10/10
ISAMind	80.93%	10% 1/10	0% 0/10	20% 2/10	40% 4/10	60% 6/10		60% 6/10	80% 8/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	89% 8/9	80% 8/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	80% 8/10	100% 10/10	100% 10/10	100% 10/10	100% 8/8	100% 10/10
DaQin	74.62%	10% 1/10	0% 0/10	20% 2/10	0% 0/10	10% 1/10	40% 4/10		70% 7/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	70% 7/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	50% 5/10	100% 10/10	80% 8/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
McRave	60.62%	10% 1/10	0% 0/10	20% 2/10	30% 3/10	50% 5/10	20% 2/10	30% 3/10		40% 4/10	90% 9/10	40% 4/10	70% 7/10	100% 10/10	100% 10/10	44% 4/9	70% 7/10	100% 10/10	90% 9/10	60% 6/10	60% 6/10	100% 10/10	50% 5/10	50% 5/10	90% 9/10	80% 8/10	80% 8/10	100% 10/10
Iron	58.98%	20% 2/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	60% 6/10		60% 6/10	90% 9/10	60% 6/10	80% 8/10	60% 6/10	88% 7/8	60% 6/10	80% 8/10	100% 10/10	70% 7/10	100% 10/10	80% 8/10	100% 10/10	70% 7/10	100% 10/10	70% 7/10	100% 8/8	100% 10/10
ZZZKBot	45.95%	0% 0/10	10% 1/10	0% 0/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	40% 4/10		70% 7/10	50% 5/10	60% 6/10	40% 4/10	33% 3/9	10% 1/10	90% 9/10	50% 5/10	100% 10/10	100% 10/10	60% 6/10	90% 9/10	60% 6/10	70% 7/10	60% 6/10	80% 8/10	100% 10/10
Steamhammer	49.61%	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	60% 6/10	10% 1/10	30% 3/10		50% 5/10	10% 1/10	60% 6/10	50% 5/10	50% 5/10	60% 6/10	90% 9/10	100% 10/10	100% 10/10	90% 9/10	90% 9/10	90% 9/10	90% 9/10	80% 8/10	75% 6/8	100% 10/10
Microwave	44.53%	0% 0/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	30% 3/10	40% 4/10	50% 5/10	50% 5/10		50% 5/10	10% 1/10	75% 6/8	70% 7/10	70% 7/10	30% 3/10	80% 8/10	40% 4/10	70% 7/10	60% 6/10	100% 10/10	80% 8/10	60% 6/10	100% 8/8	100% 10/10
LastOrder	50.77%	0% 0/10	30% 3/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	40% 4/10	90% 9/10	50% 5/10		100% 10/10	80% 8/10	60% 6/10	90% 9/10	0% 0/10	80% 8/10	90% 9/10	100% 10/10	90% 9/10	100% 10/10	10% 1/10	90% 9/10	100% 10/10	100% 10/10
Tyr	44.79%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	0% 0/10	40% 4/10	60% 6/10	40% 4/10	90% 9/10	0% 0/10		20% 2/10	80% 8/10	100% 10/10	50% 5/10	60% 6/10	100% 10/10	100% 10/10	50% 5/10	90% 9/10	30% 3/10	60% 6/10	89% 8/9	100% 10/10
MetaBot	47.93%	20% 2/10	0% 0/9	0% 0/10	20% 2/10	0% 0/10	11% 1/9	30% 3/10	56% 5/9	12% 1/8	67% 6/9	50% 5/10	25% 2/8	20% 2/10	80% 8/10		56% 5/9	50% 5/10	100% 7/7	70% 7/10	30% 3/10	70% 7/10	78% 7/9	75% 6/8	80% 8/10	78% 7/9	89% 8/9	100% 9/9
LetaBot	44.53%	0% 0/10	0% 0/10	10% 1/10	10% 1/10	10% 1/10	20% 2/10	0% 0/10	30% 3/10	40% 4/10	90% 9/10	50% 5/10	30% 3/10	40% 4/10	20% 2/10	44% 4/9		70% 7/10	90% 9/10	40% 4/10	90% 9/10	80% 8/10	40% 4/10	70% 7/10	0% 0/10	100% 10/10	100% 7/7	100% 10/10
Arrakhammer	39.77%	0% 0/10	10% 1/10	0% 0/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	10% 1/10	40% 4/10	30% 3/10	10% 1/10	0% 0/10	50% 5/10	30% 3/10		80% 8/10	50% 5/10	70% 7/10	90% 9/10	80% 8/10	90% 9/10	100% 10/10	70% 7/10	100% 9/9	100% 10/10
Ecgberht	37.94%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	50% 5/10	10% 1/10	70% 7/10	100% 10/10	50% 5/10	0% 0/7	10% 1/10	20% 2/10		70% 7/10	80% 8/10	90% 9/10	40% 4/10	60% 6/10	80% 8/10	70% 7/10	100% 6/6	90% 9/10
UAlbertaBot	31.40%	0% 0/10	10% 1/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	10% 1/10	40% 4/10	30% 3/10	0% 0/10	0% 0/10	20% 2/10	20% 2/10	40% 4/10	30% 3/10	60% 6/10	50% 5/10	30% 3/10		60% 6/10	40% 4/10	60% 6/10	60% 6/10	40% 4/10	40% 4/10	88% 7/8	90% 9/10
Ximp	29.62%	10% 1/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	0% 0/10	50% 5/10	40% 4/10	0% 0/10	0% 0/10	0% 0/10	60% 6/10	10% 1/10	0% 0/10	70% 7/10	10% 1/10	30% 3/10	20% 2/10	40% 4/10		10% 1/10	50% 5/10	90% 9/10	80% 8/10	30% 3/10	60% 6/10	100% 10/10
CDBot	22.48%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	40% 4/10	10% 1/10	30% 3/10	0% 0/10	0% 0/10	30% 3/10	20% 2/10	10% 1/10	10% 1/10	60% 6/10	90% 9/10		30% 3/10	10% 1/10	30% 3/10	60% 6/10	75% 6/8	70% 7/10
Aiur	33.72%	10% 1/10	0% 0/10	0% 0/10	30% 3/10	0% 0/10	20% 2/10	20% 2/10	50% 5/10	0% 0/10	10% 1/10	10% 1/10	40% 4/10	10% 1/10	50% 5/10	22% 2/9	60% 6/10	20% 2/10	60% 6/10	40% 4/10	50% 5/10	70% 7/10		60% 6/10	80% 8/10	20% 2/10	44% 4/9	100% 10/10
KillAll	26.46%	10% 1/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	50% 5/10	30% 3/10	40% 4/10	10% 1/10	0% 0/10	0% 0/10	10% 1/10	25% 2/8	30% 3/10	10% 1/10	40% 4/10	40% 4/10	10% 1/10	90% 9/10	40% 4/10		40% 4/10	20% 2/10	100% 9/9	100% 10/10
WillyT	31.92%	10% 1/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	30% 3/10	10% 1/10	20% 2/10	90% 9/10	70% 7/10	20% 2/10	100% 10/10	0% 0/10	20% 2/10	60% 6/10	20% 2/10	70% 7/10	20% 2/10	60% 6/10		40% 4/10	80% 8/10	100% 10/10
AILien	33.46%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	0% 0/10	20% 2/10	30% 3/10	40% 4/10	20% 2/10	40% 4/10	10% 1/10	40% 4/10	22% 2/9	0% 0/10	30% 3/10	30% 3/10	60% 6/10	70% 7/10	40% 4/10	80% 8/10	80% 8/10	60% 6/10		100% 8/8	100% 10/10
CUNYBot	13.10%	0% 0/9	0% 0/10	0% 0/10	0% 0/10	0% 0/8	0% 0/8	0% 0/10	20% 2/10	0% 0/8	20% 2/10	25% 2/8	0% 0/8	0% 0/10	11% 1/9	11% 1/9	0% 0/7	0% 0/9	0% 0/6	12% 1/8	40% 4/10	25% 2/8	56% 5/9	0% 0/9	20% 2/10	0% 0/8		100% 8/8
Hellbot	1.95%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/9	0% 0/10	0% 0/10	10% 1/10	10% 1/10	0% 0/10	30% 3/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/8

Empire of the Sun

	overall	SAID	Cher	CSE	Blue	Locu	ISAM	DaQi	McRa	Iron	ZZZK	Stea	Micr	Last	Tyr	Meta	Leta	Arra	Ecgb	UAlb	Ximp	CDBo	Aiur	Kill	Will	AILi	CUNY	Hell
SAIDA	94.23%		80% 8/10	100% 10/10	90% 9/10	100% 10/10	70% 7/10	90% 9/10	80% 8/10	100% 10/10	90% 9/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	90% 9/10	90% 9/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
CherryPi	92.66%	20% 2/10		100% 10/10	90% 9/10	90% 9/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	70% 7/10	90% 9/10	100% 9/9	100% 10/10	80% 8/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
CSE	84.62%	0% 0/10	0% 0/10		50% 5/10	40% 4/10	70% 7/10	80% 8/10	70% 7/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
BlueBlueSky	81.40%	10% 1/10	10% 1/10	50% 5/10		40% 4/10	40% 4/10	90% 9/10	60% 6/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	62% 5/8	100% 10/10	90% 9/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	70% 7/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
Locutus	81.47%	0% 0/10	10% 1/10	60% 6/10	60% 6/10		70% 7/10	70% 7/10	30% 3/10	80% 8/10	100% 10/10	100% 10/10	80% 8/10	100% 10/10	100% 10/10	89% 8/9	100% 10/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	80% 8/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
ISAMind	81.40%	30% 3/10	0% 0/10	30% 3/10	60% 6/10	30% 3/10		100% 10/10	40% 4/10	100% 10/10	100% 10/10	100% 10/10	80% 8/10	100% 10/10	100% 10/10	88% 7/8	100% 10/10	100% 10/10	100% 10/10	100% 10/10	80% 8/10	100% 10/10	100% 10/10	80% 8/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
DaQin	73.75%	10% 1/10	0% 0/10	20% 2/10	10% 1/10	30% 3/10	0% 0/10		30% 3/10	100% 10/10	100% 10/10	100% 10/10	80% 8/10	90% 9/10	100% 10/10	67% 6/9	100% 10/10	100% 10/10	100% 10/10	90% 9/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
McRave	68.85%	20% 2/10	10% 1/10	30% 3/10	40% 4/10	70% 7/10	60% 6/10	70% 7/10		40% 4/10	60% 6/10	80% 8/10	100% 10/10	100% 10/10	90% 9/10	60% 6/10	40% 4/10	100% 10/10	90% 9/10	90% 9/10	70% 7/10	100% 10/10	90% 9/10	40% 4/10	80% 8/10	70% 7/10	90% 9/10	100% 10/10
Iron	63.46%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	0% 0/10	0% 0/10	60% 6/10		60% 6/10	80% 8/10	90% 9/10	100% 10/10	90% 9/10	100% 10/10	60% 6/10	80% 8/10	100% 10/10	90% 9/10	100% 10/10	80% 8/10	100% 10/10	50% 5/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10
ZZZKBot	48.05%	10% 1/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	40% 4/10	40% 4/10		70% 7/10	50% 5/10	50% 5/10	40% 4/10	67% 6/9	40% 4/10	80% 8/10	10% 1/10	90% 9/10	100% 10/10	80% 8/10	70% 7/10	80% 8/10	90% 9/10	70% 7/10	100% 7/7	90% 9/10
Steamhammer	46.51%	10% 1/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	20% 2/10	30% 3/10		10% 1/10	10% 1/10	40% 4/10	62% 5/8	60% 6/10	40% 4/10	100% 10/10	100% 10/10	90% 9/10	50% 5/10	100% 10/10	90% 9/10	80% 8/10	90% 9/10	100% 10/10	100% 10/10
Microwave	55.60%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	20% 2/10	20% 2/10	0% 0/10	10% 1/10	50% 5/10	90% 9/10		70% 7/10	80% 8/10	78% 7/9	90% 9/10	60% 6/10	80% 8/10	100% 10/10	70% 7/10	80% 8/10	100% 10/10	90% 9/10	100% 10/10	40% 4/10	100% 10/10	100% 10/10
LastOrder	45.77%	0% 0/10	30% 3/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	0% 0/10	50% 5/10	90% 9/10	30% 3/10		0% 0/10	90% 9/10	60% 6/10	80% 8/10	0% 0/10	100% 10/10	70% 7/10	90% 9/10	80% 8/10	80% 8/10	40% 4/10	100% 10/10	90% 9/10	100% 10/10
Tyr	48.46%	0% 0/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	10% 1/10	60% 6/10	60% 6/10	20% 2/10	100% 10/10		30% 3/10	80% 8/10	100% 10/10	40% 4/10	50% 5/10	100% 10/10	100% 10/10	70% 7/10	90% 9/10	80% 8/10	50% 5/10	100% 10/10	100% 10/10
MetaBot	43.40%	0% 0/10	0% 0/9	10% 1/10	38% 3/8	11% 1/9	12% 1/8	33% 3/9	40% 4/10	0% 0/10	33% 3/9	38% 3/8	22% 2/9	10% 1/10	70% 7/10		30% 3/10	30% 3/10	100% 8/8	44% 4/9	60% 6/10	67% 6/9	100% 6/6	75% 6/8	100% 8/8	56% 5/9	90% 9/10	100% 9/9
LetaBot	41.92%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	60% 6/10	40% 4/10	60% 6/10	40% 4/10	10% 1/10	40% 4/10	20% 2/10	70% 7/10		60% 6/10	80% 8/10	60% 6/10	100% 10/10	40% 4/10	40% 4/10	50% 5/10	20% 2/10	100% 10/10	100% 10/10	100% 10/10
Arrakhammer	36.15%	0% 0/10	20% 2/10	0% 0/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	20% 2/10	60% 6/10	40% 4/10	20% 2/10	0% 0/10	70% 7/10	40% 4/10		80% 8/10	10% 1/10	80% 8/10	60% 6/10	30% 3/10	50% 5/10	80% 8/10	50% 5/10	100% 10/10	100% 10/10
Ecgberht	36.05%	0% 0/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	90% 9/10	0% 0/10	20% 2/10	100% 10/10	60% 6/10	0% 0/8	20% 2/10	20% 2/10		60% 6/10	70% 7/10	20% 2/10	40% 4/10	60% 6/10	50% 5/10	100% 10/10	100% 10/10	100% 10/10
UAlbertaBot	31.66%	10% 1/10	0% 0/10	0% 0/10	10% 1/10	10% 1/10	0% 0/10	10% 1/10	10% 1/10	10% 1/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	50% 5/10	56% 5/9	40% 4/10	90% 9/10	40% 4/10		30% 3/10	40% 4/10	70% 7/10	80% 8/10	20% 2/10	60% 6/10	80% 8/10	100% 10/10
Ximp	31.54%	10% 1/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	10% 1/10	30% 3/10	0% 0/10	0% 0/10	10% 1/10	30% 3/10	30% 3/10	0% 0/10	40% 4/10	0% 0/10	20% 2/10	30% 3/10	70% 7/10		0% 0/10	80% 8/10	90% 9/10	100% 10/10	60% 6/10	90% 9/10	100% 10/10
CDBot	33.59%	10% 1/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	20% 2/10	50% 5/10	20% 2/10	10% 1/10	0% 0/10	33% 3/9	60% 6/10	40% 4/10	80% 8/10	60% 6/10	100% 10/10		10% 1/10	40% 4/10	90% 9/10	40% 4/10	100% 10/10	90% 9/10
Aiur	29.69%	10% 1/10	0% 0/10	0% 0/10	30% 3/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	30% 3/10	0% 0/10	0% 0/10	20% 2/10	30% 3/10	0% 0/6	60% 6/10	70% 7/10	60% 6/10	30% 3/10	20% 2/10	90% 9/10		0% 0/10	60% 6/10	50% 5/10	90% 9/10	100% 10/10
KillAll	34.88%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	20% 2/10	0% 0/10	60% 6/10	50% 5/10	20% 2/10	10% 1/10	10% 1/10	20% 2/10	10% 1/10	25% 2/8	50% 5/10	50% 5/10	40% 4/10	20% 2/10	10% 1/10	60% 6/10	100% 10/10		40% 4/10	90% 9/10	100% 10/10	100% 10/10
WillyT	27.91%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	0% 0/10	10% 1/10	20% 2/10	0% 0/10	60% 6/10	20% 2/10	0% 0/8	80% 8/10	20% 2/10	50% 5/10	80% 8/10	0% 0/10	10% 1/10	40% 4/10	60% 6/10		50% 5/10	100% 10/10	100% 10/10
AILien	27.80%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	30% 3/10	0% 0/10	30% 3/10	10% 1/10	60% 6/10	0% 0/10	50% 5/10	44% 4/9	0% 0/10	50% 5/10	0% 0/10	40% 4/10	40% 4/10	60% 6/10	50% 5/10	10% 1/10	50% 5/10		100% 10/10	100% 10/10
CUNYBot	6.61%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	10% 1/10	0% 0/7	0% 0/10	0% 0/10	10% 1/10	0% 0/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	10% 1/10	0% 0/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10		90% 9/10
Hellbot	1.16%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/9	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10

Fortress

	overall	SAID	Cher	CSE	Blue	Locu	ISAM	DaQi	McRa	Iron	ZZZK	Stea	Micr	Last	Tyr	Meta	Leta	Arra	Ecgb	UAlb	Ximp	CDBo	Aiur	Kill	Will	AILi	CUNY	Hell
SAIDA	96.53%		80% 8/10	90% 9/10	90% 9/10	90% 9/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 9/9	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10
CherryPi	87.31%	20% 2/10		80% 8/10	100% 10/10	80% 8/10	100% 10/10	100% 10/10	80% 8/10	80% 8/10	70% 7/10	60% 6/10	70% 7/10	90% 9/10	100% 10/10	90% 9/10	100% 10/10	70% 7/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
CSE	85.66%	10% 1/10	20% 2/10		60% 6/10	80% 8/10	50% 5/10	100% 10/10	90% 9/10	90% 9/10	70% 7/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	75% 6/8	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10
BlueBlueSky	79.07%	10% 1/10	0% 0/10	40% 4/10		70% 7/10	80% 8/10	90% 9/10	40% 4/10	100% 10/10	70% 7/10	80% 8/10	90% 9/10	100% 10/10	100% 10/10	67% 6/9	100% 10/10	90% 9/10	100% 10/10	70% 7/10	90% 9/10	90% 9/10	80% 8/10	100% 10/10	100% 10/10	100% 10/10	100% 9/9	100% 10/10
Locutus	80.23%	10% 1/10	20% 2/10	20% 2/10	30% 3/10		50% 5/10	60% 6/10	60% 6/10	80% 8/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	80% 8/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 8/8	100% 10/10
ISAMind	77.52%	0% 0/10	0% 0/10	50% 5/10	20% 2/10	50% 5/10		80% 8/10	40% 4/10	100% 10/10	40% 4/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	80% 8/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 8/8	100% 10/10
DaQin	66.15%	0% 0/10	0% 0/10	0% 0/10	10% 1/10	40% 4/10	20% 2/10		30% 3/10	70% 7/10	60% 6/10	100% 10/10	80% 8/10	100% 10/10	90% 9/10	60% 6/10	100% 10/10	90% 9/10	100% 10/10	80% 8/10	50% 5/10	80% 8/10	100% 10/10	90% 9/10	100% 10/10	90% 9/10	80% 8/10	100% 10/10
McRave	71.81%	10% 1/10	20% 2/10	10% 1/10	60% 6/10	40% 4/10	60% 6/10	70% 7/10		80% 8/10	80% 8/10	70% 7/10	100% 10/10	100% 10/10	90% 9/10	67% 6/9	100% 10/10	100% 10/10	90% 9/10	70% 7/10	50% 5/10	100% 10/10	100% 10/10	60% 6/10	60% 6/10	80% 8/10	100% 10/10	100% 10/10
Iron	68.22%	0% 0/10	20% 2/10	10% 1/10	0% 0/10	20% 2/10	0% 0/10	30% 3/10	20% 2/10		40% 4/10	70% 7/10	90% 9/10	100% 10/10	100% 10/10	100% 9/9	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 9/9	100% 10/10
ZZZKBot	62.26%	10% 1/10	30% 3/10	30% 3/10	30% 3/10	0% 0/10	60% 6/10	40% 4/10	20% 2/10	60% 6/10		90% 9/10	70% 7/10	80% 8/10	30% 3/10	100% 7/7	100% 10/10	80% 8/10	30% 3/10	80% 8/10	100% 10/10	60% 6/10	100% 10/10	70% 7/10	100% 10/10	70% 7/10	90% 9/10	100% 10/10
Steamhammer	50.00%	0% 0/10	40% 4/10	0% 0/10	20% 2/10	0% 0/10	0% 0/10	0% 0/10	30% 3/10	30% 3/10	10% 1/10		10% 1/10	40% 4/10	60% 6/10	60% 6/10	80% 8/10	50% 5/10	100% 10/10	60% 6/10	90% 9/10	100% 10/10	70% 7/10	100% 10/10	100% 10/10	50% 5/10	100% 10/10	100% 10/10
Microwave	55.60%	0% 0/10	30% 3/10	0% 0/10	10% 1/10	0% 0/10	10% 1/10	20% 2/10	0% 0/10	10% 1/10	30% 3/10	90% 9/10		90% 9/10	50% 5/10	70% 7/10	100% 10/10	80% 8/10	90% 9/10	90% 9/10	70% 7/10	90% 9/10	80% 8/10	100% 10/10	90% 9/10	50% 5/10	100% 9/9	100% 10/10
LastOrder	47.10%	0% 0/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	60% 6/10	10% 1/10		100% 10/10	90% 9/10	100% 10/10	100% 10/10	0% 0/10	90% 9/10	90% 9/10	90% 9/10	100% 10/10	90% 9/10	10% 1/10	70% 7/10	100% 9/9	100% 10/10
Tyr	43.97%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	10% 1/10	0% 0/10	70% 7/10	40% 4/10	50% 5/10	0% 0/10		22% 2/9	100% 10/10	80% 8/10	40% 4/10	60% 6/10	100% 10/10	100% 10/10	80% 8/10	100% 10/10	30% 3/10	60% 6/10	100% 8/8	100% 10/10
MetaBot	40.25%	0% 0/9	10% 1/10	25% 2/8	33% 3/9	0% 0/10	20% 2/10	40% 4/10	33% 3/9	0% 0/9	0% 0/7	40% 4/10	30% 3/10	10% 1/10	78% 7/9		50% 3/6	62% 5/8	60% 6/10	44% 4/9	30% 3/10	60% 6/10	78% 7/9	30% 3/10	90% 9/10	44% 4/9	70% 7/10	100% 10/10
LetaBot	15.81%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	0% 0/10	0% 0/10	0% 0/10	50% 3/6		10% 1/10	0% 0/10	40% 4/10	20% 2/10	30% 3/10	10% 1/10	20% 2/10	0% 0/10	70% 7/10	71% 5/7	100% 10/10
Arrakhammer	37.35%	0% 0/10	30% 3/10	0% 0/10	10% 1/10	0% 0/10	10% 1/10	10% 1/10	0% 0/10	0% 0/10	20% 2/10	50% 5/10	20% 2/10	0% 0/10	20% 2/10	38% 3/8	90% 9/10		90% 9/10	50% 5/10	80% 8/10	60% 6/10	60% 6/10	20% 2/10	100% 10/10	20% 2/10	100% 9/9	100% 10/10
Ecgberht	37.84%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	70% 7/10	0% 0/10	10% 1/10	100% 10/10	60% 6/10	40% 4/10	100% 10/10	10% 1/10		50% 5/10	70% 7/10	10% 1/10	70% 7/10	60% 6/10	50% 5/10	80% 8/10	100% 9/9	100% 10/10
UAlbertaBot	38.13%	0% 0/10	0% 0/10	0% 0/10	30% 3/10	10% 1/10	0% 0/10	20% 2/10	30% 3/10	0% 0/10	20% 2/10	40% 4/10	10% 1/10	10% 1/10	40% 4/10	56% 5/9	60% 6/10	50% 5/10	50% 5/10		60% 6/10	40% 4/10	80% 8/10	70% 7/10	50% 5/10	90% 9/10	88% 7/8	100% 10/10
Ximp	36.92%	0% 0/10	10% 1/10	0% 0/10	10% 1/10	20% 2/10	0% 0/10	50% 5/10	50% 5/10	0% 0/10	0% 0/10	10% 1/10	30% 3/10	10% 1/10	0% 0/10	70% 7/10	80% 8/10	20% 2/10	30% 3/10	40% 4/10		0% 0/10	90% 9/10	80% 8/10	100% 10/10	80% 8/10	80% 8/10	100% 10/10
CDBot	37.84%	0% 0/10	0% 0/10	10% 1/10	10% 1/10	0% 0/10	10% 1/10	20% 2/10	0% 0/10	10% 1/10	40% 4/10	0% 0/10	10% 1/10	10% 1/10	0% 0/10	40% 4/10	70% 7/10	40% 4/10	90% 9/10	60% 6/10	100% 10/10		0% 0/10	90% 9/10	80% 8/10	100% 10/10	100% 9/9	100% 10/10
Aiur	29.07%	10% 1/10	10% 1/10	0% 0/10	20% 2/10	10% 1/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	30% 3/10	20% 2/10	0% 0/10	20% 2/10	22% 2/9	90% 9/10	40% 4/10	30% 3/10	20% 2/10	10% 1/10	100% 10/10		50% 5/10	40% 4/10	30% 3/10	100% 9/9	100% 10/10
KillAll	29.62%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	40% 4/10	10% 1/10	30% 3/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	70% 7/10	80% 8/10	80% 8/10	40% 4/10	30% 3/10	20% 2/10	10% 1/10	50% 5/10		10% 1/10	90% 9/10	90% 9/10	100% 10/10
WillyT	32.05%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	40% 4/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	90% 9/10	70% 7/10	10% 1/10	100% 10/10	0% 0/10	50% 5/10	50% 5/10	0% 0/10	20% 2/10	60% 6/10	90% 9/10		50% 5/10	100% 9/9	100% 10/10
AILien	29.34%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	20% 2/10	0% 0/10	30% 3/10	50% 5/10	50% 5/10	30% 3/10	40% 4/10	56% 5/9	30% 3/10	80% 8/10	20% 2/10	10% 1/10	20% 2/10	0% 0/10	70% 7/10	10% 1/10	50% 5/10		90% 9/10	100% 10/10
CUNYBot	10.42%	10% 1/10	0% 0/10	10% 1/10	0% 0/9	0% 0/8	0% 0/8	20% 2/10	0% 0/10	0% 0/9	10% 1/10	0% 0/10	0% 0/9	0% 0/9	0% 0/8	30% 3/10	29% 2/7	0% 0/9	0% 0/9	12% 1/8	20% 2/10	0% 0/9	0% 0/9	10% 1/10	0% 0/9	10% 1/10		100% 10/10
Hellbot	0.00%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10

Python

	overall	SAID	Cher	CSE	Blue	Locu	ISAM	DaQi	McRa	Iron	ZZZK	Stea	Micr	Last	Tyr	Meta	Leta	Arra	Ecgb	UAlb	Ximp	CDBo	Aiur	Kill	Will	AILi	CUNY	Hell
SAIDA	93.85%		80% 8/10	90% 9/10	90% 9/10	90% 9/10	90% 9/10	90% 9/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	80% 8/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	80% 8/10	90% 9/10	80% 8/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
CherryPi	91.54%	20% 2/10		70% 7/10	100% 10/10	100% 10/10	80% 8/10	100% 10/10	100% 10/10	90% 9/10	80% 8/10	60% 6/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	80% 8/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
CSE	84.23%	10% 1/10	30% 3/10		60% 6/10	70% 7/10	50% 5/10	70% 7/10	70% 7/10	90% 9/10	80% 8/10	80% 8/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
BlueBlueSky	79.62%	10% 1/10	0% 0/10	40% 4/10		90% 9/10	50% 5/10	80% 8/10	90% 9/10	80% 8/10	60% 6/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	50% 5/10	80% 8/10	100% 10/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	60% 6/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
Locutus	78.08%	10% 1/10	0% 0/10	30% 3/10	10% 1/10		60% 6/10	90% 9/10	90% 9/10	70% 7/10	80% 8/10	80% 8/10	90% 9/10	100% 10/10	80% 8/10	80% 8/10	80% 8/10	90% 9/10	100% 10/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
ISAMind	78.68%	10% 1/10	20% 2/10	50% 5/10	50% 5/10	40% 4/10		70% 7/10	30% 3/10	100% 10/10	50% 5/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	62% 5/8	80% 8/10	100% 10/10	100% 10/10	80% 8/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
DaQin	70.27%	10% 1/10	0% 0/10	30% 3/10	20% 2/10	10% 1/10	30% 3/10		30% 3/10	80% 8/10	60% 6/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	89% 8/9	80% 8/10	100% 10/10	100% 10/10	80% 8/10	60% 6/10	90% 9/10	90% 9/10	90% 9/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10
McRave	62.69%	10% 1/10	0% 0/10	30% 3/10	10% 1/10	10% 1/10	70% 7/10	70% 7/10		60% 6/10	80% 8/10	60% 6/10	60% 6/10	90% 9/10	70% 7/10	80% 8/10	70% 7/10	100% 10/10	100% 10/10	80% 8/10	30% 3/10	100% 10/10	70% 7/10	40% 4/10	60% 6/10	80% 8/10	100% 10/10	100% 10/10
Iron	65.76%	0% 0/10	10% 1/10	10% 1/10	20% 2/10	30% 3/10	0% 0/10	20% 2/10	40% 4/10		20% 2/10	100% 10/10	100% 10/10	90% 9/10	100% 10/10	100% 7/7	70% 7/10	100% 10/10	100% 10/10	80% 8/10	100% 10/10	80% 8/10	100% 10/10	90% 9/10	100% 10/10	90% 9/10	70% 7/10	100% 10/10
ZZZKBot	63.67%	0% 0/10	20% 2/10	20% 2/10	40% 4/10	20% 2/10	50% 5/10	40% 4/10	20% 2/10	80% 8/10		50% 5/10	80% 8/10	50% 5/10	70% 7/10	100% 8/8	60% 6/10	90% 9/10	70% 7/10	90% 9/10	100% 10/10	80% 8/10	100% 10/10	80% 8/10	100% 10/10	80% 8/10	75% 6/8	100% 10/10
Steamhammer	52.90%	0% 0/10	40% 4/10	20% 2/10	0% 0/10	20% 2/10	0% 0/10	10% 1/10	40% 4/10	0% 0/10	50% 5/10		30% 3/10	40% 4/10	50% 5/10	33% 3/9	50% 5/10	80% 8/10	100% 10/10	80% 8/10	90% 9/10	50% 5/10	90% 9/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10	100% 10/10
Microwave	47.49%	0% 0/10	0% 0/10	0% 0/10	10% 1/10	10% 1/10	0% 0/10	0% 0/10	40% 4/10	0% 0/10	20% 2/10	70% 7/10		30% 3/10	80% 8/10	78% 7/9	60% 6/10	90% 9/10	50% 5/10	100% 10/10	60% 6/10	70% 7/10	80% 8/10	90% 9/10	90% 9/10	20% 2/10	90% 9/10	100% 10/10
LastOrder	47.31%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	10% 1/10	50% 5/10	60% 6/10	70% 7/10		0% 0/10	80% 8/10	60% 6/10	80% 8/10	20% 2/10	90% 9/10	80% 8/10	70% 7/10	100% 10/10	90% 9/10	60% 6/10	100% 10/10	100% 10/10	100% 10/10
Tyr	44.62%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	0% 0/10	0% 0/10	30% 3/10	0% 0/10	30% 3/10	50% 5/10	20% 2/10	100% 10/10		10% 1/10	40% 4/10	90% 9/10	60% 6/10	80% 8/10	100% 10/10	100% 10/10	30% 3/10	100% 10/10	50% 5/10	60% 6/10	90% 9/10	100% 10/10
MetaBot	49.79%	0% 0/10	0% 0/10	10% 1/10	50% 5/10	20% 2/10	38% 3/8	11% 1/9	20% 2/10	0% 0/7	0% 0/8	67% 6/9	22% 2/9	20% 2/10	90% 9/10		56% 5/9	88% 7/8	90% 9/10	90% 9/10	50% 5/10	78% 7/9	78% 7/9	70% 7/10	100% 10/10	67% 6/9	90% 9/10	100% 5/5
LetaBot	39.00%	20% 2/10	0% 0/10	0% 0/10	20% 2/10	20% 2/10	20% 2/10	20% 2/10	30% 3/10	30% 3/10	40% 4/10	50% 5/10	40% 4/10	40% 4/10	60% 6/10	44% 4/9		30% 3/10	40% 4/10	20% 2/10	100% 10/10	50% 5/10	10% 1/10	50% 5/10	0% 0/10	100% 10/10	80% 8/10	100% 10/10
Arrakhammer	32.56%	0% 0/10	20% 2/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	20% 2/10	10% 1/10	20% 2/10	10% 1/10	12% 1/8	70% 7/10		70% 7/10	40% 4/10	80% 8/10	60% 6/10	50% 5/10	0% 0/10	90% 9/10	70% 7/10	100% 10/10	100% 10/10
Ecgberht	35.00%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	30% 3/10	0% 0/10	50% 5/10	80% 8/10	40% 4/10	10% 1/10	60% 6/10	30% 3/10		70% 7/10	90% 9/10	30% 3/10	20% 2/10	80% 8/10	50% 5/10	80% 8/10	100% 10/10	90% 9/10
UAlbertaBot	33.08%	10% 1/10	0% 0/10	10% 1/10	0% 0/10	10% 1/10	20% 2/10	20% 2/10	20% 2/10	20% 2/10	10% 1/10	20% 2/10	0% 0/10	10% 1/10	20% 2/10	10% 1/10	80% 8/10	60% 6/10	30% 3/10		30% 3/10	40% 4/10	70% 7/10	50% 5/10	60% 6/10	90% 9/10	70% 7/10	100% 10/10
Ximp	32.31%	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	0% 0/10	40% 4/10	70% 7/10	0% 0/10	0% 0/10	10% 1/10	40% 4/10	20% 2/10	0% 0/10	50% 5/10	0% 0/10	20% 2/10	10% 1/10	70% 7/10		0% 0/10	90% 9/10	70% 7/10	90% 9/10	50% 5/10	100% 10/10	100% 10/10
CDBot	37.84%	20% 2/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	20% 2/10	20% 2/10	50% 5/10	30% 3/10	30% 3/10	0% 0/10	22% 2/9	50% 5/10	40% 4/10	70% 7/10	60% 6/10	100% 10/10		30% 3/10	100% 10/10	80% 8/10	80% 8/10	80% 8/10	90% 9/10
Aiur	32.43%	10% 1/10	0% 0/10	0% 0/10	40% 4/10	0% 0/10	0% 0/10	10% 1/10	30% 3/10	0% 0/10	0% 0/10	10% 1/10	20% 2/10	0% 0/10	70% 7/10	22% 2/9	90% 9/10	50% 5/10	80% 8/10	30% 3/10	10% 1/10	70% 7/10		20% 2/10	60% 6/10	40% 4/10	80% 8/10	100% 10/10
KillAll	30.89%	20% 2/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	60% 6/10	10% 1/10	20% 2/10	0% 0/10	10% 1/10	10% 1/10	0% 0/10	30% 3/10	50% 5/10	100% 10/10	20% 2/10	50% 5/10	30% 3/10	0% 0/10	80% 8/10		50% 5/10	60% 6/10	100% 9/9	100% 10/10
WillyT	26.15%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	40% 4/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	40% 4/10	50% 5/10	0% 0/10	100% 10/10	10% 1/10	50% 5/10	40% 4/10	10% 1/10	20% 2/10	40% 4/10	50% 5/10		30% 3/10	90% 9/10	100% 10/10
AILien	27.03%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	20% 2/10	10% 1/10	20% 2/10	0% 0/10	80% 8/10	0% 0/10	40% 4/10	33% 3/9	0% 0/10	30% 3/10	20% 2/10	10% 1/10	50% 5/10	20% 2/10	60% 6/10	40% 4/10	70% 7/10		100% 10/10	100% 10/10
CUNYBot	11.28%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	30% 3/10	25% 2/8	0% 0/10	10% 1/10	0% 0/10	10% 1/10	10% 1/10	20% 2/10	0% 0/10	0% 0/10	30% 3/10	0% 0/10	20% 2/10	20% 2/10	0% 0/9	10% 1/10	0% 0/10		100% 10/10
Hellbot	0.78%	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/5	0% 0/10	0% 0/10	10% 1/10	0% 0/10	0% 0/10	10% 1/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10	0% 0/10

It’s a lot to digest, hmm? But there are lessons in every table, if we can only read them out. One interesting feature is the light-colored square area near the upper left, where the similar-strength protoss contingent, the Locutusoids and McRave, often had even-ish scores against each other. The square appears on most tables, but its shape varies strongly from map to map. Also see McRave versus Iron across maps.

AIIDE 2018 - race balance

This post is about race balance in AIIDE 2018, but first I want to show my version of the crosstable, because mine is minutely different from the official results. My version includes exactly one game that the official results skip, game 11821 in round 33 between AILien and CSE, recorded as a crash for CSE after 23400 frames. The only other games omitted from the official results are games that failed to start and are recorded as having a length of -1 frames. I have no idea why this one game was dropped when other crash games were kept. In any case, the effect is that my win rates for CSE and AILien are different from the official rates by a small amount, and that affects my other statistics, though the difference is only one game and it’s hardly noticeable.

	overall	SAID	Cher	CSE	Blue	Locu	ISAM	DaQi	McRa	Iron	ZZZK	Stea	Micr	Last	Tyr	Meta	Leta	Arra	Ecgb	UAlb	Ximp	CDBo	Aiur	Kill	Will	AILi	CUNY	Hell
SAIDA	95.91%		83% 83/100	93% 93/100	97% 97/100	96% 96/100	89% 89/100	95% 95/100	86% 86/100	98% 98/100	97% 97/100	97% 97/100	100% 100/100	100% 100/100	100% 100/100	96% 90/94	98% 98/100	100% 100/100	100% 100/100	87% 87/100	98% 98/100	96% 96/100	95% 95/100	96% 96/100	99% 99/100	100% 100/100	98% 94/96	100% 100/100
CherryPi	90.86%	17% 17/100		72% 72/100	86% 86/100	89% 89/100	96% 96/100	100% 100/100	85% 85/100	96% 96/100	91% 91/100	81% 80/99	91% 91/100	82% 82/100	96% 96/100	99% 92/93	98% 98/100	89% 89/100	99% 99/100	98% 98/100	99% 99/100	100% 100/100	99% 99/100	100% 100/100	100% 100/100	100% 100/100	100% 100/100	100% 100/100
CSE	87.08%	7% 7/100	28% 28/100		66% 66/100	68% 68/100	78% 78/100	84% 84/100	72% 71/99	98% 98/100	91% 91/100	98% 98/100	99% 99/100	100% 100/100	100% 100/100	94% 89/95	91% 91/100	100% 100/100	100% 100/100	98% 98/100	100% 100/100	99% 99/100	96% 96/100	100% 100/100	100% 100/100	99% 99/100	99% 97/98	100% 100/100
BlueBlueSky	81.48%	3% 3/100	14% 14/100	34% 34/100		61% 61/100	66% 66/100	92% 92/100	72% 72/100	98% 98/100	88% 88/100	97% 97/100	94% 94/100	100% 100/100	100% 100/100	64% 60/94	95% 95/100	92% 92/100	100% 100/100	89% 89/100	95% 95/100	96% 96/100	72% 72/100	97% 97/100	100% 100/100	100% 100/100	100% 92/92	100% 100/100
Locutus	81.01%	4% 4/100	11% 11/100	32% 32/100	39% 39/100		56% 56/100	76% 76/100	54% 54/100	88% 88/100	95% 95/100	97% 97/100	96% 96/100	100% 100/100	97% 97/100	94% 90/96	94% 94/100	97% 97/100	100% 100/100	94% 94/100	94% 94/100	100% 100/100	95% 95/100	98% 98/100	100% 100/100	98% 98/100	100% 90/90	100% 100/100
ISAMind	78.46%	11% 11/100	4% 4/100	22% 22/100	34% 34/100	44% 44/100		63% 63/100	49% 49/100	98% 98/100	89% 89/100	96% 96/100	93% 93/100	100% 100/100	95% 95/100	88% 79/90	92% 92/100	98% 98/100	100% 100/100	95% 95/100	93% 93/100	99% 99/100	82% 82/100	97% 97/100	100% 100/100	100% 100/100	100% 96/96	100% 100/100
DaQin	72.39%	5% 5/100	0% 0/100	16% 16/100	8% 8/100	24% 24/100	37% 37/100		42% 42/100	92% 92/100	87% 87/100	99% 99/100	96% 95/99	96% 96/100	99% 99/100	61% 58/95	95% 95/100	99% 99/100	100% 100/100	88% 88/100	73% 73/100	97% 97/100	81% 81/100	98% 98/100	100% 100/100	97% 97/100	93% 89/96	100% 100/100
McRave	65.74%	14% 14/100	15% 15/100	28% 28/99	28% 28/100	46% 46/100	51% 51/100	58% 58/100		55% 55/100	72% 72/100	63% 63/100	79% 79/100	96% 96/100	88% 88/100	51% 49/97	74% 74/100	99% 99/100	96% 96/100	72% 71/99	41% 41/100	100% 100/100	77% 77/100	58% 58/100	74% 74/100	83% 83/100	92% 89/97	100% 100/100
Iron	63.79%	2% 2/100	4% 4/100	2% 2/100	2% 2/100	12% 12/100	2% 2/100	8% 8/100	45% 45/100		41% 41/100	73% 73/100	86% 86/100	91% 91/100	94% 94/100	99% 85/86	66% 66/100	94% 94/100	100% 100/100	91% 91/100	99% 99/100	88% 88/100	97% 97/100	85% 85/100	100% 100/100	93% 93/100	91% 87/96	100% 100/100
ZZZKBot	51.13%	3% 3/100	9% 9/100	9% 9/100	12% 12/100	5% 5/100	11% 11/100	13% 13/100	28% 28/100	59% 59/100		59% 59/100	57% 57/100	55% 55/100	35% 35/100	80% 68/85	40% 40/100	83% 83/100	25% 25/100	86% 86/100	100% 100/100	72% 72/100	89% 89/100	58% 58/100	92% 92/100	73% 73/100	85% 77/91	99% 99/100
Steamhammer	50.99%	3% 3/100	19% 19/99	2% 2/100	3% 3/100	3% 3/100	4% 4/100	1% 1/100	37% 37/100	27% 27/100	41% 41/100		24% 24/100	25% 25/100	53% 53/100	57% 50/88	74% 74/100	57% 57/100	96% 96/100	89% 89/100	79% 79/100	84% 84/100	88% 88/100	91% 91/100	93% 93/100	83% 83/100	95% 91/96	100% 100/100
Microwave	50.46%	0% 0/100	9% 9/100	1% 1/100	6% 6/100	4% 4/100	7% 7/100	4% 4/99	21% 21/100	14% 14/100	43% 43/100	76% 76/100		57% 57/100	52% 52/100	72% 66/92	80% 80/100	68% 68/100	73% 73/100	81% 81/100	65% 65/100	78% 78/100	81% 81/100	91% 91/100	86% 86/100	51% 50/99	98% 90/92	100% 100/100
LastOrder	49.23%	0% 0/100	18% 18/100	0% 0/100	0% 0/100	0% 0/100	0% 0/100	4% 4/100	4% 4/100	9% 9/100	45% 45/100	75% 75/100	43% 43/100		57% 57/100	88% 87/99	75% 75/100	83% 83/100	4% 4/100	95% 95/100	85% 85/100	89% 89/100	95% 95/100	89% 89/100	35% 35/100	92% 92/100	96% 95/99	100% 100/100
Tyr	44.60%	0% 0/100	4% 4/100	0% 0/100	0% 0/100	3% 3/100	5% 5/100	1% 1/100	12% 12/100	6% 6/100	65% 65/100	47% 47/100	48% 48/100	43% 43/100		20% 20/98	61% 61/100	96% 96/100	46% 46/100	58% 58/100	98% 98/100	100% 100/100	50% 50/100	94% 94/100	49% 49/100	62% 62/100	94% 88/94	100% 100/100
MetaBot	44.42%	4% 4/94	1% 1/93	6% 6/95	36% 34/94	6% 6/96	12% 11/90	39% 37/95	49% 48/97	1% 1/86	20% 17/85	43% 38/88	28% 26/92	12% 12/99	80% 78/98		41% 32/78	62% 56/91	86% 79/92	55% 52/94	40% 38/94	68% 64/94	73% 62/85	49% 47/95	91% 85/93	65% 62/95	87% 80/92	99% 87/88
LetaBot	37.80%	2% 2/100	2% 2/100	9% 9/100	5% 5/100	6% 6/100	8% 8/100	5% 5/100	26% 26/100	34% 34/100	60% 60/100	26% 26/100	20% 20/100	25% 25/100	39% 39/100	59% 46/78		42% 42/100	76% 76/100	41% 41/100	78% 78/100	44% 44/100	36% 36/100	53% 53/100	23% 23/100	92% 92/100	89% 67/75	100% 100/100
Arrakhammer	37.24%	0% 0/100	11% 11/100	0% 0/100	8% 8/100	3% 3/100	2% 2/100	1% 1/100	1% 1/100	6% 6/100	17% 17/100	43% 43/100	32% 32/100	17% 17/100	4% 4/100	38% 35/91	58% 58/100		69% 69/100	43% 43/100	71% 71/100	77% 77/100	54% 54/100	59% 59/100	94% 94/100	63% 63/100	100% 95/95	100% 100/100
Ecgberht	36.72%	0% 0/100	1% 1/100	0% 0/100	0% 0/100	0% 0/100	0% 0/100	0% 0/100	4% 4/100	0% 0/100	75% 75/100	4% 4/100	27% 27/100	96% 96/100	54% 54/100	14% 13/92	24% 24/100	31% 31/100		58% 58/100	79% 79/100	38% 38/100	57% 57/100	66% 66/100	58% 58/100	84% 84/100	95% 83/87	95% 95/100
UAlbertaBot	34.71%	13% 13/100	2% 2/100	2% 2/100	11% 11/100	6% 6/100	5% 5/100	12% 12/100	28% 28/99	9% 9/100	14% 14/100	11% 11/100	19% 19/100	5% 5/100	42% 42/100	45% 42/94	59% 59/100	57% 57/100	42% 42/100		48% 48/100	45% 45/100	64% 64/100	75% 75/100	41% 41/100	70% 70/100	83% 78/94	98% 98/100
Ximp	32.61%	2% 2/100	1% 1/100	0% 0/100	5% 5/100	6% 6/100	7% 7/100	27% 27/100	59% 59/100	1% 1/100	0% 0/100	21% 21/100	35% 35/100	15% 15/100	2% 2/100	60% 56/94	22% 22/100	29% 29/100	21% 21/100	52% 52/100		3% 3/100	68% 68/100	84% 84/100	96% 96/100	64% 64/100	84% 71/85	94% 94/100
CDBot	31.98%	4% 4/100	0% 0/100	1% 1/100	4% 4/100	0% 0/100	1% 1/100	3% 3/100	0% 0/100	12% 12/100	28% 28/100	16% 16/100	22% 22/100	11% 11/100	0% 0/100	32% 30/94	56% 56/100	23% 23/100	62% 62/100	55% 55/100	97% 97/100		23% 23/100	62% 62/100	78% 78/100	66% 66/100	89% 79/89	93% 93/100
Aiur	31.56%	5% 5/100	1% 1/100	4% 4/100	28% 28/100	5% 5/100	18% 18/100	19% 19/100	23% 23/100	3% 3/100	11% 11/100	12% 12/100	19% 19/100	5% 5/100	50% 50/100	27% 23/85	64% 64/100	46% 46/100	43% 43/100	36% 36/100	32% 32/100	77% 77/100		27% 27/100	61% 61/100	38% 38/100	76% 65/85	96% 96/100
KillAll	29.64%	4% 4/100	0% 0/100	0% 0/100	3% 3/100	2% 2/100	3% 3/100	2% 2/100	42% 42/100	15% 15/100	42% 42/100	9% 9/100	9% 9/100	11% 11/100	6% 6/100	51% 48/95	47% 47/100	41% 41/100	34% 34/100	25% 25/100	16% 16/100	38% 38/100	73% 73/100		39% 39/100	70% 70/100	98% 94/96	95% 95/100
WillyT	27.76%	1% 1/100	0% 0/100	0% 0/100	0% 0/100	0% 0/100	0% 0/100	0% 0/100	26% 26/100	0% 0/100	8% 8/100	7% 7/100	14% 14/100	65% 65/100	51% 51/100	9% 8/93	77% 77/100	6% 6/100	42% 42/100	59% 59/100	4% 4/100	22% 22/100	39% 39/100	61% 61/100		43% 43/100	91% 85/93	100% 100/100
AILien	27.04%	0% 0/100	0% 0/100	1% 1/100	0% 0/100	2% 2/100	0% 0/100	3% 3/100	17% 17/100	7% 7/100	27% 27/100	17% 17/100	49% 49/99	8% 8/100	38% 38/100	35% 33/95	8% 8/100	37% 37/100	16% 16/100	30% 30/100	36% 36/100	34% 34/100	62% 62/100	30% 30/100	57% 57/100		96% 87/91	100% 100/100
CUNYBot	9.84%	2% 2/96	0% 0/100	1% 1/98	0% 0/92	0% 0/90	0% 0/96	7% 7/96	8% 8/97	9% 9/96	15% 14/91	5% 5/96	2% 2/92	4% 4/99	6% 6/94	13% 12/92	11% 8/75	0% 0/95	5% 4/87	17% 16/94	16% 14/85	11% 10/89	24% 20/85	2% 2/96	9% 8/93	4% 4/91		95% 80/84
Hellbot	1.36%	0% 0/100	0% 0/100	0% 0/100	0% 0/100	0% 0/100	0% 0/100	0% 0/100	0% 0/100	0% 0/100	1% 1/100	0% 0/100	0% 0/100	0% 0/100	0% 0/100	1% 1/88	0% 0/100	0% 0/100	5% 5/100	2% 2/100	6% 6/100	7% 7/100	4% 4/100	5% 5/100	0% 0/100	0% 0/100	5% 4/84

getting back to the subject at hand...

Here is the overall race balance. The only random player was UAlbertaBot, so that row and column reflect only UAlbertaBot’s results.

	overall	vT	vP	vZ	vR
terran	52%		45%	60%	67%
protoss	57%	55%		63%	67%
zerg	43%	40%	37%		62%
random	35%	33%	33%	38%

The top winner was terran and the runner-up was zerg, but the Locutusoid mass still makes it look like a protoss world. As always, race balance reflects more who the entrants are than anything else.

Here is the more interesting table, how each bot performed against each race.

#	bot	race	overall	vT	vP	vZ	vR
1	SAIDA	terran	95.91%	99%	95%	97%	87%
2	CherryPi	zerg	90.86%	82%	93%	93%	98%
3	CSE	protoss	87.08%	79%	86%	91%	98%
4	BlueBlueSky	protoss	81.48%	79%	76%	88%	89%
5	Locutus	protoss	81.01%	77%	74%	89%	94%
6	ISAMind	protoss	78.46%	80%	67%	88%	95%
7	DaQin	protoss	72.39%	78%	54%	86%	88%
8	McRave	protoss	65.74%	63%	57%	76%	72%
9	Iron	terran	63.79%	67%	50%	74%	91%
10	ZZZKBot	zerg	51.13%	44%	43%	61%	86%
11	Steamhammer	zerg	50.99%	59%	39%	58%	89%
12	Microwave	zerg	50.46%	51%	37%	63%	81%
13	LastOrder	zerg	49.23%	25%	39%	70%	95%
14	Tyr	protoss	44.60%	32%	29%	65%	58%
15	MetaBot	protoss	44.42%	45%	44%	44%	55%
16	LetaBot	terran	37.80%	34%	33%	44%	41%
17	Arrakhammer	zerg	37.24%	45%	26%	46%	43%
18	Ecgberht	terran	36.72%	20%	28%	51%	58%
19	UAlbertaBot	random	34.71%	33%	33%	38%	-
20	Ximp	protoss	32.61%	28%	33%	33%	52%
21	CDBot	zerg	31.98%	42%	23%	35%	55%
22	Aiur	protoss	31.56%	35%	30%	31%	36%
23	KillAll	zerg	29.64%	28%	26%	35%	25%
24	WillyT	terran	27.76%	30%	21%	31%	59%
25	AILien	zerg	27.04%	18%	27%	32%	30%
26	CUNYBot	zerg	9.84%	7%	15%	5%	17%
27	Hellbot	protoss	1.36%	1%	1%	2%	2%

At the top, it is interesting that #1 SAIDA had a little trouble versus random #19 UAlbertaBot, which CherryPi steamrolled, and #2 CherryPi had a little trouble versus terrans, which SAIDA annihilated. The upper protoss bloc, the Locutusoids plus #8 McRave, crushed all competition below them, with the worst matchup at 54%. Everybody in the top half was strong against zerg, even the zergs. (#11 Steamhammer was the weakest of them at ZvZ due to the micro bugs that are fixed in version 2.1.) Four zergs are closely grouped around 50%, but had different paths to get there. #15 MetaBot was equally good against all races, which I think is a sign that its 3 heads are well balanced. #18 Ecgberht was strikingly stronger against zergs than other races, reflecting its infantry first strategy. There are not many surprises in the table.

AIIDE 2018 - the unfamiliar bots

I did a quick investigation of the AIIDE bots whose names I didn’t know before. Some of them are interesting, and I will follow up.

#3 CSE and #4 BlueBlueSky were quickly identified as Locutus forks. The links are to diffs helpfully prepared by Bruce, author of Locutus.

#13 LastOrder is credited to Bilibili AI Research and is related to Overkill. Bilibili is a Chinese video sharing website, and their stock prospectus boasts of “our robust artificial intelligence empowered, interest-based content curation,” so it sort of makes sense. LastOrder uses the TensorFlow machine learning framework. The description says “all the production of unit (excluding overlord), building, upgrade, tech and trigger of attack are controlled by a pre-trained Tensorflow model using method similar to ape-X DQN. model are trained distributively against 20 different bots on a cluster of 1000 machines.” It promises more details later at Sijia Xu’s github (the author of Overkill). I see an 8MB file that looks like machine learning results. There is python code that I take to be TensorFlow glue, and C++ code that looks like Overkill. Overkill was strong in 2015 (which is the version still running on SSCAIT), but its learning experiments in 2016 and 2017 were not successful. LastOrder finished in the top half, so I gather that this time there was good progress, perhaps with the help of a larger team.

#15 MetaBot (link to github repo) is an evolved version of the familiar MegaBot. Instead of MegaBot’s 3 heads NUSBot, Skynet, and Xelnaga, MetaBot has AIUR, Skynet, and XIMP, a much stronger combination. MegaBot settled on Skynet versus most opponents, because Skynet is much stronger than NUS or Xelnaga; MetaBot should show more variety. MetaBot ranked higher than #20 XIMP or #22 AIUR (while Skynet did not compete), so there is at least a little evidence that 3 heads are better than 1.

#21 CDBot seems to have been forked from cpac, which is itself a not-very-deep fork of Steamhammer. It did not catch my interest.

#27 Hellbot is written in C# and relies on bwapi-mono-bridge2. It’s quite small and developed from scratch.

AIIDE 2018 results announced

AIIDE 2018 results are out, and they’re exciting!

SAIDA
CherryPi
CSE
BlueBlueSky
Locutus

SAIDA is first and Locutus is only fifth! #1 SAIDA scored 96% overall, 83% against #2 CherryPi, and higher against every other opponent, so the winner was clear. That sounds to me like a fair claim to be world champion. All the top bots became much stronger this year. Look how far down #9 Iron has been pushed.

Zergs #10 ZZZKBot (last year’s winner), #11 Steamhammer, #12 Microwave, #13 LastOrder all scored about 50%. That looks miserable, but it put them right behind #9 Iron and in the upper half of the table—there were 27 participants total. The top bots wiped the floor with all others. Former contenders #19 UAlbertaBot, #20 XIMP, and #22 AIUR scored in the vicinity of 33%.

I’m pleased that #11 Steamhammer finished about as high as it did last year. I have more or less kept up with progress—except progress at the summit.

Stand by for tables and analysis. I’ll be looking at the top bots to see what makes them tick. I don’t know anything about #3 CSE and #4 BlueBlueSky so that should be interesting.

various short items

SAIDA

SAIDA has been updated and is again defeating Krasi0 and Locutus. The arms race continues!

CIG 2018

I started poking at the detailed results file to figure out how to reproduce the official results exactly... then I discovered that the build order problem was wider than it first seemed. I canceled my plans. We don’t need per-map crosstables and race balance analysis of a tournament with such badly distorted results.

Steamhammer 2.1

I haven’t been working that hard on it, but I have made progress. I fixed some of the bugs introduced along with squad clustering, and found the causes of others. 2.1 should have smoother play in many cases. To say the same thing differently, Steamhammer 2.1 is suffering from feature creep, or at least bug fix creep. Hang on, it shouldn’t take too much longer.

CIG 2018 - not only Overkill was broken

I’ve been watching CIG replays. There are way too many and I watched few, but I soon noticed that Overkill was not the only bot in the tournament with broken build orders due to some unknown incompatibility. Steamhammer is also affected in every game I checked, with symptoms similar to Overkill’s though apparently less severe. Strangely, UAlbertaBot (parent of both Overkill and Steamhammer) does not seem to be affected (though I did see one game where it opened 11-11 gate instead of 9-9 gate). Tyr also had build order problems in every game I checked, and it is unrelated code.

I checked a few other bots and did not see consistent problems as with Overkill, Steamhammer, and Tyr. For example, McRave fell into an early production freeze in one game, but it played normally in other games so that was likely a garden variety bug.

It explains some mysteries about Steamhammer’s performance, though it opens others.

It seems difficult to inventory all the participants and see which were affected by similar problems. For the weaker bots, we may have to read the source to tell whether build orders are working as intended.

Can anybody diagnose it? So far we only have speculation about the cause.

AITT bots

Submission is closed for the AI Tinycraft Tournament (AITT), for bots limited to 3000 bytes of source code. 3 of the tiny bots have appeared on SSCAIT. Will more follow? Naturally, very small bots play very simple strategies:

Oh Fish - zerg 4 pool
PotatoMasher - protoss zealot rush
PurpleWavelet - protoss zealot rush

CIG 2018 - 8 game limit and other problems

I checked ISAMind and verified that it is affected by the same 8 game problem as Locutus and McRave: Its learning files store data for only 8 games total, not about 125 games as expected. Tscmoo also has a suspiciously small amount of learning data and may be affected. Ziabot has a problem with its learning data, but it looks like a different problem. Other bots appear unaffected, as far as I can judge—I could be wrong, because I don’t understand how they all work.

It’s unclear what effect the 8 game problem had on the tournament. In the best case, the CIG organizers pulled data incorrectly and the tournament itself ran normally. That seems unlikely to me. More likely, learning data for some bots was lost 8 rounds before the end. In that case, it is possible that most of the tournament ran normally, and one error near the end did not much affect results. The fact that the affected bots finished high supports the hypothesis—though, like PurpleWave, they could have finished high because they’re that good even when handicapped. In the worst case, there may have been repeated problems throughout the tournament. I’ll see if I can think of a way to use the detailed results log to narrow down the possibilities.

I feel that CIG 2018 had a lot of problems.

The 8 game problem, affecting Locutus, McRave, ISAMind, and possibly Tscmoo.
JVM bots did not write learning data at all, affecting PurpleWave, Tyr, and Ecgberht.
Ziabot’s learning problem (it might be a bot bug rather than a tournament bug, but Zia has always been reliable for me).
Overkill’s build order breakdown.

That’s a large proportion of the entrants affected by tournament surprises of one kind or another. What other problems are there that I haven’t noticed? I’ve only watched a few replays so far.

When I wrote to the CIG organizers to warn them that Steamhammer might crash a lot, they sent back what I found to be a rude reply which implied that giving them heads-up was a wrong thing to do. That is of course down to language and cultural differences. But still, communicating with the participants is part of running a tournament.

I may skip CIG next year.

CIG 2018 - what Locutus learned

Locutus only recorded 8 games. It is configured to retain 200 game records, and I read the source code and verified that Locutus does not intentionally drop game records before the limit of 200. Recording exactly 8 games is the same problem that McRave suffered, and must be due to CIG problems. I don't know what the underlying problem was. My suspicion is that CIG organizers or tournament software may have accidentally or mistakenly cleared learning data for some bots. If that is what happened, and it happened once 8 games before the end of the tournament, it seems likely that it happened more than once. Who knows, though? The error might be somewhere else. Maybe they mistakenly shipped us data from after round 8 instead of round 125—in that case the tournament may have run normally, and only the data about it is wrong.

Locutus has prepared data for some opponents, stored in the AI directory. When Locutus finds it has no game records for a given opponent, it looks in AI to see if it has prepared data, and if so, it reads in those game records. At the end of the game, it writes out the prepared game records along with the record for the newly played game, and from then on the prepared records are treated like any others and retained unless and until the 200 record limit is passed.

How many other bots were affected by the 8 game problem?

Here is Locutus’s prepared data. Against some opponents, like McRave, Locutus picks out openings to avoid at first. If other openings don’t win either, I’m sure Locutus will come back and try these anyway. Against others, it picks out winners to try first. For some, it simply provides data. Most but not all of the prepared data is for opponents which were carried over from last year, for which pre-learning is sure to be helpful... if it is done on the same maps.

#3 mcrave

opening	games	wins
12Nexus5ZealotFECannons	1	0%
Turtle	1	0%
2 openings	2	0%

#6 iron

opening	games	wins
DTDrop	14	100%
1 openings	14	100%

#7 zzzkbot

opening	games	wins
ForgeExpand5GateGoon	2	100%
1 openings	2	100%

#11 ualbertabot

opening	games	wins
4GateGoon	1	0%
9-9GateDefensive	2	50%
ForgeExpand5GateGoon	15	93%
3 openings	18	83%

#14 aiur

opening	games	wins
4GateGoon	3	100%
9-9GateDefensive	1	100%
2 openings	4	100%

#16 ziabot

opening	games	wins
9-9GateDefensive	1	0%
ForgeExpand5GateGoon	1	100%
2 openings	2	50%

#19 terranuab

opening	games	wins
DTDrop	10	100%
1 openings	10	100%

#21 opprimobot

opening	games	wins
DTDrop	11	100%
1 openings	11	100%

#22 sling

opening	games	wins
ForgeExpand5GateGoon	2	100%
1 openings	2	100%

#23 srbotone

opening	games	wins
DTDrop	7	100%
PlasmaProxy2Gate	1	100%
2 openings	8	100%

#24 bonjwa

opening	games	wins
DTDrop	6	100%
PlasmaProxy2Gate	1	100%
2 openings	7	100%

overall

	total		PvT		PvP		PvZ		PvR
opening	games	wins	games	wins	games	wins	games	wins	games	wins
12Nexus5ZealotFECannons	1	0%			1	0%
4GateGoon	4	75%			3	100%			1	0%
9-9GateDefensive	4	50%			1	100%	1	0%	2	50%
DTDrop	48	100%	48	100%
ForgeExpand5GateGoon	20	95%					5	100%	15	93%
PlasmaProxy2Gate	2	100%	2	100%
Turtle	1	0%			1	0%
total	80	92%	50	100%	6	67%	6	83%	18	83%
openings played	7		2		4		2		3

Here is Locutus’s learned data. In every case, the number of games recorded is 8 plus the number of games in the prepared data. With only 8 games there is not much to go on, but the prepared data does seem to have helped Locutus choose successful openings.

#2 purplewave

opening	games	wins
12Nexus5ZealotFECannons	1	0%
4GateGoon	1	0%
9-9GateDefensive	5	80%
Proxy9-9Gate	1	0%
4 openings	8	50%

#3 mcrave

opening	games	wins
12Nexus5ZealotFECannons	1	0%
4GateGoon	3	67%
Proxy9-9Gate	5	100%
Turtle	1	0%
4 openings	10	70%

#4 tscmoo

opening	games	wins
4GateGoon	1	0%
9-9GateDefensive	1	0%
ForgeExpand5GateGoon	4	25%
Proxy9-9Gate	2	50%
4 openings	8	25%

#5 isamind

opening	games	wins
4GateGoon	6	83%
9-9GateDefensive	1	100%
Proxy9-9Gate	1	100%
3 openings	8	88%

#6 iron

opening	games	wins
DTDrop	22	95%
1 openings	22	95%

#7 zzzkbot

opening	games	wins
ForgeExpand5GateGoon	7	86%
ForgeExpandSpeedlots	2	50%
Proxy9-9Gate	1	0%
3 openings	10	70%

#8 microwave

opening	games	wins
ForgeExpand5GateGoon	8	100%
1 openings	8	100%

#9 letabot

opening	games	wins
DTDrop	8	88%
1 openings	8	88%

#10 megabot

opening	games	wins
4GateGoon	8	100%
1 openings	8	100%

#11 ualbertabot

opening	games	wins
4GateGoon	1	0%
9-9GateDefensive	2	50%
ForgeExpand5GateGoon	23	91%
3 openings	26	85%

#12 tyr

opening	games	wins
4GateGoon	8	100%
1 openings	8	100%

#13 ecgberht

opening	games	wins
DTDrop	8	88%
1 openings	8	88%

#14 aiur

opening	games	wins
12Nexus5ZealotFECannons	1	0%
2GateDTExpo	1	100%
4GateGoon	5	80%
9-9GateDefensive	1	100%
Proxy9-9Gate	4	75%
5 openings	12	75%

#15 titaniron

opening	games	wins
DTDrop	8	100%
1 openings	8	100%

#16 ziabot

opening	games	wins
9-9GateDefensive	1	0%
ForgeExpand5GateGoon	6	83%
ForgeExpandSpeedlots	2	50%
Proxy9-9Gate	1	100%
4 openings	10	70%

#17 steamhammer

opening	games	wins
ForgeExpand5GateGoon	8	100%
1 openings	8	100%

#18 overkill

opening	games	wins
ForgeExpand5GateGoon	8	100%
1 openings	8	100%

#19 terranuab

opening	games	wins
DTDrop	18	100%
1 openings	18	100%

#20 cunybot

opening	games	wins
ForgeExpand5GateGoon	8	100%
1 openings	8	100%

#21 opprimobot

opening	games	wins
DTDrop	19	100%
1 openings	19	100%

#22 sling

opening	games	wins
ForgeExpand5GateGoon	10	100%
1 openings	10	100%

#23 srbotone

opening	games	wins
DTDrop	15	100%
PlasmaProxy2Gate	1	100%
2 openings	16	100%

#24 bonjwa

opening	games	wins
DTDrop	14	100%
PlasmaProxy2Gate	1	100%
2 openings	15	100%

#25 stormbreaker

opening	games	wins
ForgeExpand5GateGoon	8	100%
1 openings	8	100%

#26 korean

opening	games	wins
ForgeExpand5GateGoon	8	100%
1 openings	8	100%

#27 salsa

opening	games	wins
ForgeExpand5GateGoon	8	100%
1 openings	8	100%

overall

	total		PvT		PvP		PvZ		PvR
opening	games	wins	games	wins	games	wins	games	wins	games	wins
12Nexus5ZealotFECannons	3	0%			3	0%
2GateDTExpo	1	100%			1	100%
4GateGoon	33	82%			31	87%			2	0%
9-9GateDefensive	11	64%			7	86%	1	0%	3	33%
DTDrop	112	97%	112	97%
ForgeExpand5GateGoon	106	93%					79	97%	27	81%
ForgeExpandSpeedlots	4	50%					4	50%
PlasmaProxy2Gate	2	100%	2	100%
Proxy9-9Gate	15	73%			11	82%	2	50%	2	50%
Turtle	1	0%			1	0%
total	288	90%	114	97%	54	80%	86	93%	34	71%
openings played	10		2		6		4		4

CIG 2018 - what Steamhammer learned

I wrote a new script to analyze Steamhammer’s learning data. A couple points: 1. Steamhammer crashed in nearly half of its games in CIG 2018. It can’t save learning data after a crash, so against some opponents Steamhammer had few opportunities to experiment. The number of crashes varied strongly depending on the opponent. 2. Steamhammer was set to remember the previous 100 games, since I figure there’s no play advantage to remembering more. The tournament was 125 rounds long. So in the tables below, “100 games” means that Steamhammer played at least 100 games without crashing, and up to 25 games may have been dropped, the early games. Against some weak opponents, Steamhammer learned, within 25 games, how to win 100% of the remaining games, and those tables give a 100% win rate for remembered games. Steamhammer did not score 100% against any opponent overall; it always had some losses in early games.

I should be able to run the same analysis for Steamhammer forks which retain Steamhammer’s opponent model file format.

#1 Locutus

opening	games	wins
2HatchHydraBust	1	0%
3HatchHydraExpo	2	0%
3HatchLingBust	1	0%
3HatchLingExpo	1	0%
4HatchBeforeGas	1	0%
OverpoolSpeed	9	56%
6 openings	15	33%

A mystery is solved. Why was Steamhammer’s crash rate higher than I expected? Because many opponents learned to make Steamhammer crash. A crash for the opponent is a win, and the bot doesn’t care how it wins, so if it can learn a plan that makes the opponent crash reliably, it will. The stronger opponents tend to be learning bots, so Steamhammer crashed more often on average against strong opponents. This also means that my glib conclusion that Steamhammer won 66% of non-crash games, so it seems to have kept up with general progress is not sound. The non-crash games were mostly against weak opponents.

Locutus was lucky that it could figure out how to break Steamhammer. As Bruce mentioned in a comment, this Locutus version had a bug when facing certain zergling timings, and Steamhammer quickly figured out how to exploit the bug. It’s possible that Steamhammer minus the crash would have upset Locutus.

#2 PurpleWave

opening	games	wins
11Gas10PoolMuta	1	0%
3HatchHydra	3	0%
3HatchLurker	1	0%
4PoolSoft	1	0%
7Pool12Hatch	1	0%
7PoolSoft	1	0%
9Hatch8Pool	1	0%
9HatchExpo9Pool9Gas	1	0%
9PoolSpeed	1	0%
AntiFactory	1	0%
Over10Hatch	6	0%
Over10Hatch1Sunk	7	0%
Over10Hatch2Sunk	18	0%
Over10HatchBust	1	0%
Over10HatchSlowLings	4	0%
OverhatchMuta	1	0%
OverpoolHatch	1	0%
OverpoolTurtle	3	0%
ZvP_3HatchPoolHydra	2	0%
ZvP_4HatchPoolHydra	1	0%
ZvT_12PoolMuta	1	0%
ZvZ_Overpool11Gas	1	0%
22 openings	58	0%

PurpleWave shut out Steamhammer. It didn’t learn to make Steamhammer crash because every game was a win for it anyway. Steamhammer desperately tried alternatives all over the map, including crazy all-ins and openings intended for ZvT and ZvZ, and nothing worked.

#3 McRave

opening	games	wins
11Gas10PoolLurker	1	0%
4HatchBeforeGas	1	0%
9HatchExpo9Pool9Gas	1	0%
9PoolSpeed	5	100%
ZvP_3HatchPoolHydra	2	0%
5 openings	10	50%

#4 tscmoo

opening	games	wins
9PoolExpo	1	0%
9PoolHatch	1	0%
9PoolSunkHatch	1	0%
AntiFact_2Hatch	1	0%
Over10Hatch2Sunk	1	0%
OverhatchExpoLing	13	15%
OverpoolSpeed	22	23%
7 openings	40	18%

#5 ISAMind

opening	games	wins
3HatchHydraExpo	1	0%
4HatchBeforeGas	1	0%
OverpoolSpeed	4	100%
ZvP_2HatchMuta	7	0%
ZvP_3HatchPoolHydra	6	0%
5 openings	19	21%

#6 Iron

opening	games	wins
2HatchHydra	1	0%
3HatchLingExpo	2	0%
4PoolHard	1	0%
6PoolSpeed	1	0%
9Hatch8Pool	1	0%
9HatchMain9Pool9Gas	1	0%
9PoolSunkSpeed	1	0%
AntiFact_13Pool	4	0%
AntiFact_2Hatch	83	12%
AntiFactory	1	0%
Over10Hatch	1	0%
PurpleSwarmBuild	1	0%
ZvP_2HatchMuta	1	0%
ZvT_12PoolMuta	1	0%
14 openings	100	10%

Iron is not a learning bot, so it did not learn to crash Steamhammer. Still, these results show a weakness in Steamhammer: Its best opening against Iron is AntiFactory, which it tried only once in these 100 games. Steamhammer did not explore enough. I tried to fix the weakness in Steamhammer 2.0.

#7 ZZZKBot

opening	games	wins
11Gas10PoolMuta	1	0%
8Pool	7	29%
9HatchMain9Pool9Gas	1	0%
9PoolSpeed	1	0%
OverhatchMuta	1	0%
Overpool+1	1	0%
OverpoolSpeed	1	0%
ZvZ_12HatchMain	2	0%
ZvZ_12Pool	1	0%
ZvZ_12PoolLing	48	58%
ZvZ_Overgas9Pool	2	0%
ZvZ_Overpool9Gas	2	0%
12 openings	68	44%

#8 Microwave

opening	games	wins
9PoolSunkHatch	5	80%
9PoolSunkSpeed	27	67%
OverpoolSunk	1	0%
OverpoolTurtle	3	33%
ZvZ_12PoolLing	1	0%
5 openings	37	62%

This looks like successful learning. Too bad Steamhammer only successfully played 37 of the 125 games.

#9 LetaBot

opening	games	wins
11Gas10PoolLurker	1	0%
2HatchLurkerAllIn	4	0%
3HatchHydraExpo	1	0%
3HatchLurker	13	38%
9HatchExpo9Pool9Gas	45	36%
OverpoolLurker	13	31%
ZvP_2HatchMuta	1	0%
ZvT_12PoolMuta	1	0%
ZvT_13Pool	1	0%
ZvT_3HatchMuta	1	0%
10 openings	81	31%

#10 MegaBot

opening	games	wins
11Gas10PoolLurker	1	0%
3HatchHydra	1	0%
3HatchHydraExpo	1	0%
3HatchLingExpo	21	43%
Over10Hatch	1	0%
OverhatchExpoLing	1	100%
ZvP_3HatchPoolHydra	2	0%
7 openings	28	36%

#11 UAlbertaBot

opening	games	wins
3HatchLingExpo	1	0%
5PoolHard2Player	1	0%
9PoolExpo	1	0%
9PoolSpeed	1	0%
9PoolSunkHatch	46	33%
9PoolSunkSpeed	29	48%
Over10Hatch1Sunk	2	0%
OverpoolSpeed	1	0%
ZvZ_Overpool9Gas	1	0%
9 openings	83	35%

#12 Tyr

opening	games	wins
9PoolHatch	5	100%
ZvP_3HatchPoolHydra	5	0%
2 openings	10	50%

#13 Ecgberht

opening	games	wins
11Gas10PoolLurker	10	50%
2HatchLurker	23	61%
2HatchLurkerAllIn	44	75%
Over10HatchBust	3	33%
OverpoolLurker	8	75%
OverpoolSpeed	3	33%
ZvT_13Pool	1	0%
7 openings	92	65%

#14 Aiur

opening	games	wins
11Gas10PoolLurker	1	100%
5PoolHard2Player	1	100%
9PoolSunkHatch	1	100%
9PoolSunkSpeed	2	100%
Over10Hatch	1	0%
Over10Hatch1Sunk	2	50%
Over10Hatch2Hard	1	100%
Over10HatchSlowLings	1	100%
OverpoolSpeed	2	100%
OverpoolTurtle	3	67%
10 openings	15	80%

#15 TitanIron

opening	games	wins
3HatchLingBust	1	0%
AntiFact_13Pool	6	50%
AntiFact_2Hatch	1	0%
AntiFactory	74	42%
Over10Hatch2Sunk	1	0%
OverhatchExpoMuta	1	0%
OverpoolLurker	1	0%
ZvZ_Overgas9Pool	14	21%
ZvZ_Overpool9Gas	1	0%
9 openings	100	37%

This selection of openings implies that TitanIron plays a factory-first build against zerg, like Iron, and is a non-learning bot, like Iron. Later I’ll look into the source and find out for sure.

#16 Ziabot

opening	games	wins
11Gas10PoolMuta	4	25%
2.5HatchMuta	1	0%
3HatchHydraBust	1	0%
6PoolSpeed	1	0%
8Pool	7	71%
9Hatch8Pool	1	0%
9PoolHatch	4	50%
ZvP_2HatchTurtle	1	0%
ZvZ_12Pool	1	0%
ZvZ_12PoolMain	16	25%
ZvZ_Overpool11Gas	10	50%
ZvZ_Overpool9Gas	53	74%
12 openings	100	56%

Low win rates against Zia and some other opponents suggest to me that Steamhammer had other new weaknesses besides crashing. I think Steamhammer should score over 80% against Zia.

#18 Overkill

opening	games	wins
11Gas10PoolMuta	10	90%
4PoolHard	23	96%
6PoolSpeed	28	100%
9Hatch8Pool	1	0%
OverhatchLing	2	50%
OverpoolSpeed	13	92%
ZvZ_12HatchExpo	2	50%
ZvZ_12PoolMain	1	0%
8 openings	80	91%

#19 TerranUAB

opening	games	wins
2HatchLurker	52	90%
AntiFact_13Pool	8	88%
AntiFact_2Hatch	9	78%
AntiFactory	31	90%
4 openings	100	89%

#20 CUNYbot

opening	games	wins
11Gas10PoolMuta	9	78%
OverhatchLing	34	97%
ZvZ_12PoolLing	27	96%
ZvZ_Overgas9Pool	1	0%
ZvZ_Overpool9Gas	19	89%
5 openings	90	92%

#21 OpprimoBot

opening	games	wins
11Gas10PoolLurker	3	67%
2HatchLurker	2	50%
2HatchLurkerAllIn	6	83%
6PoolSpeed	19	100%
OverpoolLurker	1	0%
OverpoolSpeed	5	80%
ZvT_12PoolMuta	20	95%
ZvT_3HatchMuta	20	100%
ZvT_3HatchMutaExpo	24	100%
9 openings	100	94%

#22 Sling

opening	games	wins
4PoolHard	4	75%
4PoolSoft	6	100%
5PoolHard2Player	3	100%
ZvZ_12HatchMain	1	0%
ZvZ_Overgas9Pool	1	0%
5 openings	15	80%

The selection of fast rush openings suggests that Sling played a macro strategy which was countered by fast rushes. But I don’t want to draw strong conclusions based on 15 non-crash games out of 125.

#23 SRbotOne

opening	games	wins
11Gas10PoolLurker	14	93%
2HatchLurker	10	90%
2HatchLurkerAllIn	10	90%
3HatchLurker	17	100%
4PoolSoft	17	100%
5PoolHard	7	100%
9HatchExpo9Pool9Gas	4	75%
9PoolLurker	3	100%
OverpoolLurker	5	100%
9 openings	87	95%

The wide range of lurker openings means that SRbotOne by Johan Kayser fought with mostly barracks units. Well, we already knew that.

#24 Bonjwa

opening	games	wins
9PoolExpo	6	100%
9PoolSunkHatch	5	100%
9PoolSunkSpeed	5	100%
AntiFact_2Hatch	3	100%
AntiFactory	5	100%
ZvT_2HatchMuta	1	100%
6 openings	25	100%

#25 Stormbreaker

opening	games	wins
11Gas10PoolMuta	1	100%
4PoolHard	1	100%
9PoolSunkHatch	8	100%
9PoolSunkSpeed	8	100%
OverhatchLing	1	100%
OverhatchMuta	7	100%
OverpoolSpeed	1	100%
OverpoolSunk	7	100%
ZvZ_12HatchExpo	2	100%
ZvZ_12HatchMain	3	100%
ZvZ_12PoolLing	1	100%
ZvZ_12PoolMain	3	100%
12 openings	43	100%

#26 Korean

opening	games	wins
4PoolHard	1	100%
4PoolSoft	3	100%
5PoolHard	5	100%
5PoolHard2Player	3	100%
5PoolSoft	1	100%
6PoolSpeed	6	100%
OverhatchLing	9	100%
OverhatchMuta	12	100%
ZvZ_12HatchExpo	13	100%
ZvZ_12HatchMain	16	100%
ZvZ_12PoolLing	14	100%
ZvZ_12PoolMain	17	100%
12 openings	100	100%

#27 Salsa

opening	games	wins
4PoolHard	2	100%
4PoolSoft	4	100%
5PoolHard	7	100%
5PoolHard2Player	1	100%
5PoolSoft	1	100%
6PoolSpeed	8	100%
OverhatchLing	11	100%
OverhatchMuta	8	100%
ZvZ_12HatchExpo	12	100%
ZvZ_12HatchMain	20	100%
ZvZ_12PoolLing	13	100%
ZvZ_12PoolMain	12	100%
ZvZ_Overgas9Pool	1	100%
13 openings	100	100%

overall

	total		ZvT		ZvP		ZvZ		ZvR
opening	games	wins	games	wins	games	wins	games	wins	games	wins
11Gas10PoolLurker	31	68%	28	71%	3	33%
11Gas10PoolMuta	26	69%			1	0%	25	72%
2.5HatchMuta	1	0%					1	0%
2HatchHydra	1	0%	1	0%
2HatchHydraBust	1	0%			1	0%
2HatchLurker	87	82%	87	82%
2HatchLurkerAllIn	64	73%	64	73%
3HatchHydra	4	0%			4	0%
3HatchHydraBust	1	0%					1	0%
3HatchHydraExpo	5	0%	1	0%	4	0%
3HatchLingBust	2	0%	1	0%	1	0%
3HatchLingExpo	25	36%	2	0%	22	41%			1	0%
3HatchLurker	31	71%	30	73%	1	0%
4HatchBeforeGas	3	0%			3	0%
4PoolHard	32	91%	1	0%			31	94%
4PoolSoft	31	97%	17	100%	1	0%	13	100%
5PoolHard	19	100%	7	100%			12	100%
5PoolHard2Player	9	89%			1	100%	7	100%	1	0%
5PoolSoft	2	100%					2	100%
6PoolSpeed	63	97%	20	95%			43	98%
7Pool12Hatch	1	0%			1	0%
7PoolSoft	1	0%			1	0%
8Pool	14	50%					14	50%
9Hatch8Pool	4	0%	1	0%	1	0%	2	0%
9HatchExpo9Pool9Gas	51	37%	49	39%	2	0%
9HatchMain9Pool9Gas	2	0%	1	0%			1	0%
9PoolExpo	8	75%	6	100%					2	0%
9PoolHatch	10	70%			5	100%	4	50%	1	0%
9PoolLurker	3	100%	3	100%
9PoolSpeed	8	62%			6	83%	1	0%	1	0%
9PoolSunkHatch	66	50%	5	100%	1	100%	13	92%	47	32%
9PoolSunkSpeed	72	65%	6	83%	2	100%	35	74%	29	48%
AntiFact_13Pool	18	56%	18	56%
AntiFact_2Hatch	97	21%	96	21%					1	0%
AntiFactory	112	57%	111	58%	1	0%
Over10Hatch	9	0%	1	0%	8	0%
Over10Hatch1Sunk	11	9%			9	11%			2	0%
Over10Hatch2Hard	1	100%			1	100%
Over10Hatch2Sunk	20	0%	1	0%	18	0%			1	0%
Over10HatchBust	4	25%	3	33%	1	0%
Over10HatchSlowLings	5	20%			5	20%
OverhatchExpoLing	14	21%			1	100%			13	15%
OverhatchExpoMuta	1	0%	1	0%
OverhatchLing	57	96%					57	96%
OverhatchMuta	29	93%			1	0%	28	96%
Overpool+1	1	0%					1	0%
OverpoolHatch	1	0%			1	0%
OverpoolLurker	28	54%	28	54%
OverpoolSpeed	61	56%	8	62%	15	73%	15	87%	23	22%
OverpoolSunk	8	88%					8	88%
OverpoolTurtle	9	33%			6	33%	3	33%
PurpleSwarmBuild	1	0%	1	0%
ZvP_2HatchMuta	9	0%	2	0%	7	0%
ZvP_2HatchTurtle	1	0%					1	0%
ZvP_3HatchPoolHydra	17	0%			17	0%
ZvP_4HatchPoolHydra	1	0%			1	0%
ZvT_12PoolMuta	23	83%	22	86%	1	0%
ZvT_13Pool	2	0%	2	0%
ZvT_2HatchMuta	1	100%	1	100%
ZvT_3HatchMuta	21	95%	21	95%
ZvT_3HatchMutaExpo	24	100%	24	100%
ZvZ_12HatchExpo	29	97%					29	97%
ZvZ_12HatchMain	42	93%					42	93%
ZvZ_12Pool	2	0%					2	0%
ZvZ_12PoolLing	104	79%					104	79%
ZvZ_12PoolMain	49	73%					49	73%
ZvZ_Overgas9Pool	19	21%	14	21%			5	20%
ZvZ_Overpool11Gas	11	45%			1	0%	10	50%
ZvZ_Overpool9Gas	76	74%	1	0%			74	76%	1	0%
total	1596	64%	685	62%	155	26%	633	82%	123	29%
openings played	69		37		36		31		13

This summary table took me hours to get right, so I hope it's useful.

Steamhammer played 69 openings in 1596 non-crash games, which is around 2/3rds of the openings it knows. No single matchup had more than 37 different openings. There were far more games against terran and zerg than against protoss and random, partly due to the crashing pattern. Against the random opponents (Tscmoo and UAlbertaBot), it settled on mostly general-purpose openings, as you might expect. Its best matchup was ZvZ, with a Jaedong-like 82% win rate (and lately, Jaedong crashes half the time too, so they’re just alike).

Openings that were both popular and successful include 2HatchLurker and 2HatchLurkerAllIn versus terran, 6PoolSpeed with a 97% win rate against mostly weak opponents, 9PoolSunkSpeed used across all matchups, and ZvZ specialties OverhatchLing, ZvZ_12PoolLing, and ZvZ_Overpool9Gas. None of the opening choices surprises me, though some of the win rates do.

CIG 2018 - Overkill was broken

Did Overkill actually perform much worse in CIG 2018 than in past years? Here are the bots carried over from 2017 to 2018, with win rates in both years, with numbers from the official results. We see that Overkill collapsed in win rate from 2017 to 2018, a far bigger change than any other bot. Iron performed poorly in 2017 because it failed on the map Hitchhiker. Other bots mostly had modestly lower win rates in the stronger field this year. My 2017 crosstable was calculated from the detailed results, which included some corrupted data and are a little different from the official results—except for Sling, which was a lot different: 26.07% in 2017 versus its official 18.08%, reducing its year-over-year difference.

bot	2017	2018
UAlbertaBot	65.59%	60.58%
Overkill	62.75%	34.68%
Ziabot	61.75%	51.08%
Iron	61.62%	74.31%
Aiur	59.83%	51.54%
TerranUAB	36.78%	34.40%
SRbotOne	34.14%	24.37%
OpprimoBot	30.69%	27.11%
Bonjwa	30.67%	23.57%
Sling	18.08%	26.52%
Salsa	4.64%	1.54%

Was the difference due to the maps? N0. In 2017, Overkill scored 57% or more on every map (CIG 2017 bots x maps). In 2018, Overkill scored 38% or below on every map (official results). And 3 of the 5 maps were the same: Tau Cross, Andromeda, and Python.

Did they run different versions of Overkill? The source that they distributed for Overkill is identical in both years. Theoretically they might have run something different by mistake—but it produced the expected files in the write directory, so it would be a surprise.

Finally I downloaded the Overkill replays and watched some. The poor bot’s build orders were severely distorted, skipping over drones and buildings. It would do things like take gas on 7 and then stop all construction, or follow a normal-ish build but drop many drones so that its economy was anemic. Sometimes drones moved erratically instead of mining. It looked similar to play I’ve seen from Steamhammer when latency stuff is way out of whack. Of the games I looked at, some were hopelessly muddled, some were close to normal with only occasional dropped drones, and none were 100% good. I don’t know what the problem was, something corrupted or a server setting that Overkill could not cope with, but whatever it was, Overkill was badly broken and far short of its normal strength.

43864-OVER_ZIAB.REP (Overkill’s last game of the tournament) is an example replay that shows the problems.

It’s possible that some other bots may have been affected. If the difference was in a server setting that Overkill was not ready for, then it would be surprising if every other bot was ready.

CIG 2018 - what Overkill learned

After analyzing AIUR yesterday, I ran a similar (but much simpler) analysis for the classic zerg #18 Overkill. The version in CIG 2018 has not been updated since 2015 and is the same version that still plays on SSCAIT. In 2015 it was a sensation, placing 3rd in both CIG and AIIDE—its place of 18 in this tournament, with about 35% win rate, suggests huge progress over the past 3 years. But keep reading; Overkill appears to have been broken in this tournament. I did this analysis once before: See what Overkill learned in AIIDE 2015.

Classic Overkill knows 3 openings, a 9 pool opening which stays on one base for a good time, and 10- and 12-hatch openings to get mutalisks first. When it chooses 9 pool, that means that the opponent is either rushing (so the 9 pool is necessary to defend) or is being too greedy (which the 9 pool can exploit). Overkill counts some games twice in an attempt to learn faster, so sometimes its total game count is larger than the number of rounds in the tournament (125).

	NinePoolling		TenHatchMuta		TwelveHatchMuta		total
opponent	n	win	n	win	n	win	n	win
#1 Locutus	42	0%	42	0%	41	0%	125	0%
#2 PurpleWave	43	0%	43	0%	42	0%	128	0%
#3 McRave	44	0%	44	0%	43	0%	131	0%
#4 tscmoo	40	0%	40	0%	47	2%	127	1%
#5 ISAMind	42	0%	42	0%	41	0%	125	0%
#6 Iron	54	7%	32	0%	39	3%	125	4%
#7 ZZZKBot	47	2%	39	0%	47	2%	133	2%
#8 Microwave	54	6%	35	0%	42	2%	131	3%
#9 LetaBot	52	6%	33	0%	40	2%	125	3%
#10 MegaBot	60	12%	24	0%	41	7%	125	8%
#11 UAlbertaBot	41	0%	41	0%	48	2%	130	1%
#12 Tyr	40	0%	39	0%	47	2%	126	1%
#13 Ecgberht	57	16%	24	4%	42	12%	123	12%
#14 Aiur	94	34%	14	7%	17	12%	125	28%
#15 TitanIron	36	11%	20	0%	69	16%	125	12%
#16 Ziabot	16	0%	16	0%	93	23%	125	17%
#17 Steamhammer	107	48%	7	0%	10	10%	124	42%
#19 TerranUAB	24	67%	3	0%	98	83%	125	78%
#20 CUNYbot	18	44%	6	17%	101	66%	125	61%
#21 OpprimoBot	36	67%	3	0%	86	76%	125	71%
#22 Sling	67	46%	6	0%	52	42%	125	42%
#23 SRbotOne	23	74%	4	25%	95	89%	122	84%
#24 Bonjwa	75	92%	4	25%	46	87%	125	88%
#25 Stormbreaker	70	91%	2	0%	53	87%	125	88%
#26 Korean	77	99%	2	0%	46	93%	125	95%
#27 Salsa	46	100%	32	94%	46	100%	124	98%
total	1305	36%	597	6%	1372	40%	3274	32%

The 10 hatch opening was useless in this tournament—against every opponent, 10 hatch was the worst choice, at best tying for 0. In 2015, 10 hatch was about as successful as the other openings.

Signs are that something was wrong with Overkill in this tournament. In AIIDE 2015, then #3 Overkill scored 23% against then #4 UAlbertaBot, 68% against #5 AIUR, and 99% against #17 OpprimoBot. In CIG 2018, it was 1.6% against UAlbertaBot, 28% against AIUR, 71% against OpprimoBot. All versions appear to be the same in both tournaments—I didn’t look closely, but I did unpack the sources and check dates (in particular, Overkill has file change dates up to 8 October 2015 in both tournaments). Overkill had 14 crash games in CIG 2018, not enough to account for the difference. It’s hard to believe that the maps could have shifted results that much.

Tomorrow: What went wrong with Overkill?

CIG 2018 - what AIUR learned

Here is what the classic protoss bot AIUR learned about each opponent over the course of CIG 2018. AIUR has not been updated in many years and has fallen behind the state of the art, but its varied strategies and learning still make it a tricky opponent in a long tournament. Seeing AIUR's counters for each opponent tells us something about how the opponent played. For past editions, see AIIDE 2017 what AIUR learned and what AIUR learned (AIIDE 2015).

This is generated from data in AIUR's final write directory. There were 125 rounds and 5 maps, one 2-player and two each 3- and 4-player maps. For some opponents, all games were recorded, giving 25 games on the 2-player map and 50 games each on 3- and 4-player maps. For most opponents, fewer games were recorded. AIUR recorded 2932 games, and the results table lists 318 crashes for AIUR. 2932 + 318 = 3250, the correct total game count. Unrecorded games were lost due to crashes, and for no other reason.

First the overview, summing across all opponents.

overall	2		3		4		total
	n	wins	n	wins	n	wins	n	wins
cheese	72	49%	127	65%	132	35%	331	49%
rush	29	41%	269	33%	261	55%	559	44%
aggressive	13	23%	225	68%	184	78%	422	71%
fast expo	33	24%	185	48%	207	48%	425	46%
macro	46	33%	180	52%	135	60%	361	53%
defensive	141	75%	314	73%	379	55%	834	65%
total	334	54%	1300	56%	1298	56%	2932	56%

2, 3, 4 - map size, the number of starting positions
n - games recorded
wins - winning percentage over those games
cheese - cannon rush
rush - dark templar rush
aggressive - fast 4 zealot drop
fast expo - nexus first
macro - aim for a strong middle game army
defensive - try to be safe against rushes

Looking across the bottom row, you can see that AIUR had a plus score on every size of map, and that it had to choose different strategies to do so well. It's a strong result for a bot which has essentially no micro skills and has not been updated since 2014. It does still have the best cannon rush of any bot, if you ask me.

#1 locutus	2		3		4		total
	n	wins	n	wins	n	wins	n	wins
cheese	1	0%	8	0%	25	12%	34	9%
rush	1	0%	10	0%	6	0%	17	0%
aggressive	1	0%	4	0%	5	0%	10	0%
fast expo	1	0%	14	0%	5	0%	20	0%
macro	1	0%	7	0%	4	0%	12	0%
defensive	1	0%	7	14%	5	0%	13	8%
total	6	0%	50	2%	50	6%	106	4%

Even against the toughest opponents, AIUR can scrape a small edge with learning. Against Locutus, it pulled barely above zero, but got a few extra wins because it discovered that its cannon rush occasionally scores on 4-player maps. Results against PurpleWave below are similar. I suspect that if AIUR had played the cannon rush every game, Locutus would have adapted and nullified the edge. Maybe it did, and that’s why the edge is so small.

#2 purplewave	2		3		4		total
	n	wins	n	wins	n	wins	n	wins
cheese	1	0%	8	0%	39	18%	48	15%
rush	1	0%	8	0%	2	0%	11	0%
aggressive	1	0%	10	0%	3	0%	14	0%
fast expo	4	0%	8	0%	2	0%	14	0%
macro	1	0%	10	0%	2	0%	13	0%
defensive	3	0%	6	0%	2	0%	11	0%
total	11	0%	50	0%	50	14%	111	6%

#3 mcrave	2		3		4		total
	n	wins	n	wins	n	wins	n	wins
cheese	1	100%	1	0%	1	0%	3	33%
rush	1	0%	41	2%	1	0%	43	2%
aggressive	0	0%	2	0%	3	0%	5	0%
fast expo	1	0%	1	0%	42	17%	44	16%
macro	1	0%	3	0%	1	0%	5	0%
defensive	1	0%	2	0%	2	0%	5	0%
total	5	20%	50	2%	50	14%	105	9%

Against McRave, the choice is nexus first. McRave must have settled on a macro opening itself.

#4 tscmoo	2		3		4		total
	n	wins	n	wins	n	wins	n	wins
cheese	11	27%	1	0%	1	0%	13	23%
rush	1	0%	1	0%	3	0%	5	0%
aggressive	1	0%	11	9%	1	0%	13	8%
fast expo	5	20%	33	15%	1	0%	39	15%
macro	1	0%	2	0%	22	14%	25	12%
defensive	1	0%	2	0%	22	18%	25	16%
total	20	20%	50	12%	50	14%	120	14%

Against the unpredictable Tscmoo, AIUR wavered before settling on an unpredictable set of answers. Notice that not all the strategies are well explored: If you win less than 1 game in 5, then playing an opening 3 times is not enough. If the tournament were much longer, AIUR would likely have scored higher because of its slow but effective learning.

#5 isamind	2		3		4		total
	n	wins	n	wins	n	wins	n	wins
cheese	1	0%	2	0%	4	0%	7	0%
rush	1	100%	37	19%	38	8%	76	14%
aggressive	0	0%	1	0%	3	0%	4	0%
fast expo	1	0%	5	0%	2	0%	8	0%
macro	1	0%	1	0%	2	0%	4	0%
defensive	1	0%	4	0%	1	0%	6	0%
total	5	20%	50	14%	50	6%	105	10%

ISAMind may be based on Locutus, but unlike Locutus it is vulnerable to AIUR’s dark templar rushes. It’s a sign that it is not as mature and well tested.

#6 iron	2		3		4		total
	n	wins	n	wins	n	wins	n	wins
cheese	1	0%	1	0%	5	0%	7	0%
rush	1	0%	26	19%	2	0%	29	17%
aggressive	0	0%	2	0%	2	0%	4	0%
fast expo	1	0%	1	0%	31	10%	33	9%
macro	1	0%	19	5%	4	0%	24	4%
defensive	1	0%	1	0%	6	0%	8	0%
total	5	0%	50	12%	50	6%	105	9%

#7 zzzkbot	2		3		4		total
	n	wins	n	wins	n	wins	n	wins
cheese	4	0%	2	0%	2	0%	8	0%
rush	4	0%	4	0%	1	0%	9	0%
aggressive	3	0%	2	0%	1	0%	6	0%
fast expo	3	0%	3	0%	1	0%	7	0%
macro	7	0%	5	0%	4	0%	16	0%
defensive	4	0%	34	29%	41	12%	79	19%
total	25	0%	50	20%	50	10%	125	12%

4 pooler ZZZKBot is of course best countered by a defensive anti-rush strategy. Well, it helped, but the rush is too strong for AIUR to survive reliably. On the 2-player map, AIUR found no answer.

#8 microwave	2		3		4		total
	n	wins	n	wins	n	wins	n	wins
cheese	2	0%	2	0%	1	0%	5	0%
rush	1	0%	27	7%	1	0%	29	7%
aggressive	1	0%	1	0%	1	0%	3	0%
fast expo	1	0%	2	0%	1	0%	4	0%
macro	1	0%	1	0%	9	22%	11	18%
defensive	18	22%	17	24%	36	25%	71	24%
total	24	17%	50	12%	49	22%	123	17%

Microwave apparently also played a rushy style versus AIUR. That’s interesting. I think that AIUR’s defensive strategy is good against pressure openings generally, so Microwave was likely playing low-econ but not necessarily fast rushes.

#9 letabot	2		3		4		total
	n	wins	n	wins	n	wins	n	wins
cheese	1	0%	1	0%	1	0%	3	0%
rush	1	0%	1	0%	3	33%	5	20%
aggressive	0	0%	3	33%	1	0%	4	25%
fast expo	1	0%	41	49%	43	49%	85	48%
macro	1	100%	3	33%	1	0%	5	40%
defensive	1	0%	1	0%	1	0%	3	0%
total	5	20%	50	44%	50	44%	105	43%

Fast expo makes sense against LetaBot’s “wait for it... wait for it... here it comes!” one big smash.

#10 megabot	2		3		4		total
	n	wins	n	wins	n	wins	n	wins
cheese	1	0%	2	0%	3	0%	6	0%
rush	2	50%	4	0%	38	11%	44	11%
aggressive	1	0%	3	0%	3	0%	7	0%
fast expo	1	0%	3	0%	2	0%	6	0%
macro	2	0%	36	28%	2	0%	40	25%
defensive	18	94%	2	0%	2	0%	22	77%
total	25	72%	50	20%	50	8%	125	26%

Why did MegaBot have so much more trouble on the 2-player map? According to the official per-map result table, MegaBot did fine overall on Destination (the one 2-player map), so its trouble came only against AIUR. Maybe I should watch replays and diagnose it.

#11 ualbertabot	2		3		4		total
	n	wins	n	wins	n	wins	n	wins
cheese	1	0%	1	0%	1	0%	3	0%
rush	2	0%	43	37%	2	0%	47	34%
aggressive	1	0%	2	0%	1	0%	4	0%
fast expo	1	0%	2	0%	1	0%	4	0%
macro	18	33%	1	0%	1	0%	20	30%
defensive	1	0%	1	0%	44	16%	46	15%
total	24	25%	50	32%	50	14%	124	23%

#12 tyr	2		3		4		total
	n	wins	n	wins	n	wins	n	wins
cheese	1	0%	1	0%	1	0%	3	0%
rush	1	100%	1	0%	32	81%	34	79%
aggressive	0	0%	37	46%	8	75%	45	51%
fast expo	1	100%	3	33%	3	67%	7	57%
macro	1	0%	6	33%	3	33%	10	30%
defensive	1	0%	2	0%	3	33%	6	17%
total	5	40%	50	40%	50	72%	105	55%

I suspect that Tyr suffered here because it is a jvm bot and could not write its learning file.

#13 ecgberht	2		3		4		total
	n	wins	n	wins	n	wins	n	wins
cheese	1	100%	38	89%	2	50%	41	88%
rush	1	100%	1	0%	43	67%	45	67%
aggressive	0	0%	4	75%	1	0%	5	60%
fast expo	1	100%	1	0%	2	0%	4	25%
macro	1	0%	3	67%	1	0%	5	40%
defensive	1	0%	3	67%	1	0%	5	40%
total	5	60%	50	82%	50	60%	105	70%

#15 titaniron	2		3		4		total
	n	wins	n	wins	n	wins	n	wins
cheese	1	0%	1	0%	2	50%	4	25%
rush	1	0%	1	0%	3	33%	5	20%
aggressive	0	0%	42	79%	42	88%	84	83%
fast expo	1	0%	1	0%	1	0%	3	0%
macro	1	100%	2	50%	1	0%	4	50%
defensive	1	100%	3	0%	1	0%	5	20%
total	5	40%	50	68%	50	78%	105	71%

TitanIron appears to have been too predictable. Notice that the winning strategy on most maps was never tried (without crashing) on the 2-player map. It might have won there too.

#16 ziabot	2		3		4		total
	n	wins	n	wins	n	wins	n	wins
cheese	16	50%	2	50%	1	0%	19	47%
rush	1	0%	2	0%	1	0%	4	0%
aggressive	1	0%	1	0%	3	33%	5	20%
fast expo	1	0%	2	50%	0	0%	3	33%
macro	1	0%	1	0%	1	0%	3	0%
defensive	3	33%	42	69%	44	57%	89	62%
total	23	39%	50	62%	50	52%	123	54%

#17 steamhammer	2		3		4		total
	n	wins	n	wins	n	wins	n	wins
cheese	1	0%	1	0%	1	0%	3	0%
rush	3	67%	4	75%	9	100%	16	88%
aggressive	3	100%	17	100%	15	100%	35	100%
fast expo	2	0%	2	0%	2	50%	6	17%
macro	1	100%	10	100%	1	0%	12	92%
defensive	14	100%	16	100%	22	100%	52	100%
total	24	83%	50	92%	50	94%	124	91%

#18 overkill	2		3		4		total
	n	wins	n	wins	n	wins	n	wins
cheese	1	0%	3	0%	2	50%	6	17%
rush	0	0%	2	50%	1	0%	3	33%
aggressive	0	0%	1	0%	10	60%	11	55%
fast expo	1	0%	3	67%	0	0%	4	50%
macro	0	0%	0	0%	0	0%	0	0%
defensive	16	88%	41	90%	37	78%	94	85%
total	18	78%	50	80%	50	72%	118	76%

#19 terranuab	2		3		4		total
	n	wins	n	wins	n	wins	n	wins
cheese	1	100%	8	88%	1	0%	10	80%
rush	1	100%	11	100%	30	100%	42	100%
aggressive	0	0%	4	75%	2	50%	6	67%
fast expo	1	100%	16	100%	6	83%	23	96%
macro	1	100%	9	89%	10	90%	20	90%
defensive	1	100%	2	50%	1	0%	4	50%
total	5	100%	50	92%	50	90%	105	91%

#20 cunybot	2		3		4		total
	n	wins	n	wins	n	wins	n	wins
cheese	1	0%	2	50%	4	75%	7	57%
rush	1	100%	1	0%	2	0%	4	25%
aggressive	0	0%	4	75%	13	92%	17	88%
fast expo	1	0%	2	50%	2	50%	5	40%
macro	1	100%	9	89%	13	100%	23	96%
defensive	1	100%	32	100%	15	100%	48	100%
total	5	60%	50	90%	49	90%	104	88%

#21 opprimobot	2		3		4		total
	n	wins	n	wins	n	wins	n	wins
cheese	1	100%	12	100%	6	83%	19	95%
rush	1	100%	5	100%	7	100%	13	100%
aggressive	0	0%	7	100%	4	100%	11	100%
fast expo	1	100%	11	100%	17	100%	29	100%
macro	1	100%	8	100%	7	100%	16	100%
defensive	1	100%	7	100%	9	100%	17	100%
total	5	100%	50	100%	50	98%	105	99%

#22 sling	2		3		4		total
	n	wins	n	wins	n	wins	n	wins
cheese	1	0%	1	0%	1	0%	3	0%
rush	1	100%	5	100%	2	50%	8	88%
aggressive	0	0%	13	100%	13	100%	26	100%
fast expo	1	100%	7	100%	10	100%	18	100%
macro	1	100%	8	100%	11	100%	20	100%
defensive	1	100%	16	100%	13	100%	30	100%
total	5	80%	50	98%	50	96%	105	96%

#23 srbotone	2		3		4		total
	n	wins	n	wins	n	wins	n	wins
cheese	1	0%	2	50%	1	0%	4	25%
rush	1	100%	9	100%	3	67%	13	92%
aggressive	0	0%	13	100%	16	100%	29	100%
fast expo	1	100%	10	100%	8	100%	19	100%
macro	1	100%	7	86%	6	100%	14	93%
defensive	1	100%	9	100%	16	100%	26	100%
total	5	80%	50	96%	50	96%	105	95%

#24 bonjwa	2		3		4		total
	n	wins	n	wins	n	wins	n	wins
cheese	1	100%	9	100%	4	75%	14	93%
rush	1	100%	13	100%	10	100%	24	100%
aggressive	0	0%	7	100%	10	100%	17	100%
fast expo	1	100%	6	100%	7	100%	14	100%
macro	1	100%	7	100%	8	100%	16	100%
defensive	1	100%	8	100%	11	100%	20	100%
total	5	100%	50	100%	50	98%	105	99%

#25 stormbreaker	2		3		4		total
	n	wins	n	wins	n	wins	n	wins
cheese	4	75%	1	0%	4	75%	9	67%
rush	0	0%	5	80%	10	100%	15	93%
aggressive	0	0%	18	100%	7	100%	25	100%
fast expo	0	0%	0	0%	6	100%	6	100%
macro	0	0%	9	100%	8	100%	17	100%
defensive	20	100%	17	100%	15	100%	52	100%
total	24	96%	50	96%	50	98%	124	97%

#26 korean	2		3		4		total
	n	wins	n	wins	n	wins	n	wins
cheese	7	100%	2	100%	10	100%	19	100%
rush	0	0%	7	100%	8	100%	15	100%
aggressive	0	0%	5	100%	8	100%	13	100%
fast expo	0	0%	8	100%	8	100%	16	100%
macro	0	0%	5	100%	6	100%	11	100%
defensive	14	100%	23	100%	10	100%	47	100%
total	21	100%	50	100%	50	100%	121	100%

Well, if you win every game, learning cannot help.

#27 salsa	2		3		4		total
	n	wins	n	wins	n	wins	n	wins
cheese	9	100%	15	100%	9	100%	33	100%
rush	0	0%	0	0%	3	100%	3	100%
aggressive	0	0%	11	100%	8	100%	19	100%
fast expo	0	0%	0	0%	4	100%	4	100%
macro	0	0%	8	100%	7	100%	15	100%
defensive	15	100%	16	100%	19	100%	50	100%
total	24	100%	50	100%	50	100%	124	100%

CIG 2018 - bots that wrote data

The CIG organizers have released the final read/write folders for the 2018 tournament. I looked through all the folders to see if each bot recorded information. If it saved nothing, it did not learn. If it saved some data, it may have used it for learning (or it might be log files or whatever). I also added a curve “↕” column, whether the bot’s win rate moves up or down (or is approximately flat) between round 40 and the end of the tournament—is the bot improving until late in the tournament? Win curves early in the tournament are noisy, so they’re hard to compare. (If anybody can’t see the Unicode up and down arrows, let me know and I can change them.)

Some bots have files in their AI folder, which may be prepared data or pre-learned data for specific opponents. I note that too. Prepared data could be kept elsewhere, including in the binary, so I didn’t see all of it. We know that PurpleWave had extensive preparations for specific opponents.

As has been mentioned, bots in Java or Scala (bots which run on the jvm) were unable to write learning data. Those that depend on their learning data were playing at a severe disadvantage. #2 PurpleWave lost narrowly to #1 Locutus and was one of the affected bots. It’s a serious problem for a tournament that wants to be taken seriously.

#	bot	↕	info
1	Locutus	↑	Prepared data for 11 opponents. Learning data very similar to Steamhammer’s.
2	PurpleWave	-	jvm :-(
3	McRave	-	Looks like wins and losses of each of 16 available strategies for the previous 8 games. Perhaps a sliding window?
4	tscmoo	↑	Looks like strategy and win/loss info for each opponent, in a hard-to-read structured format. Past years have had more elaborate data.
5	ISAMind	↓	Prepared file that looks like neural network learning data. Per-opponent learned data that looks like Steamhammer data. ISAMind is based on Locutus, so that makes sense.
6	Iron	↓	Nothing.
7	ZZZKBot	-	Game records, one game per line, in an opaque format that looks about the same as last year.
8	Microwave	↑	For each opponent, wins and losses for 8 different strategies.
9	LetaBot	↑	Information about a few recent games against ZiaBot, probably not used for learning.
10	MegaBot	↓	Extensive log data. The apparent learning files are `MegaBot-vs-[opponent].xml` and give scores for NUSBot, Skynet, Xelnaga (MegaBot’s three heads).
11	UAlbertaBot	↑	Win/loss numbers for 4 protoss, 4 terran, and 5 zerg strategies. But the same strategy was always chosen for each race, so learning was turned off.
12	Tyr	↓	jvm :-(
13	Ecgberht	↓	jvm :-(
14	Aiur	↑	The familiar lists of numbers for each opponent.
15	TitanIron	↓	Nothing.
16	ZiaBot	↓	One file with data for TerranUAB, UAlbertaBot, and 3 lines for SRbotOne. Zia’s learning looks broken or disabled.
17	Steamhammer	↑	Steamhammer saved data when it did not crash, and successfully learned a little bit.
18	Overkill	↑	A file for each opponent, game records with opponent/opening/score.
19	TerranUAB	-	Nothing.
20	CUNYbot	↓	One file `output.txt` with strategy information and numbers, naming a few opponents but not most. A prepared file in the `AI` folder has the same format. It’s mysterious.
21	OpprimoBot	↓	Nothing.
22	Sling	↓	Nothing.
23	SRbotOne	↑	A large number of “stats” files named with date and time, apparently game records. For each opponent, another file giving the strategy “Terran_Attrition” and win/loss numbers. I’m not sure whether this could be learning data, but the bot did earn an up arrow.
24	Bonjwa	↑	Nothing.
25	Stormbreaker	↑	Prepared data `NN_model_policy` and `NN_model_stateValue`, apparently neural network learning data. For each opponent, game records with 4 numbers per game. The format is like Overkill’s but records more information.
26	Korean	-	Nothing.
27	Salsa	-	Nothing.

Most striking is that the “nothing” bots cluster toward the bottom. If you don’t even try to record data, either you are Iron or you performed weakly. The jvm bots, which in fact recorded nothing due to no fault of their own, still placed higher than all the nothing bots other than Iron. Perhaps recording data is a proxy for how much effort has gone into the play.

Some bots had a rising win rate (an up arrow) despite doing no learning, most distractingly UAlbertaBot. I think that since UAlbertaBot plays random, its opponents can easily get confused about it. In general, I think that playing unpredictably (either being random or choosing varied openings randomly) can mess up the learning of some other bots.

I will be analyzing what certain bots learned. It will shed light on their opponents.

CIG 2018 stand by

As usual, the detailed results file is in a slightly different format than past files. My results from analyzing it don’t quite match the official results. Stand by while I figure it out.

CIG 2018 detailed results are out

As LetaBot mentioned in a comment, CIG 2018 detailed results are out. They include a result file that I can analyze with my software, so expect the usual colorful crosstables in the coming days. For today, a few notes:

#7 ZZZKBot, whose basic strategy is 4 pool though it has added other strategies in recent years, was the only player with a plus score over #1 Locutus. On the one hand, it shows how dominant Locutus was. On the other hand, what did ZZZKBot do to win? Was it a prepared strategy? I’ll be looking into it. There are a few other interesting upsets.

The win rate over time graph shows which bots benefited from learning during the tournament, or at least which benefited from changes in play by themselves or their opponents (you could gain win rate over time if your opponents mislearn about you). To my eye, there seems to be a higher rate of curving lines than I remember from past years. I’ll look into that too.

#17 Steamhammer, with about 35% win rate, was the bot with the most crashes at 1553 out of 3250 games. That’s a much higher rate than I expected, 47%. I still do not know why the crashes never showed up in my test environment. On the upside, Steamhammer scored 66% in games where it did not crash, which suggests that it did approximately keep up with general progress over the last year. In any case, it’s another reminder that reliability is a top priority. The second place crashing bot was #27 Salsa at 35% crashes, and Salsa finished dead last. The third place crasher at 30% crashes was #15 TitanIron, which also finished unexpectedly low after high expectations among watchers who guessed it was a fork of Iron. Every other bot had a crash rate under 10%.

And there is source. I will look into the code of some participants to see how they tick.