AIIDE 2020 - what Microwave learned 1
I’ll cover Microwave over two days because it writes two files for each opponent, a “results” file giving wins/losses for each strategy and a “history” file of more detailed game records. Each summary is bulky in itself, and I don’t want to pile them up. The history file has all the information in the results file and more. In fact, a quick look at Microwave’s code says that it no longer reads the results file at all, but reconstructs its contents from the history file each game. But different presentations of the data have value in themselves; this view makes it easy to read across the columns and see where a given opening was effective.
Today is the results file, the table of strategies versus each opponent. Wow, that’s a lot of opening builds! I count 73, less than half as many as Steamhammer but still too large a number to explore in a tournament of 150 rounds. I think only bots with combinatorial strategies have more. The numbers include not only games played during the tournament, but also Microwave’s prepared data for each opponent, so they add up to more than 150 games versus each opponent. You can compare the overall win rates per opponent to see which ones Microwave was more successful against in training as opposed to in the tournament—it may indicate whether the opponent was updated for the tournament and became stronger than Microwave expected. In general, for stronger opponents training data overestimated Microwave’s success, while for weaker opponents it was the opposite (that is, the training uncovered mistakes that Microwave could then avoid).
total | #1 stardust | #2 purplewave | #3 bananabrain | #4 dragon | #5 mcrave | #7 steamhammer | #8 daqin | #9 zzzkbot | #10 ualbertabot | #11 willyt | #12 ecgberht | #13 eggbot | |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
10Hatch9Pool9gas | 28-48 37% | 0-4 0% | 0-12 0% | 3-19 14% | - | 0-1 0% | 4-5 44% | - | - | - | 21-7 75% | - | - |
10HatchMain9Pool9Gas | 2-8 20% | 0-1 0% | - | 0-1 0% | - | 1-3 25% | 1-3 25% | - | - | - | - | - | - |
10HatchTurtleHydra | 0-3 0% | - | - | - | 0-1 0% | 0-1 0% | 0-1 0% | - | - | - | - | - | - |
11HatchTurtleHydra | 0-11 0% | - | 0-10 0% | 0-1 0% | - | - | - | - | - | - | - | - | - |
11HatchTurtleLurker | 11-17 39% | - | 0-1 0% | - | 0-2 0% | 0-1 0% | 0-1 0% | - | - | - | 11-12 48% | - | - |
11HatchTurtleMuta | 4-15 21% | - | 0-7 0% | 0-2 0% | - | - | 0-1 0% | - | - | - | 4-5 44% | - | - |
12Hatch | 0-3 0% | - | - | 0-2 0% | - | 0-1 0% | - | - | - | - | - | - | - |
12HatchMain | 0-4 0% | 0-2 0% | 0-1 0% | - | - | - | 0-1 0% | - | - | - | - | - | - |
12Pool | 35-51 41% | 0-1 0% | - | - | - | 9-17 35% | 26-33 44% | - | - | - | - | - | - |
12PoolMain | 25-34 42% | 0-1 0% | - | 22-21 51% | 0-1 0% | 0-2 0% | 2-7 22% | - | - | - | 1-2 33% | - | - |
12PoolMuta | 7-20 26% | 0-2 0% | 2-9 18% | 0-1 0% | - | - | - | - | - | - | 5-8 38% | - | - |
1HatchMuta_Sparkle | 56-9 86% | - | - | 0-1 0% | - | - | - | 56-6 90% | - | 0-2 0% | - | - | - |
2HatchHydra | 161-24 87% | 0-1 0% | 0-2 0% | - | - | - | - | 0-1 0% | - | - | - | 161-20 89% | - |
2HatchLurker | 0-8 0% | 0-1 0% | 0-1 0% | 0-2 0% | - | 0-1 0% | 0-2 0% | - | - | - | - | 0-1 0% | - |
2HatchLurkerAllIn | 0-2 0% | 0-1 0% | 0-1 0% | - | - | - | - | - | - | - | - | - | - |
2HatchMuta | 74-59 56% | 1-14 7% | 0-1 0% | 3-9 25% | 60-33 65% | 0-1 0% | - | - | - | - | - | - | 10-1 91% |
2HatchMuta_Sparkle | 0-1 0% | - | - | - | - | - | - | - | - | - | 0-1 0% | - | - |
3Hatch | 0-5 0% | 0-3 0% | - | - | - | 0-2 0% | - | - | - | - | - | - | - |
3HatchExpo | 0-3 0% | 0-2 0% | - | - | - | - | - | - | - | - | 0-1 0% | - | - |
3HatchHydra | 0-2 0% | 0-1 0% | - | - | - | - | - | - | - | - | 0-1 0% | - | - |
3HatchHydraBust | 0-14 0% | 0-7 0% | 0-2 0% | 0-2 0% | - | 0-1 0% | 0-1 0% | 0-1 0% | - | - | - | - | - |
3HatchHydraExpo | 1-5 17% | - | - | - | 1-2 33% | - | 0-2 0% | - | - | 0-1 0% | - | - | - |
3HatchHydra_BHG | 0-4 0% | 0-1 0% | 0-1 0% | 0-1 0% | - | 0-1 0% | - | - | - | - | - | - | - |
3HatchLingBust | 36-41 47% | 2-20 9% | - | 2-6 25% | - | - | - | 32-15 68% | - | - | - | - | - |
3HatchLurker | 0-4 0% | - | - | - | - | 0-1 0% | - | - | - | - | 0-3 0% | - | - |
3HatchMuta | 90-106 46% | 7-58 11% | 3-9 25% | 3-19 14% | - | 0-1 0% | - | 72-14 84% | - | - | 5-5 50% | - | - |
3HatchMutaExpo | 48-64 43% | 0-1 0% | 1-25 4% | 0-1 0% | 32-22 59% | 0-1 0% | - | 9-7 56% | - | - | 6-7 46% | - | - |
3HatchPoolHydra | 1-24 4% | 1-15 6% | 0-2 0% | - | - | 0-2 0% | 0-2 0% | 0-3 0% | - | - | - | - | - |
3HatchPoolHydraExpo | 3-12 20% | 0-1 0% | - | 0-1 0% | - | 3-9 25% | - | 0-1 0% | - | - | - | - | - |
4HatchBeforeGas | 0-10 0% | 0-5 0% | 0-1 0% | 0-3 0% | - | 0-1 0% | - | - | - | - | - | - | - |
4HatchPoolHydra | 4-25 14% | 0-2 0% | 0-1 0% | 2-15 12% | 2-6 25% | - | 0-1 0% | - | - | - | - | - | - |
4PoolHard | 3-13 19% | 0-1 0% | 1-7 12% | 2-4 33% | - | - | - | - | - | - | 0-1 0% | - | - |
4PoolSoft | 61-44 58% | 0-3 0% | 0-2 0% | 0-2 0% | 7-14 33% | 0-3 0% | - | - | - | 54-17 76% | 0-3 0% | - | - |
5HatchPoolHydra | 5-28 15% | 2-26 7% | - | - | 3-2 60% | - | - | - | - | - | - | - | - |
5Pool | 7-17 29% | 0-2 0% | - | - | - | 0-1 0% | 3-10 23% | 0-1 0% | - | 4-3 57% | - | - | - |
5PoolSpeed | 29-18 62% | - | - | - | 0-1 0% | 0-1 0% | 1-2 33% | - | - | 28-14 67% | - | - | - |
6Pool | 0-6 0% | 0-2 0% | 0-1 0% | 0-2 0% | - | - | 0-1 0% | - | - | - | - | - | - |
6PoolSpeed | 4-14 22% | 0-4 0% | 3-7 30% | - | - | 1-3 25% | - | - | - | - | - | - | - |
7Pool | 0-6 0% | 0-1 0% | 0-3 0% | 0-1 0% | - | - | 0-1 0% | - | - | - | - | - | - |
7PoolHydraLingRush7D | 0-5 0% | - | 0-1 0% | - | 0-1 0% | 0-1 0% | 0-1 0% | - | - | 0-1 0% | - | - | - |
7PoolHydraRush7D | 0-2 0% | - | - | - | - | - | - | 0-1 0% | - | 0-1 0% | - | - | - |
8Pool | 0-2 0% | - | - | 0-1 0% | - | 0-1 0% | - | - | - | - | - | - | - |
8PoolHydraRush8D | 5-8 38% | - | 0-2 0% | 0-1 0% | - | - | - | - | - | 5-5 50% | - | - | - |
9Hatch9Pool9Gas | 10-12 45% | 0-1 0% | 0-6 0% | 0-1 0% | - | - | 0-1 0% | - | - | - | 10-3 77% | - | - |
9HatchMain8Pool8Gas | 2-8 20% | 0-1 0% | 2-6 25% | - | - | 0-1 0% | - | - | - | - | - | - | - |
9HatchTurtleHydra | 0-3 0% | 0-1 0% | 0-1 0% | - | - | - | 0-1 0% | - | - | - | - | - | - |
9Pool | 183-11 94% | 0-4 0% | 0-3 0% | - | - | 0-1 0% | - | 0-1 0% | - | - | 0-1 0% | 0-1 0% | 183-0 100% |
9PoolExpo | 31-9 78% | - | - | - | - | - | - | - | - | - | 31-9 78% | - | - |
9PoolGasHatchSpeed7D | 18-19 49% | 0-1 0% | 18-18 50% | - | - | - | - | - | - | - | - | - | - |
9PoolGasHatchSpeed8D | 21-29 42% | 0-4 0% | - | 12-6 67% | - | 0-2 0% | 0-1 0% | 0-3 0% | - | 1-1 50% | 8-12 40% | - | - |
9PoolHatch | 0-3 0% | - | - | - | - | - | 0-2 0% | - | 0-1 0% | - | - | - | - |
9PoolHatchGasSpeed7D | 11-8 58% | 0-1 0% | 11-6 65% | 0-1 0% | - | - | - | - | - | - | - | - | - |
9PoolHatchGasSpeed8D | 36-50 42% | 1-16 6% | 5-6 45% | 30-24 56% | 0-1 0% | 0-2 0% | 0-1 0% | - | - | - | - | - | - |
9PoolHydra | 0-3 0% | 0-1 0% | - | - | - | - | - | 0-1 0% | - | - | 0-1 0% | - | - |
9PoolLurker | 15-14 52% | 0-2 0% | - | - | - | - | - | - | - | - | 6-8 43% | 9-4 69% | - |
9PoolSpeed | 68-71 49% | 0-3 0% | 1-4 20% | 0-4 0% | - | 13-16 45% | 24-21 53% | 0-2 0% | - | - | 30-21 59% | - | - |
9PoolSpeedLing | 2-22 8% | 0-3 0% | 0-3 0% | 2-7 22% | - | 0-3 0% | 0-2 0% | 0-3 0% | - | - | 0-1 0% | - | - |
9PoolSunkHatch | 6-12 33% | 0-2 0% | 0-1 0% | 0-1 0% | 0-1 0% | - | - | - | - | 5-4 56% | 1-3 25% | - | - |
9PoolSunken | 9-15 38% | 0-1 0% | 0-1 0% | - | - | 0-1 0% | 2-10 17% | - | - | - | 7-2 78% | - | - |
Overpool | 0-4 0% | 0-1 0% | - | 0-1 0% | 0-1 0% | 0-1 0% | - | - | - | - | - | - | - |
OverpoolLurker | 0-4 0% | 0-1 0% | - | - | 0-1 0% | - | - | 0-1 0% | - | - | 0-1 0% | - | - |
OverpoolSpeed | 187-60 76% | 0-1 0% | 1-6 14% | 0-3 0% | - | 27-37 42% | 1-3 25% | - | 158-9 95% | - | 0-1 0% | - | - |
OverpoolSunken | 8-7 53% | - | - | - | - | - | - | - | - | 8-7 53% | - | - | - |
OverpoolTurtle | 1-13 7% | 0-1 0% | 1-11 8% | - | 0-1 0% | - | - | - | - | - | - | - | - |
ZvP_10Hatch9Pool | 17-30 36% | 0-5 0% | 0-8 0% | 2-5 29% | - | - | - | - | - | 15-12 56% | - | - | - |
ZvP_11Hatch10Pool | 2-12 14% | 0-2 0% | 0-7 0% | 0-1 0% | - | - | 2-2 50% | - | - | - | - | - | - |
ZvP_2HatchHydra | 2-28 7% | 0-3 0% | 0-9 0% | 0-4 0% | - | 0-2 0% | 2-10 17% | - | - | - | - | - | - |
ZvP_9Hatch9Pool | 13-34 28% | 0-2 0% | 0-10 0% | 0-1 0% | - | 13-18 42% | 0-1 0% | 0-2 0% | - | - | - | - | - |
ZvZ_Overgas11Pool | 30-24 56% | 0-3 0% | - | - | - | - | 13-15 46% | - | 17-5 77% | - | 0-1 0% | - | - |
ZvZ_Overgas9Pool | 0-5 0% | 0-2 0% | - | 0-1 0% | - | - | 0-2 0% | - | - | - | - | - | - |
ZvZ_Overpool11Gas | 5-21 19% | 0-2 0% | - | 0-2 0% | - | 5-13 28% | 0-3 0% | - | - | 0-1 0% | - | - | - |
ZvZ_Overpool9Gas | 2-13 13% | 0-2 0% | 0-1 0% | - | - | 1-7 12% | 1-3 25% | - | - | - | - | - | - |
ZvZ_OverpoolTurtle | 0-1 0% | 0-1 0% | - | - | - | - | - | - | - | - | - | - | - |
total | - 51% | 14-250 5% | 49-216 18% | 83-180 32% | 105-90 54% | 73-161 31% | 82-153 35% | 169-63 73% | 175-15 92% | 120-69 63% | 146-120 55% | 170-26 87% | 193-1 99% |
Microwave explored widely against top opponents, and concentrated efficiently on a few winning openings against weaker ones. On the other hand, although there is a flag in the configuration file named PlayGoodStrategiesFirst
(turned on), Microwave seems to have little idea which strategies are most likely to work. Versus DaQin, 1 hatch mutalisk and 3 hatch mutalisk are successful, but the most natural 2 hatch muta is never tried. Of course that’s a widespread weakness among bots.
The 3 hatch muta strategies were relatively successful overall. That’s interesting.
Comments
MicroDK on :
MicroDK on :
Jay Scott on :
Jay Scott on :
MicroDK on :
Jay Scott on :