I’m pleased with this one. This is the same data as yesterday, how each bot did against each other on each map, but organized by player rather than by map. If you’re a bot author, I think this is a better way to find out about strengths and weaknesses.
For example, the first table is from the point of view of Locutus. The percentages are Locutus’s win rates. The upset by DaQin on Aztec immediately stands out amid Locutus’s otherwise consistent results. I imagine that Bruce @ Locutus will examine those 10 games and perhaps find a bug that DaQin exploited. (Locutus played its cannons at ramp into zealot drop strategy in these games. It lost because cannons at the ramp are a poor defense when the outside is on higher ground—Aztec has low-ground main bases. Maybe a weakness in learning or preparation?)
| Locutus | overall | Benzen | Destin | Heartb | Aztec | TauCro | Androm | Circui | Empire | Fortre | Python |
|---|
| PurpleWave | 45% | 50% | 50% | 40% | 40% | 40% | 60% | 40% | 30% | 40% | 60% |
| BananaBrain | 89% | 100% | 100% | 80% | 100% | 100% | 80% | 70% | 100% | 70% | 90% |
| DaQin | 83% | 100% | 80% | 100% | 20% | 80% | 100% | 90% | 90% | 80% | 90% |
| Steamhammer | 97% | 90% | 100% | 100% | 90% | 100% | 90% | 100% | 100% | 100% | 100% |
| ZZZKBot | 99% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 90% | 100% | 100% |
| Microwave | 92% | 100% | 100% | 80% | 80% | 100% | 90% | 90% | 90% | 90% | 100% |
| Iron | 99% | 100% | 100% | 100% | 100% | 100% | 90% | 100% | 100% | 100% | 100% |
| XiaoYi | 96% | 100% | 100% | 100% | 90% | 70% | 100% | 100% | 100% | 100% | 100% |
| McRave | 99% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 90% | 100% | 100% |
| UAlbertaBot | 99% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 90% | 100% | 100% |
| AITP | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% |
| BunkerBoxeR | 99% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 90% | 100% | 100% |
| overall | 91.42% | 95% | 94% | 92% | 85% | 91% | 92% | 91% | 89% | 90% | 95% |
| PurpleWave | overall | Benzen | Destin | Heartb | Aztec | TauCro | Androm | Circui | Empire | Fortre | Python |
|---|
| Locutus | 55% | 50% | 50% | 60% | 60% | 60% | 40% | 60% | 70% | 60% | 40% |
| BananaBrain | 44% | 80% | 70% | 80% | 50% | 60% | 10% | 40% | 20% | 0% | 30% |
| DaQin | 85% | 80% | 70% | 100% | 100% | 70% | 80% | 100% | 100% | 70% | 80% |
| Steamhammer | 71% | 90% | 100% | 70% | 40% | 60% | 80% | 60% | 70% | 90% | 50% |
| ZZZKBot | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% |
| Microwave | 93% | 100% | 90% | 90% | 100% | 90% | 90% | 90% | 90% | 90% | 100% |
| Iron | 98% | 100% | 100% | 90% | 100% | 100% | 100% | 100% | 100% | 100% | 90% |
| XiaoYi | 97% | 90% | 100% | 100% | 100% | 100% | 90% | 100% | 90% | 100% | 100% |
| McRave | 89% | 100% | 90% | 100% | 100% | 90% | 80% | 100% | 70% | 70% | 90% |
| UAlbertaBot | 98% | 100% | 100% | 100% | 100% | 100% | 100% | 78% | 100% | 100% | 100% |
| AITP | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% |
| BunkerBoxeR | 97% | 100% | 90% | 90% | 100% | 100% | 100% | 100% | 90% | 100% | 100% |
| overall | 85.54% | 91% | 88% | 90% | 88% | 86% | 81% | 86% | 83% | 82% | 82% |
| BananaBrain | overall | Benzen | Destin | Heartb | Aztec | TauCro | Androm | Circui | Empire | Fortre | Python |
|---|
| Locutus | 11% | 0% | 0% | 20% | 0% | 0% | 20% | 30% | 0% | 30% | 10% |
| PurpleWave | 56% | 20% | 30% | 20% | 50% | 40% | 90% | 60% | 80% | 100% | 70% |
| DaQin | 51% | 30% | 40% | 60% | 80% | 50% | 30% | 60% | 60% | 60% | 40% |
| Steamhammer | 85% | 100% | 70% | 90% | 80% | 80% | 70% | 100% | 100% | 70% | 90% |
| ZZZKBot | 83% | 90% | 100% | 70% | 80% | 70% | 90% | 100% | 70% | 90% | 70% |
| Microwave | 71% | 90% | 70% | 90% | 70% | 60% | 70% | 60% | 80% | 60% | 60% |
| Iron | 59% | 40% | 70% | 50% | 60% | 60% | 70% | 80% | 50% | 70% | 40% |
| XiaoYi | 57% | 40% | 80% | 40% | 50% | 50% | 40% | 80% | 40% | 80% | 70% |
| McRave | 69% | 70% | 60% | 90% | 70% | 50% | 80% | 70% | 70% | 70% | 60% |
| UAlbertaBot | 84% | 80% | 90% | 80% | 90% | 80% | 90% | 80% | 89% | 90% | 70% |
| AITP | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% |
| BunkerBoxeR | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% |
| overall | 68.81% | 63% | 68% | 68% | 69% | 62% | 71% | 77% | 70% | 77% | 65% |
| DaQin | overall | Benzen | Destin | Heartb | Aztec | TauCro | Androm | Circui | Empire | Fortre | Python |
|---|
| Locutus | 17% | 0% | 20% | 0% | 80% | 20% | 0% | 10% | 10% | 20% | 10% |
| PurpleWave | 15% | 20% | 30% | 0% | 0% | 30% | 20% | 0% | 0% | 30% | 20% |
| BananaBrain | 49% | 70% | 60% | 40% | 20% | 50% | 70% | 40% | 40% | 40% | 60% |
| Steamhammer | 94% | 100% | 100% | 90% | 100% | 100% | 100% | 100% | 70% | 90% | 90% |
| ZZZKBot | 10% | 10% | 20% | 10% | 10% | 10% | 20% | 10% | 0% | 10% | 0% |
| Microwave | 83% | 90% | 60% | 60% | 90% | 100% | 80% | 90% | 100% | 80% | 80% |
| Iron | 92% | 100% | 90% | 100% | 90% | 100% | 90% | 100% | 80% | 70% | 100% |
| XiaoYi | 82% | 100% | 100% | 90% | 100% | 90% | 60% | 70% | 60% | 60% | 90% |
| McRave | 41% | 40% | 60% | 40% | 40% | 20% | 50% | 30% | 40% | 30% | 60% |
| UAlbertaBot | 78% | 70% | 100% | 80% | 90% | 70% | 80% | 80% | 70% | 60% | 80% |
| AITP | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% |
| BunkerBoxeR | 99% | 100% | 100% | 100% | 90% | 100% | 100% | 100% | 100% | 100% | 100% |
| overall | 63.33% | 67% | 70% | 59% | 68% | 66% | 64% | 61% | 56% | 57% | 66% |
| Steamhammer | overall | Benzen | Destin | Heartb | Aztec | TauCro | Androm | Circui | Empire | Fortre | Python |
|---|
| Locutus | 3% | 10% | 0% | 0% | 10% | 0% | 10% | 0% | 0% | 0% | 0% |
| PurpleWave | 29% | 10% | 0% | 30% | 60% | 40% | 20% | 40% | 30% | 10% | 50% |
| BananaBrain | 15% | 0% | 30% | 10% | 20% | 20% | 30% | 0% | 0% | 30% | 10% |
| DaQin | 6% | 0% | 0% | 10% | 0% | 0% | 0% | 0% | 30% | 10% | 10% |
| ZZZKBot | 59% | 40% | 60% | 80% | 80% | 40% | 50% | 40% | 60% | 50% | 90% |
| Microwave | 25% | 10% | 30% | 50% | 30% | 30% | 20% | 40% | 20% | 10% | 10% |
| Iron | 67% | 70% | 90% | 100% | 40% | 40% | 90% | 60% | 60% | 100% | 20% |
| XiaoYi | 50% | 30% | 60% | 50% | 20% | 10% | 80% | 50% | 80% | 60% | 60% |
| McRave | 86% | 100% | 90% | 100% | 100% | 70% | 100% | 90% | 90% | 40% | 80% |
| UAlbertaBot | 91% | 90% | 90% | 90% | 89% | 80% | 90% | 89% | 90% | 100% | 100% |
| AITP | 97% | 90% | 100% | 90% | 100% | 100% | 90% | 100% | 100% | 100% | 100% |
| BunkerBoxeR | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% |
| overall | 52.25% | 46% | 54% | 59% | 54% | 44% | 57% | 50% | 55% | 51% | 52% |
| ZZZKBot | overall | Benzen | Destin | Heartb | Aztec | TauCro | Androm | Circui | Empire | Fortre | Python |
|---|
| Locutus | 1% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 10% | 0% | 0% |
| PurpleWave | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% |
| BananaBrain | 17% | 10% | 0% | 30% | 20% | 30% | 10% | 0% | 30% | 10% | 30% |
| DaQin | 90% | 90% | 80% | 90% | 90% | 90% | 80% | 90% | 100% | 90% | 100% |
| Steamhammer | 41% | 60% | 40% | 20% | 20% | 60% | 50% | 60% | 40% | 50% | 10% |
| Microwave | 44% | 50% | 0% | 60% | 40% | 50% | 50% | 50% | 60% | 30% | 50% |
| Iron | 55% | 0% | 50% | 60% | 30% | 50% | 100% | 50% | 80% | 50% | 80% |
| XiaoYi | 49% | 60% | 90% | 70% | 10% | 20% | 60% | 40% | 20% | 70% | 50% |
| McRave | 67% | 70% | 70% | 50% | 80% | 40% | 30% | 80% | 80% | 90% | 80% |
| UAlbertaBot | 90% | 90% | 80% | 90% | 100% | 90% | 90% | 70% | 100% | 90% | 100% |
| AITP | 72% | 70% | 60% | 60% | 90% | 80% | 20% | 70% | 90% | 90% | 90% |
| BunkerBoxeR | 99% | 100% | 100% | 100% | 100% | 100% | 90% | 100% | 100% | 100% | 100% |
| overall | 52.08% | 50% | 48% | 52% | 48% | 51% | 48% | 51% | 59% | 56% | 57% |
| Microwave | overall | Benzen | Destin | Heartb | Aztec | TauCro | Androm | Circui | Empire | Fortre | Python |
|---|
| Locutus | 8% | 0% | 0% | 20% | 20% | 0% | 10% | 10% | 10% | 10% | 0% |
| PurpleWave | 7% | 0% | 10% | 10% | 0% | 10% | 10% | 10% | 10% | 10% | 0% |
| BananaBrain | 29% | 10% | 30% | 10% | 30% | 40% | 30% | 40% | 20% | 40% | 40% |
| DaQin | 17% | 10% | 40% | 40% | 10% | 0% | 20% | 10% | 0% | 20% | 20% |
| Steamhammer | 75% | 90% | 70% | 50% | 70% | 70% | 80% | 60% | 80% | 90% | 90% |
| ZZZKBot | 56% | 50% | 100% | 40% | 60% | 50% | 50% | 50% | 40% | 70% | 50% |
| Iron | 13% | 0% | 0% | 10% | 10% | 0% | 20% | 50% | 20% | 10% | 10% |
| XiaoYi | 65% | 60% | 80% | 70% | 60% | 80% | 40% | 80% | 60% | 30% | 90% |
| McRave | 64% | 60% | 80% | 100% | 70% | 50% | 60% | 70% | 60% | 30% | 60% |
| UAlbertaBot | 82% | 60% | 100% | 90% | 60% | 80% | 60% | 80% | 90% | 100% | 100% |
| AITP | 93% | 90% | 90% | 70% | 100% | 100% | 90% | 100% | 100% | 100% | 90% |
| BunkerBoxeR | 99% | 100% | 100% | 100% | 90% | 100% | 100% | 100% | 100% | 100% | 100% |
| overall | 50.67% | 44% | 58% | 51% | 48% | 48% | 48% | 55% | 49% | 51% | 54% |
| Iron | overall | Benzen | Destin | Heartb | Aztec | TauCro | Androm | Circui | Empire | Fortre | Python |
|---|
| Locutus | 1% | 0% | 0% | 0% | 0% | 0% | 10% | 0% | 0% | 0% | 0% |
| PurpleWave | 2% | 0% | 0% | 10% | 0% | 0% | 0% | 0% | 0% | 0% | 10% |
| BananaBrain | 41% | 60% | 30% | 50% | 40% | 40% | 30% | 20% | 50% | 30% | 60% |
| DaQin | 8% | 0% | 10% | 0% | 10% | 0% | 10% | 0% | 20% | 30% | 0% |
| Steamhammer | 33% | 30% | 10% | 0% | 60% | 60% | 10% | 40% | 40% | 0% | 80% |
| ZZZKBot | 45% | 100% | 50% | 40% | 70% | 50% | 0% | 50% | 20% | 50% | 20% |
| Microwave | 87% | 100% | 100% | 90% | 90% | 100% | 80% | 50% | 80% | 90% | 90% |
| XiaoYi | 26% | 10% | 50% | 0% | 50% | 20% | 40% | 20% | 30% | 40% | 0% |
| McRave | 65% | 70% | 80% | 80% | 80% | 80% | 70% | 50% | 40% | 40% | 60% |
| UAlbertaBot | 90% | 100% | 90% | 100% | 90% | 90% | 90% | 60% | 90% | 90% | 100% |
| AITP | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% |
| BunkerBoxeR | 93% | 100% | 100% | 80% | 80% | 100% | 90% | 100% | 90% | 90% | 100% |
| overall | 49.25% | 56% | 52% | 46% | 56% | 53% | 44% | 41% | 47% | 47% | 52% |
| XiaoYi | overall | Benzen | Destin | Heartb | Aztec | TauCro | Androm | Circui | Empire | Fortre | Python |
|---|
| Locutus | 4% | 0% | 0% | 0% | 10% | 30% | 0% | 0% | 0% | 0% | 0% |
| PurpleWave | 3% | 10% | 0% | 0% | 0% | 0% | 10% | 0% | 10% | 0% | 0% |
| BananaBrain | 43% | 60% | 20% | 60% | 50% | 50% | 60% | 20% | 60% | 20% | 30% |
| DaQin | 18% | 0% | 0% | 10% | 0% | 10% | 40% | 30% | 40% | 40% | 10% |
| Steamhammer | 50% | 70% | 40% | 50% | 80% | 90% | 20% | 50% | 20% | 40% | 40% |
| ZZZKBot | 51% | 40% | 10% | 30% | 90% | 80% | 40% | 60% | 80% | 30% | 50% |
| Microwave | 35% | 40% | 20% | 30% | 40% | 20% | 60% | 20% | 40% | 70% | 10% |
| Iron | 74% | 90% | 50% | 100% | 50% | 80% | 60% | 80% | 70% | 60% | 100% |
| McRave | 36% | 40% | 10% | 50% | 30% | 40% | 30% | 40% | 30% | 60% | 30% |
| UAlbertaBot | 73% | 44% | 60% | 90% | 80% | 80% | 75% | 60% | 89% | 89% | 60% |
| AITP | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% | 100% |
| BunkerBoxeR | 98% | 100% | 100% | 100% | 90% | 100% | 100% | 100% | 90% | 100% | 100% |
| overall | 48.62% | 50% | 34% | 52% | 52% | 57% | 49% | 47% | 52% | 50% | 44% |
| McRave | overall | Benzen | Destin | Heartb | Aztec | TauCro | Androm | Circui | Empire | Fortre | Python |
|---|
| Locutus | 1% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 10% | 0% | 0% |
| PurpleWave | 11% | 0% | 10% | 0% | 0% | 10% | 20% | 0% | 30% | 30% | 10% |
| BananaBrain | 31% | 30% | 40% | 10% | 30% | 50% | 20% | 30% | 30% | 30% | 40% |
| DaQin | 59% | 60% | 40% | 60% | 60% | 80% | 50% | 70% | 60% | 70% | 40% |
| Steamhammer | 14% | 0% | 10% | 0% | 0% | 30% | 0% | 10% | 10% | 60% | 20% |
| ZZZKBot | 33% | 30% | 30% | 50% | 20% | 60% | 70% | 20% | 20% | 10% | 20% |
| Microwave | 36% | 40% | 20% | 0% | 30% | 50% | 40% | 30% | 40% | 70% | 40% |
| Iron | 35% | 30% | 20% | 20% | 20% | 20% | 30% | 50% | 60% | 60% | 40% |
| XiaoYi | 64% | 60% | 90% | 50% | 70% | 60% | 70% | 60% | 70% | 40% | 70% |
| UAlbertaBot | 43% | 40% | 60% | 50% | 10% | 40% | 30% | 20% | 70% | 40% | 70% |
| AITP | 82% | 80% | 70% | 60% | 100% | 90% | 80% | 80% | 100% | 100% | 60% |
| BunkerBoxeR | 71% | 70% | 80% | 70% | 50% | 80% | 70% | 70% | 80% | 70% | 70% |
| overall | 40.00% | 37% | 39% | 31% | 32% | 48% | 40% | 37% | 48% | 48% | 40% |
| UAlbertaBot | overall | Benzen | Destin | Heartb | Aztec | TauCro | Androm | Circui | Empire | Fortre | Python |
|---|
| Locutus | 1% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 10% | 0% | 0% |
| PurpleWave | 2% | 0% | 0% | 0% | 0% | 0% | 0% | 22% | 0% | 0% | 0% |
| BananaBrain | 16% | 20% | 10% | 20% | 10% | 20% | 10% | 20% | 11% | 10% | 30% |
| DaQin | 22% | 30% | 0% | 20% | 10% | 30% | 20% | 20% | 30% | 40% | 20% |
| Steamhammer | 9% | 10% | 10% | 10% | 11% | 20% | 10% | 11% | 10% | 0% | 0% |
| ZZZKBot | 10% | 10% | 20% | 10% | 0% | 10% | 10% | 30% | 0% | 10% | 0% |
| Microwave | 18% | 40% | 0% | 10% | 40% | 20% | 40% | 20% | 10% | 0% | 0% |
| Iron | 10% | 0% | 10% | 0% | 10% | 10% | 10% | 40% | 10% | 10% | 0% |
| XiaoYi | 27% | 56% | 40% | 10% | 20% | 20% | 25% | 40% | 11% | 11% | 40% |
| McRave | 57% | 60% | 40% | 50% | 90% | 60% | 70% | 80% | 30% | 60% | 30% |
| AITP | 75% | 89% | 80% | 50% | 78% | 90% | 70% | 33% | 90% | 70% | 100% |
| BunkerBoxeR | 89% | 70% | 90% | 90% | 80% | 90% | 100% | 80% | 100% | 100% | 90% |
| overall | 28.04% | 31% | 25% | 22% | 29% | 31% | 31% | 33% | 27% | 26% | 25% |
| AITP | overall | Benzen | Destin | Heartb | Aztec | TauCro | Androm | Circui | Empire | Fortre | Python |
|---|
| Locutus | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% |
| PurpleWave | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% |
| BananaBrain | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% |
| DaQin | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% |
| Steamhammer | 3% | 10% | 0% | 10% | 0% | 0% | 10% | 0% | 0% | 0% | 0% |
| ZZZKBot | 28% | 30% | 40% | 40% | 10% | 20% | 80% | 30% | 10% | 10% | 10% |
| Microwave | 7% | 10% | 10% | 30% | 0% | 0% | 10% | 0% | 0% | 0% | 10% |
| Iron | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% |
| XiaoYi | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% |
| McRave | 18% | 20% | 30% | 40% | 0% | 10% | 20% | 20% | 0% | 0% | 40% |
| UAlbertaBot | 25% | 11% | 20% | 50% | 22% | 10% | 30% | 67% | 10% | 30% | 0% |
| BunkerBoxeR | 59% | 30% | 20% | 70% | 40% | 70% | 100% | 80% | 60% | 50% | 70% |
| overall | 11.62% | 9% | 10% | 20% | 6% | 9% | 21% | 16% | 7% | 8% | 11% |
| BunkerBoxeR | overall | Benzen | Destin | Heartb | Aztec | TauCro | Androm | Circui | Empire | Fortre | Python |
|---|
| Locutus | 1% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 10% | 0% | 0% |
| PurpleWave | 3% | 0% | 10% | 10% | 0% | 0% | 0% | 0% | 10% | 0% | 0% |
| BananaBrain | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% |
| DaQin | 1% | 0% | 0% | 0% | 10% | 0% | 0% | 0% | 0% | 0% | 0% |
| Steamhammer | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% | 0% |
| ZZZKBot | 1% | 0% | 0% | 0% | 0% | 0% | 10% | 0% | 0% | 0% | 0% |
| Microwave | 1% | 0% | 0% | 0% | 10% | 0% | 0% | 0% | 0% | 0% | 0% |
| Iron | 7% | 0% | 0% | 20% | 20% | 0% | 10% | 0% | 10% | 10% | 0% |
| XiaoYi | 2% | 0% | 0% | 0% | 10% | 0% | 0% | 0% | 10% | 0% | 0% |
| McRave | 29% | 30% | 20% | 30% | 50% | 20% | 30% | 30% | 20% | 30% | 30% |
| UAlbertaBot | 11% | 30% | 10% | 10% | 20% | 10% | 0% | 20% | 0% | 0% | 10% |
| AITP | 41% | 70% | 80% | 30% | 60% | 30% | 0% | 20% | 40% | 50% | 30% |
| overall | 8.08% | 11% | 10% | 8% | 15% | 5% | 4% | 6% | 8% | 8% | 6% |
The zergs and terrans seem more sensitive to the map than protoss. For example, Locutus vs PurpleWave win rates vary from 30% to 60%, which could be entirely due to statistical fluctuation, while ZZZKBot vs Iron ranges from 0% to 100%, which is not random. I imagine that ZZZKBot’s map selectivity has to do with its learning algorithm. But overall, there are many cases where the map seems to make a difference against opponents of similar strength. I think bots will benefit from more sensitivity to the map design.
Comments
Dan on :
Dave Churchill on :
MicroDK on :
But yes, ZZZKBot shows a lot more variance. Without training the variance can be high since it can takes time to find a working strategy. Learning bots will run into a learning cycle which enhances this effect.