how bots like maps

I decided to analyze the maps to see how bots feel about them overall. This data is derived from yesterday’s big table of how much bots like each SSCAIT map. The “spread” column is the mean of the absolute value of the Elo deviation numbers for a given map, across all the bots. I thought of calling it “controversy”; it measures how much bots like or dislike the map. Maps that all bots do OK on get low numbers; maps that some bots love and others hate get high numbers.

The “RMS” column is the root mean square of the same data. Statistically, it’s a fairer measure of the differences. It’s bigger because it puts more weight on outliers. The two measures don’t agree closely.

Destination is the most “controversial” map, with 60 Elo spread. If you pick one bot that likes Destination and one bot that dislikes it, on average the bot that likes it will have a 60 Elo advantage, which means a 59% win rate if the bots are otherwise even—nothing devastating. Neo Moon Glaive has Elo spread 41 or about 56% advantage, not much different. Even if you go with the RMS number, the peak 81 Elo RMS difference means a 61% win rate, still not much different.

map	spread	RMS
Benzene	45	57
Destination	60	78
HeartbreakRidge	53	81
NeoMoonGlaive	41	53
TauCross	51	74
Andromeda	49	70
CircuitBreaker	54	69
EmpireoftheSun	50	69
FightingSpirit	51	72
Icarus	46	60
Jade	50	64
LaMancha1.1	49	65
Python	47	60
Roadrunner	46	63

Bottom line: On this analysis, the maps don’t seem to be distorting the competition. No highly “controversial” maps are introducing widespread unfairness.

Trackbacks

No Trackbacks

Comments

krasi0 on Tuesday, October 11. 2016:

I wonder how much “controversy” an island map would introduce xD

Jay Scott on Tuesday, October 11. 2016:

Of the bots I’ve tried locally on island maps, not one was able to cope at all. 100% draws, no controversy. :-) Presumably bots that go air should beat bots that don’t make air defense, though, so... good question! I still like my suggestion of Namja Iyagi, which has many islands but is still playable as a standard map.

Add Comment

Name*

Homepage

Comment*

In reply to

E-Mail addresses will not be displayed and will only be used for E-Mail notifications.

To prevent automated Bots from commentspamming, please enter the string you see in the image below in the appropriate input box. Your comment will only be submitted if the strings match. Please ensure that your browser supports and accepts cookies, or your comment cannot be verified correctly.
CAPTCHA