archive by month
Skip to content

RPS analyzer redux

In January I wrote about the idea of an RPS analyzer that tries to predict the opponent’s strategy rock-paper-scissors style, picking up patterns in the sequence of opening tries. For example, many bots never vary a winning build until it loses, and some of those cycle through their choices in a fixed order. If successful, an RPS analyzer could improve the odds of predicting the opponent’s strategy from the get-go, so that Steamhammer could start its counter before it got scouting information to verify. At the time, I wasn’t sure whether an RPS analyzer would be a good idea.

I still think that an RPS analyzer is useless in the limit of very strong bots: PerfectBot will follow game theory and have exactly the right amount of randomness in its choices, and a pattern detector will detect nothing helpful. But as I prepare Steamhammer for AIIDE 2020 I have been playing over many games, and I’ve become convinced that most current learning bots follow predictable or partially predictable patterns that can be exploited.

The current release version of Steamhammer pays limited attention to its predictions, which are accurate only in simple cases. It deliberately shifts its attention over time from openings that counter the specific predicted enemy play toward openings which counter the opponent’s range of play. The changes to make it pay close attention to accurate predictions are easy, though. And there are easy-to-implement algorithms to detect patterns and return a prediction with its confidence level. Do you think it can be ready in time for the AIIDE deadline at the end of the month?

Trackbacks

No Trackbacks

Comments

Dilyan on :

Hola! Getting excited about aiide and SH as I like zergs. Could the games be streamed if not then showing real time score would be super, no?
About that RPS, would it be that effective if there is still undecisiveness in micro and difference between opening a d post opening strategy? Good luck yo.

Jay Scott on :

I’m sure it will not be streamed, and results will be held until the conference.

As for RPS, games where Steamhammer plays a wrong opening and games where it plays an appropriate opening are night and day.

Dilyan on :

Whats are the new improvements for SH for aiide?

Jay Scott on :

Numerous! Improvements to reactions, micro, building placement.... Opening play and middle game play are both significantly better.

jtolmar on :

The algorithms for detecting patterns in RPS play and the best strategy to counter a pattern are very simple, but they take for granted that you can recognize rock, paper, and scissors in previous games, and that you know what beats what. Learning the what beats what portion sounds pretty straightforward. Identifying the opponent's strategy sounds like a huge can of worms though.

Jay Scott on :

And yet it is already implemented.

Add Comment

E-Mail addresses will not be displayed and will only be used for E-Mail notifications.

To prevent automated Bots from commentspamming, please enter the string you see in the image below in the appropriate input box. Your comment will only be submitted if the strings match. Please ensure that your browser supports and accepts cookies, or your comment cannot be verified correctly.
CAPTCHA

Form options

Submitted comments will be subject to moderation before being displayed.