index of games

Here are the games mentioned on this site, with links to the pages they’re mentioned on. Games mentioned in passing, with no actual analysis, aren’t included.

backgammon
the neural net backgammon programs (and subsidiary pages)
TD learning as a mutation
game links
online papers:
- "Automated feature selection to maximize learning in artificial intelligence"
- "Learning and improving backgammon strategy"
- "TDLeaf(lambda): Combining temporal difference learning with game tree search"
- "TD learning of game evaluation functions with hierarchical neural architectures"

Bolo
interesting pages
game links

bridge
online papers:
- "Pragmatic reasoning in bridge"
- "Strategic planning for imperfect-information games"

checkers (8x8 draughts)
interesting pages
online papers:
- "Co-evolving checkers playing programs using only win, lose, or draw"
- "Derivative evaluation function learning using genetic operators"
- "Learning models of the opponent strategy in game playing"
- "Learning of resource allocation strategies for game playing"
- "The M* algorithm: Incorporating opponent models into adversary search"
- "NeuroDraughts: an application of temporal difference learning to draughts"
- "NeuroDraughts: the role of representation, search, training regime, and architecture in a TD draughts player"
online software:
- NeuroDraughts

chess
game links
the Morph project
NeuroChess
SAL
chess GA experiments
historical interest: Deep Thought
online papers:
- "Chunking for experience"
- "A grandmaster chess machine"
- "Generalizing closed world specialization: a chess endgame application"
- "How hard is the correct coding of an easy endgame?"
- "Learning logical exceptions in chess"
- "KnightCap: A chess program that learns by combining TD(lambda) with minimax search"
- "Machine learning in computer chess: The next generation"
- "Neural networks and chess"
- "On the automatic generation of case libraries by chunking chess games"
- "Programmes d'échecs de championnat: Architecture logicielle, synthèse de fonctions d'évaluation, parallélisme de recherche"
- "TDLeaf(lambda): Combining temporal difference learning with game tree search"
- "Temporal difference learning and chess"
online software:
- Chenard
- crafty
- KnightCap
- Nessi
- Octavius
- zzzzzz

connect-four
SAL
online papers:
- "Artificial neural nets applied to strategic games"

differential games
see pursuit-evasion games, below; most of them are differential games

draughts - also see checkers
interesting pages

go
Nici Schraudolph's go networks
game links
interesting pages
online papers:
- "Adaptive critic design in learning to play game of go"
- "Coevolutionary search among adversaries"
- "Evolving go playing strategy in neural networks"
- "Evolving neural networks to play go" (two papers of this title)
- "Exploratory learning in the game of go"
- "Go and genetic programming"
- "Go, SVM, go"
- "The Golem go program"
- "Information about the go program I'm writing"
- "The integration of a priori knowledge into a go playing neural network"
- "A machine learning approach to the game of go"
- "Machine learning, game play, and go"
- "Methods for competitive co-evolution: Finding opponents worth beating" (7x7 go)
- "Monte Carlo go"
- "Unsupervised learning of go patterns"
online software:
- GNU Go
- OpenGo
- PubGo+

nim
the Morph project
online papers:
- "Methods for competitive co-evolution: Finding opponents worth beating"

othello
game links
the strong learning othello programs - Bill, Hannibal, Keyano, Kitty, Logistello, Zebra
marker-based neurogenetic algorithm
SANE neurogenetic algorithm
online papers:
- "Automatic feature generation for problem solving systems"
- "Feature discovery for inductive concept learning"
- "Feature discovery for problem solving systems"
- "Genetic Othello v1.02"
- "Genetische Algorithmen zur Bestimmung heuristischer Bewertungsfunktionen bei Spielen"
- "A hybrid theory of feature generation"
- "Learning of position evaluation in the game of othello"
- "Using experience-based learning in game playing"
online software:
- Neurothello

ping pong
See table tennis, below.

poker
interesting pages
online papers:
- "Opponent modeling in poker"

pursuit-evasion games
pursuit-evasion games

reversi
See othello, above.

shogi
game links

soccer
robotic soccer
interesting pages - ASCII soccer (soccer-like game)
online papers:
- "Markov games as a framework for multi-agent reinforcement learning" (simplified, slightly soccer-like task)

table tennis (aka ping pong)
interesting pages

tic-tac-toe
the Morph project
SAL
historical interest: MENACE
online papers:
- "Bottom-Up Recognition Learning: A compilation-based model of limited-lookahead learning"
- "Coevolving high-level representations"
- "Competitive environments evolve better solutions for complex tasks"
- "Evolutionary induction of subroutines"
- "Explorations of the practical issues of learning prediction-control tasks using temporal difference learning methods"
- "Learning models of the opponent strategy in game playing"
- "Learning to play games from experience: An application of artificial neural networks and temporal difference learning"
- "The M* algorithm: Incorporating opponent models into adversary search"
- "Methods for competitive co-evolution: Finding opponents worth beating"
- "Modular neural networks for learning context-dependent game strategies"
- "Multi-criteria reinforcement learning"
- "TD learning of game evaluation functions with hierarchical neural architectures"

video games
online papers:
- "An adaptive video game using the method of temporal differences"
- "Incorporating advice into agents that learn from reinforcements" (two papers of this title)
- "Temporal differences-based policy iteration and applications in neuro-dynamic programming" (tetris)

other games
abalone - interesting pages
Battlecruiser: 3000AD - less-interesting pages
blackjack - online papers
a cube-control game in a virtual world - interesting pages
Diplomacy - less-interesting pages
dots and boxes - online papers
fandango - interesting pages
fortress - online software
hex - less-interesting pages
kinglet - online papers
malawi - online papers
mastermind - interesting pages
matrix games - interesting pages
ninuki-renju (aka Pente) - online software
nine men's morris - online papers
Quixo - online papers
RARS - interesting pages
senet - online papers
symmetric chess-like games - the Metagame project
tetris - rational search
turncoat-chess - the Metagame project
xconq - less-interesting pages