
The first strong computer opponent was BKG 9.8. It was written by Hans Berliner in the late 1970s on a DEC PDP-10 as an experiment in evaluating board game positions. Early versions of BKG played badly even against poor players, but Berliner noticed that its critical mistakes were always at transitional phases in the game.
He applied principles of fuzzy logic to improve its play between phases, and by July 1979, BKG 9.8 was strong enough to play against the ruling world champion Luigi Villa. It won the match, 7–1, becoming the first computer program to defeat a world champion in any board game. Berliner stated that the victory was largely a matter of luck, as the computer received more favorable dice rolls.
In the late 1980s, backgammon programmers found more success with an approach based on artificial neural networks. TD-Gammon, developed by Gerald Tesauro of IBM, was the first of these programs to play near the expert level. Its neural network was trained using temporal difference learning applied to data generated from self-play.
According to assessments by Bill Robertie and Kit Woolsey, TD-Gammon's play was at or above the level of the top human players in the world. Woolsey said of the program that "There is no question in my mind that its positional judgment is far better than mine."
Neural network research has resulted in two modern commercial programs, Jellyfish and Snowie, as well as the shareware BGBlitz and the free software GNU Backgammon. These programs not only play the game, but offer tools for analyzing games and offering detailed comparisons of individual moves. The strength of these programs lies in their neural networks' weights tables, which are the result of months of training. Without them, these programs play no better than a human novice.
No comments:
Post a Comment