Temporal difference control within a dynamic environment

Leo Galway, D.K. Charles, Michaela Black, Colin Fyfe

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

4 Citations (Scopus)

Abstract

The aim of this paper is to investigate reinforcement learning, specifically the use of Temporal Difference learning methods for the generation of player character movement, within a dynamic, digital game environment. Using a variation of the classic arcade game Pac-Man, the Sarsa and Sarsa(λ) algorithms have been utilised for the control of a Pac-Man game agent, with results indicating that the chosen learning algorithms are successful in achieving the underlying objectives of the game agent. However, a number of trade-offs between the objectives of the game agent must be made during the selection of parameter values for the learning algorithms. In the experiments presented herein, the incorporation of a priori game information into the chosen learning algorithms has shown an improvement in the performance of the game agent in terms of both the score obtained and time taken per game.

Original languageEnglish
Title of host publication8th International Conference on Intelligent Games and Simulation, GAME-ON 2007
Pages42-47
Number of pages6
Publication statusPublished - 22 Nov 2007
Event8th International Conference on Intelligent Games and Simulation, GAME-ON 2007 - Bologna, Italy
Duration: 20 Nov 200722 Nov 2007

Publication series

Name8th International Conference on Intelligent Games and Simulation, GAME-ON 2007

Conference

Conference8th International Conference on Intelligent Games and Simulation, GAME-ON 2007
Country/TerritoryItaly
CityBologna
Period20/11/0722/11/07

Keywords

  • Digital games
  • Pac-man
  • Reinforcement learning
  • Sarsa

Fingerprint

Dive into the research topics of 'Temporal difference control within a dynamic environment'. Together they form a unique fingerprint.

Cite this