Modular Reinforcement Learning Architectures for Artificially Intelligent Agents in Complex Game Environments

Christopher J Hanna, RJ Hickey, DK Charles, Michaela Black

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

6 Citations (Scopus)


Abstract: Recently there has been much research focus on the use of Reinforcement Learning (RL) algorithms for game agent control. However, although it has been shown that such agents are capable of learning in real time, the high dimensionality of agent sensor state spaces still prove to be a significant barrier to progress. This paper outlines an approach to dealing with this issue by using a modular RL architecture with a fine granularity of modules. The modular approach enables a reduction of the dimensionality in complex game-like environments by dividing the state space into smaller, more manageable sub tasks. While this approach is successful in reducing dimensionality, challenges with action selection, exploration and reward allocation arise. This paper discusses approaches to overcoming these issues.keywords: {Computer architecture;Energy states;Fires;Games;Learning;Space exploration;Tiles;computer games;learning (artificial intelligence);multi-agent systems;agent sensor state spaces;artificially intelligent agents;complex game environments;game agent control;modular reinforcement learning architectures;}
Original languageEnglish
Title of host publicationUnknown Host Publication
Number of pages8
Publication statusPublished (in print/issue) - 21 Aug 2010
EventIEEE Computational Intelligence and Games Conference - Copenhagen
Duration: 21 Aug 2010 → …


ConferenceIEEE Computational Intelligence and Games Conference
Period21/08/10 → …


Dive into the research topics of 'Modular Reinforcement Learning Architectures for Artificially Intelligent Agents in Complex Game Environments'. Together they form a unique fingerprint.

Cite this