A reinforcement learning with evolutionary state recruitment strategy for autonomous mobile robots control

In recent robotics fields, much attention has been focused on utilizing reinforcement learning (RL) for designing robot controllers, since environments where the robots will be situated in should be unpredictable for human designers in advance. However there exist some difficulties. One of them is well known as 'curse of dimensionality problem'. Thus, in order to adopt RL for complicated systems, not only 'adaptability' but also 'computational efficiencies' should be taken into account. The paper proposes an adaptive state recruitment strategy for NGnet-based actor-critic RL. The strategy enables the learning system to rearrange/divide its state space gradually according to the task complexity and the progress of learning. Some simulation results and real robot implementations show the validity of the method. (C) 2003 Elsevier B.V. All rights reserved.