Automatic generation of fuzzy inference systems by dynamic fuzzy Q-Learning

This paper presents a Dynamic Fuzzy Q-Learning (DFQL) method that is capable of tuning the Fuzzy Inference Systems (FIS) online. On-line self-organizing learning is developed so that structure and parameters identification are accomplished automatically and simultaneously based only on Q-Learning. Self-organizing fuzzy inference is introduced to calculate actions and Q-Junctions so as to enable us to deal with continuous-valued states and actions. Fuzzy rules provide a natural mean to incorporate the bias components for rapid reinforcement learning. Experimental results and comparative studies with the Fuzzy Q-Learning the wall following task of mobile robots demonstrate the superiority of the proposed DFQL method.