A Spiking Neural Learning Classifier System
Abstract
Learning Classifier Systems (LCS) are population-based reinforcement learners used in a wide variety of applications. This paper presents a LCS where each traditional rule is represented by a spiking neural network, a type of network with dynamic internal state. We employ a constructivist model of growth of both neurons and dendrites that realise flexible learning by evolving structures of sufficient complexity to solve a well-known problem involving continuous, real-valued inputs. Additionally, we extend the system to enable temporal state decomposition. By allowing our LCS to chain together sequences of heterogeneous actions into macro-actions, it is shown to perform optimally in a problem where traditional methods can fail to find a solution in a reasonable amount of time. Our final system is tested on a simulated robotics platform.
- Publication:
-
arXiv e-prints
- Pub Date:
- January 2012
- DOI:
- 10.48550/arXiv.1201.3249
- arXiv:
- arXiv:1201.3249
- Bibcode:
- 2012arXiv1201.3249H
- Keywords:
-
- Computer Science - Neural and Evolutionary Computing;
- Computer Science - Machine Learning;
- Computer Science - Robotics
- E-Print:
- 20 pages