Combining Hebbian and reinforcement learning in a minibrain model
Abstract
A toy model of a neural network in which both Hebbian learning and reinforcement learning occur is studied. The problem of `path interference', which makes that the neural net quickly forgets previously learned input-output relations is tackled by adding a Hebbian term (proportional to the learning rate $\eta$) to the reinforcement term (proportional to $\rho$) in the learning rule. It is shown that the number of learning steps is reduced considerably if $1/4 < \eta/\rho < 1/2$, i.e., if the Hebbian term is neither too small nor too large compared to the reinforcement term.
- Publication:
-
arXiv e-prints
- Pub Date:
- January 2003
- DOI:
- 10.48550/arXiv.cond-mat/0301627
- arXiv:
- arXiv:cond-mat/0301627
- Bibcode:
- 2003cond.mat..1627B
- Keywords:
-
- Disordered Systems and Neural Networks