Unsupervised learning by competing hidden units
Abstract
Despite great success of deep learning a question remains to what extent the computational properties of deep neural networks are similar to those of the human brain. The particularly nonbiological aspect of deep learning is the supervised training process with the backpropagation algorithm, which requires massive amounts of labeled data, and a nonlocal learning rule for changing the synapse strengths. This paper describes a learning algorithm that does not suffer from these two problems. It learns the weights of the lower layer of neural networks in a completely unsupervised fashion. The entire algorithm utilizes local learning rules which have conceptual biological plausibility.
- Publication:
-
Proceedings of the National Academy of Science
- Pub Date:
- April 2019
- DOI:
- 10.1073/pnas.1820458116
- arXiv:
- arXiv:1806.10181
- Bibcode:
- 2019PNAS..116.7723K
- Keywords:
-
- Computer Science - Machine Learning;
- Computer Science - Computer Vision and Pattern Recognition;
- Computer Science - Neural and Evolutionary Computing;
- Quantitative Biology - Neurons and Cognition;
- Statistics - Machine Learning
- E-Print:
- Proceedings of the National Academy of Sciences of the USA, 116 (16) 7723-7731 (2019)