The "WakeSleep" Algorithm for Unsupervised Neural Networks
Abstract
An unsupervised learning algorithm for a multilayer network of stochastic neurons is described. Bottomup "recognition" connections convert the input into representations in successive hidden layers, and topdown "generative" connections reconstruct the representation in one layer from the representation in the layer above. In the "wake" phase, neurons are driven by recognition connections, and generative connections are adapted to increase the probability that they would reconstruct the correct activity vector in the layer below. In the "sleep" phase, neurons are driven by generative connections, and recognition connections are adapted to increase the probability that they would produce the correct activity vector in the layer above.
 Publication:

Science
 Pub Date:
 May 1995
 DOI:
 10.1126/science.7761831
 Bibcode:
 1995Sci...268.1158H