Why and When Can Deep -- but Not Shallow -- Networks Avoid the Curse of Dimensionality: a Review
Abstract
The paper characterizes classes of functions for which deep learning can be exponentially better than shallow learning. Deep convolutional networks are a special case of these conditions, though weight sharing is not the main reason for their exponential advantage.
- Publication:
-
arXiv e-prints
- Pub Date:
- November 2016
- DOI:
- 10.48550/arXiv.1611.00740
- arXiv:
- arXiv:1611.00740
- Bibcode:
- 2016arXiv161100740P
- Keywords:
-
- Computer Science - Machine Learning