A New Angle on L2 Regularization
Abstract
Imagine two high-dimensional clusters and a hyperplane separating them. Consider in particular the angle between: the direction joining the two clusters' centroids and the normal to the hyperplane. In linear classification, this angle depends on the level of L2 regularization used. Can you explain why?
- Publication:
-
arXiv e-prints
- Pub Date:
- June 2018
- DOI:
- arXiv:
- arXiv:1806.11186
- Bibcode:
- 2018arXiv180611186T
- Keywords:
-
- Computer Science - Computer Vision and Pattern Recognition;
- Computer Science - Machine Learning
- E-Print:
- An explorable explanation on the phenomenon of adversarial examples in linear classification and its relation to L2 regularization. Interactive version available at: https://thomas-tanay.github.io/post--L2-regularization/