Neural Polytopes
Abstract
We find that simple neural networks with ReLU activation generate polytopes as an approximation of a unit sphere in various dimensions. The species of polytopes are regulated by the network architecture, such as the number of units and layers. For a variety of activation functions, generalization of polytopes is obtained, which we call neural polytopes. They are a smooth analogue of polytopes, exhibiting geometric duality. This finding initiates research of generative discrete geometry to approximate surfaces by machine learning.
- Publication:
-
arXiv e-prints
- Pub Date:
- July 2023
- DOI:
- arXiv:
- arXiv:2307.00721
- Bibcode:
- 2023arXiv230700721H
- Keywords:
-
- Computer Science - Machine Learning;
- Computer Science - Graphics;
- High Energy Physics - Theory;
- Mathematics - Geometric Topology
- E-Print:
- 5 pages, 9 figures. v2: References added. Accepted at the 1st Workshop on the Synergy of Scientific and Machine Learning Modeling at International Conference on Machine Learning (ICML), Honolulu, Hawaii, USA. 2023