Neural Polytopes
Jul 2, 20235 pages
Contribution to:
e-Print:
- 2307.00721 [cs.LG]
Report number:
- KUNS-2972,
- RIKEN-iTHEMS-Report-23
View in:
Citations per year
0 Citations
Abstract: (arXiv)
We find that simple neural networks with ReLU activation generate polytopes as an approximation of a unit sphere in various dimensions. The species of polytopes are regulated by the network architecture, such as the number of units and layers. For a variety of activation functions, generalization of polytopes is obtained, which we call neural polytopes. They are a smooth analogue of polytopes, exhibiting geometric duality. This finding initiates research of generative discrete geometry to approximate surfaces by machine learning.Note:
- 5 pages, 9 figures. v2: References added. Accepted at the 1st Workshop on the Synergy of Scientific and Machine Learning Modeling at International Conference on Machine Learning (ICML), Honolulu, Hawaii, USA. 2023
References(21)
Figures(73)
- [1]
- [2]
- [3]
- [4]
- [5]
- [6]
- [7]
- [8]
- [9]
- [10]
- [11]
- [12]
- [13]
- [14]
- [15]
- [16]
- [17]
- [18]
- [19]
- [20]
- [21]