Better Neural Network Expressivity: Subdividing the Simplex

This work studies the expressivity of ReLU neural networks with a focus on their depth. A sequence of previous works showed that $\lceil \log_2(n+1) \rceil$ hidden layers are sufficient to compute all continuous piecewise linear (CPWL) functions on $\mathbb{R}^n$. Hertrich, Basu, Di Summa, and Skute...

Descripción completa

Detalles Bibliográficos

Autores principales:	Bakaev, Egor, Brunck, Florestan, Hertrich, Christoph, Stade, Jack, Yehudayoff, Amir
Formato:	Artículo
Publicado:	2025
Materias:	Machine Learning Discrete Mathematics Neural and Evolutionary Computing Combinatorics
Acceso en línea:	https://arxiv.org/abs/2505.14338 http://arxiv.org/abs/2505.14338
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!