Two $\operatorname{ReLU}$ Layers is All You Need

We prove that every $\operatorname{ReLU}$ network can be exactly simulated by a $\operatorname{ReLU}$ network with two hidden layers. We present two proofs: one that is based on fillings in homological algebra and a direct combinatorial proof.

Guardado en:
Detalles Bibliográficos
Autores principales: Brunck, Florestan, Hertrich, Christoph, Ruess, Kilian, Stade, Jack, Yehudayoff, Amir
Formato: Artículo
Publicado: 2026
Materias:
Acceso en línea:https://arxiv.org/abs/2610.28587
http://arxiv.org/abs/2610.28587
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!