More Than a Toy: Random Matrix Models Predict How Real-World Neural Representations Generalize

Of theories for why large-scale machine learning models generalize despite being vastly overparameterized, which of their assumptions are needed to capture the qualitative phenomena of generalization in the real world? On one hand, we find that most theoretical analyses fall short of capturing these...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Wei, Alexander, Hu, Wei, Steinhardt, Jacob
Formato: Artículo
Publicado: 2022
Materias:
Acceso en línea:https://arxiv.org/abs/2203.06176
http://arxiv.org/abs/2203.06176
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!