Effectiveness of Arbitrary Transfer Sets for Data-free Knowledge Distillation

Knowledge Distillation is an effective method to transfer the learning across deep neural networks. Typically, the dataset originally used for training the Teacher model is chosen as the "Transfer Set" to conduct the knowledge transfer to the Student. However, this original training data may not alw...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Nayak, Gaurav Kumar, Mopuri, Konda Reddy, Chakraborty, Anirban
Formato: Artículo
Publicado: 2020
Materias:
Acceso en línea:https://arxiv.org/abs/2011.09113
http://arxiv.org/abs/2011.09113
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!