An Internal Covariate Shift Bounding Algorithm for Deep Neural Networks by Unitizing Layers' Outputs
Batch Normalization (BN) techniques have been proposed to reduce the so-called Internal Covariate Shift (ICS) by attempting to keep the distributions of layer outputs unchanged. Experiments have shown their effectiveness on training deep neural networks. However, since only the first two moments are...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Published: |
2020
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2001.02814 http://arxiv.org/abs/2001.02814 |
| Tags: |
No Tags, Be the first to tag this record!
|