![]()
0. Referencehttps://arxiv.org/abs/1803.08494 Group NormalizationBatch Normalization (BN) is a milestone technique in the development of deep learning, enabling various networks to train. However, normalizing along the batch dimension introduces problems --- BN's error increases rapidly when the batch size becomes smallarxiv.org 1. Introduction- Batch Normalization은 딥러닝에서 흔히 쓰이는 기법중 하나이다.- 하지만 이러..
![]()
0. referencehttps://arxiv.org/abs/1502.03167 Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate ShiftTraining Deep Neural Networks is complicated by the fact that the distribution of each layer's inputs changes during training, as the parameters of the previous layers change. This slows down the training by requiring lower learning rates and careful paramarxiv..
