BN Batch Normalization
Date
BN is a set of regularization methods that can speed up the training of large convolutional networks and improve the classification accuracy after convergence.
When BN is used in a certain layer of a neural network, it will standardize the internal data of each mini-batch, normalize the output to the normal distribution of N(0,1), and reduce the change of the internal neuron distribution. When training traditional deep neural networks, the input distribution of each layer changes, making training difficult, but the addition of BN can solve this problem.
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.