Introduction

Batch Normalization Biases Residual Blocks Towards the Identity Function in Deep Networks

paper

Conclusion:

1. Batch normalization can train deep residual networks (section 2).

2. Batch normalization increases the maximum stable learning rate (section 3).

3. Batch normalization has a regularizing effect (section 4).