Batch Normalization
A technique that normalizes layer inputs across a batch to accelerate training and improve stability.
In more detail
Batch normalization standardizes inputs to each layer, reducing internal covariate shift. Accelerates training, enables higher learning rates, and acts as regularization. Layer normalization and group normalization are alternatives.
Examples
- BatchNorm in CNNs
- BatchNorm in transformers
- Layer normalization in language models
Ready to Build Production AI Systems?
Join a small cohort learning directly from an engineer who's shipped AI at Atlassian and PhonePe scale.
20 weeks · Weekend live classes · 1:1 mentorship · 20+ projects.
20 Weeks
Live Weekend Classes
< 30 Seats
Small Batch
Next Soon
Get priority access
7-Day
Money-Back Guarantee
Taught by Debasish Maji · Senior AI Engineer · Ex-Atlassian (Rovo Agent) · Ex-PhonePe (550M+ users)
Get notified when the next batch opens + free AI resources