All glossary terms
conceptsintermediate

Learning Rate

A hyperparameter that controls the step size for updating model weights during training.

In more detail

Learning rate determines how much weights change based on gradients. Too high causes instability; too low causes slow convergence. Often adjusted during training through schedules. Critical hyperparameter affecting training success.

Examples

  • Fixed learning rate (0.001)
  • Learning rate scheduling
  • Adaptive learning rates (Adam)
  • Warm-up and decay schedules

Related terms

OptimizationGradient Descent
Professional AI/ML Bootcamp · Starts 2nd January, 2027

Ready to Build Production AI Systems?

Join a small cohort learning directly from an engineer who's shipped AI at Atlassian and PhonePe scale.

20 weeks · Weekend live classes · 1:1 mentorship · 20+ projects.

20 Weeks

Live Weekend Classes

< 30 Seats

Small Batch

Batch Full

Next Soon

Get priority access

7-Day

Money-Back Guarantee

Taught by Debasish Maji · Senior AI Engineer · Ex-Atlassian (Rovo Agent) · Ex-PhonePe (550M+ users)

Get notified when the next batch opens + free AI resources