Overfitting
When a model learns training data too well, including noise, and performs poorly on new unseen data.
In more detail
Overfitting occurs when a model memorizes training data rather than learning generalizable patterns. It has low training loss but high validation loss. Solutions include regularization, dropout, early stopping, and using more diverse training data.
Examples
- A model that memorizes training images but fails on new images
- High training accuracy but low test accuracy
- Detecting overfit through validation curves
Related terms
Ready to Build Production AI Systems?
Join a small cohort learning directly from an engineer who's shipped AI at Atlassian and PhonePe scale.
20 weeks · Weekend live classes · 1:1 mentorship · 20+ projects.
20 Weeks
Live Weekend Classes
< 30 Seats
Small Batch
Next Soon
Get priority access
7-Day
Money-Back Guarantee
Taught by Debasish Maji · Senior AI Engineer · Ex-Atlassian (Rovo Agent) · Ex-PhonePe (550M+ users)
Get notified when the next batch opens + free AI resources