Emergence
The phenomenon where large models suddenly develop new capabilities not present in smaller models.
In more detail
Emergent abilities appear at certain scale thresholds without explicit training. Examples: in-context learning in GPT-3, chain-of-thought reasoning in larger models. Poorly understood but important for AI capabilities.
Examples
- In-context learning appearing at 100B+ parameters
- Complex reasoning emerging in larger LLMs
- Multimodal capabilities in vision-language models
Related terms
Ready to Build Production AI Systems?
Join a small cohort learning directly from an engineer who's shipped AI at Atlassian and PhonePe scale.
20 weeks · Weekend live classes · 1:1 mentorship · 20+ projects.
20 Weeks
Live Weekend Classes
< 30 Seats
Small Batch
Next Soon
Get priority access
7-Day
Money-Back Guarantee
Taught by Debasish Maji · Senior AI Engineer · Ex-Atlassian (Rovo Agent) · Ex-PhonePe (550M+ users)
Get notified when the next batch opens + free AI resources