Context Window
The maximum number of tokens an LLM can process in a single input, determining conversation length.
In more detail
Context window defines how much text a model can consider simultaneously. Larger windows enable longer conversations and document processing. GPT-4 has 128K tokens, Claude has 200K, Gemini has 2M. Longer context windows enable more complex tasks but increase computational cost.
Examples
- GPT-4: 128K tokens
- Claude: 200K tokens
- Gemini: 2M tokens
- Llama 2: 4K tokens
Related terms
Ready to Build Production AI Systems?
Join a small cohort learning directly from an engineer who's shipped AI at Atlassian and PhonePe scale.
20 weeks · Weekend live classes · 1:1 mentorship · 20+ projects.
20 Weeks
Live Weekend Classes
< 30 Seats
Small Batch
Next Soon
Get priority access
7-Day
Money-Back Guarantee
Taught by Debasish Maji · Senior AI Engineer · Ex-Atlassian (Rovo Agent) · Ex-PhonePe (550M+ users)
Get notified when the next batch opens + free AI resources