All glossary terms
modelsintermediate

BERT (Bidirectional Encoder Representations from Transformers)

A pre-trained language model that uses bidirectional context for understanding text.

In more detail

BERT is a pre-trained Transformer encoder released by Google. Uses masked language modeling and next sentence prediction. Excellent for text understanding tasks. Foundation for many downstream NLP applications.

Examples

  • Text classification
  • Named entity recognition
  • Question answering
  • Semantic similarity

Related terms

Professional AI/ML Bootcamp · Starts 2nd January, 2027

Ready to Build Production AI Systems?

Join a small cohort learning directly from an engineer who's shipped AI at Atlassian and PhonePe scale.

20 weeks · Weekend live classes · 1:1 mentorship · 20+ projects.

20 Weeks

Live Weekend Classes

< 30 Seats

Small Batch

Batch Full

Next Soon

Get priority access

7-Day

Money-Back Guarantee

Taught by Debasish Maji · Senior AI Engineer · Ex-Atlassian (Rovo Agent) · Ex-PhonePe (550M+ users)

Get notified when the next batch opens + free AI resources