Definition #
Models learn by predicting missing parts of input data.
Key Characteristics #
- No manual labeling
- Pre-training for downstream tasks
- Common in NLP
Examples #
- BERT (language models)
- Contrastive Learning
Self-Supervised Learning
31 words·1 min