Ikibazo gihuza ibibazo · Hagati Urwego

Continued Pretraining vs Fine-Tuning Quiz

Tests the data and objective differences between continued pretraining and fine-tuning, catastrophic forgetting and replay, and when retrieval fits better.