What is Post-training?

A training method that fine-tunes models directly on preference pairs without needing a separate reward model.

An intermediate training phase between pretraining and post-training, often used for capability or domain adjustments.

Methods that adapt models by training a small subset of added parameters.

Initial large-scale model training on broad data before downstream adaptation.

A held-out dataset used to measure model quality after training.

Continuing training on domain-specific data to adapt a pre-trained model to a specific task.