Study proposes transfer-aware curriculum sampling for language-model training
An arXiv paper introduces Relative Transfer, a measure of how training examples at different difficulty levels affect one another, and proposes Transfer-aware Dynamic Curriculum Sampling for adapting training schedules during post-training.