СледваСледващо ръководство
Непрекъснато учене и катастрофално забравяне
Основи
РЪКОВОДСТВО по основи
Curriculum learning orders training examples according to a chosen schedule, often from easier to harder examples.
Чуйте това ръководствоAI-разказан · ~2 min
Its benefits depend on how difficulty is defined and on the task.
Bengio and colleagues’ 2009 paper discusses curriculum learning as a training strategy inspired by curricula in education. The paper studies tasks and curricula in specific experiments; it does not show that every task benefits from easy-to-hard training. Self-paced learning is a related approach in which the learner’s objective or current model influences which examples are selected. A common curriculum strategy orders examples from easier to harder, but schedules and difficulty measures vary. Anti-curriculum presents harder examples before easier ones under a defined schedule. Self-paced learning uses current model loss to select examples, often beginning with lower-loss cases; it is related to but distinct from a prescribed curriculum. The original 2010 self-paced paper reports experiments in object localization, noun-phrase coreference, motif finding, and handwritten-digit recognition. The continuation hypothesis proposes beginning with a smoother or easier objective and gradually approaching the target. Evaluate any schedule against a comparable baseline with the same data and compute because benefits vary by task and setup.
Train with a declared easy-to-hard sequence.
Compare with a shuffled-data baseline using the same examples.
Record the curriculum schedule and difficulty score.
Test whether ordering changes convergence or generalization.
Curriculum methods remain task-dependent. Report the difficulty measure and schedule, and compare against appropriate baselines.
Безплатен бюлетин
Три проверени AI истории всяка делнична сутрин, написани на достъпен език. Безплатно завинаги, без реклами.
Един имейл всеки делничен ден. Отписване с едно кликване. Никога не продаваме и не споделяме вашия имейл адрес.
Тествайте себе си
Незабавна обратна връзка за всеки отговор и сертификат за споделяне с подлежащ на проверка идентификационен номер, след като преминете курс.
Подкрепете безплатното AI образование. AI Understanding е 501(c)(3) с нестопанска цел — без реклами, без платен достъп, никога. Направете дарение
Curriculum learning orders training examples according to a chosen schedule, often from easier to harder examples. Its benefits depend on how difficulty is defined and on the task.
A common curriculum orders examples from easier to harder, but difficulty definitions and schedules vary by task; this is not a required or universally beneficial ordering.
Bengio и съавторите формализираха учебната програма в машинното обучение в своя документ от 2009 г.
Self-paced learning is a related approach in which the model’s current losses help select examples, often beginning with lower-loss examples and expanding the set. It is not identical to every externally specified easy-to-hard curriculum.
The continuation hypothesis proposes beginning with a smoother or easier objective and gradually moving toward the target objective; it is one possible explanation for why some curricula help, not a universal guarantee.
A curriculum’s benefit depends on task, schedule, data, and optimization. A controlled baseline with comparable data and compute is needed; no universal setting guarantees the largest gain.
Продължавай да учиш
Още ръководства, избрани за тази тема
СледваСледващо ръководство
Непрекъснато учене и катастрофално забравяне
Основи