Il prossimoProssima guida
Apprendimento continuo e oblio catastrofico
Fondamenti
GUIDA AI FONDAMENTALI
Curriculum learning orders training examples according to a chosen schedule, often from easier to harder examples.
Ascolta questa guidaNarrato dall'IA · ~2 min
Its benefits depend on how difficulty is defined and on the task.
Bengio and colleagues’ 2009 paper discusses curriculum learning as a training strategy inspired by curricula in education. The paper studies tasks and curricula in specific experiments; it does not show that every task benefits from easy-to-hard training. Self-paced learning is a related approach in which the learner’s objective or current model influences which examples are selected. A common curriculum strategy orders examples from easier to harder, but schedules and difficulty measures vary. Anti-curriculum presents harder examples before easier ones under a defined schedule. Self-paced learning uses current model loss to select examples, often beginning with lower-loss cases; it is related to but distinct from a prescribed curriculum. The original 2010 self-paced paper reports experiments in object localization, noun-phrase coreference, motif finding, and handwritten-digit recognition. The continuation hypothesis proposes beginning with a smoother or easier objective and gradually approaching the target. Evaluate any schedule against a comparable baseline with the same data and compute because benefits vary by task and setup.
Train with a declared easy-to-hard sequence.
Compare with a shuffled-data baseline using the same examples.
Record the curriculum schedule and difficulty score.
Test whether ordering changes convergence or generalization.
Curriculum methods remain task-dependent. Report the difficulty measure and schedule, and compare against appropriate baselines.
Newsletter gratuita
Tre storie verificate sull'IA ogni mattina nei giorni feriali, scritte in un inglese semplice. Gratuito per sempre, senza pubblicità.
Un'email ogni giorno feriale. Disiscriviti con un clic. Non vendiamo né condividiamo mai il tuo indirizzo.
Mettiti alla prova
Feedback immediato su ogni risposta e un certificato condivisibile con un ID verificabile una volta superato un corso.
Sostieni l'istruzione gratuita sull'IA. AI Understanding è un'organizzazione non profit 501(c)(3) — nessun annuncio, nessun paywall, mai. Fai una donazione
Curriculum learning orders training examples according to a chosen schedule, often from easier to harder examples. Its benefits depend on how difficulty is defined and on the task.
A common curriculum orders examples from easier to harder, but difficulty definitions and schedules vary by task; this is not a required or universally beneficial ordering.
Bengio e i coautori hanno formalizzato l’apprendimento curriculare nell’apprendimento automatico nel loro articolo del 2009.
Self-paced learning is a related approach in which the model’s current losses help select examples, often beginning with lower-loss examples and expanding the set. It is not identical to every externally specified easy-to-hard curriculum.
The continuation hypothesis proposes beginning with a smoother or easier objective and gradually moving toward the target objective; it is one possible explanation for why some curricula help, not a universal guarantee.
A curriculum’s benefit depends on task, schedule, data, and optimization. A controlled baseline with comparable data and compute is needed; no universal setting guarantees the largest gain.
Continua a imparare
Altre guide selezionate per questo argomento
Il prossimoProssima guida
Apprendimento continuo e oblio catastrofico
Fondamenti