A seguirPróximo guia
Aprendizagem contínua e esquecimento catastrófico
Fundamentos
GUIA de fundamentos
Curriculum learning orders training examples according to a chosen schedule, often from easier to harder examples.
Ouça este guiaNarrado por IA · ~2 min
Its benefits depend on how difficulty is defined and on the task.
Bengio and colleagues’ 2009 paper discusses curriculum learning as a training strategy inspired by curricula in education. The paper studies tasks and curricula in specific experiments; it does not show that every task benefits from easy-to-hard training. Self-paced learning is a related approach in which the learner’s objective or current model influences which examples are selected. A common curriculum strategy orders examples from easier to harder, but schedules and difficulty measures vary. Anti-curriculum presents harder examples before easier ones under a defined schedule. Self-paced learning uses current model loss to select examples, often beginning with lower-loss cases; it is related to but distinct from a prescribed curriculum. The original 2010 self-paced paper reports experiments in object localization, noun-phrase coreference, motif finding, and handwritten-digit recognition. The continuation hypothesis proposes beginning with a smoother or easier objective and gradually approaching the target. Evaluate any schedule against a comparable baseline with the same data and compute because benefits vary by task and setup.
Train with a declared easy-to-hard sequence.
Compare with a shuffled-data baseline using the same examples.
Record the curriculum schedule and difficulty score.
Test whether ordering changes convergence or generalization.
Curriculum methods remain task-dependent. Report the difficulty measure and schedule, and compare against appropriate baselines.
Boletim informativo gratuito
Três histórias verificadas de IA a cada manhã de dia útil, escritas em linguagem simples. Gratuito para sempre, sem anúncios.
Um e-mail a cada dia útil. Cancele a inscrição com um clique. Nunca vendemos ou compartilhamos seu endereço.
Teste você mesmo
Feedback instantâneo sobre cada resposta e um certificado compartilhável com um ID verificável assim que você concluir um curso.
Apoie a educação gratuita em IA. O AI Understanding é uma organização sem fins lucrativos 501(c)(3) — sem anúncios, sem paywall, nunca. Faça uma doação
Curriculum learning orders training examples according to a chosen schedule, often from easier to harder examples. Its benefits depend on how difficulty is defined and on the task.
A common curriculum orders examples from easier to harder, but difficulty definitions and schedules vary by task; this is not a required or universally beneficial ordering.
Bengio e coautores formalizaram o aprendizado curricular em aprendizado de máquina em seu artigo de 2009.
Self-paced learning is a related approach in which the model’s current losses help select examples, often beginning with lower-loss examples and expanding the set. It is not identical to every externally specified easy-to-hard curriculum.
The continuation hypothesis proposes beginning with a smoother or easier objective and gradually moving toward the target objective; it is one possible explanation for why some curricula help, not a universal guarantee.
A curriculum’s benefit depends on task, schedule, data, and optimization. A controlled baseline with comparable data and compute is needed; no universal setting guarantees the largest gain.
Continue aprendendo
Mais guias escolhidos para este tópico
A seguirPróximo guia
Aprendizagem contínua e esquecimento catastrófico
Fundamentos