Guide-yakabatana mibvunzo · Pakati Nhanho

Mibvunzo Yekudzidza Yekharikhulamu

Assess curriculum ordering, Bengio’s 2009 paper, self-paced learning, optimization hypotheses, and anti-curriculum. Check assumptions and scope.

Nzira dzekutungamira dzinoenderanaCurriculum Kudzidza
Mubvunzo 1 ye 8

What ordering does a common curriculum-learning strategy use?

Tarisa mubvunzo wese8 mibvunzo

Mhinduro uye tsananguro zvinoonekwa paunenge uchitora bvunzo.

  1. What ordering does a common curriculum-learning strategy use?
    • Present examples from easier to harder according to a chosen schedule
    • Always present the most difficult example first
    • Sort examples alphabetically and never change the order
    • Use only examples that already have perfect predictions
  2. Ndiani akasuma izwi rekuti 'curriculum learning' mubepa rinozivikanwa zvikuru ra2009?
    • Geoffrey Hinton
    • Yoshua Bengio nevamwe vaaishanda navo
    • Andrew Ng
    • Yann LeCun
  3. Mukudzidza kwekuzvifambira, ndiani anosarudza kuti ndeipi mienzaniso inotariswa se 'iri nyore' zvakakwana kudzidzira kutanga?
    • Mutsananguri wevanhu anonyora kuoma neruoko
    • Iyo hardware scheduler
    • Iyo modhi pachayo, zvichibva pane iyo mienzaniso ine yakaderera kurasikirwa
    • Akaparadzana akafanodzidziswa kuomerwa classifier chete
  4. Sei kudzidza kwekharikhulamu kungabatsira kukwenenzvera?
    • Inowedzera mwero wekudzidza otomatiki
    • Inovimbisa zero kudzidziswa kukanganisa
    • Inobvisa kudiwa kwebasa rekurasikirwa
    • Inopfavisa zvinangwa zvekutanga, zvichibatsira kudzivirira hurombo hwemunharaunda minima
  5. How should a team test whether an easy-to-hard curriculum helps a model?
    • Compare against a suitable baseline with the same data and compute budget
    • Assume it helps whenever the schedule has more stages
    • Measure training loss once and skip held-out evaluation
    • Compare runs that use different data and different compute
  6. Chii chinonzi 'anti-curriculum' kudzidza?
    • Kudzidzira pasina mienzaniso zvachose
    • Kupa mienzaniso yakaoma isati iri nyore
    • Kushandisa data yekusimbisa chete
    • Kudzivisa backpropagation
  7. Which four tasks did the 2010 self-paced learning paper report in its experiments?
    • Speech translation, protein folding, weather prediction, and music synthesis
    • Image captioning, game playing, robotics, and medical diagnosis
    • Object localization, noun-phrase coreference, motif finding, and handwritten-digit recognition
    • Clustering, sentiment analysis, machine translation, and speech diarization
  8. How can a curriculum be defined reproducibly?
    • Use the word “easy” without a criterion
    • Change the test set after each epoch
    • Select only examples the model already predicts correctly
    • Specify the example difficulty measure, ordering or schedule, and comparison baseline