Kedis ku xidhan hagaha · Dhexdhexaad Heerka

Kediska Distillation Aqoonta

Codso qaybinta macalinka, bartilmaameedyada la jilciyay, iyo qiimaynta ardayga si qotodheer, oo ay ku jirto sababta ku dayashodu aanay u dammaanad qaadin saxnaanta heerka macalinka.

Wadooyinka haga ee la xidhiidhaFaafinta Aqoonta
Su'aal 1 ee 8

In knowledge distillation, what is the student model trained to do?

Horudhac su'aal kasta8 su'aalo

Jawaabaha iyo sharraxaadaha waxay soo baxayaan markaad qaadanayso kediska.

  1. In knowledge distillation, what is the student model trained to do?
    • Si aad u tababarto model arday yar si ay ugu daydaan model macalin weyn
    • Si loo sameeyo moodal ka weyn oo sax ah
    • Si toos ah loogu calaamadiyo xogta
    • Si loo sireeyo miisaanka modelka
  2. Maxaa loola jeedaa 'aqoonta madow' ee macalinka?
    • Dhaqanka xaasidnimada qarsoon ee moodeelka
    • Qaybta qarsoon ee faylka qaabka
    • Macluumaadka ku jira ixtimaalka qaraabada ah ee macalinku ku meeleeyo fasalo khaldan
    • Xogta macalinku waligiis looma tababarin
  3. Doorkee ayuu heerkulku (T) ka ciyaaraa distillation?
    • Waxay xakameysaa xawaaraha tababarka moodeelka kaliya
    • Waxay jilcisaa softmax si ay isu ekaanshaha yar ee fasallada u noqdaan kuwo la baran karo
    • Waxay dejisaa tirada lakabyada ardayga
    • Waxay cabbirtaa soosaarka kulaylka GPU-da
  4. Khasaare ka soo baxa caadiga ah wuxuu isku daraa labada qaybood?
    • Laba abaalmarin oo kala duwan
    • Khaladka dhexdhexaadka ah ee dhexdhexaadka ah iyo luminta luminta
    • Ganaax KL oo liddi ku ah siyaasadda tixraaca iyo shaqada qiimaha
    • Eray ka duwanaansho KL oo ku habboon wax soo saarka jilicsan ee macalinka oo lagu daray iskutallaabta-entropy ee calaamadaha dhabta ah
  5. Keebaa tusaale u ah qaabka luqadda distilled?
    • ResNet-50
    • Word2Vec
    • DistilBERT
    • AlexNet
  6. Sidee buufiska sifo-ku-salaysan uga duwan yahay habka wax-soo-saarka caadiga ah?
    • Waxay u dhigantaa matalaada lakabka hoose ee dhexdhexaadka ah, ma aha oo kaliya natiijooyinka kama dambaysta ah
    • Gebi ahaanba way iska indha tirtay macalinka
    • Kaliya waxay isticmaashaa calaamado adag
    • Waxay u tababartaa macalinka halkii ardayga
  7. A teacher assigns similar small probabilities to wolf and fox when predicting dog. What can soft-target distillation transfer beyond the top label?
    • A guarantee that either alternative is the correct label
    • The teacher’s complete original training corpus
    • The teacher’s exact number of hidden layers
    • Relative relationships among the teacher’s alternative class scores
  8. A distilled student is smaller than its teacher. Which evaluation is needed before deployment?
    • Assume its accuracy must equal the teacher’s
    • Measure its task accuracy and runtime on the intended system
    • Assume fewer parameters guarantee lower latency on every device
    • Only compare the models’ names