Kedis ku xidhan hagaha · Dhexdhexaad Heerka

Perplexity iyo Kediska Qiyaasaha Luuqadda

Dib u eeg suurtagalnimada calaamad tixraaceed, iskutallaab-dhaaf ah, saldhigyo isku mid ah, calaamado la mid ah, BLEU, xadka tayada, daaqadaha macnaha guud, iyo moodooyinka la daboolay.

Wadooyinka haga ee la xidhiidhaPerplexity Iyo Qiyaasaha Luuqadda
Su'aal 1 ee 8

Under the same autoregressive text-scoring setup, what does lower perplexity indicate?

Horudhac su'aal kasta8 su'aalo

Jawaabaha iyo sharraxaadaha waxay soo baxayaan markaad qaadanayso kediska.

  1. Under the same autoregressive text-scoring setup, what does lower perplexity indicate?
    • Lower average negative log-likelihood for the reference tokens
    • A guarantee of more factually correct generated answers
    • A guarantee of a larger parameter count
    • A requirement that every top-choice prediction be correct
  2. Using natural-log negative log-likelihood, how is autoregressive perplexity computed from its average?
    • By multiplying the parameter count by the context length
    • By subtracting the average from the number of attention heads
    • By taking the average learning rate
    • By exponentiating the average negative log-likelihood
  3. Qaabku waxa uu ku meeleeyaa ixtimaalka isku midka ah ee 10,000-erey oo eray ah oo aan waxba baran. Waa maxay wareerkeeda?
    • 1
    • 10,000
    • 0
    • 100
  4. Why do tokenizer and corpus settings matter when directly comparing per-token perplexity values?
    • Perplexity ignores every scored reference token
    • All corpora necessarily produce the same likelihood
    • They change the units or reference data over which probabilities are averaged
    • Only model parameter count determines the score
  5. Which translation-reference metric uses modified n-gram precision and a brevity penalty?
    • Perplexity
    • Ciladda pixel-ka ee dhexdhexaadka ah
    • Qiyaasta moodeelka
    • BLEU
  6. Waa maxay xaddidaadda muhiimka ah ee ku riixaysa cilmi-baarayaasha ka baxsan jahwareerka si ay u qiimeeyaan tayada dhabta ah ee adduunka?
    • Perplexity waxay cabbirtaa saadaalinta kelmad soo socota, ma aha in wax-soo-saarku faa'iido, run, ama waxtar leedahay.
    • Perplexity aad bay qaali u tahay in la xisaabiyo
    • Perplexity laguma xisaabin karo xogta qoraalka
    • Perplexity kaliya waxay shaqeysaa inta lagu guda jiro wax barasho, ma aha tababar
  7. When scoring a long text with a fixed-context model, what can a sliding-window procedure provide that disjoint chunks lose near boundaries?
    • A new vocabulary learned automatically at every boundary
    • A guarantee that generated answers are factually correct
    • More preceding context for the scored target tokens
    • A requirement to count each overlapping target repeatedly
  8. Why is conventional left-to-right perplexity not directly the same score for a BERT-style masked language model?
    • BERT has no learned parameters
    • The masked model does not directly define the same autoregressive sequence factorization
    • Every masked-token probability is necessarily zero
    • Perplexity is defined only for image pixels