quiz bu lëkkale ak tegtal · Diggante Niveau

Laaj ak tontu bu jàkkarloo

Xam naka la cross-attention di may benn toppalante wala modalité mu laaj représentation ci beneen toppalante wala modalité ci model transformateur yi.

Yooni njiit yu jëm ciFàttaliku jàmbur
Laaj 1 de 8

Lan mooy wuutale bàyyi xel ci sa bopp ak bàyyi xel ci yeneen mbir?

Xoolaatal laaj bu nekk8 laaj

Sooy def quiz bi, tontu yi ak leeral yi dañuy feeñ.

  1. Lan mooy wuutale bàyyi xel ci sa bopp ak bàyyi xel ci yeneen mbir?
    • Ci cross-attention, laaj yi dañuy joge ci benn toppalante ak caabi/valeur yi ci beneen
    • Xool bu jaarul yoon jëfandikoowul softmax
    • Foofu sa bopp du dox ludul ci nataal
    • Mënu tàggat bàyyi xel ci wàccinu gradient
  2. Ci biir Transformateur encodeur-decodeur, fan la laajte yi jëm ci cross-attention di jogee?
    • Encodeur bi génn
    • decodeur bi nekk ci jamono jii
    • embeddings raw yi kese
    • matrix bu wuute
  3. Lan moo waral ñaari toppalante yi ci cross-attention mën nañu am guddaay wala anam yu wuute?
    • Ndax bàyyi xel dafay laaj ay dugal yu tolloo guddaay
    • Ndax dafay baña bàyyi xel ci benn ci toppalante yi
    • Ndax laaj yi ak caabi yi ci balluwaay yu wuute lañuy bawoo
    • Ndax dafay njëkka pad lépp ci dayo buñ tëral
  4. naka lay def ba diffusion stable di jëfandikoo cross-attention?
    • Ngir kompresse nataal yi ci ay fichier yu gëna ndaw
    • Tekki mbind ci diggante làkk yi
    • Ngir dindi bruit ci audio
    • Ngir defar gox yiñ defaree nataal ci laajtu bind bi
  5. Ban jëf ci math la cross-attention ak bàyyi sa bopp bokk?
    • Produit dot buñ yamale ak softmax
    • Konvolusioŋ ci kaw pixel yi
    • Coppite yu am solo
    • Tablo seetlu yu am kod bu dëgër
  6. What gate does Flamingo use to control information flow through its cross-attention layers?
    • A hard threshold initialized to one
    • A tanh gate initialized to zero
    • A fixed residual weight of 0.5
    • A learned vocabulary lookup table
  7. What input sequence structure does Flamingo’s paper say its visual-language model can handle?
    • Only one image followed by a fixed-length label
    • Only text tokens with no visual inputs
    • Visual and textual data interleaved in arbitrary sequences
    • Only video frames with no text
  8. What is one purpose of cross-attention in Flamingo’s visual-language architecture?
    • It replaces all text tokens with pixels
    • It prevents any information from passing between modalities
    • It performs only image resizing
    • It lets language-model layers incorporate visual features from image/video inputs