Ikibazo gihuza ibibazo · Hagati Urwego

Ijambo2Vec Skip-Gram na CBOW Ikibazo

Gereranya na CBOW ya Word2Vec na Skip-Gram intego, icyitegererezo kibi, ibice byize, hamwe nuguhitamo bigira ingaruka kumahugurwa adasanzwe.

Inzira zijyanye no kuyoboraIjambo2vec Simbuka Gram na Cbow
Ikibazo 1 Bya 8

Ubwubatsi bwa Skip-Gram buteganya iki?

Reba buri kibazo8 ibibazo

Ibisubizo nibisobanuro bigaragara mugihe ufata ikibazo.

  1. Ubwubatsi bwa Skip-Gram buteganya iki?
    • Kuzenguruka amagambo akomoka kumagambo yo hagati
    • Ijambo ryibanze kuva kumirongo ikikije amagambo
    • Interuro ikurikira mu nyandiko
    • Igice-cy-imvugo tagi ya buri jambo
  2. Nibihe bisubizo bifatika byamahugurwa ya Word2Vec?
    • Ihanurwa ryukuri kumagambo akubiyemo
    • Matrix yize yize, imirongo yayo nijambo vectors
    • Igiti cya parse yinteruro
    • Ibishoboka kuri buri cyiciro cyinyandiko
  3. Kuki Word2Vec ikoresha icyitegererezo kibi?
    • Kongera ingano yamagambo
    • Guhindura indimi
    • Kwirinda softmax yuzuye ihenze hejuru yamagambo yose
    • Gukuraho amagambo ahagarara mu buryo bwikora
  4. What does subsampling frequent words do in the later Word2Vec training method?
    • It reduces the influence of very frequent words and can speed training
    • It turns every word into a character n-gram
    • It changes CBOW into a sentence classifier
    • It guarantees better vectors for every rare word
  5. Ni uwuhe mutungo uzwi wa Word2Vec vectors werekanwa n "" umwami - umugabo + umugore ≈ umwamikazi "?
    • Kugereranya Vector ukoresheje umurongo wimibare
    • Gushakisha neza inkoranyamagambo
    • Ikibonezamvugo gikosora
    • Uburebure bwinteruro
  6. Ninde watangije Word2Vec kandi nuwuhe mwaka?
    • Geoffrey Hinton i Toronto, 2006
    • Tomas Mikolov na bagenzi be kuri Google, 2013
    • Yann LeCun muri Bell Labs, 1998
    • OpenAI, 2018
  7. What does the CBOW architecture predict from its input context?
    • Each future paragraph in the document
    • The sentiment label of the full corpus
    • The center word surrounded by the context window
    • The spelling of a character n-gram
  8. What distribution does the original Word2Vec paper use to draw negative samples?
    • A uniform distribution over all character n-grams
    • A distribution based only on word length
    • A distribution proportional to squared inverse frequency
    • A unigram word-frequency distribution raised to the 0.75 power