Idanwo ti o sopọ mọ itọsọna · Alabọde Ipele

Wav2Vec 2.0 adanwo

Test Wav2Vec 2.0’s self-supervised pretraining recipe, contrastive objective, and the limits of its low-label LibriSpeech results.

Jẹmọ itọsọna awọn ọnaWav2vec 20
Ibeere 1 ti 8

Iṣoro koko wo ni idanimọ ọrọ jẹ Wav2Vec 2.0 ti a ṣe lati koju?

Awotẹlẹ gbogbo ibeere8 ibeere

Awọn idahun ati awọn alaye han bi o ṣe n mu ibeere naa.

  1. Iṣoro koko wo ni idanimọ ọrọ jẹ Wav2Vec 2.0 ti a ṣe lati koju?
    • Aini ti aami (ti a kọ silẹ) ohun
    • Awọn faili ohun ti tobi ju lati fipamọ
    • Awọn gbohungbohun jẹ gbowolori pupọ
    • Ọrọ jẹ gidigidi lati tokenize
  2. Iru ibi-afẹde ẹkọ wo ni Wav2Vec 2.0 lo lakoko ikẹkọ iṣaaju?
    • Iyasọtọ phoneme taara pẹlu awọn aami kikun
    • Ipadanu iyatọ lori awọn apakan wiwaba ti o boju
    • Pixel atunkọ
    • Ẹkọ imudara lati awọn esi eniyan
  3. Apakan wo ni akọkọ ṣe ilana igbi igbi aise ni Wav2Vec 2.0?
    • LSTM loorekoore
    • Ayẹwo itankale
    • Ẹya CNN olona-Layer kan kooduopo
    • Ayokuro MMFC ti a fi ọwọ ṣe
  4. In a reported LibriSpeech experiment, what small labeled-data setup demonstrated low-label potential?
    • 10 minutes unlabeled with no pretraining
    • 53,000 hours labeled with no pretraining
    • One hour labeled with no unlabeled data
    • 10 minutes labeled after pretraining on 53,000 hours of unlabeled speech
  5. Kini ipa ti iwe koodu kọni ni Wav2Vec 2.0?
    • O discretizes ohun lemọlemọfún sinu apari ọrọ sipo
    • O tọju awọn ọrọigbaniwọle olumulo
    • O compresses ik tiransikiripiti
    • O yan ere gbohungbohun
  6. Awoṣe multilingual nla wo ni a kọ sori ọna Wav2Vec 2.0?
    • GPT-2
    • XLS-R
    • Stable Diffusion
    • ResNet-50
  7. What does the Transformer contribute during Wav2Vec 2.0 pretraining?
    • Converts transcripts into audio
    • Clusters final text into language labels
    • Contextualizes latent speech features around masked spans
    • Removes the feature encoder
  8. What is typically done after self-supervised pretraining to create an ASR model?
    • Replace the audio encoder with an image classifier
    • Train only on unlabeled text
    • Discard the model and use k-means alone
    • Fine-tune with transcribed speech