Kedis ku xidhan hagaha · Dhexdhexaad Heerka
Kediska Barashada Is-Idaamaynta
Dib u eeg bartilmaameedyada xogta laga helay, waji-xidhka BERT, lammaane SimCLR, baahiyaha tafatirka, la qabsiga, hawlaha xiga, madaxda saadaalinta, iyo bartilmaameedyada summad-xumaaday.
Su'aal 1 ee 8
Where does the supervision signal in the described self-supervised examples come from?
Horudhac su'aal kasta8 su'aalo
Jawaabaha iyo sharraxaadaha waxay soo baxayaan markaad qaadanayso kediska.
- Where does the supervision signal in the described self-supervised examples come from?
- A requirement for no training objective
- Only new human semantic labels for every pretraining example
- A rule that examples contain no useful information
- The data and defined transformations of it
- Which input positions contribute prediction targets to the original BERT masked-language-model loss?
- The positions selected for the MLM prediction task
- Every position in the entire input regardless of selection
- Only the first position of each new sentence
- Only positions that appear after the final sentence boundary
- Barashada ka duwan sida SimCLR, 'labada togan' waa:
- Laba sawir oo aan gebi ahaanba xidhiidh la lahayn
- Laba calaamadood oo bini'aadmigu qoray
- Laba aragtiyood oo la kordhiyey oo isku sawir ah oo ay tahay in ay u dhowaadaan meel bannaan
- Laba koobi oo ah kaydka xogta
- What annotation requirement can self-supervised pretraining reduce in the described examples?
- The need for any usable input data
- Separate task-specific semantic labels for every pretraining example
- All computational cost by definition
- The need to assess downstream performance
- How can a representation learned through self-supervision be used for a later task?
- By evaluating a task head or adapting the representation through fine-tuning
- By assuming every target task requires no labels or validation
- By discarding all representations before making predictions
- By treating the pretraining loss as proof of every application's accuracy
- Sidee buu shaqada is-maamulka uga duwan yahay kan BERT?
- Wax qoraal ah ma isticmaasho
- Waxay u baahan tahay summadaha gacanta ee kelmad kasta
- Kaliya waxay saadaalisaa erayga ugu horreeya ee dukumeentiga
- Waxay saadaalisaa calaamadda xigta halkii ay ka buuxin lahayd calaamado daboolan
- In the original SimCLR framework, which component is discarded for the reported downstream representation use?
- The encoder representation itself
- The contrastive projection head
- All training inputs before pretraining begins
- The positive-pair source-image relationship
- When original BERT pretraining replaces a selected input position with a random token, what remains its loss target?
- The newly inserted random token
- The next sentence's first token in every case
- The original token before replacement
- No target, because every random replacement is omitted from training