Kuiz Permodelan Bahasa

Jawapan dan penjelasan muncul semasa anda mengambil kuiz.

1. Dalam rumusan model bahasa autoregresif yang dinyatakan, apakah yang diramalkan daripada konteks token sebelumnya?
   • A probability distribution for the next token
   • The original file's alphabetical rank
   • Only a temperature measurement from the device
   • A mandatory image label with no sequence information
2. Had yang manakah harus dipertimbangkan untuk model bahasa n-gram sejarah pendek?
   • A requirement that all n-gram models reject every unseen sequence even with smoothing
   • A guarantee of unlimited history
   • A requirement to process only images
   • Limited context and possible zero probabilities for unseen continuations without smoothing
3. Mengapakah pralatihan model bahasa token seterusnya boleh mendapatkan sasaran tanpa anotasi kelas yang berasingan untuk setiap kedudukan?
   • The model has no training objective
   • The target next tokens are already present in the observed text
   • All training text must have been generated by the same model
   • Every position requires an external image classifier
4. Bagaimanakah penjanaan teks autoregresif menggunakan token sambungan yang dipilih?
   • It predicts every future token independently in one step
   • It discards every selected token before the next prediction
   • It appends the token and uses available earlier output as context for later predictions
   • It changes the training labels to future deployment outcomes
5. Objektif manakah yang biasanya diminimumkan untuk persediaan latihan token seterusnya autoregresif yang dinyatakan?
   • Squared numerical distance between alphabetical token ID values
   • Only the number of tokens in an output filename
   • Only hinge loss on image-pixel locations
   • Cross-entropy or negative log-likelihood for observed target tokens
6. What do temperature and top-p choices affect during sampled language-model generation?
   • How continuation tokens are selected from model scores
   • The number of trained layers after every token
   • A guarantee that all output claims become true
   • The label written in every observed training sequence
7. During teacher-forced next-token training, where does the preceding context for a target token come from?
   • Only the model's freely sampled earlier output
   • A randomly generated replacement corpus at every position
   • The observed training sequence
   • The final evaluation labels supplied after deployment
8. A stated two-token prefix has probabilities 0.5 for the first token and 0.2 for the second given the first. What is its joint prefix probability?
   • 0.7
   • 0.1
   • 0.4
   • 0.3