Idanwo ti o sopọ mọ itọsọna · Alabọde Ipele
Idanwo Iṣapeye Ipin Idiwọn
Explains ORPO’s reference-model-free preference objective, odds-ratio penalty, and combined supervised and preference training.
Ibeere 1 ti 8
Kini anfani iwulo akọkọ ti ORPO lori awọn ọna bii DPO?
Awotẹlẹ gbogbo ibeere8 ibeere
Awọn idahun ati awọn alaye han bi o ṣe n mu ibeere naa.
- Kini anfani iwulo akọkọ ti ORPO lori awọn ọna bii DPO?
- O ṣe imukuro iwulo fun awoṣe itọkasi lọtọ
- Ko nilo data ikẹkọ rara
- O ṣiṣẹ nikan lori awọn awoṣe aworan
- O ṣe onigbọwọ awọn hallucinations odo
- Kini ipin 'awọn aidọgba' ni ORPO ṣe afiwe?
- Iyara ikẹkọ dipo deede
- Awọn aidọgba ti idahun ti o yan dipo esi ti a kọ
- Meji ti o yatọ eko awọn ošuwọn
- Iwọn awoṣe dipo iwọn dataset
- What form does an ORPO preference example contain?
- Only a single unlabeled response
- A prompt with two identical completions
- A prompt with one chosen response and one disfavored response
- A reward score with no associated responses
- How does ORPO convert a response probability p into odds?
- One minus p divided by p
- The square root of p
- The logarithm of the prompt length
- p divided by one minus p
- Ipadanu ORPO jẹ apejuwe ti o dara julọ bi apapo wo?
- SFT agbelebu-entropy pẹlu iwọn awọn aidọgba-ipin ààyò ààyò
- Nikan ere-awoṣe Dimegilio
- Ipadabọ ikẹkọ-imuduro mimọ
- Abẹrẹ ariwo laileto
- Which response receives the supervised fine-tuning component of ORPO?
- Only the rejected response
- The chosen or preferred response
- A response sampled after deployment
- No response; ORPO has no language-modeling term
- Which parameter controls the weight of ORPO’s preference term relative to the supervised loss?
- Iwọn fokabulari tokenizer
- Nọmba awọn olori akiyesi
- The preference-loss coefficient
- The prompt’s character count
- Why should an ORPO result report its preference data and evaluation setup?
- ORPO results are identical across datasets
- The objective removes the need for evaluation
- The number of model layers determines every preference
- Outcomes depend on the dataset, coefficient, base model, and evaluation