Guide-yakabatana mibvunzo · Pakati Nhanho

Kudzokorora Chirango uye Decoding Controls Mibvunzo

Enzanisa tembiricha, kumusoro-k, kumusoro-p, uye kudzokorora zvirango, kusanganisira machinjiro ezvirogi asati atora sampling muLLM chizvarwa workflows.

Nzira dzekutungamira dzinoenderanaKudzokorora Chirango Uye Decoding Controls
Mubvunzo 1 ye 8

Ko kusimudza 'temperature' parameter kunoitei kune kubuda kwemodhi?

Tarisa mubvunzo wese8 mibvunzo

Mhinduro uye tsananguro zvinoonekwa paunenge uchitora bvunzo.

  1. Ko kusimudza 'temperature' parameter kunoitei kune kubuda kwemodhi?
    • Inoita kuti zvive zvakasiyana uye zvakasiyana
    • Inoita kuti iwedzere deterministic uye yakanangana
    • Anoshandura zvachose zviyero zvemuenzaniso
    • Inomhanyisa chizvarwa
  2. Ko top-p (nucleus) sampling inosarudza sei ma tokens ekufunga?
    • Inochengetedza nhamba yakatarwa yematokeni pasinei nokuti zvingaita sei
    • Inochengeta diki seti yematokeni ayo mikana inosvika pachikumbaridzo
    • Inochengeta chiratidzo chimwe chete chingangoitika
    • Inochengeta ma tokens ane mukana uri pamusoro pe50%
  3. Murango wokudzokorora unowanzoita padanho ripi?
    • Pamusoro pezvinyorwa zvakasvibiswa mushure mechizvarwa
    • Pamusoro pe data yekudzidzira
    • Pazvinyorwa pamberi pe softmax
    • On the tokenizer vocabulary
  4. MuOpenAI's text-generation API, kuvapo uye frequency zvirango zvinosiyana sei?
    • Kuvapo zviyero zvechirango zvine chiratidzo chekuverenga; frequency penalty is flat
    • Vakafanana
    • Ose ari maviri anongoshanda kune yekutanga chiratidzo
    • Frequency chirango chikero chine kangani chiratidzo chakaonekwa; chirango chekuvapo chinoshanda kamwe chete kana chakaonekwa zvachose
  5. Kuti upedze kodhi uko deterministic sampling inodiwa, ndeipi yekuseta inonyatsoenderana negwara?
    • Tembiricha iri pedyo ne zero
    • Kupisa kwakanyanya
    • Yakakwira yekudzokorora chirango pamusoro pe 2.0
    • Pamusoro-p ye1.0 ine kupisa kwakanyanya
  6. Top-k sampling inoitei?
    • Inochengeta ma tokens achipfupisa kune zvingangoita k
    • Inongochengeta k chete ma tokeni angangoitika sevanokwikwidza
    • Inowanza zvinhu zvese ne k
    • Inobvisa k zvishoma zvingangoitika zviratidzo kubva pakudzidziswa
  7. Nechirango chekudzokorora pamusoro pe1, processor yakajairwa inogadzirisa sei chiratidzo chakamboonekwa?
    • Iyo inoisa yega yega-inodzokororwa-token logit kusvika zero
    • Zvinowedzera chirango kune chese chiratidzo zvakaenzana
    • Inopatsanura gititi yakanaka nechirango uye inowanza iyo yakaipa logit nayo
    • Inobvisa chiratidzo kubva muduramazwi zvachose
  8. Top-k inosiyana sei netop-p sampling?
    • Pamusoro-k inoshandisa mukana wekuwedzera ukuwo top-p inogadzirisa kuverenga
    • Pamusoro-k inoshandura uremu hwemhando apo top-p inoshandura tokenizer
    • Iwo ese ari maviri deterministic decoding nzira
    • Pamusoro-k inochengeta nhamba yakatarwa yevanoda; top-p inochengeta mukana-misa-yakavakirwa seti