Nhungamiro yehunyanzvi

Probability Calibration

Calibration inoreva zvingangoitika zvemuenzaniso zvinofananidzira chokwadi: kana ichiti 70%, chiitiko chinofanira kuitika makumi manomwe muzana yenguva.

Teerera kugwaro iriAI-yakarondedzerwa · ~2 min

Pa peji ino2 min verenga
  1. Pfupiso
  2. Kudzika Kwakadzika
  3. Kuitwa muNyika yeChokwadi
  4. Ramangwana reKukwanisa Kugadziriswa
  5. Kuzvishandisa
  6. Ramba Uchiongorora
  7. Mibvunzo inowanzo bvunzwa

Pfupiso

Izvo zvine basa nekuti kuvimba kwakaringana kunotungamira sarudzo dzakanaka mukurapa, mari, uye njodzi-inoziva AI.

Kudzika Kwakadzika

Modhi inogona kuve yechokwadi asi yakanyatsogadziriswa. Manetiweki akadzika emazuva ano anozivikanwa nekunyanya kuzvivimba, achiburitsa 99% pakufungidzira kuri iko chaiko kushoma kazhinji. Calibration inoongorora izvi nekukasira kufanotaura nekuvimba uye nekutarisa frequency inocherechedzwa mubhaketi rega rega. Kuvimbika dhayagiramu zvirongwa zvakafanotaurwa maringe nechaiyo; muenzaniso wakanyatsogadziriswa unogara pane diagonal. Iyo Inotarisirwa Calibration Kanganiso (ECE) inopfupikisa gaka seavhareji yakayerwa pamabhini. Magadzirirwo anouya mumhando mbiri: post-hoc nzira sePlatt scaling (kukodzera a logistic shanduko), tembiricha scaling (kupatsanura matanda neakadzidza scalar T), uye isotonic regression (inotonic nhanho yakakodzera); uye nzira dzekudzidzira-nguva senge label kutsetseka kana kwakaringana kurasikirwa zvibodzwa. Calibration uye kurongeka zvinangwa zvakasiyana, uye kuvandudza chimwe hakufanirwe kuvandudza chimwe.

Kuitwa muNyika yeChokwadi

Basa remamiriro ekunze rinoita kuti fungidziro yemazuva ekunaya kwe30% mvura inyatsoona mvura inosvika makumi matatu kubva muzana yenguva yacho, chinangwa chekuverenga mabhuku.

Chikwereti-default modhi ine tembiricha-yakayerwa saka yakataurwa 5% default ngozi inoenderana ne5% yenhoroondo default rate yemitengo yezvikwereti.

Network yekuongororwa kwekurapa inodzokororwa neisotonic regression saka 'mukana mukuru wechirwere' unoratidza chiitiko chechokwadi varapi vasati vaita.

Iyo yekuzvityaira yekuona stack inogadzirisa kusavimbika kwechinhu saka 90% yevanofamba netsoka mamakisi inovimbwa zvakafanira nemodule yekuronga.

Ramangwana reKukwanisa Kugadziriswa

Sezvo AI inopinda ma-high-stakes loops, calibration inofamba kubva pakufunga kuenda kune zvinodiwa. Basa riri kukura rakanangana nekugadzirisa kusavimbika kwemhando yemutauro wakakura uye kusava nechokwadi kwemazwi, kuenzanisa pasi pekuchinja kwekugovera, uye kuenzanisa kweboka-hungwaru kuitira kuti zvingangoitika zvive zvakanaka pahuwandu hwehuwandu. Tarisira macalibration metrics padivi pekurongeka mumakadhi emodhi uye ongororo yezvemitemo, pamwe nekubatanidzwa kwakasimba nekufembera kwakasarudzika uye kufungidzira kwakasarudzika kuitira kuti masisitimu arambe akavimbika kana kuvimba kwavo kwakadzikira.

Kuzvishandisa

Nei zvichikosha

  • Mutengo uye bhajeti. Zvisarudzo zvezvivakwa zvinotyaira kuita uye mutengo wekushandisa kwemakore.
  • Sarudzo dzakajeka. Dzidzo yehunyanzvi inobatsira zvikwata kusarudza murwi wakakodzera, kwete iwo mutsva chete.
  • Kudzora kwemhando yepamusoro. Sarudzo dzeinjiniya dziri nani dzinoderedza zviitiko zvekuvimbika mukugadzira.

Chenjera

  • Kugadzirisa imwe bhenji kunogona kuvanza yakafara system kushaya simba.
  • Infrastructure uye mari yekugadzirisa inowanzotarisirwa pasi.
  • Chengetedzo uye kucherechedzwa mapundu anogona kukura sezvo masisitimu anowedzera kuoma.

Matanho anotevera

  1. Tsanangura latency, mhando, uye mutengo zvinangwa usati waitwa.
  2. Benchmark pasi pechokwadi mutoro uye data mamiriro.
  3. Chishandiso chekutarisa zvikanganiso, kudonha, uye mushandisi maitiro.
  4. Gadzirira nzira dzekudzosera kumashure uye dzezviitiko usati wawedzera.

Ramba Uchiongorora

Tsamba yemahara

Tora iyo yemazuva ese AI pfupiso

Nhatu dzakasimbiswa dzeAI nyaya mangwanani ega ega pakati pevhiki, dzakanyorwa neChirungu chakajeka. Yemahara zvachose, hapana ads.

Imwe email zuva rega rega revhiki. Bvisa kunyoresa kamwe chete. Hatimbotengese kana kugovera kero yako.

Zviedze iwe pachako

Take the Probability Calibration quiz

Mhinduro yepakarepo pamhinduro yega yega, uye chitupa chinogovaniswa chine ID inobatika kana wapedza kosi.

Tanga mibvunzo

Tsigira dzidzo yemahara yeAI. AI Understanding ndeye 501(c)(3) isingabatsiri - hapana ads, hapana paywall, zvachose. Ita chipo

Mibvunzo inowanzo bvunzwa

Chii chinonzi Probability Calibration?

Calibration inoreva zvingangoitika zvemuenzaniso zvinofananidzira chokwadi: kana ichiti 70%, chiitiko chinofanira kuitika makumi manomwe muzana yenguva. Izvo zvine basa nekuti kuvimba kwakaringana kunotungamira sarudzo dzakanaka mukurapa, mari, uye njodzi-inoziva AI.

Kuyera tembiricha kunoitei kune zvinobuda neural network?

Kuyeresa tembiricha kunopatsanura marogi neT imwe chete yakadzidzwa uyezve kushandisa softmax, kupfavisa kana kurodza zvingangoitika pasina kushandura argmax.

Chii chinomiririra dhiyagiramu yekuvimbika?

Chiratidzo chekuvimbika chinofananidza kuvimba kwakafanotaurwa kune chaiyo mhedzisiro frequency; iyo diagonal inomiririra calibration yakakwana.

Nei modhi yakarurama kwazvo ichiri kuda kugadziridzwa?

Modhi inogona kuisa fungidziro zvakanaka (yakanyanya kurongeka) asi ichipa zvisizvo zvingangove zvakakosha, saka calibration inofanirwa kutariswa zvakasiyana.

On which data is temperature scaling typically fit in the guide’s calibration workflow?

The guide says the single temperature is fit on validation data to minimize negative log-likelihood.

Why can temperature scaling improve calibration without changing top-1 accuracy?

A positive temperature rescales logits before softmax, adjusting confidence while preserving the argmax class.