Dzokera kuNhau
InnovationAI Understanding muchidimbu

AFDBench inoedza kana AI inogona kunyora nhaurirano dzeNational Weather Service kubva kumamiriro ekunze

Chinyorwa chitsva chinosuma AFDBench, bhenji rekuyedza kana mhando dzemitauro dzinogona kushandura mamiriro ekunze eAI akarongwa kuita nhaurirano dzakanyorwa nehunyanzvi National Weather Service.

5 min readRead the primary source
Primary-source image accompanying AFDBench tests whether AI can write National Weather Service forecast discussions from weather data
Primary-source documentKwakanyorwa
Muparidzi
arxiv.org
Source link
arxiv.orghttps://arxiv.org/abs/2608.24954
Source type
Gwaro rekutanga - chiziviso chepamutemo, bepa, faira, kana peji rebato rekutanga ratinoverenga zvakananga.
ContextNzwisisa izvi mumasekonzi makumi matanhatu

Tanga pano

Matemu akakosha

Kusimbisa Kudzidza
Kudzidziswa nemasaini masaini apo mumiririri anodzidza zviito zvinowedzera kudzoka kwenguva refu.
Tembiricha
Sampling setting inodzora kusarongeka mune zvakabuda.
Benchmark
Muedzo wakamisikidzwa kana dhatabheti rinoshandiswa kuyera nekuenzanisa kuita kwemuenzaniso.
Zviedze iwe pachakoAI Models Inotsanangurwa Mibvunzo

Chii chaitika

Vatsvagiri vakaunza AFDBench, bhenji uye AI meteorologist system yakagadzirirwa kuburitsa National Weather Service Area Forecast Hurukuro kubva kune yakarongeka data yekufungidzira. Vanoshuma kuti kudzidza kwekusimudzira kwakavandudza 7-bhiriyoni-parameta maitiro ehunyanzvi uye kutendeka kune yayo mamiriro ekunze pamasampuli akabatwa kubva kumahofisi maviri asina kumboonekwa eNWS.

Vanyori vanopa AFDBench sechiratidziro chekugadzira meteorological kufunga. Iyo ine 7,732 nyanzvi-yakanyorwa Nzvimbo Yekufembera Hurukuro kubva kumahofisi gumi nematatu eNational Weather Service, akapetwa nezvinotsanangurwa nebepa semagadzirirwo emamiriro ekunze eAI chaiwo. Mucherechedzo unoitirwa kuyedza kana modhi yemutauro inogona kuburitsa mhando yenhaurirano yakasarudzika inoshandiswa nevanofanotaura, asi ichiramba yakatendeka kune yakarongwa ruzivo rwunopihwa kwairi. Bepa rinoratidza huroro hwenhamba senjodzi muzvinyorwa zvepamusoro zvemeteorological. Iyo inoshandisa matatu metrics ane akasiyana tarenda. Met-Align inoyera kurongeka kwenhamba, Chimiro-Gadzirisa kuomerera kumutauro wehunyanzvi une chekuita nenhaurirano dzeNWS, uye Input-Grounding inoyera kuvimbika kune kwakabva data yemamiriro ekunze.

Kuparadzaniswa uku kunokosha nekuti nhaurirano yakagadzirwa inogona kunzwika sehunyanzvi paunenge uchichinja tembiricha kana kuwedzera ruzivo rwakanga rwusipo mukupinza. Kwainobva hakupi tsananguro izere, zvibodzwa maitiro kana mienzaniso yeaya metrics, saka abstract chete hairatidze kuti inoenzaniswa sei neyakasimbiswa meteorological verification maitiro. Mune zero-shot ongororo, vanyori vanotaura kuti yakavhurika-mabviro emitauro modhi akawana yakaderera Style-Align zvibodzwa zvingangoita 0.33 uye zvine mwero Input-Grounding inosvika 0.88. Vanoturikira mhinduro idzodzo sehumbowo hwekuti mamodheru aiwanzotadza kuburitsa rejista yeNWS yehunyanzvi uye kusagara vachishandisa data ravo rekuisa nekutendeka. Kwainobva haazivise modhi yega yega yakaongororwa, ipa inoenderana neMet-Align mibairo, kana kutsanangura mavambo ekutanga uye decoding marongero.

Vatsvagiri vakabva vashandisa Boka Relative Policy Optimization, nzira yekusimbisa-yekudzidza, vachishandisa domain-yakananga mibairo yekurongeka kwekushisa, kurongeka kwe synoptic uye kutevedzera fomati. Pa1,033 akabatwa-kunze samples kubva kumahofisi maviri eNWS asina kushandiswa kuongororwa kwekudzidziswa, vanoti Style-Align yakawedzera kubva pa0.318 kusvika 0.619 uye Input-Grounding yakasimuka kubva pa0.881 kuenda pa0.940. Bepa rinoratidza izvi sezvinenge zvakapetwa kaviri kurongeka kwehunyanzvi uye kugadzirisa nzvimbo ye7-bhiriyoni-parameter modhi.

Sosi haritauri kuti AFDBench kana modhi yakatumirwa neNational Weather Service, uye haigadzirise kuita kwechokwadi-nguva.

Kwakabva mashoko: arxiv.org ↗

Nei zvichikosha

Hurukuro dzezvemamiriro ekunze dzinopa ruzivo rwakaoma rwemamiriro ekunze, saka kukanganisa kwenhamba kana zvirevo zvisingatsigirwe zvinogona kukanganisa manzwisisiro anoita ruzivo rwemamiriro ekunze. Mupiro mukuru webepa igadziriro yekuongorora inoparadzanisa kurongeka kwenhamba, chimiro chehunyanzvi uye kuvimbika kuburitsa data pachinzvimbo chekubata kunyora kwakatsetseka sehumbowo hwechokwadi chepfungwa dzemamiriro ekunze.

Basa racho rinogadzirisa dambudziko rakavimbika muAI-yakagadzirwa nesainzi uye yeruzhinji-chengetedzo kutaurirana: mutauro wakatsetseka unogona kuvanza nhamba dzisiridzo. Muhurukuro yezvinoitika, kuchinja kuduku kwenhamba kungachinja zvinorehwa nemamiriro okunze kana kuti kusimbiswa kunoitwa njodzi. Nekuongorora kurongeka kwenhamba uye kudzika kwakavakirwa zvakasiyana nemaitiro ekunyora, AFDBench inopa nzira yekuona kutadza kunokwanisa kupotsa mutauro wakakwana. Iyo inotarisisa zvakare pamutauro wakanangana nedomasi. Nhaurirano dzeNational Weather Service dzinoshandisa zvibvumirano zvehunyanzvi zvine zvazvinoreva kune vanofanotaura asi zvinogona kusatorwa nematanho akajairwa ezvivakamutauro kana kuverenga.

Kuwedzera kwakashumwa kweStyle-Align kunoratidza, maererano nevanyori, kuti kudzidziswa kwakanangwa kunogona kudzidzisa modhi diki kubereka magungano iwayo zvakanyanya. Izvo hazviratidze kuti modhi inonzwisisa kushanduka kwemamiriro ekunze nenzira yakafanana neyemamiriro ekunze kana kuti stylistic conformity inovimbisa kufanotaura chaiko. Iyo yakashumwa yakabatwa-yekuongorora inogona kubatsira nekuti inosanganisira mahofisi maviri asina kumiririrwa mune yekudzidziswa data inotsanangurwa nebepa. Iyo dhizaini inoedza imwe dhigirii yekufambisa kupfuura mahofisi anoshandiswa kuvaka bhenji. Zvakadaro, kwabva hakuna kutaura kana mahofisi akavharirwa akasiyana mune geography, kufanotaura basa, mamiriro ekunze kana maitiro ekunyora, uye hazvipi fungidziro yekufungidzira kana ruzivo rwehuwandu. Migumisiro naizvozvo inotsigira bhenji rinovimbisa uye kuvandudzwa kwakashumwa, asi kwete chirevo chakazara chekuvimbika kwekushanda.

Kukosha kwebepa kunogona kuwedzera kupfuura kunyora kwemamiriro ekunze kana maitiro ayo ekuongorora akanzwika: masisitimu anoburitsa manyoro ehunyanzvi epamusoro anofanirwa kutariswa zvichienderana nezviyero zvekwakabva, zvibvumirano zvedomasi uye zvisingatsigirwi zvinowedzera semibvunzo yakasiyana. Zvakadaro, chirevo ichi chinobva kune chimiro cheiyo bhenjimark yakatsanangurwa kwete kubva kune yakaratidza kutumirwa kunze kwemeteorology. Sosi yacho haipe humbowo nezvemhedzisiro payambiro yeveruzhinji, kufanotaura basa, chokwadi chekufanotaura kana sarudzo dzakaitwa nevaverengi.

Interactive Mechanism

Interactive Mechanism: Iyo Inonyatsoshanda

Ongorora ari pasi tekinoroji kuseri kwekusimudzira uku uchipindirana.

Thinking Budget (Test-Time Tokens):1,024 tokens
Complex Accuracy79%Math & Code Logic
Latency3.2sTime to first full output
Inference Cost$0.0092Per query estimated
Reasoning StyleStep VerificationInternal chain depth
Active Thinking Trace:
1Deconstruct user problem into formal constraints
2Propose candidate hypotheses & step-by-step calculation
3Self-correction: Backtrack and refute subtle edge cases
4Exhaustive consistency check & final output synthesis
Core takeaway: Test-time compute fundamentally changes AI economics. Instead of only scaling during pre-training, giving reasoning models more tokens at inference time allows them to systematically solve PhD-level STEM problems.
Interactive Concept Check+10 Points
AI Models Explained Quiz

Which component of an AI application is the machine-learning model itself?

Zvekutarisa zvinotevera

Mhedzisiro yakashumwa inobva kune imwe preprint uye yakaganhurirwa-yakabatwa-evaluation. Kumwe ongororo kunofanirwa kuona kana zvakawanwa zviri mumahofisi akawanda, mamiriro ekunze uye mhuri dzemhando, kuti hurongwa uhwu hunovandudza dudziro yekufanotaura kwete matauriro ahwo chete, uye kuti hunoita sei mukuongororwa kwakaitwa nenyanzvi dzemamiriro ekunze.

Nyaya yekutanga kuona ndeye kuzvimiririra kubereka. Sosi yacho ndeye arXiv preprint yakaunzwa muna Nyamavhuvhu 25, 2026, uye zvinhu zvakapihwa hazvina chimiro chekuongorora-vezera kana kuzvimiririra. Vatsvagiri nevarapi vanozoda kuongorora iyo yakazara bhenji, tsananguro yemetric, maitiro ekudzidzisa uye data-pairing maitiro kuti vaone kana kuvandudzwa kwakataurwa kwakasimba uye kugoneka.

Evaluation hupamhi ndomumwe mubvunzo wakavhurika. AFDBench inosanganisira zvinhu kubva kumahofisi gumi nenhatu eNWS, asi iyo yakashumwa yekusimudzira-kudzidza mhedzisiro yakavakirwa pa1,033 yakabatwa-kunze samples kubva kumahofisi maviri asingaonekwe. Kwabva hakutauri kuti zvingani zviitiko zvemamiriro ekunze, matunhu ekufanotaura kana mamiriro emwaka iwo masampuli anomiririra. Kuedza kune mamwe mahofisi uye mamiriro asina kujairika kana kukurumidza kuchinja kwaizobatsira kuratidza kana zvakawanwa zvichiratidza kukosha kwemamiriro ekunze kana kuenderana nemaitiro anodzokororwa ezvinyorwa.

Hukama huri pakati pemhando yekunyora uye kufunga kwekufungidzira zvakare hunoramba husina kugadziriswa. Vanyori vanopa mubairo kunyatsoita tembiricha, kurongeka kweiyo synoptic uye kutevedzera mafomati, asi chirevo hachitsanangure kana meteorologist yevanhu vakaongorora nhaurirano dzakagadzirwa, ingave hurongwa hwakaratidza kusavimbika nenzira kwayo, kana kuti yakachengetedza makomba akakosha. Mhedzisiro yeramangwana inofanirwa kusiyanisa modhi inodhirowa yakapihwa ruzivo kubva kune iyo inogona kududzira nekuvimbika yakaoma kana kupokana yekufungidzira.

Pakupedzisira, sosi yacho inosiya mibvunzo inoshanda yekutumirwa isina kupindurwa. Hazvitauri kana sisitimu yacho ichiwanikwa pachena, yakabatana nekurarama WeatherNext 2 feed, yakatenderwa kushandiswa kweNWS, yakaongororwa pasi pezvirambidzo zvenguva chaiyo kana kuedzwa maererano nenhaurirano dzakanyorerwa nevanhu mukugadzira. Chero kutorwa kwemwana kunodawo ongororo yemunhu yakajeka uye maitiro ekuzvidavirira, kunyanya nekuti bepa racho pacharo rinogadzira mafiremu akajeka manhamba senjodzi. Kusvika iyo mibvunzo yapindurwa, AFDBench inonzwisiswa zvakanyanya sebhenji rekutsvagisa uye yakashumwa modhi-yekudzidziswa mhedzisiro, kwete sehumbowo hwekuti AI inogona yakazvimirira kuita mashandiro ekufungidzira kutaurirana.

Related guides & Quizzes

AI Models InotsanangurwaKudzidziswa kweAITsika dzeAITransformersEdza zvaunoziva - edza yemahara AI quizTarisa kumusoro izwi reAI mune yedu glossaryTevedza iyo AI modhi yekuburitsa tracker
Wakawana izvi zvinobatsira?