Ku laabo Warka
Hal-abuurnimoAI Understanding warbixin kooban

Cilmi baadhayaashu waxay soo bandhigaan AutoTuneBench si loo cabbiro la aamini karo ee matoorada u adeegaya LLM

Bartakoolka cabbiraadda iyo cabbiraadda cusub ee wakiillada moodeelka luqadda ayaa la soo bandhigay, isaga oo ka hadlaya afar hab oo guuldarraystayaal ah oo hababka cabbiraadda jira.

By 4 min readRead the primary source
Source-page capture accompanying Researchers present AutoTuneBench for trustworthy measurement of LLM serving engines
Dukumeentiga isha aasaasiga ahIsha la duubay
Daabacaha
arxiv.org
Xidhiidhka isha
arxiv.orghttps://arxiv.org/abs/2609.18123
Nooca isha
Dukumeentiga aasaasiga ah - ogeysiis rasmi ah, warqad, xereyn, ama bogga xisbiga koowaad waxaan si toos ah u akhrinay.
Dulucda sheekadaKu fahan tan 60 ilbiriqsi gudahood

Halkan ka bilow

Qodobbada muhiimka ah

Qaabka Luuqadda Weyn (LLM)
Qaab luqadeed oo lagu tabobaray qoraalka weyn si loo soo saaro oo loo falanqeeyo qoraalka.
Benchmark
Tijaabo la habeeyey ama kayd xogeed oo loo isticmaalo in lagu cabbiro laguna barbar dhigo waxqabadka moodeelka.
Is tijaabiWaa maxay AI? Kedis

Maxaa dhacay

Cilmi baadhayaashu waxay soo saareen AutoTuneBench, bar-tilmaameedka iyo borotokoolka cabbiraadda ee wakiilada tusaalaha luqadda waaweyn. Hab-maamuusku waxa uu ka hadlayaa afar hab oo guul-darraystayaal ah oo ku jira hababka cabbiraadda ee jira: gundhigga strawman, waqtiyo dhammaystiran oo aan la wareejin karin, hawlo buuxa, iyo cilladaha kaabayaasha. AutoTuneBench waxaa loogu talagalay inay bixiso cabbirro la aamini karo iyadoo la qaboojinayo hab-maamuuska kood ahaan, dhaqan gelinta tijaabada-caddaynta, iyo adeegsiga ansaxiyaha heerka xogta xogta si loo diido natiijooyinka borotokoolka ka baxsan.

Cilmi-baadhayaashu waxay caddeeyeen afar hab oo guuldarro ah oo ku jira hababka cabbirka ee jira: gundhigga strawman, waqtiyo aan la wareejin karin, hawlo buuxa, iyo cilladaha kaabayaasha.

AutoTuneBench waxay wax ka qabataa hababkan guuldarrooyinka iyadoo dejinaysa borotokoolka sidii kood, dhaqan gelinta tijaabada, iyo adeegsiga ansaxiyaha heerka xogta xogta si ay u diido natiijooyinka borotokoolka ka baxsan.

Hab-maamuuska waxaa loogu talagalay inuu bixiyo cabbirro la aamini karo iyadoo lagu dhejinayo natiijooyinka dibedda laga daabacay, oo ku saleysan tirakoobka abuur-lammaanaha ah oo leh 5% koofiyad-isweydaarsi-is-gudbin-is-gudbineed-is-beddelka.

Cilmi-baarayaashu waxay muujiyeen waxtarka AutoTuneBench iyagoo barbardhigay natiijooyinkeeda kuwa hababka cabbirka ee jira.

Natiijooyinka waxay muujiyeen in AutoTuneBench ay bixisay cabbirro sax ah oo la isku halleyn karo, oo leh xawaare dhexdhexaad ah 1.0001x oo ka sarreeya xiisaha PyTorch.

Faahfaahinta isha: arxiv.org ↗

Maxay muhiim u tahay

Horumarinta AutoTuneBench waa mid muhiim ah sababtoo ah waxay ka hadlaysaa arrin xasaasi ah oo ku saabsan wakiillada qaabka luqadda waaweyn. Hababka cabbirka ee jira inta badan waa cillado, taasoo keenta natiijooyin aan sax ahayn oo aan la isku halleyn karin. AutoTuneBench waxay bixisaa hab-maamuus qiyaaseed lagu kalsoonaan karo oo loo isticmaali karo in lagu qiimeeyo waxqabadka wakiilada LLM. Tani waxay si gaar ah muhiim ugu tahay codsiyada halka cabbirada saxda ah ee la isku halayn karo ay muhiim yihiin, sida go'aan-qaadashada sare-u-qaadista ama xaaladaha cawaaqibka cabbirrada aan saxda ahayn ay daran yihiin.

Horumarinta AutoTuneBench waa mid muhiim ah sababtoo ah waxay ka hadlaysaa arrin xasaasi ah oo ku saabsan wakiillada qaabka luqadda waaweyn.

Hababka cabbirka ee jira inta badan waa cillado, taasoo keenta natiijooyin aan sax ahayn oo aan la isku halleyn karin.

AutoTuneBench waxay bixisaa hab-maamuus qiyaaseed lagu kalsoonaan karo oo loo isticmaali karo in lagu qiimeeyo waxqabadka wakiilada LLM.

Tani waxay si gaar ah muhiim ugu tahay codsiyada halka cabbirada saxda ah ee la isku halayn karo ay muhiim yihiin, sida go'aan-qaadashada sare-u-qaadista ama xaaladaha cawaaqibka cabbirrada aan saxda ahayn ay daran yihiin.

Horumarinta AutoTuneBench waxay muujineysaa baahida loo qabo habab cabbiraadyo adag oo lagu kalsoonaan karo oo ku saabsan AI.

Interactive Mechanism

Farsamaynta Is-dhexgalka: Sida Dhabta Ay U Shaqeyso

U baadh tignoolajiyada hoose ee ka dambeeya horumarkan si isdhexgal leh.

Agent Lifecycle Stage:
1
User Intent & Planning: "Audit customer refund request #4092 and settle payment."
2
Tool Calling: Emits structured JSON call crm_get_transaction(id='4092').
3
Guardrail & Verification:🛡️ Paused: High-value action requires human operator sign-off.
4
Final Settlement: Refund recorded, email receipt dispatched, and audit log stored.
Core takeaway: An AI agent is not just a language model—it is a closed loop of planning, tool invocation, and environment feedback. Production systems require self-healing retries and strict human approval guardrails.
Hubinta Fikradda Is-dhexgalka+10 Points
What is AI? Quiz

A route planner searches possible journeys using explicit rules. What does this illustrate about AI?

Maxaa la daawan doona xiga

Saamaynta AutoTuneBench ee goobta wakiillada moodeelka luqadda weyn ayaa noqon doona mid muhiim ah. Waxay bixin doontaa hab-maamuuska cabbiraadda la aamini karo oo loo isticmaali karo in lagu qiimeeyo waxqabadka wakiilada LLM. Tani waxay awood u siin doontaa cilmi-baarayaasha iyo horumarinta si ay u sameeyaan cabbirro sax ah oo la isku halleyn karo, taasoo horseedaysa go'aan-qaadasho wanaagsan iyo codsiyo waxtar leh. Intaa waxaa dheer, horumarinta AutoTuneBench waxay muujineysaa baahida loo qabo habab cabbirro adag oo lagu kalsoonaan karo oo ku saabsan AI.

Saamaynta AutoTuneBench ee goobta wakiillada moodeelka luqadda weyn ayaa noqon doona mid muhiim ah.

Waxay bixin doontaa hab-maamuuska cabbiraadda la aamini karo oo loo isticmaali karo in lagu qiimeeyo waxqabadka wakiilada LLM.

Tani waxay awood u siin doontaa cilmi-baarayaasha iyo horumarinta si ay u sameeyaan cabbirro sax ah oo la isku halleyn karo, taasoo horseedaysa go'aan-qaadasho wanaagsan iyo codsiyo waxtar leh.

Intaa waxaa dheer, horumarinta AutoTuneBench waxay muujineysaa baahida loo qabo habab cabbirro adag oo lagu kalsoonaan karo oo ku saabsan AI.

Cilmi baadhayaashu waxay qorsheynayaan inay sii wadaan horumarinta iyo sifaynta AutoTuneBench si loo hubiyo waxtarkeeda iyo isku halaynta.

Tilmaamaha la xidhiidha & su'aalaha

Waa maxay AI?Wakiilada AIMoodooyinka AI ayaa la sharaxayTransformersTababarka AITijaabi waxaad taqaan - isku day kedis AI oo bilaash ahKa raadi erey AI qaamuuskeenaRaac qaabka AI raadraaca sii deynta
Tan faa'iido ma u heshay?