Buyela Ezindabeni
UkuqambaAI Understanding ukwaziswa

Ukuhlola Ukusebenza Kwekhono Lomenzeli we-AI nge-NVIDIA SkillEvaluator

I-NVIDIA SkillEvaluator ikala umthelela wamakhono aqinisekisiwe ekusebenzeni komenzeli we-AI ngenqubo yokuhlola yezigaba ezintathu.

7 min readRead the primary source
Source-provided image accompanying Evaluating AI Agent Skill Performance with NVIDIA SkillEvaluator
Idokhumenti yomthombo oyinhlokoUmthombo urekhodiwe
Umshicileli
developer.nvidia.com
Isixhumanisi somthombo
developer.nvidia.comhttps://developer.nvidia.com/blog/evaluating-ai-agent-skill-performance-with-nvidia-skillevaluator/
Uhlobo lomthombo
Idokhumenti eyisisekelo — isimemezelo esisemthethweni, iphepha, ukugcwalisa, noma ikhasi lomuntu wokuqala esilifunda ngokuqondile.
UmongoQonda lokhu ngemizuzwana engama-60

Qala lapha

Imigomo ebalulekile

Umenzeli we-AI
Isistimu yesofthiwe engabuka, icabange, futhi ithathe izinyathelo zokufeza umgomo, ngokuvamile isebenzisa amathuluzi nenkumbulo.
Isethi yedatha
Iqoqo lezibonelo ezihlelekile noma ezingahlelekile ezisetshenziselwa ukuqeqeshwa, ukuqinisekiswa, noma ukuhlola.
Uphawu
Isiqephu sombhalo esicutshungulwe amamodeli olimi, njengesiqephu segama noma uphawu.
ZihloleYini i-AI? Imibuzo

Kwenzekeni

I-NVIDIA SkillEvaluator iyithuluzi lomthombo ovulekile lokulinganisa ukuthi amakhono akuthinta kanjani ukusebenza kwe-ejenti ngokuhlola okumile kanye nomsebenzi womhlaba wangempela owenziwa ngaphandle nangaphandle kwekhono ngalinye. Ithuluzi lihlola amakhono kuyo yonke imikhiqizo engu-30+ ye-NVIDIA futhi libonisa Ukukhushulwa Kwekhono Okubalulekile Ekulumbeni, Ukutholakala, Ukusebenza, kanye Nempumelelo, ngezinzuzo ezimaphakathi zamaphoyinti angu-31 isiyonke kanye namaphoyinti angu-39 ngaphandle kokuvikeleka.

I-NVIDIA SkillEvaluator iyithuluzi lomthombo ovulekile lokulinganisa ukuthi amakhono akuthinta kanjani ukusebenza kwe-ejenti ngokuhlola okumile kanye nomsebenzi womhlaba wangempela owenziwa ngaphandle nangaphandle kwekhono ngalinye. Ukuqhathanisa kwakhelwa emsebenzini ofanayo we-ejenti owenziwayo futhi ngaphandle kwekhono elifanele, ngakho umehluko olinganiselwe uhlala uxhumene nekhono elibuyekezwayo. Ukuhlola okungaguquki nokusebenza komhlaba wangempela ngakho-ke kusebenza njengezingxenye ezimbili zesilinganiso esichazwe ithuluzi. Ngokuhlangene, banikeza isisekelo sokulinganisa ukuthi amakhono athinta kanjani ukusebenza kwe-ejenti.

Ithuluzi lihlola amakhono kuyo yonke imikhiqizo engu-30+ ye-NVIDIA futhi libonisa Ukukhushulwa Kwekhono Okubalulekile Ekulumbeni, Ukutholakala, Ukusebenza, kanye Nempumelelo, ngezinzuzo ezimaphakathi zamaphoyinti angu-31 isiyonke kanye namaphoyinti angu-39 ngaphandle kokuvikeleka. Ubukhulu obubikiwe benza imiphumela ifundeke kuyo yonke imikhiqizo ehlolwayo. Ukulunga, Ukutholakala, Ukusebenza, kanye Nempumelelo kuchaza izinhlobo ezisohlwini Zokuphakanyiswa Kwekhono, kuyilapho izilinganiso zifingqa izinzuzo ezishiwo zizonke kanye nomphumela oshiwo ngaphandle Kokuvikeleka. Ukufakwa komkhiqizo kanye nama-avareji amabili ayingxenye yesithombe esifanayo sokuhlola.

Imiphumela yokuhlola iqokomisa okutholakele okuthathu okusebenzayo kwamakhono omenzeli wokwakha nokuhlola amaqembu: amasethi edatha okuhlaziya akhiqiza amakhono angcono, umkhiqizo ubaluleke kakhulu kunomenzeli, futhi ukonga amathokheni akuzenzakaleli. Lokhu okutholakele kuxhumanisa inqubo yokulinganisa nomsebenzi ongokoqobo wokwakha nokuhlola amakhono. Zichaza ukuthi ikhwalithi yedathasethi yokuhlola ililolonga kanjani ikhono eliwumphumela, ukuthi umehluko womkhiqizo udlula kanjani umehluko wamahanisi, nokuthi kungani ukusetshenziswa kwamathokheni kufanele kuhlolwe ngokuhlukana kunokuba kucatshangwe ukuthi kuyathuthuka. Iphuzu ngalinye lilandela kokutholakele okwethulwe nemiphumela yokuhlola.

Ikhono lethuluzi lokulinganisa umthelela wamakhono aqinisekisiwe ekusebenzeni komenzeli we-AI kanye nokuphakanyiswa kwekhono okubalulekile kobukhulu obuhlukahlukene. Lesi silinganiso siyisizathu esiyinhloko sokusebenzisa ithuluzi: sishintsha umphumela wekhono eliqinisekisiwe ekusebenzeni komenzeli ube umphumela wokuhlola. Ubukhulu bokuphakamisa ikhono esohlwini bunikeza lowo mphumela izindlela ezimbalwa ezihlukile zokufunda, kuyilapho kugxilwe emthelela wekhono ngokwalo. Inani layo kulo mongo liyikhono lokuhlola umphumela oshiwo wokusebenza.

Inqubo yokuhlola yezigaba ezintathu zethuluzi, ehlanganisa ukuhlola okumile, ukuhlaziya okuhlukile, nemisebenzi ebukhoma eyenziwa ezindaweni ezingazodwa. Ukuhlola okumile, ukuhlaziya okuhlukile, nokusebenza okubukhoma kwemisebenzi kumele izendlalelo ezintathu ezishiwo zokuhlola zethuluzi. Ukugijima okubukhoma kwenzeka ezindaweni ezingazodwa, futhi inhlanganisela nokuhlola okumile nokuhlaziya okuhlukile kugcina inqubo ixhumene kukho kokubili ikhono ngokwalo kanye nokusebenza kwalo okubhekiwe. Lena inqubo esetshenziselwa ukukhiqiza izilinganiso ezichazwe ngenhla.

Imininingwane yomthombo: developer.nvidia.com

Kungani kubalulekile

Imiphumela yokuhlola iqokomisa okutholakele okuthathu okusebenzayo kwamakhono omenzeli wokwakha nokuhlola amaqembu: amasethi edatha okuhlaziya akhiqiza amakhono angcono, umkhiqizo ubaluleke kakhulu kunomenzeli, futhi ukonga amathokheni akuzenzakaleli.

Amasethi edatha okuhlola angcono akhiqiza amakhono angcono, njengoba amaqembu ayichaza ngokucacile imisebenzi ebalulekile, imiphumela elindelekile, kanye nezicelo ezingaphandle kobubanzi zikhiqiza amasignali okuhlola abukhali. Izincazelo ezicacile zomsebenzi ziqinisekisa ukuthi ukuhlola kuhloselwe ukukuhlolisisa ini, imiphumela elindelekile iveza ukuthi umphumela oyimpumelelo kufanele uqukathe ini, futhi izicelo ezingaphandle kobubanzi zibeka lokho okungafanele kufakwe. Ndawonye, ​​lezo zici zenza isignali yokuhlola ibe lula, yingakho ikhwalithi yedathasethi ingenye yezinto ezitholakalayo ezisebenzayo zamakhono omenzeli wokwakha nokuhlola amaqembu.

Umkhiqizo ubaluleke kakhulu kune-ejenti, njengoba i-Skill Lift ihlukahluka kakhulu kuyo yonke imikhiqizo kunawo wonke amahhanisi. Ngakho-ke ukuqhathanisa kugxile engqikithini yomkhiqizo lapho kusetshenziswa khona ikhono. I-Skill Lift ingahluka kakhulu phakathi kwemikhiqizo kunaphakathi kwamahhanisi, ngakho ukuhlola okuqondene nomkhiqizo kuhlala kubalulekile uma amaqembu ehumusha imiphumela. Lokhu okutholakele kugcina kugxilwe emthonjeni oshiwo wokuhlukahluka esikhundleni sokuphatha ihhanisi njengencazelo eyinhloko.

Ukonga amathokheni akuzenzakaleli, njengoba ithuluzi lilandelela ukusetshenziswa kwethokheni ngokuhlukile kokuthi Ukusebenza kahle futhi liveze ukuthi ikhono lithuthukisa ithokheni nokusebenza kahle noma lidinga ukulungiselelwa okwengeziwe. Isilinganiso esihlukile samathokheni sivimbela amaqembu ukuthi aphathe yonke inzuzo yokusebenza njengenzuzo yamathokheni. Ibonisa ukuthi ingabe ikhono lithuthukisa ithokheni nokusebenza kahle, noma ukuthi ukulungiselelwa okwengeziwe kuyadingeka, kuyilapho ubukhulu bokusebenza kahle buhlala buyingxenye ehlukile yokuhlola. Iphuzu elisebenzayo ukuhlola yomibili imiphumela kunokuba ucabangele omunye komunye.

Ikhono lethuluzi lokulinganisa umthelela wamakhono aqinisekisiwe ekusebenzeni komenzeli we-AI kanye nokuphakanyiswa kwekhono okubalulekile kobukhulu obuhlukahlukene. Ikhono lokulinganisa umthelela wamakhono aqinisekisiwe linikeza amaqembu indlela yokuxoxa ngokuphakanyiswa kwekhono okubikiwe kusetshenziswa izilinganiso ezishiwo emiphumeleni yethuluzi. Lokho kugcina ukuhlola kuxhumene neziqhathaniso ezibonakalayo kanye Nokulunga, Ukutholakala, Ukuphumelela, kanye Nokusebenza Kahle, ngaphandle kokunciphisa ingxoxo ibe umphumela owodwa. Umthelela wokusebenza oshiwo owenza ukulinganisa kube ndaba.

Inqubo yokuhlola yezigaba ezintathu zethuluzi, ehlanganisa ukuhlola okumile, ukuhlaziya okuhlukile, nemisebenzi ebukhoma eyenziwa ezindaweni ezingazodwa. Le nqubo ixhumanisa ukubuyekezwa okumile, ukuhlaziya okuhlukile, nomsebenzi obukhoma ungena ekuhlolweni okuchazwe ithuluzi. Izimo ezingazodwa zihlinzeka ngendawo yokuqalisa umsebenzi obukhoma, kuyilapho izendlalelo ezintathu ezishiwo zigcina ukuhlola kugxile ekhonweni nasekusebenzeni kwakho. Inqubo ibalulekile ngoba yisakhiwo esisetshenziswa ukuhlola imiphumela ebikiwe.

Interactive Mechanism

Interactive Mechanism: How It Actually Works

Explore the underlying technology behind this development interactively.

Agent Lifecycle Stage:
1
User Intent & Planning: "Audit customer refund request #4092 and settle payment."
2
Tool Calling: Emits structured JSON call crm_get_transaction(id='4092').
3
Guardrail & Verification:🛡️ Paused: High-value action requires human operator sign-off.
4
Final Settlement: Refund recorded, email receipt dispatched, and audit log stored.
Core takeaway: An AI agent is not just a language model—it is a closed loop of planning, tool invocation, and environment feedback. Production systems require self-healing retries and strict human approval guardrails.
Interactive Concept Check+10 Points
What is AI? Quiz

As use of AI scales up across an organization, what tends to matter most?

Ongakubuka ngokulandelayo

Ikhono lethuluzi lokulinganisa umthelela wamakhono aqinisekisiwe ekusebenzeni komenzeli we-AI kanye nokuphakanyiswa kwekhono okubalulekile kobukhulu obuhlukahlukene.

Ikhono lethuluzi lokulinganisa umthelela wamakhono aqinisekisiwe ekusebenzeni komenzeli we-AI kanye nokuphakanyiswa kwekhono okubalulekile kobukhulu obuhlukahlukene. Lesi silinganiso siyisizathu esiyinhloko sokusebenzisa ithuluzi: sishintsha umphumela wekhono eliqinisekisiwe ekusebenzeni komenzeli ube umphumela wokuhlola. Ubukhulu bokuphakamisa ikhono esohlwini bunikeza lowo mphumela izindlela ezimbalwa ezihlukile zokufunda, kuyilapho kugxilwe emthelela wekhono ngokwalo. Inani layo kulo mongo liyikhono lokuhlola umphumela oshiwo wokusebenza.

Inqubo yokuhlola yezigaba ezintathu zethuluzi, ehlanganisa ukuhlola okumile, ukuhlaziya okuhlukile, nemisebenzi ebukhoma eyenziwa ezindaweni ezingazodwa. Ukuhlola okumile, ukuhlaziya okuhlukile, nokusebenza okubukhoma kwemisebenzi kumele izendlalelo ezintathu ezishiwo zokuhlola zethuluzi. Ukugijima okubukhoma kwenzeka ezindaweni ezingazodwa, futhi inhlanganisela nokuhlola okumile nokuhlaziya okuhlukile kugcina inqubo ixhumene kukho kokubili ikhono ngokwalo kanye nokusebenza kwalo okubhekiwe. Lena inqubo esetshenziselwa ukukhiqiza izilinganiso ezichazwe ngenhla.

Imiphumela yokuhlola iqokomisa okutholakele okuthathu okusebenzayo kwamakhono omenzeli wokwakha nokuhlola amaqembu: amasethi edatha okuhlaziya akhiqiza amakhono angcono, umkhiqizo ubaluleke kakhulu kunomenzeli, futhi ukonga amathokheni akuzenzakaleli. Lokhu okutholakele kuxhumanisa inqubo yokulinganisa nomsebenzi ongokoqobo wokwakha nokuhlola amakhono. Zichaza ukuthi ikhwalithi yedathasethi yokuhlola ililolonga kanjani ikhono eliwumphumela, ukuthi umehluko womkhiqizo udlula kanjani umehluko wamahanisi, nokuthi kungani ukusetshenziswa kwamathokheni kufanele kuhlolwe ngokuhlukana kunokuba kucatshangwe ukuthi kuyathuthuka. Iphuzu ngalinye lilandela kokutholakele okwethulwe nemiphumela yokuhlola.

Ikhono lethuluzi lokulandelela ukusetshenziswa kwamathokheni ngokuhlukile kokuthi Ukusebenza kahle futhi liveze ukuthi ikhono lithuthukisa ithokheni nokusebenza kahle noma lidinga ukulungiselelwa okwengeziwe. Ukulandelela okuhlukile kwenza ithokheni isebenzise umbuzo ongaphendulwa ngokuqondile ekuhloleni. Amaqembu angaqhathanisa umphumela wethokheni nomphumela Wokusebenza Kahle, bese ebona ukuthi ithokheni nokusebenza kahle kwethokheni kuyathuthuka noma ukuthi ukulungiselelwa okwengeziwe kuyadingeka. Lokhu kugcina ukugcinwa kwamathokheni ekuphathweni njengokuzenzakalelayo futhi kulondoloza umehluko oshiwo kokutholakele.

Ukuhlanganiswa kwethuluzi nemikhiqizo ehlukahlukene ye-NVIDIA kanye nekhono layo lokuhlola amakhono kuyo yonke imikhiqizo engu-30+ ye-NVIDIA. Lokho kuhlanganisa kugcina ukuhlola kuxhumene nemikhiqizo lapho amakhono asetshenziswa khona. Kuphinde kusho ukuthi imiphumela eshiwo ingacatshangelwa ngokuhambisana nokuthola okugxile emkhiqizweni ukuthi i-Skill Lift iyahluka kakhulu kumikhiqizo yonkana kunawo wonke amahhanisi. Ukuhlanganiswa kanye nobubanzi bemikhiqizo engu-30+ ngakho-ke kuyizingxenye ezibalulekile zalokho ithuluzi elingakulandelela.

Imihlahlandlela ehlobene nemibuzo

Yini i-AI?ChatGPT ne-LLMsUkuziphatha kwe-AIAma-AI AgentsAmamodeli e-AI AchaziweAma-TransformersIkusasa le-AIUkuqeqeshwa kwe-AIPrompt EngineeringHlola okwaziyo — zama imibuzo ye-AI yamahhalaBheka igama le-AI kuhlu lwethu lwamagama
Uthole lokhu kuwusizo?