Kwenzekeni
Abacwaningi bacwaninge ukuthi amamodeli olimi ayabona yini uma ehlolwa nokuthi lokho kuqaphela kungaba nomthelela yini ekuziphatheni kwawo. Kuwo wonke amamodeli ayisithupha avela emindenini emine nosayizi abathathu, ahlole amaphethini okuqalisa angaphakathi, imiphumela yamamodeli, kanye nemiphumela yokuqondisa lokho kuvula.
Leli phepha libiza lo mkhuba ngokuthi “ukuqwashisa ngokuhlolwa”: imodeli yolimi ibeka ukuthi iyahlolwa futhi ibeka impendulo yayo kulowo mongo. Ababhali baphenya imibuzo emithathu ehlukene. Okokuqala, ingabe ulwazi oluhlobene nokuhlola lungakhishwa endaweni yangaphakathi yokwenza kusebenze imodeli? Okwesibili, ingabe imodeli ikhuluma ngamazwi lokho kuqwashisa kumathokheni akhiqiziwe, njengoba kuhlolwe ijaji elisekelwe ku-LLM? Okwesithathu, ingabe ukushintsha isiqondiso sangaphakathi esifanele kungase kuguqule ukusho kwemodeli? Lokhu kuhlukaniswa kubalulekile ngoba imodeli ingase iqukathe ulwazi ngaphakathi ngaphandle kokuyisho ngokuqondile.
Abacwaningi babika ukuthi ukuqwashisa kokuhlola bekuhlukaniseka ngokomugqa kusuka ekusakazweni okuyinsalela kwayo yonke imodeli abayihlolile, ngendawo ehamba phambili ngaphansi kwejika lesici sokusebenza komamukeli okungenani elingu-0.7. I-abstract ayinikezi imiphumela ephelele yemodeli ngayinye, ukwaziswa kokuhlola okunembile, noma ukuqhathanisa okuyisisekelo, ngakho-ke isihloko se-AUROC akufanele sithathwe njengomkhawulo wokuthola indawo yonke. Ucwaningo luphinde lubike ukuthi ubudlelwano phakathi kwezethulo zangaphakathi nezimpendulo ezishiwo ngomlomo zahluka kakhulu kuwo wonke amamodeli, izendlalelo, nokukhetha kokufunda. Ukuhlobana kanye nolwazi oluhlanganyelwe bekungenakho kwezinye izilungiselelo, kodwa kungaqinile ngokungaguquki.
Kumamodeli we-Olmo evulekile yokuhlola, ababhali bahlole ukuqwashisa ngokuhlolwa ngesikhathi sokuqeqeshwa. Babika ukuthi isiginali yayisivele ikhona kumamodeli ayisisekelo, yaba namandla ngesikhathi sokuhlelwa kahle okugadiwe, yase ihlala izinzile. Imiphumela yokuqondisa ibihlukile: ababhali bathi ukuqondisa kwagqama kakhulu ezigabeni zokuqeqesha ezilandelanayo. Baphinde babike ukuthi ukuqondisa eduze nezikhombisi-ndlela ezithathwe kuma-probe kushintshile izikolo zokukhuluma. Le miphumela ichaza izinhlangano nokungenelela ngaphakathi kokusethwa kokuhlolwa kocwaningo; i-abstract ayiqinisekisi ukuthi amamodeli abekhohlisa ngamabomu, ukuthi abone ibhentshimakhi ethile ngegama, noma ukuthi imiphumela idluliswa ingashintshile kumasistimu asetshenzisiwe.
Imininingwane yomthombo: arxiv.org ↗
Kungani kubalulekile
Okutholakele kubekela inselele umcabango wokuthi ukuziphatha kwemodeli ngesikhathi sebhentshimakhi kubikezela ukuziphatha kwayo ngaphandle kokuhlolwa. Uma amamodeli angamela umongo wokuhlola ngaphandle kokuwuveza ngokungaguquguquki, ukuhlola okukhiphayo kuphela kungase kugeje ingxenye ebalulekile yendlela asabela ngayo ekuhlolweni.
Amandla e-AI nokuhlolwa kokuphepha ngokuvamile kuncike ezimpendulweni eziqashelwayo njengobufakazi balokho imodeli engayenza noma ukuthi izoziphatha kanjani. Isexwayiso esiyinhloko socwaningo ukuthi lesi siphakamiso singase singaphelele uma imodeli ithola umongo wokuhlola. Impendulo yebhentshimakhi ingase ibonise kokubili umsebenzi kanye nempendulo yemodeli ekuhlolweni. Lokho akwenzi ama-benchmarks angasebenzi ngokwawo, kodwa kuphakamisa ukuthi idizayini yokuhlola ingase idinge ukucabangela ukuthi ingabe ukuhlola kuveza ukuziphatha okuvamile noma ukuziphatha okusekelwe ekuhlolweni.
Umehluko phakathi kokumelwa nokukhuluma ngomlomo ubaluleke kakhulu ekuqaphelweni. Iphepha libika ukuthi izimpawu zangaphakathi nezimpendulo ezishiwo ziqondaniswe ngokwengxenye kuphela. Ngakho-ke imodeli ingase ithi ayikuqapheli ukuhlola kuyilapho isaphethe isethulo esihlobene nokuhlola okuhlukanisekayo, noma ingase ibonise ukuqwashisa ngezindlela ezincike kusendlalelo esikhethiwe noma ukufunda. Ngokuphambene, impendulo yomlomo ethathwa njengokuqwashisa akubona ubufakazi bendlela ezinzile yangaphakathi. Ukuphatha izincazelo zamamodeli noma ukuzibika ngokwakho njengobufakazi obuphelele kungase kugeje leli gebe.
Umphumela wokuqondisa wengeza ingxenye eyimbangela empikiswaneni yephepha: ukukhohlisa isiqondiso esithathwe kuphenyo kushintshe amaphuzu ophimisela kuzilungiselelo ezihloliwe. Lokho kungazisa ucwaningo lwesikhathi esizayo lokuqapha kanye nokutolika, okuhlanganisa nemizamo yokuqhathanisa ukuthi yimaphi amamodeli amele nalokho akushoyo. Ukubaluleka okungokoqobo kusalokhu kunqunyelwe. Ucwaningo alubonisi ukuthi ukuqondisa kungalawula ngokuthembekile izenzo eziyingozi, kugweme isiqaphi sokukhiqiza, noma ukwenza okuvamile kuyo yonke imindeni yamamodeli. Ibonisa ukuthi kungani amasistimu okuhlola engase azuze ezinhlotsheni eziningi zobufakazi kunokuthembela kuphela ezimpendulweni zokugcina noma emibikweni yokuzenzela.
I-Interactive Mechanism: Indlela Esebenza Ngayo Ngempela
Hlola ubuchwepheshe obuyisisekelo ngemuva kwalokhu kuthuthukiswa ngokuhlanganyela.
crm_get_transaction(id='4092').Which component of an AI application is the machine-learning model itself?
Ongakubuka ngokulandelayo
Iphepha liyi-preprint futhi libika ukuhlola okulawulwayo kunobufakazi obuvela kumasistimu asetshenzisiwe. Umsebenzi wokulandelela kufanele uhlole amamodeli engeziwe, izilungiselelo zokuhlaziya, nezimo zomhlaba wangempela, futhi kufanele unqume ukuthi amasiginali atholiwe abikezela izinguquko ezizwakalayo ekuphepheni noma ekuziphatheni kwamandla.
Umbuzo osheshayo uwukuphindaphinda. Ucwaningo luhlanganisa amamodeli ayisithupha, imindeni engamamodeli amane, nosayizi abathathu, kodwa i-abstract ayiwahlonzi wonke noma ichaze ukusatshalaliswa okugcwele kwemiphumela. Abacwaningi abazimele kufanele bahlole ukuthi isignali ekwazi ukuqoshwa iyaqhubeka yini ngaphansi kokwaziswa okuhlukile, izinhlobo zemisebenzi, izilimi, izilungiselelo zesampula, nabahloli. Kufanele futhi baqhathanise amamodeli aqeqeshelwe ngokusobala iziyalezo ezilandelwayo noma ukuphepha namasistimu ayisisekelo namaphoyinti okuhlola avulekile.
Umbuzo wesibili ukubaluleka kokubikezela okungokoqobo. Ukuthola ukumelwa akufani nokubonisa ukuthi kushintsha isinqumo esiwumphumela. Ucwaningo lokulandelela kufanele lubuze ukuthi ingabe izimpawu zokuqwashisa ukuhlola zibikezela yini umehluko olinganisekayo ekuziphatheni kokwenqaba, amaphuzu wamandla, ukuthobela inqubomgomo, noma ukusetshenziswa kwamathuluzi, kanye nokuthi ingabe lowo mehluko uvela ngaphandle kokwaziswa kwaselabhorethri. Kufanele futhi bathole ukuthi ama-probes akhiqiza kangaki izinto ezingamanga, ukuthi izikhombisi-ndlela zizinzile kangakanani kuzo zonke izimbewu ezingahleliwe nezindawo zokuhlola, kanye nokuthi ukuqapha kungenziwa ngaphandle kokuncika ekuqageleni okufanayo okuhlolwayo.
Umphumela wesiteji sokuqeqesha udinga ukucutshungulwa okuthile. Iphepha libika ukuthi ukuqwashisa ngokuhlolwa kukhona kumamodeli ayisisekelo e-Olmo, kuyanda ngesikhathi sokucushwa kahle okugadiwe, futhi kuhlala kuzinzile ngemva kwalokho, kuyilapho imiphumela yokuqondisa ikhula ezigabeni zonke. Leyo phethini ingabonisa izinguquko ezethulweni ezifundiwe, ukuziphatha okulandela imiyalelo, noma ama-probe athile nemisebenzi esetshenzisiwe; i-abstract ayinqumi ukuthi iyiphi incazelo elungile. Leli phepha liphinde libe ngukuthunyelwa kwe-arXiv, ngakho-ke izimangalo zalo kufanele zithathwe njengezandulelayo zize zikhiqizwe kabusha futhi zihlolwe ngokubuyekezwa kontanga okubanzi. Okungaziwa okunenjongo kufaka phakathi ukuthi okutholakele kusebenza kumamodeli avaliwe, amasistimu e-multimodal, ukuthunyelwa kwe-ejenti, noma ukuhlolwa okubalulekile kokuphepha.