Chii chaitika
Vatsvagiri vakurudzira AffectOmni, hwaro hwekudzidzisa mamodheru emitauro mikuru kufunga nezve manzwiro, zvinangwa uye mamwe masaini ane chekuita mumagariro uye ane hukama nemifananidzo kana zviitiko. Iyo preprint inopokana kuti mamodheru dzimwe nguva anogona kusvika mhinduro dzakaringana nekuvimba nemamiriro akatenderedza uku uchitarisa humbowo huri pakati pevanhu hunoita kuti kufunga kwavo kuve nyore kutarisa.
Chinyorwa chakatumirwa kuarXiv musi waAug. 24 chinotsanangura AffectOmni, gadziriro yekusimbisa-yekudzidza yezvinogoneka kufunga zvine chekuita nemamodheru emitauro mikuru. Iro bepa rinotarisa pane zvemagariro uye zvine chekuita nehunyanzvi umo sisitimu ingangoda kukanganisa manzwiro, chinangwa kana kurongeka kwezviitiko. Vanyori vanocherekedza kushaya simba muhurongwa huripo: modhi inogona kupa mhinduro chaiyo ichishandisa mapfupi kubva pane yakafara mamiriro enzvimbo pane kuenda kune-yakatarisana nevanhu senge madiki-mataurirwo uye mutauro wemuviri.
Chimiro chinowedzera zvikamu zviviri zvemubairo zvinonzi People Focus uye Temporal Order. Zvinoenderana nekwakabva, People Focus inokurudzira modhi kuti isarudze humbowo hunosanganisira vanhu, nepo Temporal Order ichikurudzira kufunga kwakarongwa kwakatenderedza kana zviitiko zvichiitika. Bepa rinoti masaini aya anoitirwa kudzikisira maitiro ekudimbudzira uye kugadzirisa hukama pakati pemhinduro yemuenzaniso uye humbowo hunooneka hunoitsigira. Sosi yacho haipe ruzivo rwakakwana kuratidza kuti mibairo iyi inoita sei pamhando dzese dzezviitiko kana kuti inodzivirira kudimburira mumayedzo akazvimirira.
AffectOmni inoshandisawo mukati-boka kuenzanisa zvibodzwa panguva yekusimbisa kudzidza. Vanyori vanoti izvi zvinoitirwa kugadzirisa kuunganidzwa kwezvibodzwa mumitauro mikuru-yemhando yekutonga, uko mhinduro zhinji dzevamiriri dzinogashira zvibodzwa zvakafanana nekudaro dzinoburitsa zviratidzo zvekudzidzisa zvisina kusarura. Mushure meiyo modhi yagadzira yemahara-fomu chikonzero, Yekufunga Pfupikidza inoshandura chirevo ichocho kuita mirairo yehumbowo hunoshanda. Iyo mirairo inozoiswa mu pixel-level humbowo matunhu vachishandisa SAM3, vachigadzira izvo zvinotsanangurwa nevanyori sekunze kunoongororwa interface kunze kweiyo loop yekudzidziswa.
Iyo sosi inoshuma kuyedza pamabhenji matatu: IntentBench, Daily Omni uye WorldSense. Zvinei neakavhurika-sosi mamodheru pachiyero che7B, vanyori vanotaura kuvandudzwa kunoenderana, kusanganisira kuwana 4.66% pakuzivikanwa kwemanzwiro uye 14.29% kuwana pamabasa enguva pfupi. Kwazvakabva hakutauri kana manhamba aya ari absolute percentage-point gains kana hukama kuvandudzwa kwepercenter, uye haapi masample counts, confidence intervals, error bars kana kuenzanisa nemasisitimu akasimba evaridzi. Iyo preprint inoti kodhi iripo, asi sosi yacho haipe inoshandisika repository link kana kutsanangura mazwi ekupihwa rezinesi.
Nei zvichikosha
Kuzivikanwa kweAffect ndiko kugona kwezvirongwa zvinodudzira kudyidzana kwevanhu, asi zita chairo hariratidzire kuti modhi yaona munhu akakodzera, kutaura kana majeti. Maitiro eAffectOmni anogadzirisa dambudziko rekutsvaga nekubatanidza modhi kufunga nematunhu euchapupu anogona kuongororwa kunze kwemaitiro ekudzidzisa. Kana zvakashumwa zvakawanikwa zvikabata kupfuura mabhenji evanyori, nzira yacho inogona kupa imwe nzira yekuzvidavirira yekuongorora masystem akawanda anodudzira maitiro evanhu.
Nyaya inoshanda haisi yekungoti multimodal modhi inogona kudoma manzwiro. Mumashandisirwo anodudzira zviitiko zvemagariro, vashandisi vangangoda kuziva kuti ndeupi humbowo hunooneka hwakatungamira mutongo. Sisitimu inotara chiitiko nemazvo nechikonzero chisina kunaka inogona kutadza kana kumashure, zvipfeko, marongero kana mamwe maratidziro achinja. Kusimbisa kwebepa pane humbowo hwakatarisana nevanhu kunogadzirisa gaka rekuvimbika rakananga, kunyangwe tsime richishuma kududzira kwevanyori pane kungozvimiririra zvakasimbiswa zvakawanikwa.
Iyo nhanho yekusimbisa humbowo inogona kuita kuti inobata modhi zvinobuda zvive nyore kuongorora. Nekushandura chikonzero kuita mirairo uye kuvabatanidza nepixel-level matunhu, AffectOmni inopa kongiri yekugadzira iyo muongorori anogona kuongorora. Izvi zvinonyanya kushanda kupfuura chikumbiro chakajairika chekuti modhi izvitsanangure pachayo: kuda kunosungirirwa kune nzvimbo mumufananidzo wekuisa. Kunyangwe zvakadaro, matunhu akasimbiswa haafanire kungotorwa seumboo hwechikonzero chekufunga. Kwakabva hakuratidze kuti matunhu anoratidza akatendeka maitiro emukati akaburitsa mhinduro.
Iko kunatsiridzwa kwakashumwa kunogona kubatsira nekuti kunzwisisa kwechinguvana uye kududzira kwemanzwiro akajairika kukundikana mapoinzi mune multimodal masisitimu. Kuvandudzwa kwe14.29% pamabasa enguva pfupi, kana akaitwa akazvimiririra uye akatsanangurwa zvakajeka, anogona basa kune masisitimu anoongorora kutevedzana kwete mifananidzo yakasarudzika. Kwakabva hakutauri kuti mabasa acho akaoma sei, mabenchmarks akavakwa sei kana kuti zvakawanwa zvinoturikira kukushandiswa kwakakoshera kwakadai sedzidzo, kusvikika, mwero kana kusangana kwevanhu nemakomputa.
Iro basa rinoratidzawo yakafara dhizaini sarudzo mukuongorora kweAI: kupa mubairo kwete chete chinobuda asi kusarudzwa uye kurongeka kweuchapupu hunotsigira. Iyo nzira inogona kubatsira vaongorori kusiyanisa chaiyo yekuona inodzika kubva kumhinduro dzinogadzirwa kuburikidza nedataset mubatanidzwa. Nekudaro, mitongo ine chekuita inorerekera kune mamiriro uye kududzira. Nzira iyo inopa mibairo inotarisa pane zvinoonekwa zvevanhu zvinogona kunge zvichiri kunyora fungidziro pamusoro pekutaura kwemanzwiro, tsika dzemagariro kana zvinoreva majeti, kunyanya kana izvo fungidziro zvichiratidzwa mudhata rekudzidziswa.
Interactive Mechanism: Iyo Inonyatsoshanda
Ongorora ari pasi tekinoroji kuseri kwekusimudzira uku uchipindirana.
A route planner searches possible journeys using explicit rules. What does this illustrate about AI?
Zvekutarisa zvinotevera
Mhedzisiro yacho inobva kune imwechete 12-peji arXiv preprint uye inoshumwa nevanyori vayo; iyo sosi haigadziri yakazvimirira kudzokororwa, chaiyo-yepasirese kutumirwa kana kuita muhuwandu hwakawanda uye marongero. Basa rekutevera rinofanirwa kuyedza kana chimiro chinoramba chakavimbika netsika dzisingazivikanwi, kupindirana kusina kujeka, unhu husina kunaka hwemifananidzo uye zviratidziro apo manzwiro emanzwiro asina kujeka kana kupesana. Izvo zvichave zvakakoshawo kuona kana matunhu ehumbowo achinyatso ratidza maitiro eiyo modhi kana kungopa inonzwisisika nzvimbo dzekutsigira mushure mekunge mhinduro yagadzirwa.
Mubvunzo wekutanga kudzokorora. AffectOmni inoratidzwa searXiv preprint, kwete seyakaongororwa nevezera kana yakazvimiririra yakasimbiswa mhedzisiro. Vatsvaguri vanofanirwa kutarisa kana izvo zvakaburitswa zvinoramba zvichienderera pasi peiyo imwechete yekuongorora protocol, ingave yasara mushure mekudzora yekuwedzera data yekudzidziswa kana saizi yemuenzaniso, uye kana nzira yacho inonatsiridza kuenzanisa uye kuona kukanganisa kwete kungoita mabhenji mamakisi.
Iyo benchmark scope ichave yakakosha. Iwo masosi mazita IntentBench, Daily Omni uye WorldSense asi haitsanangure kuvharika kwavo kwevanhu, mitauro, mhando yemifananidzo, zvimiro zvetsika kana chiyero chemagariro. Ongororo dzenguva yemberi dzinofanira kuyedza manzwiro asina kujeka, masaini akasanganiswa, zviso zvakavharika, zvimiro zvemuviri zvisina kujairika uye zviratidziro umo munhu akanyanya kujeka asiri iye kunobva humbowo hwakakodzera. Vanofanirawo kushuma zvabuda muboka diki apo kududzira kunogona kusiyana mutsika nemagariro kana hurema.
The auditability claim inokodzera kuedzwa kwakanangwa. Muongorori anogona kuenzanisa matunhu akajekeswa nezvirevo zvevanhu, kukanganisa matunhu akasarudzwa, kuvavanza, kana kutsiva mamiriro ekumashure achibata humbowo huri pakati pevanhu nguva dzose. Miedzo yakadai yaizobatsira kuona kana matunhu ehumbowo akakosha kune iyo modhi sarudzo kana kuti anogadzirwa mushure mechokwadi. Kwakabva hakutaurire zviyedzo izvi, saka huwandu hwehumbowo hwechokwadi hunoramba husingazivikanwe.
Pakupedzisira, miganhu inoshanda haina kugadzwa. Iko hakuna ruzivo mune sosi nezve latency, compute mutengo, rezinesi, kuwanikwa kwekutumira, kuchengetedzwa kwekuvanzika kana kushandiswa mune mhenyu masisitimu. Vanyori vanoshuma mibairo vachipesana neakavhurika-sosi 7B-chiyero chekutanga, asi sosi yacho hairatidze kana AffectOmni inokwikwidza nemhando hombe kana yakasimba kunze kwemabhenji matatu anonzi mabhenji. Kusvikira iyo mibvunzo yapindurwa, basa rinonzwisiswa zvakanyanya sechikumbiro chekutsvagisa chine vimbiso yakashumwa mhinduro, kwete semhinduro yakasimbiswa yekududzira manzwiro evanhu.