Umuvumo uhinduka muri LLMs
Umuvumo uhindagurika nuburyo butangaje bwo gutsindwa aho imvugo yururimi yiga 'A ni B' idashobora gusubiza byimazeyo 'B ni A.' Irerekana ko LLMs ibika ibintu nkamashyirahamwe ayobora, ntabwo ari ubumenyi bufatika.
Kwibira cyane
Byanditswe mu mpapuro 2023 na Berglund na bagenzi be, umuvumo uhindura werekana ko niba umunyamideli yatojwe kuri 'nyina wa Tom Cruise ari Mary Lee Pfeiffer,' akenshi birananirana iyo babajijwe ngo 'Umuhungu wa Mary Lee Pfeiffer ni nde?' nubwo igisubizo cyumvikana. Ingaruka ikomeza kurugero rwicyitegererezo ndetse na nyuma yo guhuza neza amajana nkaya. Ntabwo ari icyuho cyo kwibuka: icyitegererezo cyabonye amakuru, ariko muburyo bumwe. Kuberako amahugurwa atezimbere ubutaha-ibimenyetso byerekana neza uko ijambo ryateganijwe muri data, ihuriro ryibarurishamibare kuva A kugeza kuri B ntabwo rihita rikora umurongo uva kuri B ugaruka kuri A. Ubushakashatsi bwamaganwe nibitekerezo byerekana ko igipimo cyonyine gitanga ibitekerezo byoroshye, bisa nkabantu kubintu bifatika.
Ubushishozi
Abahinduzi biga mukumenyesha ikimenyetso gikurikira gitanzwe mbere, bityo ivugurura ryibanze rishimangira ikarita yerekana icyerekezo 'A hanyuma B' ariko ugasiga 'B hanyuma A' idakozweho keretse iryo teka naryo rigaragara mumahugurwa. Ibyerekezo byombi bibaho munzira zitandukanye. Abashakashatsi barabyemeje bapima ibipimo bishoboka: nyuma yo kumenya ukuri kwerekanwe, ibisobanuro byatanzwe byasubitswe hafi y'ibanze, byerekana ko nta gihinduka cyumvikana cyabayeho mugihe cy'amahugurwa.
Ingaruka z'Ingamba
Umuvuduko n'igipimo
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.
Kugera no kugera
Yagura uburyo bwindimi nuburyo bwo gutumanaho.
Ibyemezo bisobanutse
Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.
Ejo hazaza h'umuvumo uhinduka muri LLMs
Impamvu zirimo kwigwa zirimo kongera amakuru yerekeranye no kongera amakuru (wongeyeho interuro ihinduwe), intego zamahugurwa ziteganya ibimenyetso mubyerekezo byombi, hamwe na sisitemu yo kugarura ibintu bigaragara neza aho gushingira kuburemere bwafashwe mumutwe. Bimwe mubyubatswe bishya hamwe nubushakashatsi bwisubiramo bigabanya icyuho. Tegereza umuvumo kugabanuka ariko ntuzimangane, kuko byerekana kudahuza gukomeye hagati yimyigire ikurikira hamwe nuburyo bufatika bwimibanire nyayo.
Gushyira mu bikorwa Isi
Ikiganiro cyerekana neza umubyeyi w'icyamamare ariko birananirana iyo asabwe kuvuga izina ry'umwana w'icyamamare w'ababyeyi.
Umunyamideli avuga 'perezida wa cyenda yari William Henry Harrison' nyamara agatsitara ku 'perezida w’umubare yari William Henry Harrison.'
Umufasha wa code wize imikorere-kuri-mapping ntashobora kugarura izina ryimikorere mubisobanuro byonyine.
Sisitemu yubuvuzi QA yahuguwe kuri 'Ibiyobyabwenge X bivura Imiterere Y' binanirwa gutondekanya ibiyobyabwenge X iyo ubajije icyo bivura Imiterere Y.
Ingaruka & Kurinda
Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.
Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.
Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.
Igishushanyo mbonera
Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.
Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.
Komeza kugenzura abantu kugenzura ibisubizo byinshi.
Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Reversal Curse in LLMs quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
ChatGPT na LLMs
Ibibazo bikunze kubazwa
What is Reversal Curse in LLMs?
Umuvumo uhindagurika nuburyo butangaje bwo gutsindwa aho imvugo yururimi yiga 'A ni B' idashobora gusubiza byimazeyo 'B ni A.' Irerekana ko LLMs ibika ibintu nkamashyirahamwe ayobora, ntabwo ari ubumenyi bufatika.
Umuvumo wo gusubira inyuma usobanura iki?
Umuvumo uhindagurika ni kunanirwa kwemeza 'B ni A' uhereye kumahugurwa kuri 'A ni B,' nubwo byombi bihwanye.
Kuki umuvumo wo guhinduka ubaho, muburyo bwa mehaniki?
Kuberako imyitozo itezimbere guhanura ibimenyetso bizakurikiraho muburyo bukurikiranye neza, ikarita yinyuma ntishobora gushimangirwa keretse iyo nayo igaragara mumahugurwa.
Kwiyongera kwicyitegererezo byerekana neza umuvumo uhinduka?
Ubushakashatsi bwambere bwasanze umuvumo ufashwe murwego rwubunini bwikitegererezo, byerekana umunzani wonyine utabikemura.
Niyihe mituweli yibasira umuvumo uhinduka?
Kwiyongera kwamakuru kwerekanwa kwerekana icyitegererezo kuri 'A ni B' na 'B ni A,' kurema ishyirahamwe ryabuze.
Nigute abashakashatsi bemeje ko icyitegererezo kitize ku buryo butaziguye ukuri?
Ibisobanuro byahinduwe byashobokaga kuguma hafi y'ibanze nyuma y'amahugurwa yo imbere, byerekana ko nta guhinduka kwumvikana kwabayeho.