Ururimi AI

Umuvumo uhinduka muri LLMs

Umuvumo uhindagurika nuburyo butangaje bwo gutsindwa aho imvugo yururimi yiga 'A ni B' idashobora gusubiza byimazeyo 'B ni A.' Irerekana ko LLMs ibika ibintu nkamashyirahamwe ayobora, ntabwo ari ubumenyi bufatika.

2 min somaIbiherutse kuvugururwa

Kwibira cyane

Byanditswe mu mpapuro 2023 na Berglund na bagenzi be, umuvumo uhindura werekana ko niba umunyamideli yatojwe kuri 'nyina wa Tom Cruise ari Mary Lee Pfeiffer,' akenshi birananirana iyo babajijwe ngo 'Umuhungu wa Mary Lee Pfeiffer ni nde?' nubwo igisubizo cyumvikana. Ingaruka ikomeza kurugero rwicyitegererezo ndetse na nyuma yo guhuza neza amajana nkaya. Ntabwo ari icyuho cyo kwibuka: icyitegererezo cyabonye amakuru, ariko muburyo bumwe. Kuberako amahugurwa atezimbere ubutaha-ibimenyetso byerekana neza uko ijambo ryateganijwe muri data, ihuriro ryibarurishamibare kuva A kugeza kuri B ntabwo rihita rikora umurongo uva kuri B ugaruka kuri A. Ubushakashatsi bwamaganwe nibitekerezo byerekana ko igipimo cyonyine gitanga ibitekerezo byoroshye, bisa nkabantu kubintu bifatika.

Ubushishozi

Abahinduzi biga mukumenyesha ikimenyetso gikurikira gitanzwe mbere, bityo ivugurura ryibanze rishimangira ikarita yerekana icyerekezo 'A hanyuma B' ariko ugasiga 'B hanyuma A' idakozweho keretse iryo teka naryo rigaragara mumahugurwa. Ibyerekezo byombi bibaho munzira zitandukanye. Abashakashatsi barabyemeje bapima ibipimo bishoboka: nyuma yo kumenya ukuri kwerekanwe, ibisobanuro byatanzwe byasubitswe hafi y'ibanze, byerekana ko nta gihinduka cyumvikana cyabayeho mugihe cy'amahugurwa.

Ingaruka z'Ingamba

Umuvuduko n'igipimo

Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.

Kugera no kugera

Yagura uburyo bwindimi nuburyo bwo gutumanaho.

Ibyemezo bisobanutse

Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.

Ejo hazaza h'umuvumo uhinduka muri LLMs

Impamvu zirimo kwigwa zirimo kongera amakuru yerekeranye no kongera amakuru (wongeyeho interuro ihinduwe), intego zamahugurwa ziteganya ibimenyetso mubyerekezo byombi, hamwe na sisitemu yo kugarura ibintu bigaragara neza aho gushingira kuburemere bwafashwe mumutwe. Bimwe mubyubatswe bishya hamwe nubushakashatsi bwisubiramo bigabanya icyuho. Tegereza umuvumo kugabanuka ariko ntuzimangane, kuko byerekana kudahuza gukomeye hagati yimyigire ikurikira hamwe nuburyo bufatika bwimibanire nyayo.

Gushyira mu bikorwa Isi

Ikiganiro cyerekana neza umubyeyi w'icyamamare ariko birananirana iyo asabwe kuvuga izina ry'umwana w'icyamamare w'ababyeyi.

Umunyamideli avuga 'perezida wa cyenda yari William Henry Harrison' nyamara agatsitara ku 'perezida w’umubare yari William Henry Harrison.'

Umufasha wa code wize imikorere-kuri-mapping ntashobora kugarura izina ryimikorere mubisobanuro byonyine.

Sisitemu yubuvuzi QA yahuguwe kuri 'Ibiyobyabwenge X bivura Imiterere Y' binanirwa gutondekanya ibiyobyabwenge X iyo ubajije icyo bivura Imiterere Y.

Ingaruka & Kurinda

Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.

Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.

Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.

Igishushanyo mbonera

1

Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.

2

Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.

3

Komeza kugenzura abantu kugenzura ibisubizo byinshi.

4

Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.

Komeza Ubushakashatsi

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the Reversal Curse in LLMs quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Tangira ikibazo

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Ubuyobozi bukurikira

ChatGPT na LLMs

Ibibazo bikunze kubazwa

What is Reversal Curse in LLMs?

Umuvumo uhindagurika nuburyo butangaje bwo gutsindwa aho imvugo yururimi yiga 'A ni B' idashobora gusubiza byimazeyo 'B ni A.' Irerekana ko LLMs ibika ibintu nkamashyirahamwe ayobora, ntabwo ari ubumenyi bufatika.

Umuvumo wo gusubira inyuma usobanura iki?

Umuvumo uhindagurika ni kunanirwa kwemeza 'B ni A' uhereye kumahugurwa kuri 'A ni B,' nubwo byombi bihwanye.

Kuki umuvumo wo guhinduka ubaho, muburyo bwa mehaniki?

Kuberako imyitozo itezimbere guhanura ibimenyetso bizakurikiraho muburyo bukurikiranye neza, ikarita yinyuma ntishobora gushimangirwa keretse iyo nayo igaragara mumahugurwa.

Kwiyongera kwicyitegererezo byerekana neza umuvumo uhinduka?

Ubushakashatsi bwambere bwasanze umuvumo ufashwe murwego rwubunini bwikitegererezo, byerekana umunzani wonyine utabikemura.

Niyihe mituweli yibasira umuvumo uhinduka?

Kwiyongera kwamakuru kwerekanwa kwerekana icyitegererezo kuri 'A ni B' na 'B ni A,' kurema ishyirahamwe ryabuze.

Nigute abashakashatsi bemeje ko icyitegererezo kitize ku buryo butaziguye ukuri?

Ibisobanuro byahinduwe byashobokaga kuguma hafi y'ibanze nyuma y'amahugurwa yo imbere, byerekana ko nta guhinduka kwumvikana kwabayeho.