Ibirenze hamwe na Polysemanticity muri AI Gusobanura
Superposition mubisobanuro bya AI nuburyo imiyoboro yimitsi itwara ibintu byinshi mubyerekezo bisangiwe, bigatuma neurone kugiti cye gisa na polysemantique kandi bigoye kubisobanura.
Kwibira cyane
Amakuru nyayo-yisi arimo ibintu byinshi bifite ireme kuruta urwego rufite ibipimo, bityo imiyoboro irabihagarika. Muri superposition, icyitegererezo cyerekana ibiranga nkicyerekezo hafi ya orthogonal icyerekezo mumwanya wo gukora aho kwitangira neuron imwe kuri buri kintu. Ibi birakora kuko ibintu byinshi ni bike (gake gikora icyarimwe), kubwibyo rimwe na rimwe kwivanga nigiciro cyemewe. Igisubizo ni neuron ya polysemantic: __AIU_PROTECTED_4 __ '' Ibikinisho by'ibikinisho bya superposition '(2022) byerekanaga neuron imwe irasa, tuvuge, isura y'injangwe, imbere yimodoka, hamwe nuburyo bumwe bwanditse. Icyangombwa, urusobe rushobora gukora ibarwa kuruta uko rufite neuron, ariko gusa iyo ibiranga ari bike bihagije kuburyo kugongana ari gake.
Ubushishozi
Geometriki, niba ugomba kubika n ibiranga m mubipimo bya n birenze m, ntushobora kubika byose orthogonal. Icyitegererezo kibatondekanya nka hafi-orthogonal vectors, ikemera kwivanga kworoheje. Moderi yimikino ikinisha geometrie yubatswe nka antipodal jambo na pentagons. Ubucucike nuburyo bushoboza: mugihe bike gusa biranga umuriro icyarimwe, ibyateganijwe biteganijwe biguma hasi, kubwibyo inyungu zo guhagararira ibintu byiyongereye biruta urusaku.
Ingaruka z'Ingamba
Igiciro na bije
Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
Ibyemezo bisobanutse
Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
Kugenzura ubuziranenge
Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.
Ejo hazaza ha superposition na Polysemanticity muri AI Gusobanura
Gusobanukirwa superposition ni urufatiro rwo gusobanurwa: autoencoders idasanzwe ibaho neza kugirango ikureho. Akazi kazoza kagamije guhanura igihe nuburyo moderi zinjira muri superposition, igishushanyo mbonera kigabanya kwivanga kwangiza, no kugereranya imipaka yibintu byinshi bishobora gupakirwa neza. Niba abashakashatsi bashobora 'guhishurira' ibintu byizerwa mu bipimo bya monosemantique ku gipimo, uburyo bwo kugenzura imiyoboro idafite umutekano buba bworoshye cyane, bugahindura agasanduku kirabura kijimye mu kintu cyegereye kode isomeka.
Gushyira mu bikorwa Isi
__AIU_PROTECTED_4 __ '2022' Ibikinisho by'ibikinisho bya superposition 'byerekana ibicuruzwa bigenzurwa uko ubuke bwiyongera
Vision neurons muri InceptionV1 isubiza ibintu byinshi bidafitanye isano, ikibazo cyambere cya polysemanticity
Gusobanura impamvu gusuzuma ururimi rumwe-moderi neuron itanga urujijo, ivanze ibisubizo kumutwe
Gutera imbaraga zidasanzwe za autoencoders, zibaho byumwihariko kubora ibikorwa birenze urugero bigasubira mubitekerezo bimwe
Ingaruka & Kurinda
Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.
Igishushanyo mbonera
Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
Tegura inzira yo gusubiza ibyabaye mbere yo gupima.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Superposition and Polysemanticity in AI Interpretability quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Imyitozo yihuta na Megatron
Ibibazo bikunze kubazwa
What is Superposition and Polysemanticity in AI Interpretability?
Superposition mubisobanuro bya AI nuburyo imiyoboro yimitsi itwara ibintu byinshi mubyerekezo bisangiwe, bigatuma neurone kugiti cye gisa na polysemantique kandi bigoye kubisobanura.
Ni iki 'superposition' bivuga mu miyoboro iva mu mitsi?
Ibirenzeho ni ingamba zo gushushanya ibintu bitandukanye kuruta ibipimo ukoresheje hafi-orthogonal, icyerekezo cyerekeranye n'umwanya wo gukora.
Ni ubuhe buryo butuma superposition ikora neza nubwo ibangamira ibintu?
Kuberako ibintu byinshi bidakunze gukora icyarimwe, kugongana ni gake, bityo ikiguzi cyo kwivanga kiguma hasi.
Neuron 'polysemantic' ni iki?
Polysemantic neurons umuriro kubintu byinshi bidafitanye isano, nizo ngaruka zigaragara za superposition.
Niyihe mpapuro Anthropic yazanye ubushakashatsi bwagenzuwe kuri iki kintu muri 2022?
'Ibikinisho by'Ibikinisho bya Superposition' yakoresheje imiyoboro mito, igenzurwa kugirango yerekane igihe nuburyo ibintu bipakirwa hamwe.
Niba urwego rugomba kubika ibintu byinshi birenze ibipimo, niki kidashobora kwirindwa?
Ntushobora guhuza byinshi hagati ya orthogonal vectors kuruta ibipimo, bityo ibiranga bikarangira nkibyinshi-hafi ya orthogonal icyerekezo hamwe na hamwe.