Jagorar Fasaha

Fassarar Injiniya

Fassarar injina shine ƙoƙarin juyar da injiniyan ƙididdige ƙididdiga na cikin cibiyoyin sadarwar jijiyoyi zuwa algorithms masu fahinta na ɗan adam.

2 min karatuAn sabunta ta ƙarshe

Dubawa

Rather than asking 'which input mattered,' it asks 'what is this network actually computing, circuit by circuit?'

Zurfafa nutsewa

Inda hanyoyin kamar SHAP ke bayyana bayanai da abubuwan da aka fitar, fassarar injina yana buɗe akwatin kuma yayi nazarin ma'auni da kunnawa kansu. Masu bincike (musamman a Anthropic, OpenAI, da kuma ilimi) suna ɗaukar na'ura mai canzawa azaman shirin da za'a iya haɗawa, gano 'circuits': ƙananan ƙananan ƙwayoyin cuta da shugabannin kulawa waɗanda ke aiwatar da takamaiman aiki. Abubuwan da aka gano na ƙasa sun haɗa da 'shugabannin ƙaddamarwa,' shugabannin hankali waɗanda ke kwafin ƙira don ba da damar koyo a cikin mahallin, da kuma gano cewa neurons guda ɗaya galibi 'polysemantic' ne,' harbe-harbe don yawancin ra'ayoyin da ba su da alaƙa saboda ƙirar ta ƙunshi ƙarin fasali fiye da girma (superposition). A yanzu ana amfani da na'urorin da ba su da yawa don raba waɗannan su zama masu tsafta, 'fasalolin' monosemantic, kamar jagorar da ke kunna kan gadar Golden Gate.

Fahimtar Fasaha

Babban cikas shine babban matsayi: hanyar sadarwa mai girma d tana iya wakiltar abubuwa fiye da d fasali ta hanyar adana su a matsayin kusan kwatance-kwakwalwa, don haka kowane neurons yana kunna wuta don ra'ayoyi marasa alaƙa. Rarraba autoencoders suna magance wannan ta hanyar koyon cikakken ƙamus wanda ke sake gina kunnawa ta amfani da ƴan raka'a masu aiki kawai a lokaci guda, suna zazzage abubuwan da za'a iya fassarawa. Daga nan masu bincike suka inganta da'irori tare da saɓani, ɓarna ko kunnawa 'patching' don tabbatar da wani ɓangaren yana aiwatar da ƙididdige ƙididdiga.

Dabarun Tasiri

Kudin da kasafin kuɗi

Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru.

Shawarwari masu haske

Ilimin fasaha yana taimaka wa ƙungiyoyi su zaɓi tari mai kyau, ba kawai sabon abu ba.

Kula da inganci

Zaɓuɓɓukan injiniya mafi kyau suna rage abin dogaro a cikin samarwa.

Makomar Fassarar Mechanistic

Fassarar injina ita ce tsakiyar aminci ga AI: fahimtar abubuwan cikin gida na iya ba mu damar bincika ƙira don yaudara, gano iyawa masu haɗari, da jagoranci ɗabi'a ta hanyar gyara fasali kai tsaye. Aiki na kusa yana mai da hankali kan ƙwanƙwasa ƙwaƙƙwaran autoencoders zuwa ƙira na kan iyaka, sarrafa sarrafa keɓancewa, da gina ingantaccen ƙamus na fasali. Manufar burin ita ce 'MRI don cibiyoyin sadarwa na jijiyoyi', hanya don karanta tunanin samfurin kafin turawa, kodayake fassarar tsarin sikelin biliyan a ma'auni ya kasance babban ƙalubale a buɗe.

Aiwatar da Gaskiyar Duniya

Anthropic ya fitar da miliyoyin abubuwan da ake iya fassarawa daga Claude kuma ya nuna cewa haɓaka fasalin gadar 'Golden Gate' guda ɗaya ya sa ƙirar ta ambaci gadar cikin raɗaɗi, yana nuna jagorar ɗabi'a kai tsaye.

Masu bincike sun gano 'shugabannin shigar' a cikin tasfoma masu yin kwafi da ci gaba da maimaita alamu, suna bayyana mahimmin hanyar da ke bayan koyo cikin yanayi.

Ana amfani da facin kunnawa don gano inda samfurin ke adana gaskiya (misali, babban birnin ƙasa), yana bayyana takamaiman yadudduka da abubuwan da ke da alhakin.

Ƙungiyoyin tsaro suna bincika fasalulluka na ciki don gano ko ƙirar tana wakiltar ra'ayoyi kamar yaudara ko umarni mara aminci, ba da damar sa ido ko sa baki.

Hatsari & Tsare-tsare

Haɓaka ma'auni ɗaya na iya ɓoye manyan raunin tsarin.

Sau da yawa ana raina kayan more rayuwa da kuma kuɗin kulawa.

Tsaro da gibin lura na iya girma yayin da tsarin ke ƙara haɓaka.

Taswirar Hanya

1

Ƙayyade latency, inganci, da maƙasudin farashi kafin aiwatarwa.

2

Alamar ma'auni a ƙarƙashin ainihin kaya da yanayin bayanai.

3

Kula da kayan aiki don kurakurai, ɗigo, da tasirin mai amfani.

4

Shirya bijirowa da hanyoyin mayar da martani kafin sikeli.

Ci gaba da Bincike

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the Mechanistic Interpretability quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Fara tambayoyi

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Jagora na gaba

Rarraba Autoencoders don Fassara

Tambayoyin da ake yawan yi

What is Mechanistic Interpretability?

Fassarar injina shine ƙoƙarin juyar da injiniyan ƙididdige ƙididdiga na cikin cibiyoyin sadarwar jijiyoyi zuwa algorithms masu fahinta na ɗan adam. Maimakon tambayar 'wane shigar da ke da mahimmanci,' yana tambaya 'menene wannan hanyar sadarwa ta zahiri ke lissafin, kewayawa ta da'ira?'

Menene maƙasudin tsakiyar fassarar injiniyoyi?

Fassarar injina na nufin fahimtar ainihin algorithms hanyar sadarwa tana aiwatarwa a ciki, ba kawai alaƙar shigarwa-fitarwa ba.

Menene 'superposition' ke nufi a cikin hanyar sadarwa na jijiyoyi?

Babban matsayi yana ƙyale hanyar sadarwa ta ɓoye ƙarin ra'ayoyi fiye da yadda take da neurons/dimensions ta hanyar adana su azaman kusan kwatance-kwakwalwa masu haɗe-haɗe, haifar da jijiyoyin polysemantic.

Menene 'shugabannin shigar'?

Shuwagabannin ƙaddamarwa suna gano abin da ya faru a baya na alamar yanzu kuma su kwafi abin da ya biyo baya, maɓalli na hanyar da ke ba da damar koyo a cikin yanayi.

Ta yaya masu bincike suka tabbatar da cewa da'irar da aka gano da gaske tana yin ƙididdige ƙididdiga?

Hanyoyin haddasawa kamar kunna facin ko gwajin zubar da ciki ko canza wani sashi a zahiri yana canza halayen da suka dace, suna tabbatar da matsayinsa.

Me yasa ake ɗaukar fassarar injina da mahimmanci ga amincin AI?

Fahimtar fasalulluka na cikin gida da da'irori na iya ba da damar tantancewa don yaudara ko iyawa masu haɗari da ba da damar sa baki da aka yi niyya, tallafawa ƙaƙƙarfan turawa.