Lens na Logit da Lens Tunatarwa
Lens ɗin logit da ruwan tabarau masu kyan gani dabarun fassara ne waɗanda ke leƙawa a ɓoye na juzu'in taswira ta layi don ganin abin da ƙirar ke 'tunanin' kafin ya ba da amsa ta ƙarshe.
Dubawa
They reveal how a prediction gradually forms as information flows up through the network.
Zurfafa nutsewa
Transformer yana gina amsarsa da ƙari: kowane Layer yana ƙarawa zuwa 'raguwar rafi' mai gudana wanda kawai ake juya shi zuwa yiwuwar kalma a ƙarshe. Ruwan tabarau na logit, wanda nostalgebraist ya gabatar a cikin 2020, yana gajerun hanyoyin wannan ta hanyar amfani da ƙirar ƙarshe ta ƙarshe (da ka'idar Layer) kai tsaye zuwa yadudduka masu tsaka-tsaki, don haka zaku iya karanta mafi kyawun zato na hanyar sadarwa a kowane zurfin. Wannan sau da yawa yana nuna amsar tana kyalkyali a tsaka-tsaki-zuwa-marigayi. Lens ɗin da aka saurara (Belrose da abokan aiki, 2023) yana haɓakawa akansa ta hanyar horar da ƙaramin binciken affine akan kowane Layer don fassara ɓoyayyun jihohin zuwa tushe na ƙarshe, daidaita ra'ayi da rashin daidaiton ɗanyen ruwan tabarau na logit yana wahala, musamman a farkon yadudduka da kuma cikin iyalai daban-daban.
Fahimtar Fasaha
Dukansu hanyoyin suna amfani da raƙuman rafi: kowane Layer yana rubuta ƙarin sabuntawa zuwa vector da aka raba wanda matrix ɗin da ba a haɗa shi ba daga baya yana aiwatar da ayyukan ƙamus. Ruwan tabarau na logit yana sake yin amfani da wannan daidai abin da ba a haɗa shi ba a kan matsakaitan jihohi ba tare da ƙarin horo ba. Lens ɗin da aka kunna a maimakon haka yana koyon taswirar layi na layi ɗaya (wanda aka koya 'mafassara') don haka ana canza yanayin kowane Layer zuwa tsarin da Layer na ƙarshe yake tsammani, yana samar da santsi, ƙarin aminci da ƙananan tsinkaya.
Dabarun Tasiri
Kudin da kasafin kuɗi
Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru.
Shawarwari masu haske
Ilimin fasaha yana taimaka wa ƙungiyoyi su zaɓi tari mai kyau, ba kawai sabon abu ba.
Kula da inganci
Zaɓuɓɓukan injiniya mafi kyau suna rage abin dogaro a cikin samarwa.
Makomar Lens na Logit da Lens Mai Sauraro
Dabarun lens suna zama daidaitattun don gano yadda gaskiya, ƙi, ko son zuciya ke fitowa a zurfin, da kuma gano lokacin da samfurin ya san' amsa da wuri. Yi tsammanin haɗa su tare da ƙananan autoencoders da causal patching don motsawa daga bayanin tsinkaya zuwa bayanin hanyoyin. Har ila yau bincike yana binciken ko matsakaicin karatun karatu ya bayyana bayanan sirri ko yaudarar ƙirar ƙira ta ɓoye a cikin fitowar sa ta ƙarshe, yana mai da ruwan tabarau ya zama tubalan ginin ɗan takara don tantance aminci da sa ido na faɗakarwa da wuri.
Aiwatar da Gaskiyar Duniya
Yin amfani da ruwan tabarau na logit don kallon amsa ta zahiri kamar babban birni yana fitowa a cikin tsakiyar ƙirar ƙira
Aiwatar da ruwan tabarau mai kunnawa don kwatanta yadda iyalai daban-daban ke haduwa akan tsinkaya a zurfin
Gano cewa samfurin ya 'yanke shawarar' amsa da yawa kafin fitarwa
Gano yadudduka inda tsinkayar alama mai cutarwa ko son zuciya ta fara zama rinjaye a cikin rafi
Hatsari & Tsare-tsare
Haɓaka ma'auni ɗaya na iya ɓoye manyan raunin tsarin.
Sau da yawa ana raina kayan more rayuwa da kuma kuɗin kulawa.
Tsaro da gibin lura na iya girma yayin da tsarin ke ƙara haɓaka.
Taswirar Hanya
Ƙayyade latency, inganci, da maƙasudin farashi kafin aiwatarwa.
Alamar ma'auni a ƙarƙashin ainihin kaya da yanayin bayanai.
Kula da kayan aiki don kurakurai, ɗigo, da tasirin mai amfani.
Shirya bijirowa da hanyoyin mayar da martani kafin sikeli.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Logit Lens and Tuned Lens quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Lens ɗin Logit da Ƙaddamar da Matsakaici Layer
Tambayoyin da ake yawan yi
What is Logit Lens and Tuned Lens?
Lens ɗin logit da ruwan tabarau masu kyan gani dabarun fassara ne waɗanda ke leƙawa a ɓoye na juzu'in taswira ta layi don ganin abin da ƙirar ke 'tunanin' kafin ya ba da amsa ta ƙarshe. Suna bayyana yadda tsinkaya ke tasowa a hankali yayin da bayanai ke gudana ta hanyar hanyar sadarwa.
Menene ruwan tabarau na logit yake yi?
Ruwan tabarau na logit yana aiwatar da jahohi na tsaka-tsakin rafi ta hanyar da ba a haɗa su ba don ganin alamun da aka annabta na ƙirar a kowane zurfin.
Wanne maɓalli na haɓakawa mai kunna ruwan tabarau ya ƙara akan ɗanyen ruwan tabarau na logit?
Lens ɗin da aka saurara yana koyon fassarar layi-layi-layi-layi, yana gyara son zuciya da ba da ƙarin aminci, ƙarancin ruɗani fiye da ɗanyen ruwan tabarau na logit.
Wane tsari ne a cikin tasfoma ya sa waɗannan ruwan tabarau mai yiwuwa?
Kowane Layer yana rubuta ƙarin sabuntawa zuwa rafukan da aka raba, don haka tsara wannan rafi da wuri yana kusantar matsakaicin tsinkaya.
Wanene ya gabatar da ainihin ruwan tabarau na logit, kuma kusan yaushe?
Nostalgebraist ne ya gabatar da ruwan tabarau na logit a cikin gidan yanar gizo na 2020 yana nazarin tsinkayar matsakaicin GPT-2.
A ina ruwan tabarau na logit ke yawan nuna amsar ƙarshe 'crystallizing'?
Abubuwan karatu yawanci suna nuna madaidaicin alamar samun yuwuwar a tsakanin tsaka-tsaki zuwa ƙarshen yadudduka yayin da lissafin ke taruwa.