Barlow ejima na mbelata redundancy
Barlow Twins bụ usoro a na-ahụ maka onwe ya nke na-amụta ihe nnọchianya site n'ime ka njikọ njikọ dị n'etiti echiche abụọ agbakwunyere nso na matrix njirimara.
Nchịkọta
It avoids collapse through a redundancy-reduction principle rather than negatives or momentum encoders.
Ime miri emi
Nke Facebook AI kwadoro na 2021 wee kpọọ aha ya n'aha onye ọkà mmụta akwara ozi H. Barlow's redundancy-mbelata ụkpụrụ, Barlow Twins na-enye echiche abụọ gbagọrọ agbagọ nke onyonyo site na netwọkụ yiri ya iji mepụta batches abụọ nke ntinye. Ọ na-agbakọ matrix cross-correlation matrix n'etiti akụkụ nke vector abụọ a na-etinye, tụrụ n'ofe ogbe. Ebumnobi na-akpali matrix a na njirimara: ntinye diagonal kwesịrị ịbụ 1 (ihe ọ bụla na-adịghị agbanwe agbanwe na mgbakwunye) na ntinye nke na-apụ apụ kwesịrị ịbụ 0 (atụmatụ dị iche iche na-ejikọta ya, na-ebelata redundancy). Okwu on-diagonal na-amanye mgbanwe; okwu mbelata-diagonal redundancy-mbelata na-egbochi ndammana n'ihi na njirimara ndị eji achọ mma enweghị ike ịbụ otu. N'adịghị ka BYOL ọ chọghị asymmetry, amụma, ma ọ bụ nkwụsị gradient, na n'adịghị ka SimCLR ọ chọghị ụzọ abụọ na-adịghị mma, n'agbanyeghị na ọ na-erite uru na ntinye akụkụ dị elu.
Nghọta nka nka
Ọnwụ ahụ nwere akụkụ abụọ a chịkọtara n'elu matrix cross-correlation matrix C: nchikota nke (1 - C_ii)^2 okwu ndị na-adịghị agbanwe agbanwe na diagonal, gbakwunyere nchikota lambda arọ nke C_ij^2 okwu redundancy off-diagonal. N'ihi na matriks ahụ na-edozi n'elu ogbe ahụ, usoro ahụ siri ike na nha batch, uru bara uru karịa ụzọ dị iche iche na-agụ agụụ maka nnukwu batches nke ọjọọ. Arụmọrụ akpịrịkpa na embedding dimensionality, otú projectors na-emekarị nnọọ obosara.
Mmetụta atụmatụ
Ọnụ ego na mmefu ego
Mkpebi ihe owuwu ụlọ na-akwalite arụmọrụ yana ọnụ ahịa ọrụ ruo ọtụtụ afọ.
Mkpebi doro anya
Nkà mmụta nka na-enyere ndị otu egwuregwu aka ịhọrọ nchịkọta ziri ezi, ọ bụghị naanị nke kachasị ọhụrụ.
Quality akara
Nhọrọ injinia ka mma na-ebelata ihe omume ntụkwasị obi na mmepụta.
Ọdịnihu nke ejima Barlow na mbelata redundancy
Barlow Twins nyere aka kpalite ezinaụlọ ozi gbasara usoro nlekọta onwe ya, ọkachasị VICReg, nke na-ekewa ọdịiche, mgbanwe, na okwu nnabata n'ụzọ doro anya. Na-atụ anya redundancy-mbelata na njiri mara ebumnobi ịnọgide na-agwa ka anyị na-ebu ụzọ na-azụ encoders na-emepụta kọmpat, na-abụghị redundant atụmatụ, na ịgbatị gabiga oyiyi n'ime multimodal na oge-usoro ntọala ebe ịchọọ, siri ike nnọchiteanya na-enyere ala ala ụdị ịmụta site mmachi aha.
Mmejuputa n'ezie n'ụwa
Ihe ngbanwe onyonyo na-ebu ụzọ azụ nke na-enye njiri mara mma bara uru maka nhazi ọkwa ala nwere oke data akpọrọ.
Ọzụzụ na ngwaike na-agafeghị oke ebe nnukwu batches na-adịghị mma na-agaghị ekwe omume, ebe ọ bụ na Barlow Twins enweghị mmetụta nke nha nha.
Na-emepụta kọmpat, ntinye anaghị arụ ọrụ maka nchịkọta ma ọ bụ nchọpụta anomaly na onyonyo ihe mmetụta ụlọ ọrụ.
Na-eje ozi dị ka usoro ntọala na-ahụ maka onwe ya na nyocha na-atụnyere atụmatụ ịzere ọdịda n'ofe SimCLR, BYOL, na VICReg.
Ihe ize ndụ & okporo ụzọ nche
Ịkwalite otu akara ngosi nwere ike zoo adịghị ike sistemụ sara mbara.
A na-eledakarị ihe akụrụngwa na ụgwọ ọrụ anya.
Ọdịiche nchekwa na nleba anya nwere ike itolite ka sistemu na-adịwanye mgbagwoju anya.
Map mmejuputa
Kọwaa latency, ịdịmma na ebumnuche ọnụ ahịa tupu mmejuputa ya.
Benchmark n'okpuru ibu dị adị na ọnọdụ data.
Nleba anya akụrụngwa maka mperi, ịkpafu na mmetụta onye ọrụ.
Kwadebe ụzọ nzaghachi azụghachi azụ na ihe omume tupu ịchachaa.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Barlow Twins and Redundancy Reduction quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
Agbụ-nke-nkwado maka Mbelata Hallucination
Ajụjụ a na-ajụkarị
What is Barlow Twins and Redundancy Reduction?
Barlow Twins bụ usoro a na-ahụ maka onwe ya nke na-amụta ihe nnọchianya site n'ime ka njikọ njikọ dị n'etiti echiche abụọ agbakwunyere nso na matrix njirimara. Ọ na-ezere ndakpọ site n'ụkpụrụ mbelata redundancy kama ịbụ ihe na-adịghị mma ma ọ bụ ihe ntinye ọkụ.
Kedu ihe matrix Barlow Twins na-agbalị ịkwaga na njirimara?
Barlow Twins na-ebugharị matriks njikọ njikọ n'etiti ihe mgbakwunye echiche abụọ ahụ na matriks njirimara.
Kedu ihe ndenye diagonal nke matriks njirimara ebumnuche na-akwado?
Ndenye diagonal nso 1 pụtara na njirimara ọ bụla na-aza otu ihe na nleba anya abụọ agbagoro, na-amanye ngbanwe.
Kedu ihe ndenye a na-ebugharị na efu na-arụpụta?
Zero off-diagonals pụtara ihe dị iche iche na-achọ mma, nke na-ebelata redundancy ma kwụsị obere ndakpọ.
Ụkpụrụ neuroscience nke onye kpaliri aha na echiche usoro ahụ?
Akpọrọ aha usoro a n'aha H. Barlow na ụkpụrụ nkwụghachi azụ ya nke koodu ntinye akwara nke ọma.
E jiri ya tụnyere BYOL, gịnị ka Barlow Twins anaghị achọ?
Barlow Twins na-eji netwọk ndị yiri ya na-enweghị amụma, nkwụsị-gradient, ma ọ bụ EMA, na-adabere kama na mbelata redundancy-mbelata.