Swin Transformer
Ihe ntụgharị Swin bụ ihe ntụgharị ọhụụ nke na-ahazi onyonyo n'ime windo ndị agbanweela, nke nwere usoro, na-eme ka nlebara anya rụọ ọrụ nke ọma iji tụọ onyonyo dị elu.
Nchịkọta
It works as a general-purpose backbone for classification, detection, and segmentation.
Ime miri emi
Standard Vision Transformers na-agbakọ nlebara anya n'ofe ihe oyiyi niile, nke na-akwụ ụgwọ na-eto eto quadratically na nha onyonyo, ihe mgbochi maka nnukwu ọrụ dị ka nchọpụta. Nchoputa Microsoft webatara na 2021, Swin (WINdows gbanwere) kama kewaa onyonyo a ka ọ bụrụ obere windo na-anaghị ekpuchi ma na-atụle nlebara anya onwe onye naanị n'ime windo ọ bụla, na-eme ka ọnụ ahịa na-eto n'ahịrị na nha onyonyo. Iji mee ka ozi gafee oke mpio, akwa ndị ọzọ na-agbanwe grid windo, yabụ patches ndị kewapụrụ ugbu a na-ekekọrịta windo. Swin na-ewulitekwa ọkwa: ọ na-amalite site na obere patches ma jiri nwayọọ nwayọọ na-ejikọta ha, na-emepụta maapụ atụmatụ ọtụtụ dị ka CNN, nke na-abanye nke ọma n'ime nchọpụta na nhazi nkewa.
Nghọta nka nka
Ịrụ ọrụ nke Swin na-abịa site na nleba anya nke onwe nke ọtụtụ isi nke dabeere na windo (W-MSA): nlebara anya dị na windo ndị edoziri (dịka ọmụmaatụ 7x7 patches), ya mere mgbagwoju anya na-adabere n'ahịrị karịa ka ọ na-eji ọnụ ọgụgụ nke patches. Ihe mgbochi na-esote na-eji nlegharị anya windo gbanwere (SW-MSA), na-ewepụ nkebi mpio ahụ site na ọkara otu windo ka njikọ cross-window guzoro. Ngwunye jikọtara ọnụ na-ejikọta patches agbataobi n'etiti ọkwa, na-ebelata mkpebi ohere na ọwa okpukpu abụọ iji wuo pyramid mara mma.
Mmetụta atụmatụ
Ọsọ na ọnụ ọgụgụ
Visual AI nwere ike megharịa nyocha, nchọpụta na mkpado ọrụ n'ọtụtụ.
Mee nhọrọ
Otu ndị na-emepụta ihe nwere ike imepụta echiche ngwa ngwa site na ngbanwe akwụkwọ ntuziaka ole na ole.
Team na usoro ọrụ
Ọrụ nwere ike iji onyonyo na akara vidiyo siri ike ịhazi.
Ọdịnihu nke Swin Transformer
Swin gosipụtara na ndị na-ahụ maka nhazi, ndị na-ahụ maka mpaghara nwere ike ịsọ mpi ma ọ bụ tie CNNs dị ka ọkpụkpụ azụ ọhụụ zuru ụwa ọnụ, na Swin V2 kpaliri nke a na ụdị ijeri ijeri na mkpebi dị elu. Na-atụ anya na-agwakọta nke convolutional inductive ele mmadụ anya n'ihu na nlebara anya, ndị kasị mma nlebara anya variants, na Swin-ụdị azụ ọkpụkpụ azụ multimodal na video ụdị. Dị ka ntọala ntọala maka ọhụụ tozuru okè, nhazi usoro nke na-emepụta atụmatụ dị iche iche ka bara uru karịsịa maka ọrụ ibu amụma.
Mmejuputa n'ezie n'ụwa
Nhazi ImageNet dị elu dị ka ọkpụkpụ azụ azụchara azụ
Nchọpụta ihe na ihe atụ azụ ọkpụkpụ azụ dị ka Mask R-CNN na Cascade R-CNN
Akụkụ semantic nke ihe nkiri okporo ụzọ yana onyonyo satịlaịtị
Nyocha ihe onyonyo ahụike ebe mkpebi dị elu na nkọwa ọtụtụ ọnụọgụ dị mkpa
Ihe ize ndụ & okporo ụzọ nche
Ikike onyonyo na nkwenye nwere ike bụrụ ihe egwu dị n'iwu ma ọ bụrụ na edoghị anya.
Ọrụ nlereanya nwere ike ịdịgasị iche n'ofe ọkụ, igwe mmadụ, na gburugburu.
Enwere ike ghara ịhụ ihe dị mma ma ọ bụrụ na enyochaghị oke ntụkwasị obi.
Map mmejuputa
Kọwaa ụkpụrụ nnabata maka nkenke, icheta, na ụgwọ njehie.
Nwalee na data dabara na ọnọdụ mmepụta n'ezie.
Tinye nyocha mmadụ maka obere obi ike ma ọ bụ amụma mmetụta dị elu.
Sochie ihe nlere anya wee megharịa ka emechara mgbanwe igwefoto ma ọ bụ dataset.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Swin Transformer quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
Mgbasa Transformers
Ajụjụ a na-ajụkarị
What is Swin Transformer?
Ihe ntụgharị Swin bụ ihe ntụgharị ọhụụ nke na-ahazi onyonyo n'ime windo ndị agbanweela, nke nwere usoro, na-eme ka nlebara anya rụọ ọrụ nke ọma iji tụọ onyonyo dị elu. Ọ na-arụ ọrụ dị ka ọkpụkpụ azụ azụ izugbe maka nhazi, nchọpụta na nkewa.
Kedu ihe 'Swin' na Swin Transformer pụtara?
Swin na-anọchi anya Windows Shifted, usoro na-eme ka nleba anya mpaghara gbanwee ozi n'ofe ọkwa.
Gịnị kpatara ịgbakọ nlebara anya onwe onye n'ime windo mpaghara ji baa uru?
Idochi anya na windo ndị nwere oke na-eme ka ọnụ ahịa mgbakọ na-eto n'ahịrị na nha onyonyo, n'adịghị ka uto quadratic nlebara anya zuru ụwa ọnụ.
Kedu ka Swin si ekwe ka ozi gafere n'etiti windo dị iche iche?
N'ígwé ndị ọzọ na-atụgharị grid windo site na ọkara windo, yabụ patches na mbụ na windo dị iche iche nwere ike ịbịaru ibe ha nso.
Kedu ihe oyi akwa-jikota na-eme n'etiti ọkwa Swin?
Patch merging na-ejikọta patches ndị agbata obi iji belata mkpebi oghere yana omimi ọwa okpukpu abụọ, na-ewulite ọkwa dị iche iche.
Kedu ihe kpatara nhazi ọkwa nke Swin ji baa uru karịsịa?
Maapụ atụmatụ ọtụtụ ihe na-eṅomi ọkpụkpụ azụ CNN, yabụ Swin na-ejikọta ngwa ngwa na usoro amụma dị oke egwu dị ka Mask R-CNN.