I-VISual AI GUIDE

Ukutholwa kwe-DETR Transformer

I-DETR (i-DEtection TRAnsformer) yenza kabusha ukutholwa kwento njengenkinga yokubikezela okuqondile exazululwe nge-transformer, isusa izinyathelo eziklanywe ngesandla njengamabhokisi okubamba ihange kanye nokucindezelwa okungekona okukhulu.

Uhlolojikelele

I-DETR (i-DEtection TRAnsformer) yenza kabusha ukutholwa kwento njengenkinga yokubikezela okuqondile exazululwe nge-transformer, isusa izinyathelo eziklanywe ngesandla njengamabhokisi okubamba ihange kanye nokucindezelwa okungekona okukhulu. Kubalulekile ngoba kunikeze ukutholwa ipayipi elihlanzekile, elisuka ekupheleni elikhuthaze igagasi lamamodeli ombono asekelwe ku-transformer.

I-DETR Transformer Detection ingeyokugeleza kokusebenza kombono wekhompyutha ohumusha noma okhiqiza imidiya ebonakalayo ukuze ihlaziywe, isebenze, futhi isungule.

I-Deep Dive

Yethulwe yi-Facebook AI ngo-2020, i-DETR ihlanganisa umgogodla we-CNN nesikhiphi khodi se-transformer. I-CNN ikhipha izici zesithombe; isifaki khodi sihlanganisa umongo womhlaba wonke kuso sonke isithombe; futhi idikhoda ithatha isethi egxilile 'yemibuzo yento' efundiwe futhi iguqule ngayinye ibe into etholiwe (ikilasi kanye nebhokisi elihlanganisayo) noma umphumela 'okungekho lutho'. Intsha eyinhloko ukufanisa kabili: phakathi nokuqeqeshwa i-algorithm yaseHungary ithola isabelo esisodwa-to-one phakathi kokubikezela nezinto eziyiqiniso eliphansi, ngakho imodeli ifunda ukukhipha ibhokisi eliyingqayizivele into ngayinye ngokuqondile. Lokhu kuqeda ukucindezelwa okungekona okuphezulu nokushuna ihange. Ukuhwebelana kwaba ukuhlangana okunensayo kanye nokunemba kwezinto ezincane okubuthakathaka, okulandelela okufana ne-Deformable DETR ebhekiswe.

I-Technical Insight

Indlela echazayo ye-DETR iwukulahlekelwa okusekelwe kusethi ngokufaniswa kwe-Hungarian. Esikhundleni sokuthola izinkulungwane zamabhokisi okusetshenzwa kulengwa, ikhipha inombolo egxilile yezibikezelo (ngokuvamile imibuzo yezinto eziyi-100) futhi iqondanise into eyodwa kuya kweyodwa nezinto eziyiqiniso, ijezisa kokubili amaphutha okuhlelwa kanye nebhokisi kumapheya afanisiwe futhi isunduze imibuzo engenakuqhathaniswa iye kokuthi 'akukho nto.' Ngenxa yokuthi ukufanisa kukodwa kuya kokukodwa, ukutholwa okuyimpinda kucindezelwa idizayini kunesinyathelo esihlukile sangemuva kokucubungula.

I-Mastering DETR Transformer Detection

I-DETR (i-DEtection TRAnsformer) yenza kabusha ukutholwa kwento njengenkinga yokubikezela okuqondile exazululwe nge-transformer, isusa izinyathelo eziklanywe ngesandla njengamabhokisi okubamba ihange kanye nokucindezelwa okungekona okukhulu. Kubalulekile ngoba kunikeze ukutholwa ipayipi elihlanzekile, elisuka ekupheleni elikhuthaze igagasi lamamodeli ombono asekelwe ku-transformer. I-DETR Transformer Detection ingeyokugeleza kokusebenza kombono wekhompyutha ohumusha noma okhiqiza imidiya ebonakalayo ukuze ihlaziywe, isebenze, futhi isungule. Ukuze wakhe ukuqonda okujulile, phatha i-DETR Transformer Detection njengemodeli yokusebenza, hhayi isici esisodwa: chaza imiphumela oyifunayo, ucacise ukucabanga, futhi uhlukanise lokho isistimu engakwenza ngokwethembeka kulokho okusadinga ukwahlulela kochwepheshe.

Empeleni, amaqembu aqinile asebenzisa ukunemba kwebhalansi ye-DETR Transformer Detection namaqiniso okusebenza njengekhwalithi yedatha, ukuhluka kokukhanya, nokuvumelana kwamalebula. Babhala imibandela yempumelelo ecacile, ukuhlola okuqhathaniswa nedatha engokoqobo nokugeleza komsebenzi, futhi baphindaphinde ngokusekelwe kumaphethini okuhluleka aqashiwe esikhundleni sokuwina kwebhentshimakhi yesikhathi esisodwa. Yilapho ukuqonda kwethiyori kuguquka kube amandla ahlala njalo kuwo wonke umkhiqizo, inqubomgomo, kanye nokusebenza.

I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini. Ngesikhathi esifanayo, amalungelo ezithombe kanye nemvume kungaba ubungozi bomthetho uma ukutholakala kungacacile. Indlela eqine kakhulu iwukuhlanganisa isivinini sokuhlola nesiyalo sokuphatha: qhuba abashayeli bezindiza, bamba ubufakazi, ushicilele amalogi ezinqumo, futhi ubuyekeze izivikelo ngokuqhubekayo njengoba imodeli yokuziphatha, okulindelwe ngabasebenzisi, kanye nezimfuneko zokulawula zishintsha.

I-Strategic Impact

I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini.

I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.

Amathimba aqanjiwe angakwazi ukulinganisa imiqondo ngokushesha ngezibuyekezo ezimbalwa ezenziwa mathupha.

Amathimba aqanjiwe angakwazi ukulinganisa imiqondo ngokushesha ngezibuyekezo ezimbalwa ezenziwa mathupha. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.

Imisebenzi ingasebenzisa amasiginali wesithombe nawevidiyo obekunzima ukuwenza ngaphambilini.

Imisebenzi ingasebenzisa amasiginali wesithombe nawevidiyo obekunzima ukuwenza ngaphambilini. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.

Ikusasa Lokutholwa Kwe-DETR Transformer

I-DETR yethule wonke umndeni wama-transformer okubona. Okuhlukile okufana ne-Deformable DETR, DAB-DETR, DN-DETR, ne-DINO kusheshise ukuqeqeshwa nokunemba okuthuthukisiwe, ngamamodeli esitayela se-DINO afinyelela phezulu kumabhentshimakhi okutholwa. I-paradigm esekelwe embuzweni, ekupheleni ukuya ekupheleni manje inweba ekuhlukaniseni, ukulandelela, nokutholwa kwe-3D, kanye nezitholi zesilulumagama esivulekile zakhela phezu kwayo. Lindela ukuhlangana okuqhubekayo kokutholwa, ukuhlukaniswa, nokusekelwa kolimi kuzakhiwo ezihlanganisiwe ze-transformer, i-DETR ekhunjulwa njengesinyathelo esibalulekile esisuse i-heuristics eyenziwe ngesandla.

Ukuqaliswa Komhlaba Wangempela

Ukutholwa kanye nesibhakela abahamba ngezinyawo nezimoto kumadathasethi ocwaningo lokushayela ngokuzenzakalelayo

Inika amandla ukuhlukaniswa kwe-panoptic uma kunwetshwa ekuqageleni kwemaski ngephikiseli ngayinye

Isebenza njengomgogodla wezakhiwo ze-open-vocabulary kanye nezitholi eziphansi

Ukuthola izinto ezithombeni zeshalofu lokudayisa ngaphandle kokushuna osayizi behange ngedathasethi ngayinye

Amaphethini Okusebenzisa

Ukutholwa kwe-DETR Transformer ekusebenzeni

Ukutholwa kanye nesibhakela abahamba ngezinyawo nezimoto kumadathasethi ocwaningo lokushayela ngokuzenzakalelayo.

Ukuthola nokushaya abahamba ngezinyawo nezimoto kudathasethi yocwaningo lokushayela ngokuzenzakalelayo Amaqembu ngokuvamile athola imiphumela engcono lapho echaza izinga eliphezulu ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi elandelela kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

Ukutholwa kwe-DETR Transformer ekusebenzeni

Inika amandla ukuhlukaniswa kwe-panoptic uma kunwetshwa ekuqageleni kwemaski ngephikiseli ngayinye.

Ukunika amandla ukuhlukaniswa kwe-panoptic uma kunwetshwa ekubikezelweni kwemaski yephikiseli ngayinye Amaqembu ngokuvamile athola imiphumela engcono uma echaza izilinganiso zekhwalithi ngaphambili, agcina indlela yokukhuphuka yomuntu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

Ukutholwa kwe-DETR Transformer ekusebenzeni

Isebenza njengomgogodla wezakhiwo ze-open-vocabulary kanye nezitholi eziphansi.

Isebenza njengomgogodla wokwakhiwa kwezithonjana zamagama avulekile kanye nezisekelo Amaqembu ngokuvamile athola imiphumela engcono uma echaza izinga eliphezulu ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

Ukutholwa kwe-DETR Transformer ekusebenzeni

Ukuthola izinto ezithombeni zeshalofu lokudayisa ngaphandle kokushuna osayizi behange ngedathasethi ngayinye.

Ukuthola izinto ezithombeni zamashalofu okudayisa ngaphandle kokushuna osayizi behange ngesethi yedatha ngayinye Amaqembu ngokuvamile athola imiphumela engcono uma echaza izilinganiso zekhwalithi ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

Izingozi & Guardrails

!

Amalungelo ezithombe kanye nemvume kungaba ubungozi bezomthetho uma ukuvela kungacacile.

!

Ukusebenza kwemodeli kungahluka kukho konke ukukhanya, izibalo zabantu, kanye nezindawo.

!

Okuhle okungelona iqiniso kungase kungabonakali ngaphandle uma izinga lokuzethemba liqashelwa.

Ukuqalisa Umhlahlandlela

1

Chaza indlela yokwamukela yokunemba, ukukhumbula, nezindleko zamaphutha.

Chaza indlela yokwamukela yokunemba, ukukhumbula, nezindleko zamaphutha. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

2

Hlola ngedatha efana nezimo zangempela zokukhiqiza.

Hlola ngedatha efana nezimo zangempela zokukhiqiza. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

3

Engeza isibuyekezo somuntu ukuze uthole ukuzethemba okuphansi noma izibikezelo zomthelela omkhulu.

Engeza isibuyekezo somuntu ukuze uthole ukuzethemba okuphansi noma izibikezelo zomthelela omkhulu. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

4

Landelela ukukhukhuleka kwemodeli bese uqinisekisa kabusha ngemva kwezinguquko zekhamera noma zesethi yedatha.

Landelela ukukhukhuleka kwemodeli bese uqinisekisa kabusha ngemva kwezinguquko zekhamera noma zesethi yedatha. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

Qhubeka Uhlole