Ukuqashelwa Kwesenzo
Ukuqashelwa kwesenzo kuwumsebenzi wokufundisa amakhompuyutha ukuhlonza lokho abantu noma izinto ezenziwa *kuvidiyo - ukugijima, ukuvayizisa, ukuwa, ukuvula umnyango - hhayi nje lokho okuvela kuhlaka olulodwa.
Uhlolojikelele
It matters because understanding motion over time unlocks applications from sports analytics to elderly fall detection.
I-Deep Dive
Ukuqashelwa kwesenzo kudlula ukuhlukaniswa kwesithombe okumile ngokucabanga ngendlela amaphikseli ashintsha ngayo phakathi nesikhathi. Uhlaka olulodwa lungabonisa umuntu phakathi komoya; ukulandelana kuphela okuveza ukuthi ziyagxuma, ziyawa, noma ziyatshuza. Izici zokunyakaza ezenziwe ngezandla zamasistimu okuqala afana nokugeleza kwe-optical nama-trajectories aminyene. Izindlela zesimanje zisebenzisa amanethiwekhi ajulile: ukubukeka kwenqubo yezakhiwo ezimbili zokusakaza (amafreyimu e-RGB) nokunyakaza (ukugeleza kwe-optical) ngokwehlukana; Amanethiwekhi okuxhumana e-3D (njenge-C3D ne-I3D) ashelela izihlungi esikhaleni *kanye* nesikhathi; kanye neziguquli zevidiyo (i-TimeSformer, i-VideoMAE) zisebenza ukunaka kuwo wonke ama-spatio-temporal patches. Amabhentshimakhi ajwayelekile ahlanganisa i-Kinetics (amakilasi angu-700 esenzo somuntu avela ku-YouTube), i-UCF101, kanye ne-Something-Something, ephoqa amamodeli ukuthi aqonde isiqondiso sesikhashana kunomongo wesigcawu nje.
I-Technical Insight
Inselele eyinhloko ukumodela ubukhulu besikhashana. I-3D convolution inweba isihlungi esivamile se-2D nge-eksisi ejulile ehlanganisa ozimele abambalwa, ngakho ifunda amaphethini okunyakaza ngokuqondile. Iqhinga le-I3D 'likhuphula' izisindo kusukela kunethiwekhi yesithombe se-2D esiqeqeshwe kusengaphambili ku-ImageNet ukuya ku-3D ngokuyiphindaphinda ngesikhathi, inikeze iphoyinti lokuqala eliqinile. Izindlela zokusakaza-mbili esikhundleni salokho ziphakela ukugeleza kwe-optical okuhlanganiswe kusengaphambili kugatsha elihlukile, ukunyakaza kombhalo wekhodi ngokusobala bese kuhlanganisa nezici zokubukeka.
I-Strategic Impact
Isivinini nesikali
I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini.
Yakha ukukhetha
Amathimba aqanjiwe angakwazi ukulinganisa imiqondo ngokushesha ngezibuyekezo ezimbalwa ezenziwa mathupha.
Ithimba kanye nokusebenza komsebenzi
Imisebenzi ingasebenzisa amasiginali wesithombe nawevidiyo obekunzima ukuwenza ngaphambilini.
Ikusasa Lokuqashelwa Kwesenzo
Inkambu ishintshela kuma-transformer wevidiyo asebenza kahle kanye nokuziqeqesha kwangaphambili okuzigadile (ukumodela okufihliwe kwevidiyo) okufunda ezithombeni ezingenamalebula, ezinciphisa ukuthembela ezichasiselweni ezibizayo. Lindela ukuhlanganiswa okuqinile namamodeli ezilimi eziningi ukuze amasistimu angagcini ngokulebula izenzo kodwa azichaze futhi acabange ngazo ngolimi lwemvelo. Isikhathi sangempela, ukubonwa okukudivayisi kwezinto ezigqokwayo, amarobhothi, namakhamera ahlakaniphile kuwumngcele omkhulu, eduze nokuqashelwa okucolisekile okwehlukanisa ukunyakaza okucashile, okucishe kufane.
Ukuqaliswa Komhlaba Wangempela
Amasistimu okubona ukuwa ezindlini ezinakekela asebekhulile axwayisa abasebenzi lapho umhlali ewa, ahlukanisa ukuwa nokuhlala noma ukulala phansi.
Izinkundla zezibalo zezemidlalo ezimaka ngokuzenzakalelayo okusetshenzelwanga, ezilwiwayo, kanye nezithombe ezithombeni zomdlalo zokuqeqesha nokusakaza amaphuzu avelele
Ukugadwa nokuphepha okubonisa ukuziphatha okungavamile njengokulwa, ukuzulazula, noma othile ukugibela uthango
Ukuxhumana okulawulwa ngokuthinta kanye nezinhlelo zokusebenza zokufaneleka ezibala ama-reps futhi zihlole ifomu lokuzivocavoca ngokubona ukunyakaza komzimba ngokuhamba kwesikhathi
Izingozi & Guardrails
Amalungelo ezithombe kanye nemvume kungaba ubungozi bezomthetho uma ukuvela kungacacile.
Ukusebenza kwemodeli kungahluka kukho konke ukukhanya, izibalo zabantu, kanye nezindawo.
Okuhle okungelona iqiniso kungase kungabonakali ngaphandle uma izinga lokuzethemba liqashelwa.
Ukuqalisa Umhlahlandlela
Chaza indlela yokwamukela yokunemba, ukukhumbula, nezindleko zamaphutha.
Hlola ngedatha efana nezimo zangempela zokukhiqiza.
Engeza isibuyekezo somuntu ukuze uthole ukuzethemba okuphansi noma izibikezelo zomthelela omkhulu.
Landelela ukukhukhuleka kwemodeli bese uqinisekisa kabusha ngemva kwezinguquko zekhamera noma zesethi yedatha.
Qhubeka Uhlole
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Action Recognition quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Umhlahlandlela olandelayo
Ukuqashelwa Ubuso
Imibuzo evame ukubuzwa
What is Action Recognition?
Ukuqashelwa kwesenzo kuwumsebenzi wokufundisa amakhompuyutha ukuhlonza lokho abantu noma izinto ezenziwa *kuvidiyo - ukugijima, ukuvayizisa, ukuwa, ukuvula umnyango - hhayi nje lokho okuvela kuhlaka olulodwa. Kubalulekile ngoba ukuqonda ukunyakaza ngokuhamba kwesikhathi kuvula izinhlelo zokusebenza kusukela kuzibalo zezemidlalo kuye ekutholweni kokuwa kwabadala.
Yini ehlukanisa ngokuyisisekelo ukuqashelwa kwesenzo ekuhlukaniseni izithombe ezijwayelekile?
Amamodeli aqaphela isenzo anyakaza ngokulandelana kozimele, njengoba isithombe esisodwa esimile ngokuvamile asikwazi ukuveza ukuthi othile uyagxuma, uyawa, noma uyatshuza.
Kunethiwekhi yakudala yokuqaphela isenzo sokusakaza okubili, ukusakaza kwesibili kuvamise ukucubungula ini?
Izakhiwo ezisakazwa kabili zisebenzisa igatsha elilodwa ekubukekeni (ozimele be-RGB) kanye negatsha lesibili lokugeleza kokubona, okufaka ikhodi ngokusobala ukunyakaza phakathi kwamafreyimu.
I-3D convolution yengeza ini uma iqhathaniswa ne-convolution evamile ye-2D?
I-3D convolution inweba isihlungi ngokujula/ubukhulu besikhathi, ukusivumela ukuthi sifunde amaphethini okunyakaza ngokuqondile kumafreyimu alandelanayo.
Iliphi iqhinga 'lokwehla kwamandla emali' elisetshenziswa imodeli ye-I3D?
I-I3D 'ikhukhumeza' izisindo eziqeqeshwe kusengaphambili ezithombeni ze-2D (njenge-ImageNet) zibe yi-3D ngokuzikopisha eduze kwe-eksisi yesikhashana, inikeze ukuqaliswa okuqinile.
Kungani isethi yedatha ye-Something-Something iphawuleka ngokubonwa kwesenzo?
Okuthile-Okuthile kuklanywe ngendlela yokuthi isenzo sincike ekuhlelekeni kwesikhashana nokunyakaza, ukuvimbela amamodeli kusukela ekukopeleni esebenzisa ingemuva noma ukubukeka kwento yodwa.