Visual AI GUIDE

Optical Flow

Kuyerera kweOptical inofungidzira kuti pixel yega yega inofamba sei pakati peakateedzana mavhidhiyo mafuremu, ichigadzira mepu yakaomesesa yemafambisirwo emagetsi.

2 min verengaLast update

Pfupiso

It is how machines perceive movement, speed, and direction in video.

Kudzika Kwakadzika

Kuyerera kweOptical kunopa museve mudiki wekufamba kune yega pixel, ichitsanangura painoratidzika kunge inofamba kubva kune imwe furemu kuenda kune inotevera. Nzira dzechinyakare dzinogara pafungidziro ye 'kupenya kusingachinji' - poindi inochengeta kupenya kwakafanana painofamba - yakasanganiswa nekutsvedza zvipingaidzo, sezviri muLucas-Kanade (sparse) uye Horn-Schunck (dense) algorithms. Izvi zvinoshanda zvakanaka kune zvidiki, zvinyoro zvinyoro asi zvinonetsa nekufamba nekukurumidza, occlusions, uye matunhu makuru asina mavara. Kudzidza kwakadzama kwakachinja munda: network senge FlowNet, PWC-Net, uye kunyanya RAFT dzidza kuenzanisa maficha pamafuremu uye nekudzokorora kukwenenzvera ndima yekuyerera. Iyo inobuda inotyaira kunzwisisa kwevhidhiyo chero kupi mubvunzo usiri chete 'chii chiri mufuremu?' asi 'zviri kufamba sei?'

Technical Insight

RAFT, nzira yekucherekedza, inovaka 4D 'mutengo wevhoriyamu' inoverengera kuti pixel yega yega mufuremu imwe inoenderana sei nepixel yega yega mufuremu mbiri, yobva yashandisa inodzokororwa inodzokorodza opareta (a GRU) kunatsiridza fungidziro yekuyerera pamusoro pematanho madiki akawanda - sekudzokorodza miseve yakanangana nemitambo iri nani. Uku kukwenenzvera kunodzokororwa, kwete fungidziro huru, inopa kwakapinza, kuyerera kwakaringana kunyangwe kune kwakakura kutamiswa uye neruzivo rwakanaka, uye inokwenenzvera mumativi akasiyana.

Strategic Impact

Kumhanya uye chiyero

Visual AI inogona kuita otomatiki yekuongorora, yekuona, uye yekumaka mabasa pachiyero.

Vaka sarudzo

Zvikwata zvekugadzira zvinogona prototype pfungwa nekukurumidza nekudzokororwa kwemaoko mashoma.

Team uye workflow

Mashandisirwo anogona kushandisa masaini emifananidzo nemavhidhiyo ayo aimbove akaoma kugadzirisa.

Ramangwana reOptical Flow

Kuyerera kweOptical iri kufamba ichienda kunguva-chaiyo, fungidziro yepamusoro-soro pamidziyo yemupendero, kusanganisa kwakasimba nekudzika uye 3D kuyerera kwechiitiko, uye kudzidziswa kwekuzvitarisira kunodzidza kubva kuvhidhiyo mbishi pasina anodhura pasi-echokwadi mavara. Sezvo masisitimu anozvimiririra uye marobhoti anoda kusimba kwekufamba kunzwisisa, tarisira kuyerera kusanganisa nekutevera chinhu nekufembera kuitira kuti michina isangoona mafambiro azvino asi fungidzira kuti zvinhu zvichatevera kupi, kunyangwe kuburikidza nekuvharika uye nekukurumidza kufamba kwekamera.

Real-World Implementation

Vhidhiyo kugadzikana mumafoni uye chiito makamera anodzima kunze shaky handheld motion

Kududzira kweframe kunogadzira mukati-kati-mafuremu kuita kuti vhidhiyo iite seyakapfava kana kuti imhanye zvishoma nezvishoma

Mutyairi-rubatsiro uye mota dzinozvimiririra dzinofungidzira kumhanya uye nzira yemotokari dziri pedyo nevanofamba netsoka.

Vhidhiyo yekumanikidza macodecs kufanotaura kufamba pakati pemafuremu kuti uchengetedze vhidhiyo zvakanyanya

Njodzi & Guardrails

Kodzero dzemifananidzo uye kubvumirwa kunogona kuve njodzi dzepamutemo kana provenance isina kujeka.

Kuita kwemuenzaniso kunogona kusiyanisa kupenya, huwandu hwevanhu, uye nharaunda.

Manyepo enhema anogona kusacherechedzwa kunze kwekunge zvikumbaridzo zvekuvimba zvikatariswa.

Implementation Roadmap

1

Tsanangura maitiro ekugamuchirwa echokwadi, kurangarira, uye mutengo wekukanganisa.

2

Edzai nedata rinoenderana nemamiriro chaiwo ekugadzira.

3

Wedzera ongororo yemunhu kune yakaderera-kusavimbika kana yakakwirira-inokanganisa kufanotaura.

4

Tevera modhi kudonha uye simbisa mushure mekuchinja kwekamera kana dataset.

Ramba Uchiongorora

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the Optical Flow quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Tanga mibvunzo

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Mibvunzo inowanzo bvunzwa

What is Optical Flow?

Kuyerera kweOptical inofungidzira kuti pixel yega yega inofamba sei pakati peakateedzana mavhidhiyo mafuremu, ichigadzira mepu yakaomesesa yemafambisirwo emagetsi. Ndiwo maonerwo emuchina kufamba, kumhanya, uye gwara muvhidhiyo.

Chii chinonzi optical flow inofungidzira?

Kuyerera kweOptical kunogadzira mafambiro mavector anotsanangura mafambiro epixel imwe neimwe kubva kune imwe furemu kuenda kune inotevera.

Chii chinonzi 'brightness constancy' fungidziro inoshandiswa muclassic optical flow?

Nzira dzeClassic dzinofungidzira kupenya kwepoindi yemuviri kunoramba kuripo sezvainofamba, izvo zvinoita kuti vazvienzanise pakati pemafuremu.

Ndeipi nzira yemazuva ano yekudzidza-yakadzika inozivikanwa nekunatsiridza kuyerera uchishandisa mutengo wevhoriyamu uye inodzokororwa inodzokororwa?

RAFT inovaka 4D mutengo wevhoriyamu uye inoshandisa anodzokororwa opareta kunatsiridza kuyerera pamusoro pezvinhanho zvidiki zvakawanda, kuwana mamiriro-e-iyo-anyanzvi echokwadi.

Sei nzira dzechinyakare dzemaziso-kuyerera dzichinetsekana nemafambiro makuru, anokurumidza?

Nzira dzakavakwa padiki-kufamba fungidziro dzinorasa track apo pixel inosvetuka kure pakati pemafuremu, ichikonzera kukanganisa.

Ndeipi application inotsamira zvakananga pakufungidzira mafambiro pakati pemafuremu?

Kududzira kweframe kunogadzira mafuremu epakati uchishandisa inofungidzirwa pixel kufamba, kugadzira vhidhiyo yakapfava kana inononoka.