InoteveraGaidhi rinotevera
Federated Learning
Tekinoroji
Nhungamiro yehunyanzvi
Kudzidza kwakasiyana kunodzidzisa modhi kudhonza zvinhu zvakafanana pamwe chete uye kusundira zvinhu zvakasiyana munzvimbo yekumisikidza.
Teerera kugwaro iriAI-yakarondedzerwa · ~2 min
It matters because it lets AI learn powerful representations from mostly unlabeled data, powering image search, recommendations, and multimodal models.
Panzvimbo pekufanotaura zita, kudzidza kwakasiyana kunodzidza nekuenzanisa: kupihwa chinhu cheancho, modhi inodzidziswa kuitira kuti inofananidzwa 'yakanaka' imhare pedyo nayo munzvimbo yevekita nepo isingaenderane 'negative' ivhu kure. Recipe yakajairwa yekuzvitarisira (seSimCLR) inogadzira zvakanaka nekutora maviri akasarudzika ekuwedzera emufananidzo mumwechete (chirimwa, ruvara jitter, blur); zvimwe zvese zviri mubatch hazvina kunaka. Iyo modhi inoisa mamepu kune mavekita uye kurasikirwa kunopa mubairo wepamusoro kufanana kwevaviri uye kuderera kufanana kwevamwe. Izvi zvinogadzira zvinomisikidza uko chinhambwe chinoratidza zvinoreva, saka basa rezasi rinoda mavara mashoma. CLIP inoshandisa iyo pfungwa imwe chete mumodalities, ichifananidza mifananidzo kune zvinyorwa zvavo.
CLIP kudzidza nzvimbo yakagovaniswa yemifananidzo-yemavara kuitira kuti utsvage muraibhurari yemifananidzo ine mutsara wakanyorwa senge 'imbwa iri pabhodhi rekutamba'.
Kufanogadzirira chiono chemusana neSimCLR pamifananidzo isina kunyorwa, wozoigadzirisa kuti ionekwe nechirwere iine kadiki kakanyorwa chete.
Kuvaka chigadzirwa kana nziyo kurudziro uko zvakamisikidzwa kwezvinhu zvakafarirwa nemushandisi zvinogara padhuze kuti zvitore muvakidzani ari pedyo.
Masisitimu ekusimbisa kumeso anodzidzisa kuisirwa saka mafoto maviri emunhu mumwe ari padyo uye vanhu vakasiyana vari kure.
Kudzidza kwakasiyana kuri kusangana neakafukidzwa uye anogadzira kuzvitarisira kuita zvinangwa zvakasanganiswa zvinotora kufanana kwepasirese uye ruzivo rwakanaka. Mhedzisiro yaro yakakura ndeye multimodal: inomisikidzwa yakamisikidzwa mufananidzo-chinyorwa (uye ikozvino odhiyo nevhidhiyo) embeddings inotsigira kutsvaga, kudzoreredza-yakawedzera chizvarwa, uye zero-pfuti kupatsanura, uye iwo tsoka inokura. Tarisira basa rakawanda mukuderedza havi yezvimedu zvakakura, pakuwedzera kuri nani uye nzira dzisina kunaka dzekuchera migodhi, uye pakuwedzera nzira yekuenda kumatunhu akaita sekufungidzira kwekurapa uye nguva-yakatevedzana uko mavara ari kushomeka uye anodhura.
Tsamba yemahara
Nhatu dzakasimbiswa dzeAI nyaya mangwanani ega ega pakati pevhiki, dzakanyorwa neChirungu chakajeka. Yemahara zvachose, hapana ads.
Imwe email zuva rega rega revhiki. Bvisa kunyoresa kamwe chete. Hatimbotengese kana kugovera kero yako.
Zviedze iwe pachako
Mhinduro yepakarepo pamhinduro yega yega, uye chitupa chinogovaniswa chine ID inobatika kana wapedza kosi.
Tsigira dzidzo yemahara yeAI. AI Understanding ndeye 501(c)(3) isingabatsiri - hapana ads, hapana paywall, zvachose. Ita chipo
Kudzidza kwakasiyana kunodzidzisa modhi kudhonza zvinhu zvakafanana pamwe chete uye kusundira zvinhu zvakasiyana munzvimbo yekumisikidza. Izvo zvine basa nekuti inoita kuti AI idzidze inomiririra ine simba kubva kuzhinji isina kunyorwa dhata, simba rekutsvaga mifananidzo, kurudziro, uye multimodal modhi.
Kudzidza kwakasiyana kunoumba nzvimbo yekumisikidza kuitira kuti mapeya anoenderana ari padyo uye asingaenderane mapeya ari kure kure.
SimCLR inoumba zvakanaka kubva kune maviri akawedzera maonero echifananidzo chimwe, nemimwe mifananidzo mubatch inoshanda seyakaipa.
InfoNCE, softmax pamusoro pekufanana zvibodzwa zvine tembiricha, ndiyo yakajairika inosiyanisa chinangwa.
Kudzidza kwakasiyana kunobatsira kubva kune zvakawanda zvakashata; mutsara unovapa ivo vachichengeta batch size inogoneka.
Pasina zvakaipa, modhi inogona kuita mepu zvese kune imwechete vector; kumira-gradient uye nhanho dzekusimudzira zvinodzivirira kudonha uku.
Ramba uchidzidza
Mamwe madhairekitori akasarudzirwa nyaya iyi
InoteveraGaidhi rinotevera
Federated Learning
Tekinoroji