InoteveraGaidhi rinotevera
Maitiro eSpatial Transformer Networks
AI Yekutarisa
Gwara reVisual AI
Diffusion Transformers
Diffusion Transformers (DiTs) inoshandura iyo convolutional U-Net pamwoyo wemufananidzo uye vhidhiyo jenareta kune Transformer musana.
Teerera kugwaro iriAI-yakarondedzerwa · ~2 min
Pa peji ino2 min verenga
Pfupiso
This architecture powers leading systems like Stable Diffusion 3 and OpenAI's Sora, and it scales remarkably well as you add compute.
Kudzika Kwakadzika
Diffusion modhi inogadzira mapikicha nekutanga kubva paruzha rwakachena uye nekudzokorodza kuita ruzha mumufananidzo wakabatana. Kwemakore network ichiita iyo denoising yaive U-Net, inogadziriswa dhizaini. Iyo Diffusion Transformer, yakaunzwa naPeebles na Xie muna 2022, inotsiva U-Net neTransformer. Mufananidzo wacho unotanga wakatsikirirwa munzvimbo yakanyarara, yakakamurwa kuita zvigamba zvidiki, uye chigamba chimwe nechimwe chinova chiratidzo, senge mazwi emhando yemutauro. Iyo Transformer inozogadzirisa aya ma tokens nekuzvitarisa wega pane imwe neimwe nhanho yedenoising. Chinhu chakakosha chekuwana ndechekuti DiT performance inovandudza kufanofungidzira sezvaunowedzera saizi yemuenzaniso uye kuderedza saizi yechigamba, uchitevera yakachena kuyera mitemo. Uku scalability ndosaka mameseji-kune-vhidhiyo uye yepamusoro-yekupedzisira mameseji-kune-mufananidzo masisitimu akatamira zvakanyanya kuTransformer backbones.
Kuitwa muNyika yeChokwadi
OpenAI's Sora inoshandisa Transformer musana pamusoro pezvigamba zvemuchadenga kugadzira mavhidhiyo akareba-maminiti, akavimbika kubva mukurudziro yemavara.
Yakagadzika Diffusion 3 inotora multimodal Diffusion Transformer (MMDiT) kuti ienzanise zvirinani mifananidzo yakagadzirwa ine yakadzama yezvinyorwa tsananguro.
Vatsvaguri vanoyera DiT kusvika kumabhiriyoni emaparamita uye vanocherekedza mhando yemufananidzo ichinatsiridza fungidziro, ichitungamira komputa-bhajeti sarudzo.
Iyo studio inoshandisa DiT-yakavakirwa modhi kuti iwedzere zvipfupi zvipfupi, inobata akawedzera vhidhiyo mafuremu seyekuwedzera chigamba tokeni kuita denoise.
Ramangwana reDiffusion Transformers
Diffusion Transformers iri kuita iyo default musana wekugadzira midhiya. Yavo tokeni-yakavakirwa dhizaini inoita kuti ive yakasikwa yekubatanidza mifananidzo, vhidhiyo, uye kunyange multimodal chizvarwa pasi peimwe scalable architecture. Tsvagiridzo iri kusundira kuvhidhiyo yakareba, kugadziriswa kwepamusoro, uye kutarisisa kwakanyanya kudzikamisa mutengo wequadratic wematokeni mazhinji. Tarisira kusangana pakati pemutauro nemhando dzezviono, uko zvakafanana Transformer scaling mabikirwo uye zvivakwa zvinoshanda zvese, zvichiwedzera kufambira mberi mumamodeli epasirese uye vhidhiyo inodyidzana.
Kuzvishandisa
Nei zvichikosha
- Kumhanya uye chiyero. Visual AI inogona kuita otomatiki yekuongorora, yekuona, uye yekumaka mabasa pachiyero.
- Vaka sarudzo. Zvikwata zvekugadzira zvinogona prototype pfungwa nekukurumidza nekudzokororwa kwemaoko mashoma.
- Team uye workflow. Mashandisirwo anogona kushandisa masaini emifananidzo nemavhidhiyo ayo aimbove akaoma kugadzirisa.
Chenjera
- Kodzero dzemifananidzo uye kubvumirwa kunogona kuve njodzi dzepamutemo kana provenance isina kujeka.
- Kuita kwemuenzaniso kunogona kusiyanisa kupenya, huwandu hwevanhu, uye nharaunda.
- Manyepo enhema anogona kusacherechedzwa kunze kwekunge zvikumbaridzo zvekuvimba zvikatariswa.
Matanho anotevera
- Tsanangura maitiro ekugamuchirwa echokwadi, kurangarira, uye mutengo wekukanganisa.
- Edzai nedata rinoenderana nemamiriro chaiwo ekugadzira.
- Wedzera ongororo yemunhu kune yakaderera-kusavimbika kana yakakwirira-inokanganisa kufanotaura.
- Tevera modhi kudonha uye simbisa mushure mekuchinja kwekamera kana dataset.
Ramba Uchiongorora
Tsamba yemahara
Tora iyo yemazuva ese AI pfupiso
Nhatu dzakasimbiswa dzeAI nyaya mangwanani ega ega pakati pevhiki, dzakanyorwa neChirungu chakajeka. Yemahara zvachose, hapana ads.
Imwe email zuva rega rega revhiki. Bvisa kunyoresa kamwe chete. Hatimbotengese kana kugovera kero yako.
Zviedze iwe pachako
Take the Diffusion Transformers quiz
Mhinduro yepakarepo pamhinduro yega yega, uye chitupa chinogovaniswa chine ID inobatika kana wapedza kosi.
Tsigira dzidzo yemahara yeAI. AI Understanding ndeye 501(c)(3) isingabatsiri - hapana ads, hapana paywall, zvachose. Ita chipo
Mibvunzo inowanzo bvunzwa
What is Diffusion Transformers?
Diffusion Transformers (DiTs) inoshandura iyo convolutional U-Net pamwoyo wemufananidzo uye vhidhiyo jenareta kune Transformer musana. Ichi chivakwa chine masimba ekutungamirira masisitimu akaita seStable Diffusion 3 uye OpenAI's Sora, uye inoyera zvinoshamisa paunowedzera komputa.
Ndechipi chikamu chinotsiviwa neDiffusion Transformer ichienzaniswa nemhando dzechinyakare dzekuparadzira?
DiTs inotsiva iyo U-Net, iyo convolutional network yakaita denoising, ine Transformer musana.
Ko DiT inoshandura sei chifananidzo kuita chimwe chinhu chinoshandurwa neTransformer?
Mufananidzo wakaremara wakakamurwa kuita zvigamba zvidiki, uye chigamba chega chega chinova chiratidzo, chinofananidzwa nemazwi mumuenzaniso wemutauro.
Pepa rekutanga reDiT rakawanei nezve kuyera?
Hunhu hweDiT hunovandudzika nenzira yakachena, inofanotaurwa paunowedzera modhi komputa uye kushandisa zvigamba zvidiki, uchitevera mitemo yekuyera.
MaDiTs anowanzo pinza sei majekiseni senge nhanho yenguva uye mameseji ekukurumidza?
DiTs dzinoshandisa adaptive layer normalization kufanotaura chiyero uye chinja maparamita ezvakajairwa zvikamu kubva pachiratidzo chekugadzirisa.
Chii chinonzi 'adaLN-zero' kutanga chinogonesa?
adaLN-zero inotangisa modulation kuitira kuti chivharo chimwe nechimwe chiite sechiziviso, chinogadzika nekuvandudza kudzidziswa.
Ramba uchidzidza
Mazano anoenderana
Mamwe madhairekitori akasarudzirwa nyaya iyi