Amabwiriza ya AI

Impinduka

Diffusion Transformers (DiTs) bahinduranya U-Net ihamye kumutima wibishusho na generator ya videwo kumugongo wa Transformer.

Umva iki gitaboAI-byavuzwe · ~2 min

Kuriyi page2 min soma
  1. Incamake
  2. Kwibira cyane
  3. Gushyira mu bikorwa Isi
  4. Ejo hazaza h'abahindura Diffusion
  5. Kubishyira mubikorwa
  6. Komeza Ubushakashatsi
  7. Ibibazo bikunze kubazwa

Incamake

This architecture powers leading systems like Stable Diffusion 3 and OpenAI's Sora, and it scales remarkably well as you add compute.

Kwibira cyane

Moderi ya Diffusion itanga amashusho mugutangirira ku rusaku rwiza no kubisubiramo mubishusho bihuye. Kumyaka umuyoboro ukora iyo denoising yari U-Net, imyubakire yemeza. Impinduka ya Diffusion, yatangijwe na Peebles na Xie mu 2022, isimbuza U-Net na Transformer. Ishusho yabanje gukusanyirizwa mumwanya wihishe, igabanyijemo uduce duto, kandi buri patch iba ikimenyetso, cyane nkamagambo muburyo bw'ururimi. Transformer noneho itunganya ibi bimenyetso hamwe no kwiyitaho kuri buri ntambwe yerekana. Icy'ingenzi cyagaragaye ni uko imikorere ya DiT itera imbere mu buryo buteganijwe uko wongera ubunini bw'icyitegererezo kandi ukagabanya ingano ya patch, ukurikiza amategeko yo gupima neza. Ubu bunini ni impamvu sisitemu-kuri-videwo na sisitemu yohejuru-yinyandiko-y-amashusho yimukiye ahanini muri Transformer umugongo.

Gushyira mu bikorwa Isi

__AIU_PROTECTED_10 __ 'Sora ikoresha umugongo wa Transformer hejuru yigihe cyagenwe kugirango ubyare amashusho yiminota-minini, yizerwa cyane uhereye kumyandiko.

Diffusion Stable 3 ifata Multimodal Diffusion Transformer (MMDiT) kugirango ihuze neza amashusho yakozwe hamwe nibisobanuro birambuye byanditse.

Abashakashatsi bapima DiT kugeza kuri miliyari y'ibipimo kandi bakareba ubwiza bw'amashusho bugenda butera imbere, bayobora ibyemezo bya bije.

Sitidiyo ikoresha moderi ishingiye kuri DiT kugirango yongere amashusho magufi, ifata amashusho yandi mashusho nkibimenyetso byinyongera byerekana.

Ejo hazaza h'abahindura Diffusion

Impinduka za Diffusion ziba umugongo wambere kubitangazamakuru bitanga umusaruro. Igishushanyo cyabo gishingiye kubimenyetso bituma bakora muburyo bwo guhuza amashusho, videwo, ndetse nibisekuru byinshi munsi yububiko bumwe. Ubushakashatsi burimo gusunika kuri videwo ndende, gukemura cyane, no kurushaho kwitabwaho kugirango ugabanye igiciro cya kane cyibimenyetso byinshi. Tegereza guhuza imvugo nicyitegererezo, aho bisa na Transformer scaring resept hamwe nibikorwa remezo bikora byombi, byihutisha iterambere mubyitegererezo byisi na videwo ikorana.

Kubishyira mubikorwa

Impamvu ari ngombwa

  • Umuvuduko n'igipimo. AI igaragara irashobora gukora igenzura, gutahura, no gutondekanya imirimo kurwego.
  • Kubaka amahitamo. Amakipe arema arashobora prototype ibitekerezo byihuse hamwe nintoki nkeya.
  • Itsinda hamwe nakazi. Ibikorwa birashobora gukoresha amashusho nibimenyetso bya videwo byari bigoye gutunganya.

Witondere

  • Uburenganzira bwishusho hamwe no kwemererwa birashobora guhinduka ibyago byemewe n'amategeko niba ibimenyetso bidasobanutse.
  • Imikorere yicyitegererezo irashobora gutandukana kumurika, demografiya, nibidukikije.
  • Ibyiza byibinyoma birashobora kutamenyekana keretse niba ibyiringiro byateganijwe bikurikiranwa.

Intambwe ikurikira

  1. Sobanura ibipimo byo kwemererwa kugiciro, kwibutsa, nibiciro byamakosa.
  2. Gerageza hamwe namakuru ajyanye nuburyo nyabwo bwo gukora.
  3. Ongeraho isubiramo ryabantu kubwizere buke cyangwa guhanura cyane.
  4. Kurikirana icyitegererezo cya drift hanyuma uhindurwe nyuma ya kamera cyangwa dataset ihinduka.

Komeza Ubushakashatsi

Ibaruwa y'amakuru y'ubuntu

Ibuka amakuru ya buri munsi ya AI

Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.

Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.

Isuzume

Take the Diffusion Transformers quiz

Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.

Tangira ikibazo

Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano

Ibibazo bikunze kubazwa

What is Diffusion Transformers?

Diffusion Transformers (DiTs) bahinduranya U-Net ihamye kumutima wibishusho na generator ya videwo kumugongo wa Transformer. Ubu bwubatsi bufite imbaraga ziyobora sisitemu nka Stable Diffusion 3 na __AIU_PROTECTED_10 __ 'Sora, kandi ipima neza kuburyo wongeyeho compte.

Niki kintu gihindura Diffusion Transformer ugereranije na moderi gakondo yo gukwirakwiza?

DiTs isimbuza U-Net, umuyoboro wemeza wakoze denoising, hamwe numugongo wa Transformer.

Nigute DiT ihindura ishusho mubintu Transformer ishobora gutunganya?

Ishusho yihishe igabanijwemo uduce duto, kandi buri patch iba ikimenyetso, gisa namagambo murugero rwururimi.

Ni iki impapuro z'umwimerere DiT zabonye zijyanye no gupima?

Ubwiza bwa DiT butera imbere muburyo busukuye, buteganijwe uko wongera compte yicyitegererezo kandi ugakoresha uduce duto, ukurikiza amategeko yo gupima.

Nigute DiTs itera inshinge nka timestep hamwe nibisobanuro byihuse?

DiTs ikoresha uburyo bwo guhuza n'imihindagurikire y'ikirere kugira ngo hamenyekane ibipimo n'ibipimo byerekana ibipimo bisanzwe biva ku kimenyetso cyerekana.

Ni iki gutangiza 'adaLN-zeru' bigeraho?

adaLN-zeru itangiza modulation kuburyo buri gice kibanza gukora nkirangamuntu, ituza kandi igateza imbere amahugurwa.