KontrolNet
ControlNet ab yokk-on la buy may model yiy defar nataal ñu mëna doxal seen bopp ci anam wu jaar yoon, loolu dina tax nga mëna tànn li ngay génne ci boor yi, pose yi, kàrtu xóotaayu yi, wala scribbles yi.
Résumé
It turns text-to-image from a slot machine into a controllable design tool.
Plongeur bu xóot
Lvmin Zhang ak ay naataangoom ñoo ko dugal ci 2023, ControlNet dafay boole ci xeetu diffusion buñ tàggat bu njëkk bu melni Diffusion Stable te doo tàggataat mbir yépp. Dafay klone bloku enkodeer yi ci diffusion U-Net ci benn kopi buñu mëna tàggat, ba noppi mu boole kopi boobu ak orginaal biñ gelé jaaraleko ci ay couche convolution yu amul dara (zero-convs). Yii zero-convs tàmbaliwul dara, kon tàggat yaram dafay tàmbali ci doxalinu model bi njëkk ba noppi di jàng ndànk-ndànk ni ñuy injecte conditionnement. Kondisioneer bi kàrtu barab la: nataalu catu Canny, yax OpenPose, kàrtu xóotaayu, masku segmentaasioŋ, wala jëmmal bu dëgërul. Lépp soo ko boolee mooy nataal biñ defar dafay topp jumtukaayu kàrtu kontre bi, ci noonu la bind bi di tëralee stil bi ak ëmbiit li, loolu dina tax artist yi mëna wóolu, ñu mëna ko baamtu.
Gis-gis xarala
Kaf giy màndargaal mooy konvolusioŋ nul. Ndax couche yiy boole dañuy tàmbali ci zero poids, branch ControlNet bi du yokk dara ci ndoorte li, kon model bi dafay nuru original bi ci ndoortelu tàggat bi. Loolu dafay moytu bruit bu bonn bi layers yu bees yi di dugal, ba noppi dafay tax fine-tuning nekk stabil ba ci dataset yu ndaw. Degrade yi dañuy dugg ci zero-convs yi, ñu ubbi ndànk-ndànk yoonu kondisioneer bi, jàng ni ñuy doxalee ci anam wu wóor.
njeextalu pexe
Gaawaay ak yaatuwaay
Visual IA mën na otomatise saytu, gis ak etiketu liggéey ci eskaal.
Tabax tànneef
Ekipu kreatif yi mën nañu defar konsept yu gëna gaaw te duñu def lu bari ci loxo.
Ekip ak def liggéey
Liggéeyukaay yi mën nañu jëfandikoo siñaal nataal wala wideo yu jafewoon lool ci liggéey.
Ëlëgu ControlNet
Kondisioneeru xeetu ControlNet mingi nekk infrastructure buñ miin ci jumtukaayi sos lu bees, ak stacking yu bari (boole pose ak xóotaayu ak boor yi) ak adaptatër yu gëna woyof yu melni T2I-Adapter ak IP-Adapter. Xaarandi boole bu gëna dëgër ci diffusion wideo ngir doxal mouvement bu méngoo, soppali interactif ci jamono dëgg, ak model yuñ boole muy nangu xeeti doxal yu bari benn yoon, di dindi dig wi dox diggante sketching ak rendu bu mujj.
Doxal ci àdduna dëgg
Tëj pose bu dëggu bu ab personage ak yax OpenPose bi ngay soppi yéere ak ginaaw jaaraleko ci laaj bi
Jëfandikoo kàrtu Canny edge ngir soppi stil nataalu tabax boole ci baña yàq ligne architecture yi
Soppi scribble yu ñu desine ak loxo ñu nekk ay tegtal yu leer ngir konsept art ak storyboard
Jëfandikoo kàrtu xóotaayu seen yi ñuy defar ngir sargal jëmmal 3D ngir rendu produit yi ak maquette jëmmal biir
Risk yi ak balustrade yi
Yelleefi nataal ak nangu mën na nekk risku yoon sudee fi ñu bawoo leerul.
Performance model bi mën na wuute ci leeraay bi, demographie bi ak environmaa bi.
Njuumteg positive yi mën nañu dem te kenn duko seetlu fileek xool wuñu buntu wóolu sa bopp.
Roadmap ngir samp gi
Mandargal kritërium nangug njub, woowaat ak njëgu njuumte.
Saytu ak done yu méngoo ak anam yi ñuy liggéeyee dëgg.
Yokk jàngat nit ngir xam fu wóorul dara wala am njeexital yu rëy.
Toppal model drift bi nga baaxal ko ginaaw bi kamera bi wala done yi soppeekoo.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the ControlNet quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
SLAM buy wane
Laaj yi ñuy faral di laaj
What is ControlNet?
ControlNet ab yokk-on la buy may model yiy defar nataal ñu mëna doxal seen bopp ci anam wu jaar yoon, loolu dina tax nga mëna tànn li ngay génne ci boor yi, pose yi, kàrtu xóotaayu yi, wala scribbles yi. Dafay soppi bind-à-nataal ci masin slot mu nekk jumtukaayu jëmmal buñ mëna saytu.
Ban jafe-jafe la ControlNet njëkka saafara ci defar nataal?
ControlNet dafay may jëfandikukat yi ñu mëna jiite génne gi ci anam yu bari yu melni boor yi, pose yi, wala xóotaayu, suko defee ñu mëna saytu defar bi te baña nekk ci anam wu bari.
Lan mooy wareefu 'konvolusioŋ nul' ci ControlNet?
Convolution yu amul benn njariñ duñu def dara ci ndoorte li, kon model bi dafay méngoo ak li njëkk ba noppi di jàng conditionnement ndànk-ndànk te baña gaawa jeex.
Ci yii, yan ci ñoom mooy dugal ControlNet bi baax?
ControlNet dafay jëfandikoo kàrtu barab yu melni yax pose, kàrtu xóotaayu, catu Canny, ak masku segmentation ngir tegtal jëmmal.
naka la ControlNet di méngoo ak xeetu diffusion bu njëkk bi melni diffusion bu dëgër?
ControlNet dafay klone ba noppi di tàggat benn kopi encoder bi ci noonu muy tëye U-Net bi njëkk, ba noppi denc xam-xam bimu jàng.
Ci biir liggéeyu ControlNet, lan mooy faral di tëral stil bi ak ëmbiit li ci jamono ji kàrtu njiit bi di tëral jumtukaay bi?
Bind bi dafay saytu stil bi ak sujet bi, waaye kàrtu saytu bi mooy tëral xeetu barab bi.