GLIGEN Grounded Generation
GLIGEN (Ground-Language-to-Hoto Generation) yana ba ku damar sarrafa daidai inda abubuwa suka bayyana a cikin hoton da aka ƙirƙira ta hanyar ciyar da kwalaye masu ɗaure samfurin da lakabi tare da saurin rubutu.
Dubawa
It turns vague text-to-image into precise, layout-controllable synthesis.
Zurfafa nutsewa
Misalin rubutu-zuwa hoto na yau da kullun suna kokawa tare da sarrafa sararin samaniya: nemi 'kallo zuwa hagu na kare' kuma galibi kuna samun kuskuren jeri. GLIGEN, wanda aka gabatar a cikin 2023, yana warware wannan ta hanyar ƙara abubuwan shigar ƙasa kamar akwatunan ɗaure waɗanda aka haɗa tare da rubutu ko mahallin hoto, maɓalli, ko hotunan tunani. Mahimmanci, yana daskare ainihin ma'aunin samfurin da aka riga aka horar da shi kuma yana allura sabbin matakan kulawa da kai wanda za'a iya horar da shi wanda ke ɗaukar alamun ƙasa. Wannan yana nufin yana ginawa akan samfuri kamar Stable Diffusion ba tare da lalata ilimin da aka koya ba, kuma gating yana farawa kusa da sifili don haka ana kiyaye halayen ƙirar tushe tun farkon horo. Sakamakon shine tsarar ƙasa mai buɗewa ta duniya: zaku iya sanya abubuwan da aka siffanta na sabani a ƙayyadaddun wurare, kuma yana ƙayyadaddun ra'ayoyi da shimfidu waɗanda ba a gani yayin horon ƙasa.
Fahimtar Fasaha
GLIGEN yana wakiltar kowane mahallin ƙasa azaman alamar da ke haɗa rubutunsa ko hoton sa tare da bayanan sararin samaniya, kamar daidaitawa guda huɗu na akwatin da aka ɓoye ta hanyar fasalulluka na Fourier. Waɗannan alamomin ƙasa suna shiga cikin daskararrun watsawar U-Net ta hanyar sabbin abubuwan da aka saka gated mai kula da kai wanda aka sanya tsakanin abubuwan da ake da su na kulawa da kai. Ƙofar da za a iya koyo, wadda aka fara zuwa sifili, tana sarrafa yadda ƙasa ke yin tasiri ga tsara, don haka ƙara sarrafawa yana ƙasƙanta da kyau kuma horo ya tsaya tsayin daka.
Dabarun Tasiri
Gudu da sikelin
Kayayyakin AI na iya sarrafa aiki da bincike, ganowa, da ayyuka masu alama a sikelin.
Gina zaɓuɓɓuka
Ƙungiyoyin ƙirƙira za su iya samar da ra'ayoyi cikin sauri tare da ƙarancin bita da hannu.
Ƙungiya da aikin aiki
Ayyuka na iya amfani da siginar hoto da bidiyo waɗanda a baya suke da wahalar aiwatarwa.
Makomar GLIGEN Grounded Generation
Ƙirƙirar ƙasa da shimfidar wuri-mai sarrafawa yana zama daidaitattun kayan aikin samarwa. Yi tsammanin yanayin yanayin yanayin salon GLIGEN don haɗawa tare da sauran hanyoyin sarrafawa kamar ControlNet da faɗakarwar yanki, da haɓaka cikin bidiyo da 3D inda sanya abu akan lokaci da sararin samaniya ya fi mahimmanci. Kamar yadda samfura ke ɗaukar musaya masu biyowa na koyarwa, ja-da-saukar da sarrafa shimfidu da ƙayyadaddun zane-zanen yanayi za su sa madaidaicin abun da ke ciki ya isa ba tare da dabarun injiniyan gaggawa ba.
Aiwatar da Gaskiyar Duniya
Sanya tambari ko samfur a cikin ainihin yanki na tallan da aka samar ta amfani da akwatin ɗaure
Ƙirƙirar rikitattun al'amuran ta hanyar tantance inda kowane hali ko abu ya kamata ya zauna kafin nunawa
Samar da bayanan horo don gano abu tare da sanannun wuraren akwatin gaskiya
Zana wani abu da aka siffanta cikin yankin da mai amfani ya zana na hoton da ke akwai
Hatsari & Tsare-tsare
Haƙƙoƙin hoto da yarda na iya zama haxarin doka idan ba a fayyace ba.
Ayyukan samfuri na iya bambanta a ko'ina cikin haske, ƙididdiga, da mahalli.
Ƙarya tabbataccen ƙila ba za a iya lura da shi ba sai dai idan an kula da ƙofofin amincewa.
Taswirar Hanya
Ƙayyade ma'auni na karɓa don daidaito, tunowa, da farashi na kuskure.
Gwada tare da bayanan da suka dace da ainihin yanayin samarwa.
Ƙara bita na ɗan adam don ƙarancin amincewa ko tsinkaya mai tasiri.
Bi diddigin ƙirar ƙira kuma sake ingantawa bayan canje-canjen kamara ko saitin bayanai.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the GLIGEN Grounded Generation quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Rubutu-zuwa-3D Generation
Tambayoyin da ake yawan yi
What is GLIGEN Grounded Generation?
GLIGEN (Ground-Language-to-Hoto Generation) yana ba ku damar sarrafa daidai inda abubuwa suka bayyana a cikin hoton da aka ƙirƙira ta hanyar ciyar da kwalaye masu ɗaure samfurin da lakabi tare da saurin rubutu. Yana juya madaidaicin rubutu-zuwa-hoto zuwa madaidaici, haɗawar shimfidar wuri-mai sarrafa.
Wace matsala GLIGEN ke magance da farko?
GLIGEN yana ƙara abubuwan shigar ƙasa kamar akwatunan ɗaure ta yadda za ku iya sarrafa daidai inda aka sanya abubuwa, wanda rubutu a sarari yake faɗakarwa mara kyau.
Ta yaya GLIGEN ke adana ilimin da aka riga aka horar da samfurin watsawa?
GLIGEN yana daskare samfurin tushe kuma yana allura sabbin matakan kula da kai, don haka ainihin ilimin da aka koyo ya tsaya cik.
Menene ainihin shigar da ƙasa GLIGEN ke karɓa?
GLIGEN yana goyan bayan ƙasa ta hanyar akwatuna masu ɗaure tare da abubuwan rubutu/hoto, maɓalli, da hotunan tunani.
Me yasa ƙofa a cikin sabbin matakan kulawa na GLIGEN aka fara zuwa sifili?
Ƙofar da aka fara sifili na nufin ƙaddamar da ƙasa ba ta da wani tasiri da farko, tana kiyaye ƙirar asali da kuma kiyaye kwanciyar hankali yayin da iko ke tasowa.
Menene ma'anar 'buɗaɗɗen duniya' tushen ƙasa a cikin GLIGEN?
GLIGEN ya keɓanta fiye da tsarin horo na ƙasa, yana ajiye abubuwan da aka kwatanta a ƙayyadaddun wurare.