Makambani GUIDE
LAION uye Vhura Datasets
LAION isangano reGerman risingabatsiri iro rakaburitsa akavhurika emifananidzo-mameseji mameseti, ane mukurumbira LAION-5B, ayo akakurudzira kudzidziswa kweakavhurika generative modhi seStable Diffusion.
Teerera kugwaro iriAI-yakarondedzerwa · ~2 min
Pa peji ino2 min verenga
Pfupiso
Izvo zvine basa nekuti yakaita web-scale multimodal data kuwanikwa pachena kune vanotsvaga kunze kwemakambani makuru.
Kudzika Kwakadzika
LAION (Large-scale Artificial Intelligence Open Network) is a German nonprofit founded in 2021 to democratize machine learning research by releasing large open datasets. Its best-known release, LAION-5B, contains roughly 5.85 billion image-text pairs filtered from Common Crawl web data using OpenAI's CLIP model to keep pairs where the caption and image align. LAION distributes URLs and metadata while the original image files remain on their web hosts. The dataset helped researchers train and study open image-text models, including Stable Diffusion. In December 2023, researchers reported URLs to suspected child sexual abuse material in LAION-5B, and LAION withdrew the dataset for a safety revision. In August 2024, LAION described Re-LAION versions created by comparing existing records with partner-provided hash lists. The release excludes known suspect links identified by those partners as of July 2024; LAION explicitly states that filters cannot guarantee all harmful content has been removed from web-scale data.
Kuitwa muNyika yeChokwadi
Kudzidzisa akavhurika mavara-kune-mufananidzo modhi seStable Diffusion pamabhiriyoni emifananidzo-caption pairs
Kuvaka uye kuenzanisa CLIP-chimiro-chinyorwa kudzoreredza uye zero-pfuti classification masisitimu
Kutsvaga kurerekera kwedataset, kuchengetedza zvemukati, uye kuwanikwa kwedata pawebhu chiyero
Kusefa subsets nemutauro, resolution, kana aesthetic mamaki kuti ugadzire akagadzirika-tuning datasets
Ramangwana reLAION uye Vhura Datasets
Vhura multimodal datasets ichasangana nekuwedzera kumanikidza kutenderedza copyright, mvumo, uye zvinokuvadza zvemukati, kusundira kune kwakasimba kusefa, kuunganidza-kuziva marezinesi, uye kubuda kwekunyoresa. Kuburitswa kweLAION kweyakacheneswa dhatabheti kunoratidza shanduko yakanangana nekuchengetedza kuongororwa sedanho rekutanga. Tarisira data rakawanda rekugadzira kana rezinesi, maitiro ekutanga, uye maturusi ekuona. Iko kukakavara pakati pekuvhurika kwemahara emalabhu madiki uye njodzi dzepamutemo uye dzetsika dzewebhu-scraped data inotsanangura chikamu chinotevera chekuvaka dataset.
Kuzvishandisa
Nei zvichikosha
- Nzira yemutengesi. Mamepu emigwagwa emutengesi anopesvedzera izvo izvo timu yako inogona kugadzira inotevera.
- Mutengo uye bhajeti. Mamiriro ezvekutengeserana uye sarudzo dzekuendesa dzinokanganisa mutengo wenguva refu uye njodzi.
- Ngozi uye kuchengeteka. Kambani inokurudzira inogadzirisa kusarudzika kwechigadzirwa, mamiriro ekuchengetedza, uye kuvhurika.
Chenjera
- Zviziviso zvekutanga zvinogona kupfuura kugadzikana mune chaiyo yekugadzira workflows.
- Mitengo yeAPI kana shanduko yepolicy inogona kukanganisa fungidziro husiku.
- Kutsamira kune mumwe-mutengesi kunowedzera kukiya-mukati uye mari yekufambisa.
Matanho anotevera
- Ongorora vanopa uchishandisa ako ega mabasa uye dataset.
- Wongorora zvakavanzika, chengetedzo, uye mazwi emutemo usati wabatanidzwa.
- Chengetedza chirongwa chekudzokera kumashure kune mamodheru kana vatengesi.
- Tarisa zvinyorwa zvekuburitsa kuitira kuti shanduko yemigwagwa isashamise zvikwata.
Ramba Uchiongorora
Tsamba yemahara
Tora iyo yemazuva ese AI pfupiso
Nhatu dzakasimbiswa dzeAI nyaya mangwanani ega ega pakati pevhiki, dzakanyorwa neChirungu chakajeka. Yemahara zvachose, hapana ads.
Imwe email zuva rega rega revhiki. Bvisa kunyoresa kamwe chete. Hatimbotengese kana kugovera kero yako.
Zviedze iwe pachako
Take the LAION and Open Datasets quiz
Mhinduro yepakarepo pamhinduro yega yega, uye chitupa chinogovaniswa chine ID inobatika kana wapedza kosi.
Tsigira dzidzo yemahara yeAI. AI Understanding ndeye 501(c)(3) isingabatsiri - hapana ads, hapana paywall, zvachose. Ita chipo
Mibvunzo inowanzo bvunzwa
Chii chinonzi LAION uye Vhura Datasets?
LAION isangano reGerman risingabatsiri iro rakaburitsa akavhurika emifananidzo-mameseji mameseti, ane mukurumbira LAION-5B, ayo akakurudzira kudzidziswa kweakavhurika generative modhi seStable Diffusion. Izvo zvine basa nekuti yakaita web-scale multimodal data kuwanikwa pachena kune vanotsvaga kunze kwemakambani makuru.
Chii chinonzi LAION chinonyanya kugovera mumifananidzo-yezvinyorwa zvinyorwa?
LAION haitore mifananidzo; inogovera maURL uye metadata, saka vashandisi vanotora mifananidzo kubva kune yavo yekutanga mawebhusaiti.
Anenge mangani emifananidzo-mavara maviri ari muLAION-5B?
LAION-5B ine 5.85 bhiriyoni yemifananidzo-mavara maviri, saka iyo '5B' muzita rayo.
Ndeipi modhi yakashandiswa neLAION kusefa mifananidzo-yemavara maviri emhando yekurongeka?
LAION yakashandisa OpenAI's CLIP kuyera kufanana kwemifananidzo uye kurasa mapepa asina kunyatsoenderana.
Ndeipi yakakurumbira yakavhurika generative modhi yakadzidziswa uchishandisa LAION data?
Yakagadzika Diffusion, yakavhurika mavara-kune-mufananidzo modhi, yakadzidziswa paLAION mufananidzo-chinyorwa data.
What issue led LAION to withdraw LAION-5B in December 2023?
Researchers identified URLs to suspected CSAM in LAION-5B. LAION withdrew the dataset and later described a revision using partner-provided hash lists; this does not establish that every suspicious link was live or that every possible harmful item has been removed.
Ramba uchidzidza
Mazano anoenderana
Mamwe madhairekitori akasarudzirwa nyaya iyi