Incamake
Chinchilla ni 2022 DeepMind isanga urugero rwindimi nini rwarakozwe nabi: kubwingengo yimibare ihamye ugomba gupima ibipimo hamwe namakuru hafi kimwe, ntabwo wubaka icyitegererezo kinini. Yahinduye uburyo inganda zingana ingano yicyitegererezo namakuru yamahugurwa.
Chinchilla Compute-Optimal Training yicaye murwego rwibanze rwa AI. Iyo ubisobanukiwe, izindi ngingo za AI zoroha gusuzuma no kugereranya.
Kwibira cyane
Impapuro za Chinchilla za DeepMind zasubiwemo gupima kandi zitoza moderi zirenga 400 kugirango zibone compte-nziza. Umutwe wumutwe wintoki: ingano yicyitegererezo hamwe nibimenyetso byamahugurwa bigomba gukura mugufunga, ibimenyetso 20 byamahugurwa kuri buri kintu. Kugirango babigaragaze, bahuguye Chinchilla, moderi ya miliyari 70-yerekana ibipimo bya miriyoni 1,4, bakoresheje compte imwe na miliyari 280-ya Gopher yatojwe ku bimenyetso bike cyane. Chinchilla, nubwo ari ntoya inshuro enye, yarushije Gopher, GPT-3, n'ibindi bihangange hafi ya byose. Isomo ryatesheje agaciro umwanzuro OpenAI umwanzuro ushimangira ubunini burenze amakuru, werekana moderi nyinshi zamamaye zasize imikorere kumeza kuba nini cyane kandi ifite inzara.
Ubushishozi
Chinchilla igihombo gikwiye nka L (N, D) = E + A · N ^ (- α) + B · D ^ (- β), hamwe na α na β byombi hafi 0.34, bivuze ibipimo namakuru bitanga hafi muburyo bumwe. Kunonosora ibi munsi yimibare ihamye (kubara ≈ 6 · N · D kubahindura) bitanga ibisubizo bingana. Icyitegererezo gito, gikungahaye ku makuru nacyo gihendutse gukora ku mwanzuro, bityo inyungu zacyo zikomatanya mu kohereza, ntabwo ari imyitozo gusa.
Kumenya Chinchilla Kubara-Amahugurwa meza
Chinchilla ni 2022 DeepMind isanga urugero rwindimi nini rwarakozwe nabi: kubwingengo yimibare ihamye ugomba gupima ibipimo hamwe namakuru hafi kimwe, ntabwo wubaka icyitegererezo kinini. Yahinduye uburyo inganda zingana ingano yicyitegererezo namakuru yamahugurwa. Chinchilla Compute-Optimal Training yicaye murwego rwibanze rwa AI. Iyo ubisobanukiwe, izindi ngingo za AI zoroha gusuzuma no kugereranya. Kugirango wubake byimbitse, fata Chinchilla Compute-Optimal Training nkicyitegererezo gikora, ntabwo ari ikintu kimwe: gusobanura ibyagezweho, gusobanura ibitekerezo, no gutandukanya ibyo sisitemu ishobora gukora byizewe nibisaba guca imanza zinzobere.
Mu myitozo, amakipe akomeye akoresha Chinchilla Compute-Optimal Training yubaka icyitegererezo gikomeye cyambere, hanyuma ushushanye izo moderi kubibuza umusaruro. Bandika ibipimo ngenderwaho byerekana intsinzi, bagerageza kurwanya amakuru afatika hamwe nakazi keza, kandi bagasubiramo bashingiye kubikorwa byagaragaye ko batsinzwe aho gutsinda inshuro imwe. Aha niho imyumvire yubumenyi ihinduka mubushobozi burambye kubicuruzwa, politiki, nibikorwa.
Iragufasha gutandukanya ibyifuzo bya tekiniki bisobanutse nururimi rwo kwamamaza. Igihe kimwe, Amakipe atandukanye arashobora gukoresha ijambo rimwe muburyo butandukanye, sobanura intera hakiri kare. Uburyo bukomeye cyane ni uguhuza umuvuduko wikigereranyo hamwe na disipuline yimiyoborere: kuyobora abaderevu, gufata ibimenyetso, gutangaza ibyemezo byicyemezo, no gukomeza kuvugurura uburyo bwo kwirinda nkimyitwarire yicyitegererezo, ibyo abakoresha bategereje, nibisabwa n'amategeko bigenda bihinduka.
Ingaruka z'Ingamba
Iragufasha gutandukanya ibyifuzo bya tekiniki bisobanutse nururimi rwo kwamamaza.
Iragufasha gutandukanya ibyifuzo bya tekiniki bisobanutse nururimi rwo kwamamaza. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Urashobora kubaza ibibazo byiza byo gushyira mubikorwa mbere yo gukoresha amafaranga cyangwa igihe.
Urashobora kubaza ibibazo byiza byo gushyira mubikorwa mbere yo gukoresha amafaranga cyangwa igihe. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Amakipe afite imyumvire isangiwe akora ibicuruzwa byiza, politiki, nibyemezo byo kwiga.
Amakipe afite imyumvire isangiwe akora ibicuruzwa byiza, politiki, nibyemezo byo kwiga. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Gushyira mu bikorwa-Isi
Guhitamo guhugura moderi ya miliyari 7-yerekana kuri tiriyari 2 aho kuba miliyari 30 kuri moderi nkeya kuri data nkeya kuri bije imwe.
Ugereranije ko miliyari 10-yerekana urugero yifuza ko miliyari 200 zerekana ibimenyetso kugirango bibe byiza.
Gutsindishiriza icyitegererezo gito cyoherejwe kugirango ugabanye buri kibazo cyibiciro mugihe uhuza ubuziranenge bwa mukeba.
Kugenzura icyitegererezo gihari no kurangiza cyarakozwe, hanyuma utegure imyitozo ndende ikora aho kongera ibipimo.
Uburyo bwo Gushyira mu bikorwa
Chinchilla Kubara-Amahugurwa meza mubikorwa
Guhitamo guhugura moderi ya miliyari 7-yerekana kuri tiriyari 2 aho kuba miliyari 30 kuri moderi nkeya kuri data nkeya kuri bije imwe.
Guhitamo guhugura icyitegererezo cya miliyari 7 kuri tiliyoni 2 aho kuba miliyari 30 kuri moderi ntoya cyane ku ngengo yimari imwe Amakipe akunze kubona umusaruro ushimishije iyo asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo bikurikirana, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.
Chinchilla Kubara-Amahugurwa meza mubikorwa
Ugereranije ko miliyari 10-yerekana urugero yifuza ko miliyari 200 zerekana ibimenyetso kugirango bibe byiza.
Ugereranije ko miliyari 10-yerekana ibipimo byerekana ko hafi miliyari 200 zerekana ibimenyetso kugirango bibe byiza kuri compte-optique nziza Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.
Chinchilla Kubara-Amahugurwa meza mubikorwa
Gutsindishiriza icyitegererezo gito cyoherejwe kugirango ugabanye buri kibazo cyibiciro mugihe uhuza ubuziranenge bwa mukeba.
Gutsindishiriza icyitegererezo gito cyoherejwe kugirango ugabanye ibiciro kuri buri kibazo mugihe uhuje ubuziranenge bwa mukeba wamakipe mubusanzwe abona umusaruro ushimishije mugihe asobanura ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi agakurikirana inyungu zumusaruro hamwe nibiciro byamakosa mugihe.
Chinchilla Kubara-Amahugurwa meza mubikorwa
Kugenzura icyitegererezo gihari no kurangiza cyarakozwe, hanyuma utegure imyitozo ndende ikora aho kongera ibipimo.
Kugenzura icyitegererezo gihari no kwemeza ko byakozwe, hanyuma ugategura imyitozo ndende yo gukora aho kugirango ibipimo byongerwe Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo byimbitse, kandi agakurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe.
Ingaruka & Kurinda
Amakipe atandukanye arashobora gukoresha ijambo rimwe muburyo butandukanye, sobanura intera hakiri kare.
Ibipimo birashobora kugaragara bikomeye mugihe imikorere-yisi-itaringaniye.
Kwirengagiza ubuziranenge bwamakuru na gahunda yo gusuzuma akenshi bitanga ibisubizo byoroshye.
Igishushanyo mbonera
Tangira nururimi rusobanutse rwibisubizo ukeneye.
Tangira nururimi rusobanutse rwibisubizo ukeneye. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Toranya intsinzi imwe hamwe nuburyo bumwe bwo gutsindwa mbere yo kwipimisha.
Toranya intsinzi imwe hamwe nuburyo bumwe bwo gutsindwa mbere yo kwipimisha. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Koresha umuderevu muto hamwe namakuru ahagarariye, ntabwo ari demo yashizweho.
Koresha umuderevu muto hamwe namakuru ahagarariye, ntabwo ari demo yashizweho. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Inyandiko aho Chinchilla Compute-Optimal Training ifasha kandi nuburyo bworoshye bworoshye.
Inyandiko aho Chinchilla Compute-Optimal Training ifasha kandi nuburyo bworoshye bworoshye. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.