Incamake
Amategeko yo gupima Chinchilla, kuva muri DeepMind mu 2022, yerekanaga ko indimi nini nini zavuzwe nabi: ku ngengo yimibare ihamye, ugomba gupima ingano yicyitegererezo hamwe namakuru yamahugurwa hafi yingana. Nibyingenzi kuko yasobanuye icyo ingano yicyitegererezo 'optimal' isobanura kandi ihindura uburyo laboratoire ikoresha compte.
Amategeko yo gupima Chinchilla ni igice cyururimi-AI ikoreshwa mu gusoma, kubyara, gushyira mu byiciro, no guhindura inyandiko n'imvugo ku gipimo.
Kwibira cyane
Mbere ya Chinchilla, icyerekezo cyari ukubaka moderi nini nini (nka 175B-parameter ya GPT-3) mugihe imyitozo kumubare muto ugereranije. DeepMind yahuguye moderi zirenga 400 mubunini na bije yamakuru, hanyuma ihuza umurongo uteganya igihombo nkigikorwa cyibipimo nibimenyetso munsi yingengo yimibare ihamye (FLOP). Ibisubizo byabo: ibipimo nibimenyetso byamahugurwa bigomba gupimirwa hamwe, hafi igipimo cya 1 kuri 1, bivuze ibimenyetso 20 byamahugurwa kuri buri kintu. Kugirango babigaragaze, bahuguye Chinchilla, moderi ya 70B yerekana ibipimo bya miriyoni 1,4, byarushije cyane 280B ibipimo bya Gopher nubwo yakoresheje mudasobwa imwe, kuko yatojwe amakuru menshi cyane.
Ubushishozi
Amategeko aturuka muguhuza imikorere yibihombo L (N, D) aho N ari ibipimo na D ni ibimenyetso, harimo-igihombo kidasubirwaho, urugero-ingano, hamwe namakuru-ingano yamakuru. Kugabanya igihombo ukurikije imbogamizi ya compte (compte igereranijwe hafi N inshuro D) itanga ibisubizo ko N na D nziza byombi bikura nkimbaraga zo kubara hamwe nibintu bisa, bityo rero compte-optimal iguma hafi yikimenyetso 20 kuri buri kintu.
Kumenya amategeko yo gupima Chinchilla
Amategeko yo gupima Chinchilla, kuva muri DeepMind mu 2022, yerekanaga ko indimi nini nini zavuzwe nabi: ku ngengo yimibare ihamye, ugomba gupima ingano yicyitegererezo hamwe namakuru yamahugurwa hafi yingana. Nibyingenzi kuko yasobanuye icyo ingano yicyitegererezo 'optimal' isobanura kandi ihindura uburyo laboratoire ikoresha compte. Amategeko yo gupima Chinchilla ni igice cyururimi-AI ikoreshwa mu gusoma, kubyara, gushyira mu byiciro, no guhindura inyandiko n'imvugo ku gipimo. Kugirango wubake byimbitse, fata amategeko yo gupima Chinchilla nk'icyitegererezo gikora, ntabwo ari ikintu kimwe: gusobanura ibyagezweho, gusobanura ibitekerezo, no gutandukanya ibyo sisitemu ishobora gukora byizewe nibisaba guca imanza zinzobere.
Mubimenyerezo, amakipe akomeye akoresha Chinchilla Scaling Laws igishushanyo mbonera, kugarura, no gusuzuma imirongo nka sisitemu imwe y'itumanaho ihuriweho. Bandika ibipimo ngenderwaho byerekana intsinzi, bagerageza kurwanya amakuru afatika hamwe nakazi keza, kandi bagasubiramo bashingiye kubikorwa byagaragaye ko batsinzwe aho gutsinda inshuro imwe. Aha niho imyumvire yubumenyi ihinduka mubushobozi burambye kubicuruzwa, politiki, nibikorwa.
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika. Mugihe kimwe, ibintu bya Hallucinated birashobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi. Uburyo bukomeye cyane ni uguhuza umuvuduko wikigereranyo hamwe na disipuline yimiyoborere: kuyobora abaderevu, gufata ibimenyetso, gutangaza ibyemezo byicyemezo, no gukomeza kuvugurura uburyo bwo kwirinda nkimyitwarire yicyitegererezo, ibyo abakoresha bategereje, nibisabwa n'amategeko bigenda bihinduka.
Ingaruka z'Ingamba
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Yagura uburyo bwindimi nuburyo bwo gutumanaho.
Yagura uburyo bwindimi nuburyo bwo gutumanaho. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.
Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Gushyira mu bikorwa-Isi
Chinchilla ya 70M ya DeepMind itsinze 280B Gopher kubipimo ukoresheje compte ingana, mumahugurwa kumakuru menshi cyane
Kuyobora amakipe guteganya hafi 20 ibimenyetso byamahugurwa kuri buri kintu mugihe utegura icyitegererezo
Gutsindishiriza ibintu bito, bikungahaye kuri moderi nka LLaMA bihendutse gukora mugihe cyo gufata umwanzuro
Kugereranya niba icyitegererezo giteganijwe 'cyashizweho' kandi cyakungukira byinshi mumibare yinyongera kuruta ibipimo byiyongereye
Uburyo bwo Gushyira mu bikorwa
Amategeko yo gupima Chinchilla mubikorwa
Chinchilla ya 70M ya DeepMind itsinze 280B Gopher kubipimo ukoresheje compte ingana, mumahugurwa kumakuru menshi.
Chinchilla ya 70M ya DeepMind itsinze Gopher 280B ku bipimo ukoresheje compte ingana, mu guhugura amakuru menshi cyane Amakipe akunze kubona umusaruro ushimishije iyo asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo byimanza, kandi agakurikirana inyungu zibyara umusaruro nibiciro byigihe.
Amategeko yo gupima Chinchilla mubikorwa
Kuyobora amakipe guteganya hafi 20 ibimenyetso byamahugurwa kuri buri kintu mugihe utegura icyitegererezo.
Kuyobora amatsinda guteganya hafi 20 ibimenyetso byamahugurwa kuri buri kintu mugihe uteganya kuva mucyitegererezo Amakipe asanzwe abona umusaruro ushimishije mugihe asobanura ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro nibiciro byigihe.
Amategeko yo gupima Chinchilla mubikorwa
Gutsindishiriza ibintu bito, bikungahaye kuri moderi nka LLaMA bihendutse gukora mugihe cyo gufata umwanzuro.
Gutsindishiriza ibintu bito, bikungahaye kuri data nka LLaMA bihendutse gukora mugihe cyo gufata umwanzuro Amakipe akunze kubona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo byimanza, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe.
Amategeko yo gupima Chinchilla mubikorwa
Kugereranya niba icyitegererezo giteganijwe 'cyashizweho' kandi cyakungukira byinshi mumibare yinyongera kuruta ibipimo byiyongereye.
Kugereranya niba icyitegererezo giteganijwe 'cyashizweho' kandi kikaba cyunguka byinshi mumibare yinyongera kuruta ibipimo byiyongereye Amakipe ubusanzwe abona ibisubizo byiza mugihe asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo byimanza, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe runaka.
Ingaruka & Kurinda
Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.
Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.
Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.
Igishushanyo mbonera
Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.
Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.
Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Komeza kugenzura abantu kugenzura ibisubizo byinshi.
Komeza kugenzura abantu kugenzura ibisubizo byinshi. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.
Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.