Incamake
FP8 ni 8-biti ireremba-nimero yimibare ituma moderi ya AI ibika uburemere no gukoresha imibare ukoresheje kimwe cya kane cyo kwibuka kumibare isanzwe ya 32-bit. Nuburyo bwingenzi bwo gukora moderi nini zihendutse kandi byihuse guhugura no gukora.
Imiterere ya FP8 na Low-Precision nuburyo bwububiko bwa tekiniki bugira ingaruka kumiterere yicyitegererezo, igiciro cyibikorwa remezo, ubukererwe, no kwizerwa mubipimo.
Kwibira cyane
Imiyoboro ya Neural igizwe na miliyari y'imibare. Ubusanzwe iyo mibare yakoresheje bits 32 (FP32) cyangwa 16 bits (FP16 / BF16) buri umwe. FP8 ibagabanya kuri bits 8 gusa, igabanya kwibuka hamwe numuyoboro mugari hafi ya kabiri na 16-bit. Hariho uburyo bubiri busanzwe bwa FP8: E4M3 (bits 4 yerekana, 3 mantissa bits) itanga ibisobanuro byinshi ariko intera ntoya, kandi E5M2 (5 yerekanwe, 2 mantissa) itanga intera yagutse ariko intambwe yoroheje. Gucuruza-ni ubudahemuka: bits nkeya bisobanura kuzenguruka amakosa. Kugirango ugumane ukuri, ibikorerwa bikurikizwa kuri tensor cyangwa kuri buri kintu cyo gupima ibintu bikuraho indangagaciro murwego rwa FP8. Hopper ya NVIDIA na Blackwell GPUs yongeyeho ibyuma bya moteri ya FP8 ya matrix, bituma iba ingirakamaro mumahugurwa no gufata umwanzuro. Imiterere mishya nka MXFP8, MXFP4, na NVFP4 isunika ndetse hepfo hamwe na micro-scaring bloks.
Ubushishozi
Ikibazo cya FP8 ni intera igaragara. Hamwe nintoki gusa zerekana bits, nini cyangwa ntoya ibikorwa birenze cyangwa byuzuye kuri zeru. Gukosora ni igipimo: kugwiza tensor kubintu kugirango indangagaciro zayo zigwe mumadirishya ihagarariwe na FP8, kora FP8 kugwiza-kwegeranya, hanyuma ugabanye inyuma, akenshi ukusanya amafaranga igice mubice bisobanutse neza (FP16 / FP32). E4M3 isanzwe ikoreshwa muburemere no gukora, E5M2 kuri gradients aho intera irenze ibintu neza.
Kumenya FP8 na Imiterere-Ntoya
FP8 ni 8-biti ireremba-nimero yimibare ituma moderi ya AI ibika uburemere no gukoresha imibare ukoresheje kimwe cya kane cyo kwibuka kumibare isanzwe ya 32-bit. Nuburyo bwingenzi bwo gukora moderi nini zihendutse kandi byihuse guhugura no gukora. Imiterere ya FP8 na Low-Precision nuburyo bwububiko bwa tekiniki bugira ingaruka kumiterere yicyitegererezo, igiciro cyibikorwa remezo, ubukererwe, no kwizerwa mubipimo. Kugirango wubake byimbitse, fata imiterere ya FP8 na-Precision Imiterere nkicyitegererezo gikora, ntabwo ari ikintu kimwe: gusobanura ibyagezweho, gusobanura ibitekerezo, no gutandukanya ibyo sisitemu ishobora gukora byizewe nibisaba guca imanza zinzobere.
Mubimenyerezo, amatsinda akomeye akoresha FP8 na Format-Precision Imiterere ihindura imyubakire, amakuru, hamwe nibikorwa remezo birwanya kwizerwa nigiciro. Bandika ibipimo ngenderwaho byerekana intsinzi, bagerageza kurwanya amakuru afatika hamwe nakazi keza, kandi bagasubiramo bashingiye kubikorwa byagaragaye ko batsinzwe aho gutsinda inshuro imwe. Aha niho imyumvire yubumenyi ihinduka mubushobozi burambye kubicuruzwa, politiki, nibikorwa.
Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka. Mugihe kimwe, Guhindura igipimo kimwe gishobora guhisha intege nke za sisitemu. Uburyo bukomeye cyane ni uguhuza umuvuduko wikigereranyo hamwe na disipuline yimiyoborere: kuyobora abaderevu, gufata ibimenyetso, gutangaza ibyemezo byicyemezo, no gukomeza kuvugurura uburyo bwo kwirinda nkimyitwarire yicyitegererezo, ibyo abakoresha bategereje, nibisabwa n'amategeko bigenda bihinduka.
Ingaruka z'Ingamba
Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.
Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Gushyira mu bikorwa Isi
Guhugura indimi nini kuri NVIDIA Hopper / Blackwell GPUs ukoresheje FP8 kugirango winjize hafi inshuro ebyiri na BF16
Gukora chatbot umwanzuro muri FP8 kuburyo icyitegererezo gihuye na GPU nkeya kandi gisubiza ibyifuzo byinshi kumasegonda
Koresha E5M2 mugutumanaho gahoro gahoro mugihe cyamahugurwa yatanzwe kugirango ugabanye umurongo wa interineti hagati yumutwe
Kohereza MXFP4 / NVFP4-yuzuye-moderi kugirango ihuze imipaka-yerekana urugero kuri GPU imwe yibuka cyane kugirango ifate umwanzuro uhendutse
Uburyo bwo Gushyira mu bikorwa
Imiterere ya FP8 na Hasi-Yuzuye mubikorwa
Guhugura indimi nini kuri NVIDIA Hopper / Blackwell GPUs ukoresheje FP8 kugirango winjize hafi inshuro ebyiri na BF16.
Guhugura indimi nini kuri NVIDIA Hopper / Blackwell GPUs ukoresheje FP8 kugirango winjize hafi inshuro ebyiri zose hamwe na BF16 Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe runaka.
Imiterere ya FP8 na Hasi-Yuzuye mubikorwa
Gukora chatbot umwanzuro muri FP8 kuburyo icyitegererezo gihuye na GPU nkeya kandi gisubiza ibyifuzo byinshi kumasegonda.
Gukora ikiganiro cya chatbot muri FP8 kuburyo icyitegererezo gihuye na GPU nkeya kandi kigasubiza ibyifuzo byinshi kumasegonda Amakipe asanzwe abona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamuka kwabantu kubibazo byimbitse, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe runaka.
Imiterere ya FP8 na Hasi-Yuzuye mubikorwa
Koresha E5M2 mugutumanaho gahoro gahoro mugihe cyamahugurwa yatanzwe kugirango ugabanye umurongo wa interineti hagati yumutwe.
Gukoresha E5M2 mugutumanaho gahoro gahoro mugihe cyamahugurwa yatanzwe kugirango ugabanye umurongo wa neti hagati yumutwe Amakipe akunze kubona umusaruro mwiza mugihe asobanura ibipimo byimbere imbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi agakurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe.
Imiterere ya FP8 na Hasi-Yuzuye mubikorwa
Kohereza MXFP4 / NVFP4-yuzuye-moderi kugirango ihuze imipaka-yerekana urugero kuri GPU imwe yibuke cyane kugirango ifate umwanzuro uhendutse.
Kohereza moderi ya MXFP4 / NVFP4 kugirango ihuze urugero-rugero rwumupaka kuri GPU imwe yibuke cyane ya GPU kubitekerezo bihendutse Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.
Ingaruka & Kurinda
Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.
Igishushanyo mbonera
Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Tegura inzira yo gusubiza ibyabaye mbere yo gupima.
Tegura inzira yo gusubiza ibyabaye mbere yo gupima. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.