Ubuyobozi bwa tekiniki
Imiterere ya FP8 na Hasi-Yuzuye
FP8 ni 8-biti ireremba-nimero yimibare ituma moderi ya AI ibika uburemere no gukoresha imibare ukoresheje kimwe cya kane cyo kwibuka kumibare isanzwe ya 32-bit.
Umva iki gitaboAI-byavuzwe · ~2 min
Kuriyi page2 min soma
Incamake
Nuburyo bwingenzi bwo gukora moderi nini zihendutse kandi byihuse guhugura no gukora.
Kwibira cyane
Imiyoboro ya Neural igizwe na miliyari y'imibare. Ubusanzwe iyo mibare yakoresheje bits 32 (FP32) cyangwa 16 bits (FP16 / BF16) buri umwe. FP8 ibagabanya kuri bits 8 gusa, igabanya kwibuka hamwe numuyoboro mugari hafi ya kabiri na 16-bit. Hariho uburyo bubiri busanzwe bwa FP8: E4M3 (bits 4 yerekana, 3 mantissa bits) itanga ibisobanuro byinshi ariko intera ntoya, kandi E5M2 (5 yerekanwe, 2 mantissa) itanga intera yagutse ariko intambwe yoroheje. Gucuruza-ni ubudahemuka: bits nkeya bisobanura kuzenguruka amakosa. Kugirango ugumane ukuri, ibikorerwa bikurikizwa kuri tensor cyangwa kuri buri kintu cyo gupima ibintu bikuraho indangagaciro murwego rwa FP8. Hopper ya NVIDIA na Blackwell GPUs yongeyeho ibyuma bya moteri ya FP8 ya matrix, bituma iba ingirakamaro mumahugurwa no gufata umwanzuro. Imiterere mishya nka MXFP8, MXFP4, na NVFP4 isunika ndetse hepfo hamwe na micro-scaring bloks.
Gushyira mu bikorwa Isi
A team benchmarks an FP8 training recipe on hardware with supported matrix operations and compares it with BF16.
An inference team checks weight, activation, and cache memory before selecting FP8 serving.
A training implementation uses an FP8 encoding with a wider range for tensors whose values require it.
A deployment team evaluates supported four-bit formats against an accuracy and memory budget.
Kazoza ka FP8 na Imiterere-Ntoya
Lower-precision formats should be evaluated as complete recipes rather than universal speed or quality guarantees. Block scaling, mixed-precision layers, and supported kernels can help balance numerical error with memory and compute costs. Four-bit formats such as MXFP4 and NVFP4 are additional choices on supporting systems; their range, scaling, and hardware requirements differ. A team should benchmark its own workload and retain higher precision where measured errors justify it.
Kubishyira mubikorwa
Impamvu ari ngombwa
- Igiciro na bije. Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
- Ibyemezo bisobanutse. Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
- Kugenzura ubuziranenge. Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.
Witondere
- Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
- Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
- Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.
Intambwe ikurikira
- Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
- Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
- Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
- Tegura inzira yo gusubiza ibyabaye mbere yo gupima.
Komeza Ubushakashatsi
Ibaruwa y'amakuru y'ubuntu
Ibuka amakuru ya buri munsi ya AI
Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.
Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.
Isuzume
Take the FP8 and Low-Precision Formats quiz
Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.
Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano
Ibibazo bikunze kubazwa
Niki FP8 na Format-Precision Imiterere?
FP8 ni 8-biti ireremba-nimero yimibare ituma moderi ya AI ibika uburemere no gukoresha imibare ukoresheje kimwe cya kane cyo kwibuka kumibare isanzwe ya 32-bit. Nuburyo bwingenzi bwo gukora moderi nini zihendutse kandi byihuse guhugura no gukora.
Umubare wa FP8 ukoresha bangahe ugereranije numero isanzwe ya FP32?
FP8 ikoresha bits 8 mugihe FP32 ikoresha 32 bits, FP8 rero ifata kimwe cya kane cyububiko nubunini.
Ni iki ibirango bya 'E4M3' na 'E5M2' bisobanura imiterere ya FP8?
E4M3 bisobanura bits 4 zerekana na 3 mantissa; E5M2 bisobanura 5 ibyerekana na 2 mantissa bits. Ibindi byinshi byerekana kwagura intera; byinshi mantissa bits ongeraho neza.
Kuki imiyoboro ya FP8 ikoresha ibintu bipima kuri tensors?
Hamwe nibintu bike byerekana bits, indangagaciro nini zirengerwa nuduto duto munsi ya zeru. Igipimo gikuraho tensors mumadirishya akoreshwa ya FP8 mbere yimibare.
Nubuhe bucuruzi-bubi ningenzi nyamukuru yo gukoresha FP8?
Bits nkeya bisobanura coarser guhagararirwa hamwe nikosa ryinshi. Inyungu ni mike cyane yibuka nubunini, kandi imibare yihuse kubikoresho bishyigikiwe.
Nibihe bisekuruza bya NVIDIA GPU byabanje kongeramo ibikoresho byabigenewe kubibare bya FP8?
GPUs ishingiye kuri Hopper nka H100 yazanye inkunga ya FP8 Tensor Core, hanyuma Blackwell yaje kuyigeza kuri FP4.
Komeza wige
Kuyobora
Abandi bayobozi batoranijwe kuriyi ngingo