Dubawa
Hankalin Flash hanya ce mai wayo don ƙididdige matakin kulawa a cikin Transformers ba tare da taɓa rubuta babban matrix ɗin hankali don rage ƙwaƙwalwar ajiya ba. Yana sa samfuran yanayi mai tsayi da sauri da sauri da ingantaccen ƙwaƙwalwar ajiya ba tare da canza lissafin su ba.
Hankalin Flash wani shingen ginin fasaha ne wanda ke shafar ingancin ƙira, farashin kayayyakin more rayuwa, jinkiri, da aminci a sikeli.
Zurfafa nutsewa
Daidaitaccen hankali yana kwatanta kowane alamar da kowane alamar, yana samar da matrix N-by-N wanda ke girma da ƙarfi tare da tsayin jeri. A hankali, an rubuta wannan matrix ɗin zuwa kuma an sake karantawa daga ƙwaƙwalwar ajiyar bandwidth mai girma na GPU (HBM), kuma wannan rufewa - ba haɓakawa ba - shine ainihin ƙugiya. Hankalin Flash, wanda Tri Dao da abokan aiki suka gabatar a cikin 2022, yana sake tsara lissafin don haka matrix ɗin ba a taɓa adanawa sosai ba. Yana aiwatar da tambayoyi, maɓallai, da ƙima a cikin ƙananan fale-falen fale-falen da suka dace da sauri akan SRAM akan guntu, yana ƙididdige sakamako na ɓangarori, kuma yana ɗinke su tare ta amfani da dabarar kan layi mai gudana-softmax. Fitowar ta lissafi iri ɗaya ce ga hankali na yau da kullun amma yana amfani da ƙwaƙwalwar layin layi kuma yana aiki da sauri sau da yawa, musamman akan dogayen jeri.
Fahimtar Fasaha
Babban dabarar shine tiling tare da software na kan layi. Softmax yawanci yana buƙatar duka jeri na maki don ƙididdige adadin adadin sa, amma Flash Attention yana kiyaye iyakar gudu da jimlar gudu yayin da yake gudana kowane tayal, yana sake fasalin abubuwan da aka fitar a baya don haka sakamakon ƙarshe daidai ne. Saboda matsakaicin maki yana tsayawa a cikin SRAM (umarni na girma da sauri fiye da HBM), algorithm ɗin yana sane da IO: yana rage yawan karantawa da rubutu maimakon ayyukan ƙididdiga.
Jagoran Hankalin Flash
Hankalin Flash hanya ce mai wayo don ƙididdige matakin kulawa a cikin Transformers ba tare da taɓa rubuta babban matrix ɗin hankali don rage ƙwaƙwalwar ajiya ba. Yana sa samfuran yanayi mai tsayi da sauri da sauri da ingantaccen ƙwaƙwalwar ajiya ba tare da canza lissafin su ba. Hankalin Flash wani shingen ginin fasaha ne wanda ke shafar ingancin ƙira, farashin kayayyakin more rayuwa, jinkiri, da aminci a sikeli. Don gina zurfin fahimta, kula da Hankalin Flash azaman ƙirar aiki, ba fasali ɗaya ba: ayyana sakamakon da ake so, fayyace zato, da raba abin da tsarin zai iya yi da dogaro daga abin da har yanzu ke buƙatar yanke hukunci na ƙwararru.
A aikace, ƙungiyoyi masu ƙarfi da ke amfani da Hankalin Flash suna haɓaka gine-gine, bayanai, da zaɓin abubuwan more rayuwa tare da dogaro da farashi. Suna rubuta ƙayyadaddun ƙa'idodin nasara, gwaji akan bayanan gaskiya da gudanawar aiki, da jujjuyawar bisa ga tsarin gazawar da aka lura maimakon cin nasara na lokaci ɗaya. Wannan shine inda fahimtar ka'idar ta juya zuwa iyawa mai dorewa a cikin samfura, manufofi, da ayyuka.
Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru. A lokaci guda, Haɓaka ma'auni ɗaya na iya ɓoye manyan raunin tsarin. Hanyar da ta fi dacewa ita ce haɗa saurin gwaji tare da horon gudanarwa: gudanar da matukin jirgi, kama shaida, buga rajistan ayyukan yanke shawara, da ci gaba da sabunta abubuwan tsaro kamar yadda halayen ƙira, tsammanin mai amfani, da buƙatun tsari ke tasowa.
Dabarun Tasiri
Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru.
Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.
Ilimin fasaha yana taimaka wa ƙungiyoyi su zaɓi tari mai kyau, ba kawai sabon abu ba.
Ilimin fasaha yana taimaka wa ƙungiyoyi su zaɓi tari mai kyau, ba kawai sabon abu ba. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.
Zaɓuɓɓukan injiniya mafi kyau suna rage abin dogaro a cikin samarwa.
Zaɓuɓɓukan injiniya mafi kyau suna rage abin dogaro a cikin samarwa. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.
Aiwatar da Gaskiyar Duniya
Horar da manyan nau'ikan harshe kamar Llama da tsarin ajin GPT tare da tagogi masu tsayi mai tsayi a ƙananan farashin ƙwaƙwalwar ajiya.
Bauta wa mataimakan hira cikin sauri ta hanyar hanzarta matakin cikawa inda aka fara karanta dogon lokaci.
Ƙaddamar da kayan aikin nazarin daftarin aiki waɗanda ke shigar da littattafai gabaɗaya ko ma'ajin ƙididdiga ta hanyar ba da kulawar dogon layi mai yiwuwa akan GPU ɗaya.
Ƙarfafa hangen nesa da masu Canza sauti inda manyan bayanai masu ƙarfi ke haifar da jerin alamun dogon lokaci.
Hanyoyin Aiwatarwa
Flash Hankali a aikace
Horar da manyan nau'ikan harshe kamar Llama da tsarin ajin GPT tare da tagogi masu tsayi mai tsayi a ƙananan farashin ƙwaƙwalwar ajiya.
Horar da manyan nau'ikan harshe kamar Llama da tsarin ajin GPT tare da windows mahalli mai tsayi a ƙananan farashin ƙwaƙwalwar ajiya Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don ƙararraki, da bin diddigin nasarorin samarwa da ƙimar kuskure a kan lokaci.
Flash Hankali a aikace
Bauta wa mataimakan hira cikin sauri ta hanyar hanzarta matakin cikawa inda aka fara karanta dogon lokaci.
Hidimar mataimakan taɗi cikin sauri ta hanyar haɓaka matakin prefill inda aka fara karanta dogon lokaci Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ƙofofin inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'i, da kuma bin diddigin nasarorin samarwa da ƙimar kuskure akan lokaci.
Flash Hankali a aikace
Ƙaddamar da kayan aikin nazarin daftarin aiki waɗanda ke shigar da littattafai gabaɗaya ko ma'ajin ƙididdiga ta hanyar ba da kulawar dogon layi mai yiwuwa akan GPU ɗaya.
Ƙaddamar da kayan aikin nazarin daftarin aiki waɗanda ke shigar da littattafan gabaɗaya ko lambobin ƙididdigewa ta hanyar ba da kulawa ta dogon lokaci mai yiwuwa akan ƙungiyoyin GPU guda ɗaya yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'in gefe, da bin diddigin nasarorin samarwa da ƙimar kuskure akan lokaci.
Flash Hankali a aikace
Ƙarfafa hangen nesa da masu Canza sauti inda manyan bayanai masu ƙarfi ke haifar da jerin alamun dogon lokaci.
Ƙarfafa hangen nesa da masu canza sauti inda manyan bayanai masu ƙarfi ke haifar da jeri mai tsayin gaske Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ƙofofin inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'in gefe, da bin duk nasarorin samarwa da farashi na kuskure akan lokaci.
Hatsari & Tsare-tsare
Haɓaka ma'auni ɗaya na iya ɓoye manyan raunin tsarin.
Sau da yawa ana raina kayan more rayuwa da kuma kuɗin kulawa.
Tsaro da gibin lura na iya girma yayin da tsarin ke ƙara haɓaka.
Taswirar Hanya
Ƙayyade latency, inganci, da maƙasudin farashi kafin aiwatarwa.
Ƙayyade latency, inganci, da maƙasudin farashi kafin aiwatarwa. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.
Alamar ma'auni a ƙarƙashin ainihin kaya da yanayin bayanai.
Alamar ma'auni a ƙarƙashin ainihin kaya da yanayin bayanai. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.
Kula da kayan aiki don kurakurai, ɗigo, da tasirin mai amfani.
Kula da kayan aiki don kurakurai, ɗigo, da tasirin mai amfani. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.
Shirya bijirowa da hanyoyin mayar da martani kafin sikeli.
Shirya bijirowa da hanyoyin mayar da martani kafin sikeli. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.