Uhlolojikelele
I-Multi-Query Attention (MQA) iyi-twist egcina inkumbulo ekunakeni kwe-transformer eyabelana ngesethi eyodwa yokhiye kanye namanani kuwo wonke amakhanda okunaka. Isheshisa ukukhiqizwa kombhalo ngokunciphisa inkumbulo okufanele imodeli ishove nxazonke.
I-Multi-Query Attention iyingxenye yesitaki solimi-AI esisetshenziselwa ukufunda, ukukhiqiza, ukuhlukanisa, nokuguqula umbhalo nenkulumo ngesilinganiso.
I-Deep Dive
Ukunaka okujwayelekile kwamakhanda amaningi kunikeza inhloko ngayinye umbuzo wayo, ukhiye, kanye nokuqagela kwenani. Ngesikhathi sokukhiqiza, okhiye namanani awo wonke amathokheni adlule kufanele afakwe kunqolobane futhi alayishwe kabusha esinyathelweni ngasinye - le cache ye-KV iba ibhodlela eliyinhloko, njengoba ukuyifunda ngekhanda kuhamba kancane kunezibalo ngokwazo. I-Multi-Query Attention, ehlongozwe nguNoam Shazeer ngo-2019, igcina imibuzo ehlukene ngekhanda ngalinye kodwa igoqa okhiye namanani ekhanda elilodwa okwabelwana ngalo. Lokhu kunciphisa inqolobane ye-KV ngesici esilingana nenani lamakhanda, ngezinye izikhathi 8x kuya ku-64x amancane. Umphumela uba ukuqoshwa kwe-autoregressive okusheshayo kanye nenkumbulo elula, enekhwalithi ephansi yediphu. Indawo emaphakathi, Ukunakwa Kombuzo Ohlanganisiwe, kulinganisa ukuhwebelana.
I-Technical Insight
Ku-MQA, izisindo zombuzo zisakhiqiza amavekhtha wemibuzo angu-H ahlukene, kodwa ukuqagela kokhiye owodwa kanye nokuqagela kwenani elilodwa kwabelwana ngawo wonke amakhanda. Ikhanda ngalinye libala ukunaka lisebenzisa owalo umbuzo ngokumelene nokhiye namanani afanayo. Ngenxa yokuthi izithambisi ezigcinwe kunqolobane ze-K kanye ne-V azisalingani nenani lamakhanda, umkhawulokudonsa wenkumbulo ngesikhathi sokukhishwa kwekhodi wehla kakhulu - futhi umkhawulokudonsa, hhayi wokubala, yilokho isivinini sokukhiqiza amasango kuma-accelerator esimanje.
Ukwazi Ukunakwa Kwemibuzo Eminingi
I-Multi-Query Attention (MQA) iyi-twist egcina inkumbulo ekunakeni kwe-transformer eyabelana ngesethi eyodwa yokhiye kanye namanani kuwo wonke amakhanda okunaka. Isheshisa ukukhiqizwa kombhalo ngokunciphisa inkumbulo okufanele imodeli ishove nxazonke. I-Multi-Query Attention iyingxenye yesitaki solimi-AI esisetshenziselwa ukufunda, ukukhiqiza, ukuhlukanisa, nokuguqula umbhalo nenkulumo ngesilinganiso. Ukuze wakhe ukuqonda okujulile, phatha Ukunakwa Kwemibuzo Eningi njengemodeli yokusebenza, hhayi isici esisodwa: chaza imiphumela efiselekayo, ucacise ukucabanga, futhi uhlukanise lokho isistimu engakwenza ngokwethembeka kulokho okusadinga ukwahlulela kochwepheshe.
Empeleni, amaqembu aqinile asebenzisa imiyalo yokuklama ye-Multi-Query Attention, ukubuyisa, nokubuyekeza amalophu njengohlelo olulodwa lokuxhumana oludidiyelwe. Babhala imibandela yempumelelo ecacile, ukuhlola okuqhathaniswa nedatha engokoqobo nokugeleza komsebenzi, futhi baphindaphinde ngokusekelwe kumaphethini okuhluleka aqashiwe esikhundleni sokuwina kwebhentshimakhi yesikhathi esisodwa. Yilapho ukuqonda kwethiyori kuguquka kube amandla ahlala njalo kuwo wonke umkhiqizo, inqubomgomo, kanye nokusebenza.
Ukugeleza komsebenzi wolimi kungahamba ngokushesha ngaphandle kokudela ukuvumelana. Ngesikhathi esifanayo, amaqiniso Akhohliwe angafaka imibiko buthule, ukugeleza kosekelo, noma imiphumela yocwaningo. Indlela eqine kakhulu iwukuhlanganisa isivinini sokuhlola nesiyalo sokuphatha: qhuba abashayeli bezindiza, bamba ubufakazi, ushicilele amalogi ezinqumo, futhi ubuyekeze izivikelo ngokuqhubekayo njengoba imodeli yokuziphatha, okulindelwe ngabasebenzisi, kanye nezimfuneko zokulawula zishintsha.
I-Strategic Impact
Ukugeleza komsebenzi wolimi kungahamba ngokushesha ngaphandle kokudela ukuvumelana.
Ukugeleza komsebenzi wolimi kungahamba ngokushesha ngaphandle kokudela ukuvumelana. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Yandisa ukufinyelela kuzo zonke izilimi nezitayela zokuxhumana.
Yandisa ukufinyelela kuzo zonke izilimi nezitayela zokuxhumana. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Amaqembu angachitha isikhathi esiningi ekwahluleleni kuyilapho i-automation isingatha impinda.
Amaqembu angachitha isikhathi esiningi ekwahluleleni kuyilapho i-automation isingatha impinda. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Ukuqaliswa Komhlaba Wangempela
Ukusheshisa ukukhiqizwa kwamathokheni kubasizi bengxoxo lapho inqolobane ye-KV, hhayi ikhompuyutha eluhlaza, ikhawulela ukuphuma.
Google's PaLM, esebenzise i-Multi-Query Attention ukuze inike amandla ukucabangela ngezinga elikhulu.
Ukukhonza abasebenzisi abaningi ngesikhathi esisodwa ku-GPU eyodwa ngokunciphisa inkumbulo yenqolobane ye-KV yesicelo ngasinye.
Ukunakwa Kwemibuzo Ehlanganisiwe ku-Llama 2 70B kanye ne-Llama 3, inzalo eqondile elinganisa isivinini se-MQA nekhwalithi yokunaka okugcwele.
Amaphethini Okusebenzisa
Ukunakwa kwemibuzo eminingi ekusebenzeni
Ukusheshisa ukukhiqizwa kwamathokheni kubasizi bengxoxo lapho inqolobane ye-KV, hhayi ikhompuyutha eluhlaza, ikhawulela ukuphuma.
Ukusheshisa ukwenziwa kwamathokheni kumathokheni kubasizi bengxoxo lapho inqolobane ye-KV, hhayi ikhompuyutha eluhlaza, ikhawulela i-output Amaqembu ngokuvamile athola imiphumela engcono lapho echaza imingcele yekhwalithi ngaphambili, egcina indlela yokukhuphuka yomuntu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Ukunakwa kwemibuzo eminingi ekusebenzeni
Google's PaLM, esebenzise i-Multi-Query Attention ukuze inike amandla ukucabangela ngezinga elikhulu.
Google's PaLM, esebenzise i-Multi-Query Attention ukuze inike amandla Amaqembu e-inference asezingeni eliphezulu ngokuvamile athola imiphumela engcono uma echaza izinga eliphezulu ngaphambili, egcina indlela yokukhuphuka kwabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Ukunakwa kwemibuzo eminingi ekusebenzeni
Ukukhonza abasebenzisi abaningi ngesikhathi esisodwa ku-GPU eyodwa ngokunciphisa inkumbulo yenqolobane ye-KV yesicelo ngasinye.
Ukukhonza abasebenzisi abaningi ngesikhathi esisodwa ku-GPU eyodwa ngokunciphisa inkumbulo yenqolobane ye-KV yesicelo ngasinye ngokuvamile athola imiphumela engcono lapho echaza izinga eliphezulu ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Ukunakwa kwemibuzo eminingi ekusebenzeni
Ukunakwa Kwemibuzo Ehlanganisiwe ku-Llama 2 70B kanye ne-Llama 3, inzalo eqondile elinganisa isivinini se-MQA nekhwalithi yokunaka okugcwele.
Ukunakwa Kwemibuzo Ehlanganisiwe ku-Llama 2 70B kanye ne-Llama 3, inzalo eqondile elinganisa isivinini se-MQA nekhwalithi yokunaka okugcwele Amathimba ngokuvamile athola imiphumela engcono uma echaza imingcele yekhwalithi ngaphambili, egcina indlela yokukhuphuka komuntu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Izingozi & Guardrails
Amaqiniso akhonjiwe angafaka ngokuthula imibiko, ukugeleza kosekelo, noma imiphumela yocwaningo.
Ukuzwela okusheshayo kungadala imiphumela engahambisani kuzo zonke izicelo ezifanayo.
Idatha yombhalo ebucayi ingase idalulwe uma izilawuli zokufinyelela zibuthakathaka.
Ukuqalisa Umhlahlandlela
Chaza ifomethi yokuphumayo, ithoni, namazinga wekhwalithi ngaphambi kokukhishwa.
Chaza ifomethi yokuphumayo, ithoni, namazinga wekhwalithi ngaphambi kokukhishwa. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Izimpendulo eziyisisekelo ngemithombo ethembekile noma nini lapho ukunemba kubalulekile.
Izimpendulo eziyisisekelo ngemithombo ethembekile noma nini lapho ukunemba kubalulekile. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Gcina indawo yokuhlola isibuyekezo somuntu ukuze uthole imiphumela ephezulu.
Gcina indawo yokuhlola isibuyekezo somuntu ukuze uthole imiphumela ephezulu. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Landela amaphethini okuhluleka futhi uqeqeshe kabusha imiyalo noma ukuhamba komsebenzi njalo.
Landela amaphethini okuhluleka futhi uqeqeshe kabusha imiyalo noma ukuhamba komsebenzi njalo. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.