Dubawa
Jamba babban samfurin yare ne daga AI21 Labs wanda ke ba da ra'ayi na Transformer tare da shimfidar sararin samaniya na Mamba (da cakuda-ƙwararrun masana) don samun ingantaccen yanayi na dogon lokaci ba tare da barin ingancin Transformer ba. Yana da mahimmanci saboda yana nuna ƙirar gine-ginen na iya doke tsaftataccen Transformers akan ƙwaƙwalwar ajiya da fitarwa a tsayin jeri.
Jamba Hybrid Transformer-Mamba Models wani ɓangare ne na tarin harshe-AI da ake amfani da shi don karantawa, ƙirƙira, rarrabawa, da canza rubutu da magana a sikeli.
Zurfafa nutsewa
Masu Canza-zafi masu tsafta suna biyan farashi mai ƙididdigewa cikin kulawa yayin da mahallin ke girma, da maɓalli na ma'aunin ma'auni tare da tsayin jeri. Samfuran sararin samaniya masu tsafta kamar Mamba ma'auni a layi da kuma kiyaye ƙayyadaddun yanayi mai maimaitawa, amma a tarihi suna jan hankalin wasu ayyuka. Jamba yana haɗa duka biyun: yana tattara tubalan inda yawancin yadudduka suke Mamba (mai rahusa, madaidaiciya, mai girma don jerin dogon lokaci) da ƙaramin lamba suna da daidaitattun kulawa (ƙarfi a daidai tunowa da tunani cikin mahalli). Hakanan yana ƙara yadudduka cakuda-na-ƙwararru (MoE) don haɓaka iya aiki yayin kiyaye sigogi masu aiki daidai gwargwado. Jamba ta farko da aka saki tare da taga mahallin alamar 256K kuma zai iya dacewa da mahallin mahallin akan GPU guda ɗaya fiye da masu canzawa masu kama da juna, godiya ga ƙaramin ma'ajin KV ɗin sa.
Fahimtar Fasaha
Mamba zaɓaɓɓen samfurin sararin samaniya ne: maimakon halartar kowane alamar da ta gabata, tana kiyaye yanayin da aka sabunta akai-akai akai-akai, tare da ƙofofin da ke dogaro da shigar da ke yanke shawarar abin da za a kiyaye ko mantawa. Jamba ta raba ƴan yadudduka masu cikakken kulawa a tsakanin yawancin yadudduka na Mamba don haka ƙirar tana riƙe da ainihin kulawa ta dogon zango yayin da yawancin ƙididdigewa da ƙwaƙwalwar ajiya ke kasancewa a layi ɗaya, kuma hanyar MoE tana kunna juzu'in ƙwararru ne kawai.
Jagoran Samfuran Jumhuriyar Jumhuriyar Canjin-Mamba
Jamba babban samfurin yare ne daga AI21 Labs wanda ke ba da ra'ayi na Transformer tare da shimfidar sararin samaniya na Mamba (da cakuda-ƙwararrun masana) don samun ingantaccen yanayi na dogon lokaci ba tare da barin ingancin Transformer ba. Yana da mahimmanci saboda yana nuna ƙirar gine-ginen na iya doke tsaftataccen Transformers akan ƙwaƙwalwar ajiya da fitarwa a tsayin jeri. Jamba Hybrid Transformer-Mamba Models wani ɓangare ne na tarin harshe-AI da ake amfani da shi don karantawa, ƙirƙira, rarrabawa, da canza rubutu da magana a sikeli. Don haɓaka fahimta mai zurfi, ɗauki Jamba Hybrid Transformer-Mamba Models azaman ƙirar aiki, ba fasali ɗaya ba: ayyana sakamakon da ake so, fayyace zato, da raba abin da tsarin zai iya yi da dogaro daga abin da har yanzu ke buƙatar yanke hukunci na ƙwararru.
A aikace, ƙungiyoyi masu ƙarfi da ke amfani da Jamba Hybrid Transformer-Mamba Models ƙirƙira ƙira, maidowa, da sake duba madaukai azaman tsarin sadarwar haɗin gwiwa ɗaya. Suna rubuta ƙayyadaddun ƙa'idodin nasara, gwaji akan bayanan gaskiya da gudanawar aiki, da jujjuyawar bisa ga tsarin gazawar da aka lura maimakon cin nasara na lokaci ɗaya. Wannan shine inda fahimtar ka'idar ta juya zuwa iyawa mai dorewa a cikin samfura, manufofi, da ayyuka.
Gudun aikin harshe na iya tafiya da sauri ba tare da sadaukar da daidaito ba. A lokaci guda, abubuwan da ba a iya gani ba na iya shigar da rahotanni cikin nutsuwa, kwararar goyan baya, ko abubuwan bincike. Hanyar da ta fi dacewa ita ce haɗa saurin gwaji tare da horon gudanarwa: gudanar da matukin jirgi, kama shaida, buga rajistan ayyukan yanke shawara, da ci gaba da sabunta abubuwan tsaro kamar yadda halayen ƙira, tsammanin mai amfani, da buƙatun tsari ke tasowa.
Dabarun Tasiri
Gudun aikin harshe na iya tafiya da sauri ba tare da sadaukar da daidaito ba.
Gudun aikin harshe na iya tafiya da sauri ba tare da sadaukar da daidaito ba. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.
Yana faɗaɗa damar shiga cikin harsuna da salon sadarwa.
Yana faɗaɗa damar shiga cikin harsuna da salon sadarwa. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.
Ƙungiyoyi za su iya ciyar da ƙarin lokaci akan hukunci yayin da aiki da kai ke sarrafa maimaitawa.
Ƙungiyoyi za su iya ciyar da ƙarin lokaci akan hukunci yayin da aiki da kai ke sarrafa maimaitawa. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.
Aiwatar da Gaskiyar Duniya
Sarrafa abubuwan shigarwar alamar 256K kamar dogayen bayanan shari'a ko manyan ma'ajiyar lambobi akan GPU guda ɗaya waɗanda ba za su iya dacewa da cache na Transformer's KV ba.
Hidimar tattaunawa mai zurfi mai zurfi inda ƙayyadaddun yanayin Mamba ke kiyaye ƙwaƙwalwar ajiya yayin da tattaunawa ke girma.
Binciken daftarin aiki da haɓaka-dawowa-ƙararru sama da manyan sansanonin ilimi cushe kai tsaye cikin mahallin
Gudun buɗaɗɗen nauyi mai tsayi LLM (An fito da Jamba tare da buɗaɗɗen ma'auni) don bincike kan gine-ginen gine-gine.
Hanyoyin Aiwatarwa
Jamba Hybrid Transformer-Mamba Model a aikace
Sarrafa abubuwan shigarwar alamar 256K kamar dogayen bayanan shari'a ko manyan ma'ajiyar lamba akan GPU guda ɗaya waɗanda ba za su dace da ma'ajin KV mai kama da Transformer ba.
Gudanar da abubuwan shigar da alamar 256K kamar dogayen bayanan shari'a ko manyan ma'ajiyar lambobi akan GPU guda ɗaya waɗanda ba za su dace da ƙungiyoyin cache na Transformer na KV yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'in gefe, da bin diddigin abubuwan samarwa da ƙimar kuskure akan lokaci.
Jamba Hybrid Transformer-Mamba Model a aikace
Hidimar tattaunawa mai zurfi mai zurfi inda ƙayyadaddun yanayin Mamba ke kiyaye ƙwaƙwalwar ajiya yayin da tattaunawa ke girma.
Hidimar tattaunawa mai tsayi mai tsayi inda ƙayyadaddun yanayin Mamba ke kiyaye ƙwaƙwalwar ajiya yayin da tattaunawa ke girma Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don ƙararraki, da bin diddigin nasarorin samarwa da farashi na kuskure akan lokaci.
Jamba Hybrid Transformer-Mamba Model a aikace
Binciken daftarin aiki da haɓaka-dawowa-ƙararru sama da manyan sansanonin ilimi cushe kai tsaye cikin mahallin.
Binciken daftarin aiki da ƙwararrun tsararru sama da manyan sansanonin ilimi da aka cusa kai tsaye cikin mahallin Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ƙofofin inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'in gefe, da bin duk nasarorin samarwa da ƙimar kuskure na tsawon lokaci.
Jamba Hybrid Transformer-Mamba Model a aikace
Gudun buɗaɗɗen nauyi mai tsayi LLM (An fito da Jamba tare da buɗaɗɗen ma'auni) don bincike kan gine-ginen masana'antu.
Gudun buɗaɗɗen nauyi mai tsayi LLM (An saki Jamba tare da buɗaɗɗen ma'auni) don bincike a cikin gine-ginen gine-gine Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don ƙararraki, da kuma bin diddigin abubuwan da ake samu da kuma tsadar kuɗi a kan lokaci.
Hatsari & Tsare-tsare
Abubuwan da aka ruɗe suna iya shigar da rahotanni cikin nutsuwa, kwararar tallafi, ko abubuwan bincike.
Hankali na gaggawa na iya ƙirƙirar sakamako mara daidaituwa a cikin buƙatun iri ɗaya.
Za a iya fallasa bayanan rubutu mai ma'ana idan ikon samun dama yana da rauni.
Taswirar Hanya
Ƙayyade tsarin fitarwa, sautin, da ma'auni masu inganci kafin fitowa.
Ƙayyade tsarin fitarwa, sautin, da ma'auni masu inganci kafin fitowa. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.
Amsa a ƙasa tare da amintattun tushe a duk lokacin da daidaito ya shafi mahimmanci.
Amsa a ƙasa tare da amintattun tushe a duk lokacin da daidaito ya shafi mahimmanci. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.
Ajiye wurin binciken ɗan adam don abubuwan da ake samu masu girma.
Ajiye wurin binciken ɗan adam don abubuwan da ake samu masu girma. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.
Bibiyar tsarin gazawar kuma sake horar da tsokaci ko tafiyar aiki akai-akai.
Bibiyar tsarin gazawar kuma sake horar da tsokaci ko tafiyar aiki akai-akai. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.