Modèlu Falcon
Falcon famiy xeetu làkk yu yaatu la yu bawoo ci Daaray Xarala yu Bees yi ci UAE (TII) ci Abu Dhabi.
Résumé
They matter because they put a government-backed Middle Eastern lab on the global open-model map and pioneered large-scale training on heavily filtered web data.
Plongeur bu xóot
Daaray Xarala yu Bees yi (TII) moo defar Falcon, di labo gëstu bu nguur gi ci Abu Dhabi, moo tax mu nekk benn ci jeegoo yu gëna am solo ci juntuwaay yu bees yi ci bitti Etats Unis ak Chine. Falcon 40B ak Falcon 180B xeetu njëkk yi, ñu génne leen ci lu ubbeeku, ci diir bu gàtt ñu ngi nekkoon ci biir LLM yi gëna ubbeeku, ñu xamee leen ndax dañu leen tàggat bu bari ci RefinedWeb, muy benn done bu mag buñ tabax ci segg ak deduplicate ay done yu Common Crawl ci kaw done web yi. TII dafa wax ni done web yuñ setal bu baax kese ñoo mëna xëcc corpus yiñ tànnee loxo. Ginaaw loolu, Falcon Mamba dugal ci architecture espaas bu réew mi ngir wuutu transformatër yi, Falcon 2 yokk ci làkk yu bari ak yeneen làkk yu ñuy xoole. Royuwaay yi dañu leen génne ci anam wu ñuy nangu, di ñaax nit ñi ñu jëfandikoo ko ci wàllu jënd ak jaay ci àdduna bi yépp.
Gis-gis xarala
Modèle transformateur yu Falcon dañuy jëfandikoo ay laaj yu bari, fu ay boppu yu bari di bokk benn projection bu am solo ak valeur, loolu dafay wàññi bu baax jëfandikoo mémoire bi ci diiru inference ak gaaw defar. RefinedWeb dafa wane ni scale ak segg bu dëgër ci mbindu web bu ñor mën nañu méngoo ak done yiñ tànn. Falcon Mamba amul benn coppite ci transformatër yi, di jëfandikoo xeetu espace-state buy doxal ay toppalante ak memory bu jege-constant, guddaay bi du ci dara.
njeextalu pexe
Pexem jaaykat
Kartu yoonu jaaykat yi ñooy wane man-man yi sa ekip mëna tabax ci kanam.
Njëgg ak budget
Anamu jënd ak jaay ak tànneefi dugal dañu am njeexital ci njëg ak risk ci diir bu xawa yàgg.
Risk ak kaaraange
Li liggéeyukaay bi di ñaax mooy tëral ni produit bi di doxee, kaaraange gi ak ubbeeku gi.
Ëlëgu modelu Falcon
TII mingi taxawal Falcon ni IA flagship bu am doole, di yaatal ci lakk yu bari (bokk ci ndimmbalu Araab bu dëgër), multimodal, ak yeneen xeetu architecture yu melni Mamba yuy yegg ba ci ay contexte yu gudd te yomb. Xaarandil ay anam yu gëna ndaw te am njariñ ngir dugal ci boor yi ak wéyal génne yu ubbeeku yi nga xamni dugal xaalis ci réew mi moo ko jàppale. Falcon dafay wane anam wu gëna yaatu ci réew yi tabax ay xeetu fondasioŋ yuñ defaree seen bopp ngir wàññi dependence ci Etats Unis ak Chine ci furnisër yu juntuwaay yu bees yi.
Doxal ci àdduna dëgg
Benn kompiñi bu nekk ci diwaan boobu moo defar xeetu Falcon ngir jàppale kiliyaan yi ci làkku Araab, di jàngale ci làkk yu bari.
Gëstukat yi dañuy jàngat Falcon Mamba ngir mëna jëfandikoo ay këyit yu gudd lool ci jëfandikoo memory bimu am ci espace-state.
Benn startup dafay dugal benn model Falcon bu ubbeeku ci jënd ak jaay te doo fay API, ndax lisence bimu am.
Saytukattu done yi dañu jàngat setu done RefinedWeb ngir xam naka la segg web bu metti mëna wecci corpus tàggat yiñ tànn.
Risk yi ak balustrade yi
Koom-koomu ubbite mën na raw stabilite ci def liggéeyu defar dëgg.
Njëg yi ci API wala coppite ci sàrt yi mën nañu dindi xalaat yi ci guddi gi.
Dependence ci benn jaaykat dafay yokk njëgu tëjug ak migraasioŋ.
Roadmap ngir samp gi
Saytu sa fournisseur yi nga jëfandikoo sa liggéey ak say done.
Xoolaat mbir yu nëbbu, kaaraange ak sàrti yoon balaa ngay boole.
Fexe am palaŋu fallback ci model yi wala jaaykat yi.
Xool notu génne yi suko defee coppite yi ci kàrtu yoon du jaaxal ekip yi.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Falcon Models quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
Yi models by 01.AI
Laaj yi ñuy faral di laaj
What is Falcon Models?
Falcon famiy xeetu làkk yu yaatu la yu bawoo ci Daaray Xarala yu Bees yi ci UAE (TII) ci Abu Dhabi. Dañu am solo ndax dañu def benn labo bu moyen orient bu nguur gi jàppale ci kàrtu model bu ubbeeku bi ba noppi ñu jiite tàggat yu yaatu ci done web yuñ segg bu baax.
Ban mbootaay moo defar xeetu Falcon yi?
TII moo defar Falcon, di kuréel gu yor gëstu bu nguur gi jàppale ci Abu Dhabi, UAE.
Lan moo gënoon fës ci done yu RefinedWeb yi ñu jëfandikoon ngir tàggat xeetu Falcon yu njëkk ya?
RefinedWeb dafa wane ni done web yuñ segg bu baax, mën nañu xëcc corpus yiñ tànn bu baax ngir tàggat LLM yi.
Ban pexem bàyyi xel la modelu transformatëru Falcon yi di jëfandikoo ngir denc mémoire bi ci inference bi?
Laajte yu bari dañuy may njiit yu bari ñu bokk benn projection key/valeur, wàññi mémoire bi ak gaaw defar.
Lan moo wuutale Falcon Mamba ci wàllu tabax ak xeetu Falcon yiñ gëna xam?
Falcon Mamba dafay jëfandikoo architecture espace-state buñ tànnee, di liggéey ci ay toppalante yu gudd ak memory bu sax, du bàyyi xel ci transformateur.
Ci yan xeetu anam lañuy faral di génne ay model Falcon?
Modèlu Falcon yi dañu leen di génne ci anam wu leer, di jàppale jëfandikoo jënd ak jaay ci àdduna bi yépp.