Ọnụ AI
Ọnụ AI bụ igwe ojii nke e wuru kpọmkwem maka AI mepere emepe, na-ahapụ ndị mmepe ka ha na-agba ọsọ, na-eme nke ọma, na ụdị ụgbọ oloko dị ka Llama na DeepSeek na akụrụngwa GPU ngwa ngwa.
Nchịkọta
It matters because it gives teams a transparent, lower-cost alternative to closed model providers without giving up control of their data.
Ime miri emi
Tọrọ ntọala na 2022 site na Vipul Ved Prakash na otu ndị nyocha Stanford jikọtara ọnụ, ọnụ AI na-edobe onwe ya dị ka igwe ojii maka mepere emepe na okike AI. Ihe onyinye ya bụ isi bụ ikpo okwu inference nke na-enye ọtụtụ narị ụdị mepere emepe dịka Meta's Llama, Mistral, Qwen na DeepSeek site na OpenAI- APIs dakọtara, yabụ ịgbanye n'ụdị mepere emepe nwere ike ịbụ mgbanwe otu ahịrị. Ọ na-agbazikwa ụyọkọ GPU (GPU ụyọkọ / ohere GPU ngwa ngwa) maka ọzụzụ ma na-enye ngwaọrụ ndozi dị mma. Otu ogwe aka nyocha nyere aka n'ọrụ dị ka RedPajama, nchekwa data mepere emepe na-emegharị data ọzụzụ Llama, yana nkwalite ụdị Flash. The pitch: ohere imeghe ihe nlereanya gbakwunyere ọsọ ọsọ, ọnụ ala, mmepụta ọkwa ọkwa.
Nghọta nka nka
Ọsọ ọnụ na-abịa site na inference engineering, ọ bụghị naanị akụrụngwa akụrụngwa. Ọ na-eji kernel kachasị mma (esi na ọrụ FlashAttention rịdata), nhọpụta ntule, ọnụọgụ, na batching na-aga n'ihu iji kwanye ọtụtụ akara n'otu GPU. A na-enye ụdịdị n'azụ OpenAI-dakọtara REST API, ya mere arịrịọ na-adị ka ebe njedebe azụmahịa mana ụzọ isi meghee arọ. Maka ọzụzụ, ọ na-akụ GPU n'ime ụyọkọ bandwit dị elu nwere njikọ njikọ ngwa ngwa, yana ndị otu nyocha ya nwere datasets mepere emepe na ụzọ na-alaghachi azụ n'ime ikpo okwu.
Mmetụta atụmatụ
Atụmatụ ndị na-ere ahịa
Ụzọ ndị na-ere ahịa na-emetụta atụmatụ ndị otu gị nwere ike ịrụ na-esote.
Ọnụ ego na mmefu ego
Usoro azụmahịa na nhọrọ mbugharị na-emetụta ọnụ ahịa ogologo oge yana ihe egwu.
Ihe ize ndụ na nchekwa
Ihe mkpali ụlọ ọrụ na-akpụzi ndabara ngwaahịa, ọnọdụ nchekwa, na oghere.
Ọdịnihu nke Ọnụ AI
Ọnụ ọgụgụ AI na-agba ọsọ n'ụdị mepere emepe nwere ike - DeepSeek, Llama, Qwen - sistemụ mechiri emechi na-amawanye nke ọma. Na-atụ anya itinye ego miri emi na ntinye dị ọnụ ala karịa, ijere echiche-ihe nlere anya, oke ọrụ na-arụ ọrụ na ikike GPU echekwabara maka ụlọ ọrụ kpachara anya iziga data na API mechiri emechi. Ka ọnụ ọgụgụ mepere emepe na-emechi ọdịiche dị mma, nzọ ọnụ bụ na ọtụtụ ụlọ ọrụ ga-achọ ịnwe na hazie ụdị ha. Asọmpi sitere na hyperscalers na igwe ojii GPU ndị ọzọ ga-arụgide oke, na-akwalite ọkachamara ọzọ na arụmọrụ na ahụmịhe onye nrụpụta.
Mmejuputa n'ezie n'ụwa
Mmalite swaps API OpenAI maka ụdị Llama n'ọnụ ọnụ OpenAI dakọtara ọnụ iji belata ọnụ ahịa ntinye aka mgbe ị na-edobe otu koodu ahụ.
Otu ụlọ ọrụ na-agbazite ụyọkọ GPU raara onwe ya nye na ọnụ iji dozie ụdị mepere emepe na akwụkwọ ime ụlọ nkeonwe.
Onye nrụpụta na-eji API enweghị ihe nkesa na-eme DeepSeek maka nkata nkata na-ejikwa akụrụngwa GPU ọ bụla.
Otu ndị nyocha na-eji mkpokọta dataset RedPajama mepere emepe yana ngwa ọrụ iji zụlite ụdị asụsụ akọwapụtara nke ngalaba.
Ihe ize ndụ & okporo ụzọ nche
Mwepụta ọkwa nwere ike karịa nkwụsi ike na usoro nrụpụta n'ezie.
Ọnụ ahịa API ma ọ bụ mgbanwe amụma nwere ike imebi echiche n'otu abalị.
Ndabere otu onye na-ere ahịa na-abawanye mkpọchi na ọnụ ahịa mbugharị.
Map mmejuputa
Nyochaa ndị na-eweta ọrụ site na iji ọrụ nke gị na nhazi data.
Nyochaa nzuzo, nchekwa na usoro iwu tupu njikọta.
Jikwaa atụmatụ ọdịda n'ofe ụdị ma ọ bụ ndị na-ere ahịa.
Nyochaa ndetu mwepụta ka mgbanwe map ụzọ ghara iju ndị otu anya.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Together AI quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
Ọnụ ọgụgụ AI
Ajụjụ a na-ajụkarị
What is Together AI?
Ọnụ AI bụ igwe ojii nke e wuru kpọmkwem maka AI mepere emepe, na-ahapụ ndị mmepe ka ha na-agba ọsọ, na-eme nke ọma, na ụdị ụgbọ oloko dị ka Llama na DeepSeek na akụrụngwa GPU ngwa ngwa. Ọ dị mkpa n'ihi na ọ na-enye ndị otu ụzọ ụzọ doro anya, dị ọnụ ala karịa ndị na-eweta ihe nlereanya mechiri emechi na-ahapụghị njikwa data ha.
Kedu ihe bụ ọnụ AI a maara nke ọma dị ka ikpo okwu igwe ojii?
Ọnụ AI bụ ígwé ojii wuru maka AI mepere emepe yana omenala, lekwasịrị anya n'ijere ozi, imezigharị nke ọma, na ọzụzụ ụdị mepere emepe.
Kedu ihe kpatara eji kọwaa API Together ka 'OpenAI-dakọtara'?
_AIU_PROTECTED_10__-dakọtara pụtara usoro arịrịọ dakọtara, yabụ ndị mmepe nwere ike tụọ koodu dị na ụdị mepere emepe nwere obere mgbanwe.
Kedu ọrụ emeghe dataset jikọtara na nyocha ọnụ AI?
RedPajama bụ mbọ setịpụ data mepere emepe, jikọtara ya na ọnụ, nke megharịrị data ọzụzụ ụdị Llama.
Kedu usoro na-enyere ọnụ aka ijere ọtụtụ token kwa GPU?
Ọnụ na-eji nhọpụta ntule, kernel ụdịdị FlashAttention kachasị mma, ọnụọgụ, na batching na-aga n'ihu iji kwalite mmepụta.
Ewezuga API enweghị ihe nkesa, kedu akụrụngwa na-enye ọnụ maka nnukwu ọrụ ọzụzụ?
Otu ụyọkọ GPU gbakọtara ọnụ yana njikọ njikọ bandwit dị elu maka ọzụzụ na nnukwu ọrụ.