Royuwaayi làkk yu ndaw
Modèlu làkk yu ndaw yi (SLMs) ay model IA yu kompact lañu, lu ci bari ay téemeeri milioŋ wala ay miliyaar ciy paramet, ñu defar leen ngir ñu mëna dox bu baax ci telefon yi, ordinatër portatif yi ak aparey yi.
Résumé
They trade some raw capability for speed, privacy, and the ability to run without a data center.
Plongeur bu xóot
Bi nga xamee ni model frontier yi mën nañu am téemeeri milyaar wala trillion ci parametre yi ak racks yu GPU yi, model lakk yu ndaw yi dañuy firndeel ni tàggat bu jaar yoon mën na boole ay performance yu am doole ci benn paquet bu gëna ndaw. Modèle yu melni famiy Phi bu _AIU_PROTECTED_5_, Gemma bu Google, ak xeetu Llama yu gëna ndaw yi dañuy wane ni kalite done yi, du dayo bi kese, mooy dawal kàttan gi. Li yéeme ci gis-gis bi mooy tàggat ci done yu gëna set, yuñ gëna bàyyi xel, dafay tax model bu ndaw mëna xëcc yeneen yu gëna mag ci liggéey yu bari. SLMs yi dañuy tijji IA ci aparey bi: dañuy dox ci ordinatër portable wala smartphone, kon sa done du musa génn ci aparey bi, latency bi dafa néew, te amul njëgu cloud buy laaj. Dina ñu gëna xéewale itam ngir defar ay domen yuñ jagleel. Li ci baax mooy dañu gëna néew luñu am ci xam-xam àdduna bi, te dañu gëna néew doole ci liggéey yi gëna tar ci xalaat suñu ko méngale ak model yu mag yi.
Gis-gis xarala
Xeeti pexe yu bari ñooy tax model yu ndaw yi gëna am njariñ. Distilaasioŋ xam-xam dafay tàggat ndongo bu ndaw ngir toppandoo jàngalekat bu mag, di toxal kàttan ci paramet yu néew. Quantization dafay wàññi njubteg lim ci poid yi, ci misaal joge ci 16-bit dem ba ci 4-bit, di wàññi memory bi ak di gaawlu inference bi te du ñàkk lu bari ci kalite bi. Dagg dafay dindi poids yu bari yi. Lu gëna am solo mooy, done tàggat yu baax, yu segg bu baax, ni ci xeetu Phi yi ñu tàggat ci ëmbiit bu niru ak téere jàngat, dafay tax ñu néew paramet ñu dem fu sori ci li eskaal bu ñor bi kese digle.
njeextalu pexe
Gaawaay ak yaatuwaay
Liggéeyukaay yi ci làkk yi mën nañu gëna gaaw te duñu yàq deggoo gi.
Dugg ak yegg
Dafay yaatal jëfandikoo gi ci làkk yi ak ci anam yi ñuy jokkoo.
dogal yu gëna leer
Ekip yi mën nañu gëna yàgg ci àtte ci jamono ji otomatisation di liggéey ci baamtu.
Ëlëgu misaali làkk yu ndaw yi
Royuwaayi làkk yu ndaw yi bokk nañu ci wàll yi gëna gaaw ci IA, te li ko waral mooy laaj ñu am kumpa, njëg yu yomb, ak mëna nekk ci biti. Xaarandi SLMs di gëna jëm ci sistem operaasioŋ yi, navigateur yi, ak app yi, di liggéey ci liggéey yi ñuy faral di def ci aparey bi, fekk ñuy yóbbu laaj yu jafe yi ci niir yi. Weyal yokkute ci kantite, distilaasioŋ, ak curaasioŋu done ñu ngi wéy di tëj bërëb bi ak xeetu model yu gëna mag. Ëlëg mën na nekk ecosystem hybrid fu ay model yu ndaw yu am doole di def liggéey yu bari yu bës bu nekk, model yu mag yi ñuy reserve ngir xalaat yu gëna ñaaw.
Doxal ci àdduna dëgg
Doxal ab assistant IA bu amul jokkolante ci ab telefon bu xarañ suko defee ay done yu bopp duñu musa genni ci aparey bi
Tontu bu xarañ ak man-mani tënk yuñ tabax ci biir sistemu jëfandikoo ordinatër portable
Defar ab model bu dëgër ci dokimaa privé yu hopitaal te doo yónnee ay done ci cloud bi
Dugalal ab model bu woyof ci ab aparey IoT wala oto ngir gaaw, digle ci baat
Risk yi ak balustrade yi
Lépp lu jaarul yoon mën na dugg ci rapoor yi, jàppale ci liggéey bi, wala ci njariñu gëstu bi.
Sensibilite bu gaaw mën na jur njariñ yu wuute ci laajte yu noonu mel.
Done yu am solo mën nañu feeñ sudee seytu jëfandikoo gi néew doole.
Roadmap ngir samp gi
Mandargal formaa génne gi, melokaan bi, ak standard kalite yi laata ngay dugal ko.
Tontu yu am solo ak balluwaay yu wóor saa yu dëggu bi di am solo.
Fexeel am barabu xool nit ñi ngir am njariñ yu am solo.
Toppal anami gacce yi ak di faral di tàggataat ay laaj wala def-liggéey.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Small Language Models quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
Mën-mën yu feeñ ci misaali làkk yu mag
Laaj yi ñuy faral di laaj
What is Small Language Models?
Modèlu làkk yu ndaw yi (SLMs) ay model IA yu kompact lañu, lu ci bari ay téemeeri milioŋ wala ay miliyaar ciy paramet, ñu defar leen ngir ñu mëna dox bu baax ci telefon yi, ordinatër portatif yi ak aparey yi. Dañuy weccoo yenn kàttan yu bees ngir gaawaay, nëbbëtu, ak mëna daw te amul benn santu done.
Lan mooy li gëna xëcc nit ñi ci xeetu làkk wu ndaw?
SLMs yi dañu kompact ba mëna dox ci barab bi ci hardware konsomatër, joxe latency bu woyof, privacy, te amul benn njëgu cloud buy laaj.
Lan moo waral model yu ndaw yi di xëccoo model yu gëna mag yi?
Royuwaay yu melni famiy Phi dañu wane ni done yu sell, yu am kalite, boole ci ëmbiit yu niro ak téere jàng, dañuy may paramet yu néew ñu am njariñ yu am solo.
Luy distilaasioŋ xam-xam?
Distillation dafay toxal kàttan jàngalekat bu mag ci modelu ndongo bu gëna ndaw, boole performance ci paramet yu néew.
Lan la kantite di def ci xeetu làkk bu ndaw?
Quantization dafay denc poid yi ci anam wu gëna woyof, lu melni 4-bit ci barabu 16-bit, wàññi jëfandikoo mémoire ak gaaw inference ak perte kalite bu néew.
Lan mooy njariñu jëfandikoo làkk wu ndaw?
Compactness dafay am njëg: SLMs xam-xam bi gëna néew ak xalaat bu gëna néew ci jafe-jafe yi gëna tar moo gën xeetu frontiere yi gëna mag.