Generation buñu tënk ak Grammaire Guided
Generation buñ tënk dafay forse modelu làkk bi mu defar ay output yuy méngoo saa yu nekk ak structure buñ joxe, lu melni JSON bu baax, SQL, wala expression regular.
Résumé
It matters because it eliminates an entire class of parsing failures, making LLMs reliable enough to wire into real software pipelines.
Plongeur bu xóot
Modèlu làkk bu jaar yoon dafay jël misaalu token bi ci topp ci lu yomb, suko defee mu mëna defar JSON bu jaarul yoon, valeur enum bu baaxul, wala parenthèses yu tolloowul. Generation constrained dafay soppi jéego échantillonnage bi ci boppam: ci position bu nekk system bi dafay xayma token yi legal ba leegi ñu jox leen benn schema wala grammaire, ba noppi maske probabilite yi ci bépp token budul yoon ci zero balaa echantillonnage bi. Regle yi dañu leen di faral di fësal ci anamu nàfar bu amul muy tekki (ñu koy faral di boole ci formaa GBNF bi llama.cpp di jëfandikoo), muy wax buñ yamale, wala benn Schema JSON. Bibliothèque yu melni Retour, Njàngale, ak XGrammar, boole ci OpenAI ak 'mode JSON,' dañuy jëfandikoo lii. Ndax yoon yi jaarul yoon dañu leen di dagg, model bi mënul musa génne benn buum bu dul parse, fekk mingi tànn ci boppam ci wéy yu baax yi.
Gis-gis xarala
Kaf gi gëna am solo mooy masin bu am tolluwaayu token. Grammaire bi wala regex bi dañu koy boole ci ay etaa, te etaa bu nekk amna mask buñ njëkka xayma buy màndargaal ban token vocabulaire mooy tëye génne gi. Ginaaw bi model bi defaree ay logit, ay jeton yudul yoon ñu ngi leen di def ci infini négatif, kon softmax daf leen jox amul benn probabilite. masin bi dafay awaase ci etaa bi ak token bu nekk buñu nangu. Tokenizer bu jaarul yoon (benn token buy jëm ci ay pexe grammaire) mooy wàll wi gëna tar, ñu koy saafara ci indexe vocabulaire bi ci automaton bi laataa jot.
njeextalu pexe
Gaawaay ak yaatuwaay
Liggéeyukaay yi ci làkk yi mën nañu gëna gaaw te duñu yàq deggoo gi.
Dugg ak yegg
Dafay yaatal jëfandikoo gi ci làkk yi ak ci anam yi ñuy jokkoo.
dogal yu gëna leer
Ekip yi mën nañu gëna yàgg ci àtte ci jamono ji otomatisation di liggéey ci baamtu.
Ëlëgu jamono ju tënk ak jiite Grammaire
Xaarandil dekodaas bu tënk nekk lu jaadu, jege-zero-ci kaw man-man ci biir motëri inference yu melni vLLM ak TensorRT-LLM moo gën ab bibliothèque boulong. Gëstu dafay puus ci wàllu tënk yu gëna riis, grammer yu mat sëkk, defar kode yuñ saytu xeetu, ak tënk yuy tëral dëgg semantik, te baña yam ci syntax kese. Couplage bu gëna dëgër ak agent yi ak woote jumtukaay dina tax model yi mëna joxe argument fonction ci anam wu wóor. Jafe-jafe bi gëna mag mooy nga baña joxe leeral yu gëna jub, ndax yenn saa yi grammer yu tar mën nañu tax model bi baña tontu ci anam wu gëna baax.
Doxal ci àdduna dëgg
Forse benn LLM ngir mu genne JSON bu méngoo ndànk ak schema API bi suko defee kodu downstream bi du musa jot njuumte parse
Defar SQL buñu mëna wax ni dina baax ci wàllu sintaks ci wàllu nàqaru base de done balaa ñu koy jëfandikoo
Teg ay génnug ab xaajkat ci benn ci etiketu kategori yu fiks yi di jëfandikoo ab tënk regex wala enum
Defar ay argument woote fonction ngir agent yiy jëfandikoo jumtukaay yuy méngoo saa yu nekk ak xeetu parametre yiñ soxla ci jumtukaay bi
Risk yi ak balustrade yi
Lépp lu jaarul yoon mën na dugg ci rapoor yi, jàppale ci liggéey bi, wala ci njariñu gëstu bi.
Sensibilite bu gaaw mën na jur njariñ yu wuute ci laajte yu noonu mel.
Done yu am solo mën nañu feeñ sudee seytu jëfandikoo gi néew doole.
Roadmap ngir samp gi
Mandargal formaa génne gi, melokaan bi, ak standard kalite yi laata ngay dugal ko.
Tontu yu am solo ak balluwaay yu wóor saa yu dëggu bi di am solo.
Fexeel am barabu xool nit ñi ngir am njariñ yu am solo.
Toppal anami gacce yi ak di faral di tàggataat ay laaj wala def-liggéey.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Constrained and Grammar-Guided Generation quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
Decodage buñu tënk
Laaj yi ñuy faral di laaj
What is Constrained and Grammar-Guided Generation?
Generation buñ tënk dafay forse modelu làkk bi mu defar ay output yuy méngoo saa yu nekk ak structure buñ joxe, lu melni JSON bu baax, SQL, wala expression regular. Dafa am solo ndax dafay dindi bépp xeetu njuumte parsing, tax LLMs gëna wóor ngir mëna wire ci pipeline losisel dëgg.
Lan la generation constrainte di soppi ci generation text?
Generation constrained dafay dugg ci waxtu decodage, di dindi probabilite yi jetons yi nara dog structure bi war balaa ñuy jël échantillon.
Ci yii, yan ci ñoom mooy anam wi ñuy gëna faral di fësalee sàrti jëmmal ci wàllu nàfar?
Dañuy faral di leeral ay tënk ni grammaire bu amul muy tekki (lu melni, GBNF), expression reguleer, wala Schema JSON.
naka lañuy tere ñu tànnee token yudul yoon?
Masking dafay def ay token yudul yoon ci infini négatif, kon ginaaw softmax duñu am benn probabilite te kenn mënu leen sample.
Lan mooy jafe-jafe teknik bi gëna mag ci samp ay tënk ci wàllu token?
Benn token mën na jàll ci ëmbeefi nàfar yi, kon dañu wara indexe vocabulaire bi bu baax ci automaton bi ngir mëna jëflante ak jafe-jafe yii.
Lan mooy njariñu defar bu gàtt ngir sistemu defar yi?
Ci tabax, génne gi dafay méngoo saa yu nekk ak structure bi, kon parser yi ci suuf duñu musa tëf ci mbind mu jaarul yoon. Du garanti ni dëgg gi dëgg la.