Gufata vuba
Kwihutira gufunga kureka moderi ya AI ikongera gukoresha imirimo yo kubara yakoze kumurongo winyandiko aho kuyisubiramo buri gihe.
Incamake
It dramatically cuts cost and latency when the same long instructions, documents, or examples appear in request after request.
Kwibira cyane
Iyo imvugo yururimi isomye ikibazo, ihindura buri kimenyetso muburyo bwimibare yimbere yiswe urufunguzo-agaciro (KV) ibice binyuze mubitekerezo byayo. Mubisanzwe ibi bibaho bishya kuri buri cyifuzo, nubwo 90% byihutirwa bisa. Kwihutira kubika bibika ibyo KV ibanziriza kubirango byashyizwe ahagaragara, bityo icyifuzo cya nyuma gitangirana ninyandiko imwe gishobora gusimbuka neza igice gishya. Abatanga nka Anthropic na OpenAI bagaragaza ibi bakwemerera ibendera ryibanze rihamye; cache hits yishyurwa kugabanutse cyane (akenshi 90% kubiciro byinjiza) kandi igasubiza vuba. Nibyiza kubiganiro hamwe na sisitemu ihamye, imiyoboro ya RAG ikoresha inyandiko zimwe, cyangwa abakozi basubiramo amateka maremare.
Ubushishozi
Cishing ikora kuko impinduka ya transformateur nimpamvu: buri kimenyetso cyitabira gusa ibimenyetso mbere yacyo. KV rero ivuga kuri prefix ntizigera ihinduka mugihe wongeyeho ibimenyetso bishya nyuma. Ubwihisho burafunguye kumurongo wukuri-wikimenyetso cyurwo rwibanze, niyo mpamvu niyo inyuguti imwe ihindura hakiri kare mugihe itesha agaciro ibintu byose kumanuka. Cashe ni igihe gito (iminota), ibitswe kuri buri mutanga, kandi cacheable blok isanzwe igomba kurenza umubare wikimenyetso.
Ingaruka z'Ingamba
Igiciro na bije
Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
Ibyemezo bisobanutse
Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
Kugenzura ubuziranenge
Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.
Igihe kizaza cyo guhita
Tegereza cishing kugirango ihinduke kandi irambe, hamwe nababitanga babona umwanya wongeye gukoreshwa aho gusaba ibimenyetso byintoki. Cierarchical and part cishing irashobora kureka ibyahinduwe hagati yihuta kongera gukoresha ibice bidahindutse kumpande zombi. Nkuko abakozi bahuza ibintu byinshi n'amateka y'ibikoresho, kwambukiranya hamwe no kwambukiranya-abakoresha basanganywe cashe kuri sisitemu isanzwe ibaye urufunguzo rwo gukora miriyoni-token imiterere yubukungu, kandi kubikoresho-bikoresho bizakoresha KV ikoreshwa muburyo bworoshye bwo gufata umwanzuro.
Gushyira mu bikorwa Isi
Umukiriya-ushyigikirwa na chatbot ikora politike yayo ya 5.000-ya sisitemu na sisitemu ya tone kuburyo buri mukoresha ukoresha yishyura igiciro cyuzuye kubibazo bishya.
Porogaramu yo kugarura-yongerewe (RAG) ifata inyandiko nini yerekana inshuro imwe, hanyuma igasubiza ibibazo byinshi kubyerekeye kubijyanye nigice gito.
Umufasha wa coding yihishe ibiri muri codebase nini cyangwa dosiye nkibisobanuro byagenwe mugihe uwatezimbere abaza ibibazo bikurikirana.
Umukozi wa AI afata igihe kirekire, gikura ibikoresho-gukoresha inyandiko-mvugo kugirango buri ntambwe nshya ntisubire kwishura ibiganiro byose byabanjirije.
Ingaruka & Kurinda
Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.
Igishushanyo mbonera
Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
Tegura inzira yo gusubiza ibyabaye mbere yo gupima.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Prompt Caching quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Umutekano wihuse
Ibibazo bikunze kubazwa
What is Prompt Caching?
Kwihutira gufunga kureka moderi ya AI ikongera gukoresha imirimo yo kubara yakoze kumurongo winyandiko aho kuyisubiramo buri gihe. Igabanya cyane ikiguzi nubukererwe mugihe amabwiriza maremare, inyandiko, cyangwa ingero zigaragara mubisabwa nyuma yo kubisabwa.
Ni ubuhe buryo bwihuse kubika cyane cyane kubika no gukoresha?
Cishing ikiza KV kwitondera ibarwa kubisobanuro bihamye kugirango bitagomba kubarwa kuri buri cyifuzo.
Ni ukubera iki bigomba guhuzwa neza mbere, ikimenyetso cya token?
Kubera ko buri kimenyetso cyitabira gusa ibimenyetso byambere, guhindura ikimenyetso hakiri kare bitesha agaciro leta yose ishingiye kuri yo, kumena cache.
Nibihe bintu byunguka BYINSHI muburyo bwihuse?
Cishing yishura mugihe igice kinini, gisa kimwe cyongeye gukoreshwa mubisabwa byinshi, nka sisitemu ihamye cyangwa inyandiko isangiwe.
Hafi ya ahendutse angahe cache ikubita kubimenyetso byinjiza hamwe nababitanga bakomeye?
Abatanga ibicuruzwa mubisanzwe bishyuza amafaranga yinjiza hafi 90% kubiciro bisanzwe byinjira, impamvu nyamukuru cishing ibika amafaranga.
Ni hehe ibikoreshwa byongeye gushyirwa kugirango bigabanuke neza?
Gushyira ibintu bihamye mbere nkibisobanuro hamwe nibihinduka nyuma hanyuma ureke cache prefix yongeye gukoreshwa mugihe ibimenyetso bishya gusa bitunganijwe.