InoteveraGaidhi rinotevera
AI Schema Markup Generation
Tekinoroji
Nhungamiro yehunyanzvi
Cache-yakawedzerwa chizvarwa (CAG) inofanorodha hwaro hwese, hwakasimba hweruzivo mumutauro wemodhi yakakosha-kukosha (KV) cache kamwe uye inoshandisa zvakare cache yemubvunzo wega wega, pachinzvimbo chekudzoreredza magwaro pane chero mubvunzo sezvinoita RAG.
Teerera kugwaro iriAI-yakarondedzerwa · ~3 min
Izvo zvine basa kune diki, yakagadzikana corpora nekuti inobvisa zvikanganiso zvekudzoreredza uye indekisi kugadzirisa ichipindura nekukurumidza pane kuverenga zvakare magwaro nguva yega yega.
Cache-yakawedzerwa chizvarwa, kana CAG, inotsiva danho rekudzoreredza nekurodha. Panzvimbo pekutsvaga hwaro hweruzivo pamubvunzo wega wega, sisitimu inodyisa hwaro hwese hweruzivo kune modhi kamwe, inochengetedza inokonzeresa kiyi-kukosha (KV) cache, uye inoshandisazve iyo cache pamubvunzo wega wega unotevera. Nzira iyi yakatsanangurwa mupepa raDecember 2024 rakanzi Usaite RAG: Kana Cache-Augmented Generation ndiyo Yese Yaunoda Kuti Uite Ruzivo Mabasa. Iyo KV cache ndiyo seti yepakati yekutarisisa makiyi uye inokoshesa transformer inokokorodza kune yega tokeni yayakaverenga. Kazhinji inovakwa panguva yekukumbira kumwe chete uye inoraswa. MuCAG, zvinyorwa zvinogadziriswa nguva isati yasvika, cache inochengetwa, uye mubvunzo wega wega unowedzerwa mushure meiyo cached prefix. Iyo modhi inongoverengera iyo mitsva yemubvunzo tokeni isati yagadzira, saka mhinduro dzinotanga nekukurumidza kupfuura kana magwaro akaverengwazve nguva yega yega. Mushure mekupindura, ma tokeni akaiswa anodzikiswa kuti cache idzokere kumagwaro ayo-chete mamiriro emubvunzo unotevera. Mabhenefiti haasi ekudzoreredza zvikanganiso, sezvo gwaro rega rega riripo, hapana embedding index kana vector dhatabhesi rekuchengetedza, uye yakaderera per-mubvunzo latency pane isina ruzivo refu mamiriro. Iyo miganho inotevera yakananga: iyo corpus yese inofanirwa kukwana mufafitera remamiriro emuenzaniso, modhi inofanira kuramba ichinyatsofunga pamusoro peiyo yakawanda zvinyorwa, uye chero shanduko kumagwaro zvinoreva kuvaka patsva cache. Saka CAG inokodzera mabhesi eruzivo madiki, akatsiga senge bhuku rezvigadzirwa, seti yemitemo, sirabhasi kana chinyorwa chekutonga chakamisikidzwa. Iyo haina kukodzera kuunganidzwa hombe, kukurumidza kushandura kana mvumo-yakasefa. Imwe pfungwa isiriyo ndeyekuti CAG inodzidzisa modhi. Hapana chinhu chakanyatsogadziriswa; uremu hauchinji. Commercial prompt caching kubva kune API vanopa ihama inogarwa yepfungwa imwe chete.
Kambani ine 60-peji bhuku revashandi rekushandisa inofanorodha muKV cache yeyakavhurika-huremu modhi, saka wese mubvunzo weHR unopindurwa nebhuku rekushandisa rakazara riripo uye pasina vector dhatabhesi rekuchengetedza.
Mutengesi wesoftware anobata bhuku rekushandisa kune mubatsiri wekutsigira uye anovakazve cache chete kana bhuku idzva raburitswa.
Murairidzi anofanorodha sirabhasi yekosi uye manotsi ehurukuro kuitira kuti mubatsiri wekudzidza agone kupindura mibvunzo yevadzidzi nekukurumidza musemesita yese.
Chikwata chekuteerera chinoshandisa inogarwa API's kukurumidza caching kuchengetedza yakamisikidzwa yekutonga zvinyorwa seyakavharirwa prefix, kubhadhara mareti akaderedzwa ekuverenga anodzokororwa pamibvunzo yakawanda.
CAG's inoshanda renji inokura semamiriro windows kureba uye KV cache compression inovandudza, asi inoramba yakasungwa nendangariro uye nemafambisirwo emamodheru anofunga pamusoro pezvakareba zvakanyanya. Magadzirirwo eHybrid idanho rinotevera rechisikigo: cache yakagadzikana musimboti wemagwaro anowanzodiwa uye tora muswe wakareba paunoda. Tsvagiridzo yekumanikidza cache, kurodha cache kune yakachipa yekuchengetedza, uye kusarudza kuti ndeapi tokens yekuchengeta inogona kuita hombe yakarongedzerwa corpora kushanda. Parizvino bvunzo ine musoro ndeye empirical: enzanisa CAG, RAG uye yakajeka kureba mamiriro pamibvunzo yako wega, mutengo uye yekuvandudza frequency.
Tsamba yemahara
Nhatu dzakasimbiswa dzeAI nyaya mangwanani ega ega pakati pevhiki, dzakanyorwa neChirungu chakajeka. Yemahara zvachose, hapana ads.
Imwe email zuva rega rega revhiki. Bvisa kunyoresa kamwe chete. Hatimbotengese kana kugovera kero yako.
Zviedze iwe pachako
Mhinduro yepakarepo pamhinduro yega yega, uye chitupa chinogovaniswa chine ID inobatika kana wapedza kosi.
Tsigira dzidzo yemahara yeAI. AI Understanding ndeye 501(c)(3) isingabatsiri - hapana ads, hapana paywall, zvachose. Ita chipo
Cache-yakawedzerwa chizvarwa (CAG) inofanorodha hwaro hwese, hwakasimba hweruzivo mumutauro wemodhi yakakosha-kukosha (KV) cache kamwe uye inoshandisa zvakare cache yemubvunzo wega wega, pachinzvimbo chekudzoreredza magwaro pane chero mubvunzo sezvinoita RAG. Izvo zvine basa kune diki, yakagadzikana corpora nekuti inobvisa zvikanganiso zvekudzoreredza uye indekisi kugadzirisa ichipindura nekukurumidza pane kuverenga zvakare magwaro nguva yega yega.
CAG inokokorodza cache yeKV yekorasi pachine nguva uye anoishandisa zvakare pamubvunzo wega wega.
Makiyi uye kukosha kubva kumatanho ekutarisisa akachengetwa saka ekutanga tokens haafanire kudzokororwa.
Kubvisa ma tokens akawedzerwa kunodzosera cache kune yayo yakachena preloaded mamiriro emubvunzo unotevera.
Nekuti gwaro rega rega rakatakurwa, iyo corpus inovharirwa nehwindo remukati uye inowanikwa ndangariro.
Mapepa ekuverenga akatoitwa uye akachengetwa, saka mubvunzo chete ndiwo unogadziriswa pamubvunzo wega wega.
Ramba uchidzidza
Mamwe madhairekitori akasarudzirwa nyaya iyi
InoteveraGaidhi rinotevera
AI Schema Markup Generation
Tekinoroji