Canja wurin da sauri
Rubutun gaggawa yana ƙyale ƙirar AI ta sake yin amfani da aikin lissafin da ya yi akan maimaita guntun rubutu maimakon sake sarrafa shi kowane lokaci.
Dubawa
It dramatically cuts cost and latency when the same long instructions, documents, or examples appear in request after request.
Zurfafa nutsewa
Lokacin da samfurin harshe ya karanta faɗakarwa, yana jujjuya kowace alama zuwa jihohi masu ƙididdigewa da ake kira maɓalli-value (KV) vectors ta hanyar kulawarsa. Yawanci wannan yana faruwa sabo akan kowace buƙata, koda kashi 90% na faɗakarwa iri ɗaya ce. Matsakaicin gaggawa yana adana waɗancan jihohin KV da aka ƙididdige su don alamar prefix, don haka buƙatun daga baya wanda ya fara da rubutu iri ɗaya zai iya tsallakewa kai tsaye zuwa sabon ɓangaren. Masu bayarwa kamar Anthropic da OpenAI suna fallasa wannan ta hanyar ba ku damar tuta ingantaccen prefix; Ana yin lissafin cache hits a rangwame mai zurfi (sau da yawa 90% kashe farashin shigarwa) kuma a amsa da sauri. Yana da kyau don taɗi tare da ƙayyadaddun tsarin faɗakarwa, bututun RAG suna sake amfani da takaddun iri ɗaya, ko wakilai masu maimaita dogon tarihi.
Fahimtar Fasaha
Caching yana aiki saboda kulawar taswira shine sanadi: kowace alama kawai tana zuwa alamun kafinta. Don haka KV ya faɗi don prefix ba zai taɓa canzawa ba lokacin da kuka ƙara sabbin alamu daga baya. Ana ƙulla ma'ajin ɗin akan ainihin madaidaicin alamar alama na wannan prefix, wanda shine dalilin da ya sa ko da gyara harafi ɗaya da wuri a cikin gaggawa yana lalata duk abin da ke ƙasa. Cache na ɗan gajeren lokaci ne (mintuna), ana adana kowane mai bayarwa, kuma toshe cacheable yawanci dole ne ya wuce ƙaramin ƙidayar alama.
Dabarun Tasiri
Kudin da kasafin kuɗi
Hukunce-hukuncen gine-gine suna haifar da aiki da tsadar aiki na shekaru.
Shawarwari masu haske
Ilimin fasaha yana taimaka wa ƙungiyoyi su zaɓi tari mai kyau, ba kawai sabon abu ba.
Kula da inganci
Zaɓuɓɓukan injiniya mafi kyau suna rage abin dogaro a cikin samarwa.
Makomar caching na gaggawa
Yi tsammanin caching ya zama atomatik kuma ya daɗe, tare da masu samarwa suna gano tazarar da za a sake amfani da su maimakon buƙatar alamomin hannu. Tsare-tsare da ɓangarori na iya barin gyare-gyare a tsakiyar gaggawar sake amfani da sassan da ba su canza ba a kowane gefe. Yayin da wakilai ke jujjuya manyan abubuwan da suka faru da tarihin kayan aiki, zama na giciye da masu amfani da keɓantattun bayanai don faɗakarwar tsarin gama gari za su zama mabuɗin don samar da mahallin alamar miliyoyin tattalin arziki, kuma samfuran kan na'urori za su ɗauki irin wannan sake amfani da KV don zazzagewar gida.
Aiwatar da Gaskiyar Duniya
Abokin ciniki mai goyon bayan chatbot yana adana manufofin sa na alama 5,000 da tsarin sautin sauti don haka kowane saƙon mai amfani kawai yana biyan cikakken farashi don sabuwar tambayar.
Ƙa'idar da aka haɓaka (RAG) tana adana babban daftarin aiki sau ɗaya, sannan ta amsa tambayoyi da yawa game da shi a ɗan ƙaramin farashi.
Mataimakin codeing yana adana abubuwan da ke cikin babban codebase ko fayil azaman kafaffen prefix yayin da mai haɓakawa ke yin tambayoyi na gaba.
Wakilin AI yana adana tsayin daka, mai girma kwafin amfanin kayan aiki don kowane sabon mataki baya sake lissafin duk tattaunawar da ta gabata.
Hatsari & Tsare-tsare
Haɓaka ma'auni ɗaya na iya ɓoye manyan raunin tsarin.
Sau da yawa ana raina kayan more rayuwa da kuma kuɗin kulawa.
Tsaro da gibin lura na iya girma yayin da tsarin ke ƙara haɓaka.
Taswirar Hanya
Ƙayyade latency, inganci, da maƙasudin farashi kafin aiwatarwa.
Alamar ma'auni a ƙarƙashin ainihin kaya da yanayin bayanai.
Kula da kayan aiki don kurakurai, ɗigo, da tasirin mai amfani.
Shirya bijirowa da hanyoyin mayar da martani kafin sikeli.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Prompt Caching quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Amintaccen Tsaro na AI
Tambayoyin da ake yawan yi
What is Prompt Caching?
Tsayawa da sauri yana barin ƙirar AI ta sake yin amfani da aikin lissafin da ya yi akan maimaita guntun rubutu maimakon sake sarrafa shi kowane lokaci. Yana yanke farashi da jinkiri sosai lokacin da dogayen umarni, takardu, ko misalai suka bayyana cikin buƙata bayan buƙata.
Menene saurin caching da farko ke adanawa da sake amfani?
Caching yana adana jihohin kulawar KV da aka lissafta don ingantaccen prefix don kada a sake ƙididdige su akan kowace buƙata.
Me yasa prefix ɗin da aka adana zai dace daidai, alamar alama?
Tunda kowace alama tana zuwa kawai ga alamun farko, canza alamar farko tana lalata kowace jihar da ta dogara da ita, tana karya cache.
Wane yanayi ne ya fi amfana daga caching na gaggawa?
Caching yana biyan kuɗi lokacin da aka sake yin amfani da babban nau'i iri ɗaya a cikin buƙatun da yawa, kamar ƙayyadadden tsarin faɗakarwa ko takaddar raba.
Kusan nawa ne mafi arha cache hits akan alamun shigarwa tare da manyan masu samarwa?
Masu samarwa galibi suna lissafin shigarwar da aka adana a kusan kashi 90 cikin 100 akan adadin shigarwar na yau da kullun, babban dalilin caching yana adana kuɗi.
A ina ya kamata a sanya abun cikin da za a sake amfani da shi don ƙara yawan bugun cache?
Sanya barga abun ciki a farko azaman prefix da canza abun ciki daga baya yana ba da damar sake amfani da prefix ɗin da aka adana yayin da sabbin alamun kawai ake sarrafa su.