InoteveraGaidhi rinotevera
Kufungidzira LLM API Mari uye Tokeni Budget
Tekinoroji
Nhungamiro yehunyanzvi
LLM APIs inochaja pane tokeni, chunk yemavara ingangoita matatu-makota ezwi rechirungu.
Teerera kugwaro iriAI-yakarondedzerwa · ~3 min
Matokeni ekuisa aunotumira uye anoburitsa tokeni ayo modhi anogadzira ane mareti akasiyana, uye zvinobuda zvinowanzodhura zvakapetwa kakawanda. Kuti ufungidzire mutengo, verenga tokeni nechiratidzo chemupi wekupa kana nzvimbo yekuverengera uye wowanza divi rega rega nechiyero chayo chemiriyoni. Sanganisira akavanzika ma tokeni senge sisitimu inosimudzira, nhaurirano nhoroondo uye kufunga.
Mienzaniso haiverengi mavara kana mazwi zvakananga. A tokenizer inopatsanura zvinyorwa kuita tokens, zvinova zvakajairika mavara akateedzana anodzidzwa kubva mukudzidziswa data. Murairo wakajairika wechigunwe weChirungu une mavara mana, kana zvikamu zvitatu zvezwi, pachiratidzo. Izvo zvinoisa 1,000 mazwi paanenge 1,300 kusvika 1,400 tokens. Kodhi, nhamba, mazita asina kujairika uye mitauro yakawanda isiri yeChirungu inoshandisa mamwe tokeni pazwi. Mhuri yega yega yemhando ine tokenizer yayo, saka iwo mameseji mamwechete anogona kuburitsa maverengero akasiyana nevapi vakasiyana. Mitengo inowanzotorwa pamiriyoni tokens, ine yakaparadzana yekupinza uye yekubuda mitengo. Matokeni ekubuda anodhura zvakanyanya nekuti modhi inoagadzira imwe panguva, nepo ichikwanisa kugadzira ma tokens ekupinza anoenderana. Kubuda kunowanzo kutengwa kakati wandei chiyero chekuisa, kazhinji pakati pechina kana kasere, asi reshiyo inosiyana nemuenzaniso. Heino muenzaniso wakashandiswa nemitengo yakagadzirwa: kuisa pamadhora matatu pamiriyoni tokens uye inobuda pamadhora gumi nemashanu pamiriyoni. Basa rinotumira zviuru zvitanhatu zvekupinza tokens (system yekukurumidza, mirairo uye gwaro) uye inodzosa mazana masere ekubuda tokeni. - Input: 6,000 x $3 / 1,000,000 = $0.018 - Output: 800 x $15 / 1,000,000 = $0.012 - Total: $0.03 per task Pamabasa 10 000 pazuva, zvinosvika madhora mazana matatu pazuva. Mabhiri chaiwo anowanzo kushamisa vanhu, nezvikonzero zvinofanotaurwa: - Chat maapplication anotumira zvakare hurukuro yese pane imwe nguva, saka kupinza kunokura nemeseji yega yega. - Mamodheru ekurangarira anoburitsa ma tokeni emukati ekufunga anobhadharwa sekubuda, kunyangwe kana asina kuratidzwa zvizere. - Tsananguro dzechishandiso, magwaro akadzoserwa uye mifananidzo zvese zvinoverengerwa sekuisa. -Kuedzazve uye kutadza kufona kunodhurawo mari. Mafungiro matatu asiri iwo akajairika: izvo zviratidzo zvakaenzana mazwi, kuti kuzadza iyo modhi yemamiriro hwindo ndeyemahara, uye kuti modhi ine yakaderera pane-chiratidzo mutengo unogara wakachipa pane rimwe basa. Muenzaniso wakasimba unopedza mukuedza kushoma unogona kudhura zvishoma zvachose.
Mugadziri anoshandisa OpenAI's open-source tiktoken raibhurari kuverenga zviuru zvitatu-mazwi ekutsigira chinyorwa asati atumira. Inouya kune angangoita zviuru zvina zvematokens, uye anoisa yambiro yebhajeti kuti ienderane.
Chikwata chechatbot chinoona kuti yakawanda yebhiri rayo rinobva pakutumira 2,000-token system kukurumidza uye yakazara chat nhoroondo pane yega yega. Iyo inoderedza mutengo nekupfupisa kutendeuka kwechikuru uye kushandisa kukurumidza caching.
Kambani inogadzira 50,000 chigadzirwa tsananguro nehusiku humwe inofambisa basa kune batch API. Iyo batch API inobhadharisa zvishoma, uye mukudzoka mibairo inosvika mukati memaawa panzvimbo yemasekonzi.
Chikwata chinoturikira zvirimo muchiHindi nechiJapan mabhajeti akawanda papeji pane eChirungu. Nema tokenizer akajairika, chirevo chimwe chete chinowanzotora mamwe ma tokeni mumitauro iyoyo.
Per-token mitengo yeimwe nhanho yekugona yakaderera zvakanyanya mumakore mashoma apfuura. Kushandiswa kwese kunowanzo kukwira zvakadaro, nekuti maapplication anoshandisa mamiriro akareba, vamiririri vanofona kwakawanda uye mamodheru ekufunga anoburitsa zvakawanda. Mitengo iri kuramba ichiwedzera kusiana, iine mareti akaparadzana ekuisa cached, zvikumbiro zvenguva refu, batch mabasa uye kufunga. Izvo zvinoita kuti zvive zvakakosha kuyera kushandiswa chaiko pabasa pane kuenzanisa mitengo yemusoro. Zvishandiso zvemitengo zvakaita semabhajeti, kuteedzera mutengo we-per-feature uye otomatiki modhi nzira zvinogona kuzove zvikamu zvakajairwa zveLLM application.
Tsamba yemahara
Nhatu dzakasimbiswa dzeAI nyaya mangwanani ega ega pakati pevhiki, dzakanyorwa neChirungu chakajeka. Yemahara zvachose, hapana ads.
Imwe email zuva rega rega revhiki. Bvisa kunyoresa kamwe chete. Hatimbotengese kana kugovera kero yako.
Zviedze iwe pachako
Mhinduro yepakarepo pamhinduro yega yega, uye chitupa chinogovaniswa chine ID inobatika kana wapedza kosi.
Tsigira dzidzo yemahara yeAI. AI Understanding ndeye 501(c)(3) isingabatsiri - hapana ads, hapana paywall, zvachose. Ita chipo
LLM APIs inochaja pane tokeni, chunk yemavara ingangoita matatu-makota ezwi rechirungu. Matokeni ekuisa aunotumira uye anoburitsa tokeni ayo modhi anogadzira ane mareti akasiyana, uye zvinobuda zvinowanzodhura zvakapetwa kakawanda. Kuti ufungidzire mutengo, verenga tokeni nechiratidzo chemupi wekupa kana nzvimbo yekuverengera uye wowanza divi rega rega nechiyero chayo chemiriyoni. Sanganisira akavanzika ma tokeni senge sisitimu inosimudzira, nhaurirano nhoroondo uye kufunga.
Chirungu mavhareji angangoita mavara mana kana 0.75 mazwi pachiratidzo, saka 1,000 mazwi angangoita 1,300 kusvika 1,400 tokens.
Kugadzira tokens imwe neimwe inotora nguva yakawanda yekombuta pane kugadzirisa ma tokens ekupinza anoenderana.
6,000 x 3 / 1,000,000 = $0.018 uye 800 x 15 / 1,000,000 = $0.012, iyo inowedzera kusvika $0.03.
Imwe neimwe meseji nyowani inowanzo sanganisira ese ekutanga matende, saka tokeni dzekuisa dzinoungana kunze kwekunge nhoroondo yakatemwa kana kupfupikiswa.
Kufunga tokeni anogadzirwa nemuenzaniso, saka anobhadhariswa sekubuda kunyangwe iwe usingaaone ese.
Ramba uchidzidza
Mamwe madhairekitori akasarudzirwa nyaya iyi
InoteveraGaidhi rinotevera
Kufungidzira LLM API Mari uye Tokeni Budget
Tekinoroji