InoteveraGaidhi rinotevera
Kufungidzira LLM API Mari uye Tokeni Budget
Tekinoroji
Nhungamiro yehunyanzvi
Max tokens ndicho chivharo chekuti mangani matokeni emuenzaniso anogona kuburitsa mumhinduro imwe, uye kumisa kutevedzana tambo dzinopera chizvarwa kana modhi yangodziburitsa.
Teerera kugwaro iriAI-yakarondedzerwa · ~3 min
Pamwe chete nechikonzero chekupedzisa iyo API inodzoka, ivo vanosarudza painogumira mhinduro uye vanokuudza kuti yakaguma yega kana kuti yakagurwa. Kuvawana zvakanaka kunodzivirira truncated JSON, mhinduro dzakapera nehafu uye kutambisa mari.
Mutauro wemodhi unogadzira chiratidzo chimwe panguva kusvikira chimwe chinhu chauudza kuti imire. Pane zvikonzero zvitatu zvakajairika kuti inomira. Iyo inoburitsa yayo yekupedzisira-yekutendeuka tokeni, zvichireva kuti yakafunga kuti mhinduro yakakwana. Inosvika pahuwandu hwehuwandu hwematokeni awakabvumira. Kana kuti inogadzira zvinyorwa zvinoenderana neimwe yekumira kwako kutevedzana. Max tokens anowanzo kuvhiringidzika nehwindo remukati. Hwindo remamiriro ekunze ndiyo nhamba yese yematokeni iyo modhi inogona kubata kamwechete, kuisa pamwe nekubuda. Max tokens anongoganhura kuburitsa kwekufona kamwe chete. Modhi ine hwindo rakakura kwazvo remamiriro ekunze rinogona kuramba richiburitsa mhinduro pfupi kana max tokens akaiswa pasi, uye kuisa plus max tokeni kazhinji kunofanirwa kukwana mukati mehwindo remukati. MaAPI anoshuma kuti nei chizvarwa chakapera. OpenAI's Chat Completions API inodzosa finish_reason senge 'mira' kune yakasikwa magumo kana inofananidzwa yekumira kutevedzana, 'kureba' pakarohwa muganho wekubuda, uye 'tool_calls' apo modhi inoda kufonera chishandiso. Anthropic's Messages API inodzosa stop_reason senge 'end_turn', 'max_tokens', 'stop_sequence' kana 'tool_use'. Anthropic inoda max_tokens pachikumbiro chese. Nezve mamodheru ayo ekufunga, OpenAI yakaunza max_completion_tokens, iyo inoverenga yakavanzika yekufunga tokeni pamwe nekubuda kunooneka. Kumisa kutevedzana kunobatsira kune akarongwa mafomati: kupera mushure mekuvhara tag, kumira pamberi pechitauriri, kana kucheka mushure mechimwe chinyorwa. Iwo mameseji mameseji haawanzo kuverengerwa mune zvakadzoserwa zvakabuda, saka kodhi haifanirwe kutarisira kuiona. Chikanganiso chakanyanya kusateera chikonzero chekupedzisa. Mhinduro yakaderedzwa inogona kutaridzika seyakajeka, kunyanya prose, nepo yakarongeka inobuda ichingotyora. Imwe pfungwa isiriyo ndeyekuti yakaderera max tokens inoita kuti modhi inyore muchidimbu. Hazviiti; iyo modhi inonyora sezvainowanzoita uye inogurwa. Kumbira kupfupika mukukurumidza uye shandisa muganhu sevhavha yekuchengetedza.
Muchidimbu anoisa max tokens ku150 uye dzimwe pfupiso dzinopera pakati pemutsara; kutarisa chikonzero chekupedzisa kunoratidza 'kureba' kune idzo mafoni, saka app inosimudza muganho uye inokumbira pfupiso pfupi mukuchimbidza panzvimbo.
Chinyorwa chinoburitsa data seJSON chinotadza kupfuudza nezvemhinduro imwe mumakumi mashanu; kukundikana kwega kwega kwakange kwarova muganho wekubuda, saka kodhi ikozvino inoedza zvakare nepamusoro pepamusoro apo chikonzero chekupedzisa chinoti kubuda kwakaderedzwa.
Mugadziri anogadzira mutsara mumwechete wenhaurirano panguva anoshandisa kutevedzana kwekumira 'Mushandisi:' kuti modhi isaenderere mberi nekunyorawo mutsetse unotevera wemushandisi.
Chikwata chinoenda kumuenzaniso wekufunga chinowana mhinduro dzichidzoka dzisina chinhu nekuti kufunga kwakavanzika kunoshandisa iyo inogumira, saka vanosimudza muganho kuti vasiye nzvimbo yekufunga uye mhinduro.
Miganho yekubuda yakakura sezvo mamodheru anotsigira zvizvarwa zvenguva refu, uye yakarongeka yekubuda maficha ayo anomanikidza mhinduro kune schema kuderedza, asi usabvisa, njodzi yekuderedzwa, sezvo mhinduro yakareba yakakwana inogona kurova chivharo. Mamodheru ekurangarira aita kuti bhajeti rekubuda rive rakakosha nekuti ma tokeni akavanzika zvino anogovera muganho wakafanana. Mazita eParameter uye chikonzero chekupedzisa anosiyana pakati pevanopa uye akachinja nekufamba kwenguva, saka zvine musoro kuti utarise zvinyorwa zvazvino uye nekuputira izvi zvinyorwa mudiki diki kodhi yako.
Tsamba yemahara
Nhatu dzakasimbiswa dzeAI nyaya mangwanani ega ega pakati pevhiki, dzakanyorwa neChirungu chakajeka. Yemahara zvachose, hapana ads.
Imwe email zuva rega rega revhiki. Bvisa kunyoresa kamwe chete. Hatimbotengese kana kugovera kero yako.
Zviedze iwe pachako
Mhinduro yepakarepo pamhinduro yega yega, uye chitupa chinogovaniswa chine ID inobatika kana wapedza kosi.
Tsigira dzidzo yemahara yeAI. AI Understanding ndeye 501(c)(3) isingabatsiri - hapana ads, hapana paywall, zvachose. Ita chipo
Max tokens ndicho chivharo chekuti mangani matokeni emuenzaniso anogona kuburitsa mumhinduro imwe, uye kumisa kutevedzana tambo dzinopera chizvarwa kana modhi yangodziburitsa. Pamwe chete nechikonzero chekupedzisa iyo API inodzoka, ivo vanosarudza painogumira mhinduro uye vanokuudza kuti yakaguma yega kana kuti yakagurwa. Kuvawana zvakanaka kunodzivirira truncated JSON, mhinduro dzakapera nehafu uye kutambisa mari.
Max tokens caps inobuda kune imwe runhare. Iro hwindo remukati ndiro rakaparadzana rinokwana muganho unovhara mapindiro uye zvinobuda.
'kureba' zvinoreva kugadzirwa kwakamira nekuti muganhu wakasvikwa, saka mhinduro inogona kunge isina kukwana.
'end_turn' zvinoreva kuti modhi yakapera zvega. 'max_tokens' zvinoreva kuti yakagurwa, uye 'stop_sequence' zvinoreva imwe yetambo dzako dzakafananidzwa.
Muganhu wakaoma kumira, kwete murairo. Kumbira kupfupika mukukurumidza uye chengetedza muganhu sevhavha yekudzivirira.
Misa kutevedzana kuguma chizvarwa uye kazhinji haabatanidzwe mune zvakadzoserwa zvakabuda, saka kodhi yako haifanirwe kuvimba nekuiona.
Ramba uchidzidza
Mamwe madhairekitori akasarudzirwa nyaya iyi
InoteveraGaidhi rinotevera
Kufungidzira LLM API Mari uye Tokeni Budget
Tekinoroji