Nhungamiro yehunyanzvi

Max Tokens uye Stop Sequences

Max tokens ndicho chivharo chekuti mangani matokeni emuenzaniso anogona kuburitsa mumhinduro imwe, uye kumisa kutevedzana tambo dzinopera chizvarwa kana modhi yangodziburitsa.

Teerera kugwaro iriAI-yakarondedzerwa · ~3 min

Pa peji ino4 min verenga
  1. Pfupiso
  2. Kudzika Kwakadzika
  3. Kuitwa muNyika yeChokwadi
  4. Ramangwana reMax Tokens uye Stop Sequences
  5. Kuzvishandisa
  6. Ramba Uchiongorora
  7. Mibvunzo inowanzo bvunzwa

Pfupiso

Pamwe chete nechikonzero chekupedzisa iyo API inodzoka, ivo vanosarudza painogumira mhinduro uye vanokuudza kuti yakaguma yega kana kuti yakagurwa. Kuvawana zvakanaka kunodzivirira truncated JSON, mhinduro dzakapera nehafu uye kutambisa mari.

Kudzika Kwakadzika

Mutauro wemodhi unogadzira chiratidzo chimwe panguva kusvikira chimwe chinhu chauudza kuti imire. Pane zvikonzero zvitatu zvakajairika kuti inomira. Iyo inoburitsa yayo yekupedzisira-yekutendeuka tokeni, zvichireva kuti yakafunga kuti mhinduro yakakwana. Inosvika pahuwandu hwehuwandu hwematokeni awakabvumira. Kana kuti inogadzira zvinyorwa zvinoenderana neimwe yekumira kwako kutevedzana. Max tokens anowanzo kuvhiringidzika nehwindo remukati. Hwindo remamiriro ekunze ndiyo nhamba yese yematokeni iyo modhi inogona kubata kamwechete, kuisa pamwe nekubuda. Max tokens anongoganhura kuburitsa kwekufona kamwe chete. Modhi ine hwindo rakakura kwazvo remamiriro ekunze rinogona kuramba richiburitsa mhinduro pfupi kana max tokens akaiswa pasi, uye kuisa plus max tokeni kazhinji kunofanirwa kukwana mukati mehwindo remukati. MaAPI anoshuma kuti nei chizvarwa chakapera. OpenAI's Chat Completions API inodzosa finish_reason senge 'mira' kune yakasikwa magumo kana inofananidzwa yekumira kutevedzana, 'kureba' pakarohwa muganho wekubuda, uye 'tool_calls' apo modhi inoda kufonera chishandiso. Anthropic's Messages API inodzosa stop_reason senge 'end_turn', 'max_tokens', 'stop_sequence' kana 'tool_use'. Anthropic inoda max_tokens pachikumbiro chese. Nezve mamodheru ayo ekufunga, OpenAI yakaunza max_completion_tokens, iyo inoverenga yakavanzika yekufunga tokeni pamwe nekubuda kunooneka. Kumisa kutevedzana kunobatsira kune akarongwa mafomati: kupera mushure mekuvhara tag, kumira pamberi pechitauriri, kana kucheka mushure mechimwe chinyorwa. Iwo mameseji mameseji haawanzo kuverengerwa mune zvakadzoserwa zvakabuda, saka kodhi haifanirwe kutarisira kuiona. Chikanganiso chakanyanya kusateera chikonzero chekupedzisa. Mhinduro yakaderedzwa inogona kutaridzika seyakajeka, kunyanya prose, nepo yakarongeka inobuda ichingotyora. Imwe pfungwa isiriyo ndeyekuti yakaderera max tokens inoita kuti modhi inyore muchidimbu. Hazviiti; iyo modhi inonyora sezvainowanzoita uye inogurwa. Kumbira kupfupika mukukurumidza uye shandisa muganhu sevhavha yekuchengetedza.

Kuitwa muNyika yeChokwadi

Muchidimbu anoisa max tokens ku150 uye dzimwe pfupiso dzinopera pakati pemutsara; kutarisa chikonzero chekupedzisa kunoratidza 'kureba' kune idzo mafoni, saka app inosimudza muganho uye inokumbira pfupiso pfupi mukuchimbidza panzvimbo.

Chinyorwa chinoburitsa data seJSON chinotadza kupfuudza nezvemhinduro imwe mumakumi mashanu; kukundikana kwega kwega kwakange kwarova muganho wekubuda, saka kodhi ikozvino inoedza zvakare nepamusoro pepamusoro apo chikonzero chekupedzisa chinoti kubuda kwakaderedzwa.

Mugadziri anogadzira mutsara mumwechete wenhaurirano panguva anoshandisa kutevedzana kwekumira 'Mushandisi:' kuti modhi isaenderere mberi nekunyorawo mutsetse unotevera wemushandisi.

Chikwata chinoenda kumuenzaniso wekufunga chinowana mhinduro dzichidzoka dzisina chinhu nekuti kufunga kwakavanzika kunoshandisa iyo inogumira, saka vanosimudza muganho kuti vasiye nzvimbo yekufunga uye mhinduro.

Ramangwana reMax Tokens uye Stop Sequences

Miganho yekubuda yakakura sezvo mamodheru anotsigira zvizvarwa zvenguva refu, uye yakarongeka yekubuda maficha ayo anomanikidza mhinduro kune schema kuderedza, asi usabvisa, njodzi yekuderedzwa, sezvo mhinduro yakareba yakakwana inogona kurova chivharo. Mamodheru ekurangarira aita kuti bhajeti rekubuda rive rakakosha nekuti ma tokeni akavanzika zvino anogovera muganho wakafanana. Mazita eParameter uye chikonzero chekupedzisa anosiyana pakati pevanopa uye akachinja nekufamba kwenguva, saka zvine musoro kuti utarise zvinyorwa zvazvino uye nekuputira izvi zvinyorwa mudiki diki kodhi yako.

Kuzvishandisa

Nei zvichikosha

  • Mutengo uye bhajeti. Zvisarudzo zvezvivakwa zvinotyaira kuita uye mutengo wekushandisa kwemakore.
  • Sarudzo dzakajeka. Dzidzo yehunyanzvi inobatsira zvikwata kusarudza murwi wakakodzera, kwete iwo mutsva chete.
  • Kudzora kwemhando yepamusoro. Sarudzo dzeinjiniya dziri nani dzinoderedza zviitiko zvekuvimbika mukugadzira.

Chenjera

  • Kugadzirisa imwe bhenji kunogona kuvanza yakafara system kushaya simba.
  • Infrastructure uye mari yekugadzirisa inowanzotarisirwa pasi.
  • Chengetedzo uye kucherechedzwa mapundu anogona kukura sezvo masisitimu anowedzera kuoma.

Matanho anotevera

  1. Tsanangura latency, mhando, uye mutengo zvinangwa usati waitwa.
  2. Benchmark pasi pechokwadi mutoro uye data mamiriro.
  3. Chishandiso chekutarisa zvikanganiso, kudonha, uye mushandisi maitiro.
  4. Gadzirira nzira dzekudzosera kumashure uye dzezviitiko usati wawedzera.

Ramba Uchiongorora

Tsamba yemahara

Tora iyo yemazuva ese AI pfupiso

Nhatu dzakasimbiswa dzeAI nyaya mangwanani ega ega pakati pevhiki, dzakanyorwa neChirungu chakajeka. Yemahara zvachose, hapana ads.

Imwe email zuva rega rega revhiki. Bvisa kunyoresa kamwe chete. Hatimbotengese kana kugovera kero yako.

Zviedze iwe pachako

Take the Max Tokens and Stop Sequences quiz

Mhinduro yepakarepo pamhinduro yega yega, uye chitupa chinogovaniswa chine ID inobatika kana wapedza kosi.

Tanga mibvunzo

Tsigira dzidzo yemahara yeAI. AI Understanding ndeye 501(c)(3) isingabatsiri - hapana ads, hapana paywall, zvachose. Ita chipo

Mibvunzo inowanzo bvunzwa

Chii chinonzi Max Tokens uye Stop Sequences?

Max tokens ndicho chivharo chekuti mangani matokeni emuenzaniso anogona kuburitsa mumhinduro imwe, uye kumisa kutevedzana tambo dzinopera chizvarwa kana modhi yangodziburitsa. Pamwe chete nechikonzero chekupedzisa iyo API inodzoka, ivo vanosarudza painogumira mhinduro uye vanokuudza kuti yakaguma yega kana kuti yakagurwa. Kuvawana zvakanaka kunodzivirira truncated JSON, mhinduro dzakapera nehafu uye kutambisa mari.

Chii chinomisa max tokens?

Max tokens caps inobuda kune imwe runhare. Iro hwindo remukati ndiro rakaparadzana rinokwana muganho unovhara mapindiro uye zvinobuda.

Kufona kwako kunodzosa chikonzero chekupedzisira che'refu' muOpenAI's API. Chii chaitika?

'kureba' zvinoreva kugadzirwa kwakamira nekuti muganhu wakasvikwa, saka mhinduro inogona kunge isina kukwana.

Ndeipi Anthropic stop_reason inoratidza kuti modhi yakafunga kuti mhinduro yayo yakakwana?

'end_turn' zvinoreva kuti modhi yakapera zvega. 'max_tokens' zvinoreva kuti yakagurwa, uye 'stop_sequence' zvinoreva imwe yetambo dzako dzakafananidzwa.

Sei kuseta yakaderera max tokens kukosha kusingaite kuti mhinduro dzipfupike?

Muganhu wakaoma kumira, kwete murairo. Kumbira kupfupika mukukurumidza uye chengetedza muganhu sevhavha yekudzivirira.

Kutevedzana kwekumira kunosanganisirwa kunosanganisirwa mumavara akadzoswa here?

Misa kutevedzana kuguma chizvarwa uye kazhinji haabatanidzwe mune zvakadzoserwa zvakabuda, saka kodhi yako haifanirwe kuvimba nekuiona.