Nhungamiro yehunyanzvi

Automatic Prompt Optimization uye DSPy

Otomatiki nekukurumidza optimization inoshandisa algorithm kutsvaga zvirinani mirairo kana mashoma-epfuti mienzaniso.

Teerera kugwaro iriAI-yakarondedzerwa · ~3 min

Pa peji ino4 min verenga
  1. Pfupiso
  2. Kudzika Kwakadzika
  3. Kuitwa muNyika yeChokwadi
  4. Ramangwana reOtomatiki Prompt Optimization uye DSPy
  5. Kuzvishandisa
  6. Ramba Uchiongorora
  7. Mibvunzo inowanzo bvunzwa

Pfupiso

Inopa zvibodzwa zvemumiriri zvinopesana nemetric pane seti yemienzaniso pane kuvimba nemaoko-tweaked mazwi. Maitiro anozivikanwa anosanganisira APE, Google DeepMind's OPRO uye DSPy, yakavhurika-sosi chimiro kubva kuStanford. Pamwe chete vanoshandura huinjiniya nekukurumidza kubva pakufungidzira kuita inoyerwa, inodzokororwa maitiro.

Kudzika Kwakadzika

Kurudziro yemaoko ine kushaya simba kunozivikanwa. Izwi rinoshanda kune imwe modhi, dhatabheti kana shanduro inogona kunyarara kushanda pane imwe, uye shanduko dzinowanzo kutongwa pamienzaniso mishoma. Otomatiki nekukurumidza optimization inotsiva icho loop nekutsvaga. Unopa zvinhu zvitatu: - Basa. - Seti yezvipo, zvine mutsindo nezvinotarisirwa zvinobuda. - Metric, senge mutambo chaiwo kana rubriki inopihwa neimwe modhi. Iyo optimizer inogadzira mafungidziro evamiriri, anoamhanyisa, anoaisa zvibodzwa uye anochengeta vakundi. Mienzaniso yepakutanga yakaita kuti pfungwa yacho ive yakasimba. APE (Automatic Prompt Engineer, Zhou et al., 2022) vaive nemuenzaniso waikurudzira mirairo yakawanda kubva mumienzaniso yekupinza-yekubuda, ndokuzochengeta iwo epamusoro-zvibodzwa. OPRO (Optimization by Prompting, Yang et al., Google DeepMind, 2023) yakashandisa LLM se optimizer. Yayo meta-yekukurumidza yakanyorwa mirairo yekutanga nezvibodzwa zvavo, uye modhi yakakurudzira mitsva. OPRO yakawana mirairo yakadai sekuti "femera zvakadzama uye shanda padambudziko iri nhanho-nhanho," iyo yakawana zvakanaka kune imwe modhi pagiredhi-chikoro math. Mazwi akakwenenzverwa anogona kuve asina kujeka uye akananga kune modhi. DSPy inoenderera mberi nekuchinja kuti zvirongwa zvinonyorwa sei. Yakagadzirwa kuStanford NLP naOmar Khattab nevabatsiri uye yakaunzwa muna 2023. Iwe unozivisa zvinoitwa nedanho rega rega nesaini, se "mubvunzo, mamiriro -> mhinduro," uye batanidza mamodule se Predict kana ChainOfThought. An optimizer (yakambodaidzwa kuti teleprompter), yakadai seBootstrapFewShot kana MIPROv2, uye "inounganidza" chirongwa nekusarudza zviratidzo uye mirairo yemodule yega yega kuti uwedzere metric yako. Mafungiro matatu asiri iwo akakodzera kugadziriswa: - Maturusi aya anobvisa kutonga kwevanhu. Ivo havadaro, nekuti metric uye mienzaniso inotsanangura "zvirinani." -Optimized zvirevo zvakachengeteka kuvimba. Vanogona kupfuudza diki dataset. - Optimization ndeyemahara. Inodhura chaiyo API mafoni, dzimwe nguva akawanda.

Kuitwa muNyika yeChokwadi

Chikwata chiri kuvaka tsigiro-tiketi classifier inonyora DSPy siginicha "tiketi -> chikamu" uye inopa mazana maviri akanyorwa matikiti uye metric yechokwadi. An optimizer anobva atora mashoma-mapfuti ekuratidzira anonakisa.

Kana kambani ikafamba kubva kune mumwe mupi weLLM ichienda kune mumwe, inodzokorodza DSPy optimizer yayo yemhando nyowani. Iyo hainyore neruoko-zvekukurudzira izvo zvakarongedzerwa kune yekare modhi.

Muongorori anomhanyisa OPRO-maitiro loop. Imwe modhi inokurudzira mazwi matsva ekuraira, mazwi ega ega anopihwa pabhenji yemasvomhu, uye iyo yakanyanya-zvibodzwa nhoroondo inodzokera muchikamu chinotevera chezvikumbiro.

Pombi yekudzoreredza-yakawedzerwa yemubvunzo-mhinduro inogadziridzwa kupera kusvika kumagumo, ine metric inoongorora mhinduro dzekupedzisira dzichipikisa mhinduro dzereferenzi. Zvese zviri zviviri nhanho yekunyora-mubvunzo uye nhanho yekupindura zvinovandudza pamwechete.

Ramangwana reOtomatiki Prompt Optimization uye DSPy

Kurumidza optimization iri kuita yakajairika chikamu cheLLM engineering, padivi pekuongorora masutu, pane kuda kuziva. Mibvunzo yakavhurika yasara. Mazano akakwenenzverwa anofambiswa sei pakati pemhando? Iwe unonyora sei mametrics ehunhu hunoenderana senge toni kana kubatsira? Iwe unodzivirira sei kuwandisa madiki dataset? Imwe tsvagiridzo inosanganisa kukurumidza optimization neyakajeka-tuning, uye DSPy inotsigira ese ari maviri. Mamodheru anochinja kazhinji, saka kugona kugadziridza otomatiki pakatarisana neyakagadzika bvunzo seti inogona kuve yakakosha kupfuura chero yakangwara yekumhanyisa. Kutsanangura mametrics akanaka uye mienzaniso inoramba iri basa revanhu.

Kuzvishandisa

Nei zvichikosha

  • Mutengo uye bhajeti. Zvisarudzo zvezvivakwa zvinotyaira kuita uye mutengo wekushandisa kwemakore.
  • Sarudzo dzakajeka. Dzidzo yehunyanzvi inobatsira zvikwata kusarudza murwi wakakodzera, kwete iwo mutsva chete.
  • Kudzora kwemhando yepamusoro. Sarudzo dzeinjiniya dziri nani dzinoderedza zviitiko zvekuvimbika mukugadzira.

Chenjera

  • Kugadzirisa imwe bhenji kunogona kuvanza yakafara system kushaya simba.
  • Infrastructure uye mari yekugadzirisa inowanzotarisirwa pasi.
  • Chengetedzo uye kucherechedzwa mapundu anogona kukura sezvo masisitimu anowedzera kuoma.

Matanho anotevera

  1. Tsanangura latency, mhando, uye mutengo zvinangwa usati waitwa.
  2. Benchmark pasi pechokwadi mutoro uye data mamiriro.
  3. Chishandiso chekutarisa zvikanganiso, kudonha, uye mushandisi maitiro.
  4. Gadzirira nzira dzekudzosera kumashure uye dzezviitiko usati wawedzera.

Ramba Uchiongorora

Tsamba yemahara

Tora iyo yemazuva ese AI pfupiso

Nhatu dzakasimbiswa dzeAI nyaya mangwanani ega ega pakati pevhiki, dzakanyorwa neChirungu chakajeka. Yemahara zvachose, hapana ads.

Imwe email zuva rega rega revhiki. Bvisa kunyoresa kamwe chete. Hatimbotengese kana kugovera kero yako.

Zviedze iwe pachako

Take the Automatic Prompt Optimization and DSPy quiz

Mhinduro yepakarepo pamhinduro yega yega, uye chitupa chinogovaniswa chine ID inobatika kana wapedza kosi.

Tanga mibvunzo

Tsigira dzidzo yemahara yeAI. AI Understanding ndeye 501(c)(3) isingabatsiri - hapana ads, hapana paywall, zvachose. Ita chipo

Mibvunzo inowanzo bvunzwa

Chii chinonzi Automatic Prompt Optimization uye DSPy?

Otomatiki nekukurumidza optimization inoshandisa algorithm kutsvaga zvirinani mirairo kana mashoma-epfuti mienzaniso. Inopa zvibodzwa zvemumiriri zvinopesana nemetric pane seti yemienzaniso pane kuvimba nemaoko-tweaked mazwi. Maitiro anozivikanwa anosanganisira APE, Google DeepMind's OPRO uye DSPy, yakavhurika-sosi chimiro kubva kuStanford. Pamwe chete vanoshandura huinjiniya nekukurumidza kubva pakufungidzira kuita inoyerwa, inodzokororwa maitiro.

Chii chaunofanira kupa kuitira otomatiki kukurumidza optimization kushanda?

Iyo optimizer inoda basa, mienzaniso uye metric saka inokwanisa kuhwina makwikwi emumiriri uye kuchengeta iwo akanakisa.

MuOPRO, chii chinotamba basa reiyo optimizer?

OPRO inoshandisa modhi yemutauro se optimizer. Inoona mirairo yapfuura nezvibodzwa zvavo uye inokurudzira mitsva.

Chii chinonzi OPRO "Tora mweya wakadzika uye shanda padambudziko iri nhanho-nhanho" mhedzisiro inoratidze?

Murairo wakaita zvakanaka kune imwe modhi pagiredhi-chikoro masvomhu. Mazwi anowanikwa nekutsvaga anogona kushamisa uye anogona kusaendeswa kune mamwe mamodheru.

Chii chinonzi DSPy siginecha?

Masiginicha anozivisa izvo module inofanirwa kuita maererano neinopinza uye inobuda minda. DSPy inobva yagadzirisa kukurumidza.

DSPy's BootstrapFewShot inowana sei zviratidzo zvayo?

Matekisheni akabudirira anove mashoma-emienzaniso, kusanganisira yematanho emukati ausina kumbozvinyora iwe pachako.