Nhungamiro yehunyanzvi

Kunyorazve Mubvunzo uye Multi-Query Retrieval

Kunyorazve mubvunzo uye kudzoreredza kwemibvunzo yakawanda inyanzvi dzeRAG dzinoshandura mubvunzo wemushandisi usati watsvaga, nekuudzokorora, kuutyora kuita mibvunzo midiki, kana kugadzira akati wandei nekubatanidza zvabuda.

Teerera kugwaro iriAI-yakarondedzerwa · ~3 min

Pa peji ino3 min verenga
  1. Pfupiso
  2. Kudzika Kwakadzika
  3. Kuitwa muNyika yeChokwadi
  4. Ramangwana reKunyora Patsva uye Multi-Query Retrieval
  5. Kuzvishandisa
  6. Ramba Uchiongorora
  7. Mibvunzo inowanzo bvunzwa

Pfupiso

Izvo zvine basa nekuti vashandisi vanowanzo bvunza isina kujeka, yekukurukurirana kana yakawanda-chikamu mibvunzo ine mazwi asingaenderane nemagwaro, uye mubvunzo uri nani unogona kutaura ndima dzakakodzera kutsvaga kumwechete chaiko kungapotsa.

Kudzika Kwakadzika

Hunhu hwekutsvagisa hunoenderana zvakanyanya nemubvunzo. Vashandisi vanonyora mibvunzo mipfupi, isinganzwisisike kana yekukurukurirana, nepo zvinyorwa zvichishandisa iwo ega mazwi. Sanduro yemubvunzo inovhara gap iyo yekutsvaga isati yaitika. Iyo yakapusa fomu ndeyekunyorazve: LLM inoshandura meseji yemushandisi kuita mubvunzo wakajeka wekutsvaga. Izvi zvakakosha mu-multi-turn chat, uko kunotevera se "uye muna 2023?" hazvireve chinhu pasina nhoroondo, saka sisitimu inodzoreredza nhaurirano kuita mubvunzo wakazvimirira. Kuparara kunopatsanura mubvunzo wakaoma kuita mibvunzo midiki inogona kutorwa yakaparadzana, inobatsira pakuenzanisa kana mibvunzo yakawanda-hop. Nhanho-shure yekukurudzira, yakatsanangurwa neGoogle DeepMind vaongorori muna 2023, inobvunza mubvunzo wakawanda kutanga kutora kumashure misimboti. Multi-query kudzoreredza inoburitsa akati wandei emubvunzo, inomhanyisa tsvakiridzo yega yega, uye inobatanidza mhinduro. LangChain yakasimudzira izvi neMultiQueryRetriever yayo. RAG-Fusion inosanganisa mibvunzo yakawanda ine reciprocal rank fusion (RRF), nzira yakatsanangurwa naCormack, Clarke naBuettcher muna 2009, iyo inokora gwaro rega rega nekupfupisa 1/(k + chinzvimbo) pane zvese zvawanikwa. Mapepa anoonekwa epamusoro mumazita akati wandei anokwira kumusoro asingade zvibodzwa zvinofananidzwa. Imwe nzira yakabatana, HyDE (Hypothetical Document Embeddings, Gao uye vaanoshanda navo, 2022), ine modhi inonyora mhinduro yekufungidzira uye inomisikidza iyo panzvimbo yemubvunzo, nekuti chinyorwa chakaita semhinduro chinowanzogara padyo nendima dzemhinduro chaidzo munzvimbo yekumisikidza. Mafungiro asiri iwo: mizhinji mibvunzo haisi nani nguva dzose. Musiyano wega wega unowedzera latency uye mutengo, uye akasiyana akagadzirwa zvisina kunaka anogona kukukurwa kubva muchinangwa chemushandisi, achidhonza magwaro asina basa. Kunyora zvakare kunogona kudonhedza zvipingaidzo zvakakosha semazuva kana mazita echigadzirwa. Yera kurangarira uye pindura mhando pamibvunzo chaiyo usati watora matanho aya.

Kuitwa muNyika yeChokwadi

Mumubatsiri wekutaura, iyo yekutevera "ko nezvevashandi venguva pfupi?" inonyorwazve kumubvunzo wakamira wakadai se "gwaro rezororo revabereki revashandi venguva pfupi" vachishandisa hurukuro yekutanga.

Mubvunzo wekuenzanisa mitengo yevapi vemakore maviri unoiswa mukutsvaga kwakasiyana kwemupi wega wega, uye mibairo inosanganiswa isati yapindurwa.

Bot yekutsigira inogadzira zvirevo zvina zve "app yangu inoramba ichindiburitsa", kusanganisira tekinoroji mazwi sekupera kweseshini uye tokeni yekuzorodza, uye inosanganisa mhedzisiro nekudzoreredza chinzvimbo fusion.

Mubatsiri wekutsvagisa anoshandisa nhanho yekudzokera kumashure kutanga kutsvaga iyo general musimboti kuseri kwemubvunzo wakamanikana, obva atora zvakati wandei, achipa iyo modhi zvese kumashure uye zvakati.

Ramangwana reKunyora Patsva uye Multi-Query Retrieval

Sezvo agentic RAG ichipararira, shanduko yemubvunzo iri kuwedzera kubatwa nemuenzaniso uchisarudza chekutsvaga, ichidzokorodza kana mhinduro dzichiita sedzisina kusimba, kwete nedanho rekunyora patsva. Izvo zvinoita kuti iwo epasi mazano, kuora, mutsauko uye fusion, zvinyanye kukosha kunyangwe zvazvinoita zvishoma. Kunatsurudzwa mumamodheru ekumisikidza uye kutsvaga kwakasanganiswa kunoderedza kusawirirana kwemazwi asi hazvibvise kukosha kwekujekesa mibvunzo isina kujeka kana yekutaura. Tarisira kuti zvikwata zvishandise nzira idzi zvakasarudzwa, zvichikonzerwa kana mubvunzo uchiita sewakaoma kana kuti kutora kwekutanga kunenge kusina kusimba, kuenzanisa kunaka nemutengo.

Kuzvishandisa

Nei zvichikosha

  • Mutengo uye bhajeti. Zvisarudzo zvezvivakwa zvinotyaira kuita uye mutengo wekushandisa kwemakore.
  • Sarudzo dzakajeka. Dzidzo yehunyanzvi inobatsira zvikwata kusarudza murwi wakakodzera, kwete iwo mutsva chete.
  • Kudzora kwemhando yepamusoro. Sarudzo dzeinjiniya dziri nani dzinoderedza zviitiko zvekuvimbika mukugadzira.

Chenjera

  • Kugadzirisa imwe bhenji kunogona kuvanza yakafara system kushaya simba.
  • Infrastructure uye mari yekugadzirisa inowanzotarisirwa pasi.
  • Chengetedzo uye kucherechedzwa mapundu anogona kukura sezvo masisitimu anowedzera kuoma.

Matanho anotevera

  1. Tsanangura latency, mhando, uye mutengo zvinangwa usati waitwa.
  2. Benchmark pasi pechokwadi mutoro uye data mamiriro.
  3. Chishandiso chekutarisa zvikanganiso, kudonha, uye mushandisi maitiro.
  4. Gadzirira nzira dzekudzosera kumashure uye dzezviitiko usati wawedzera.

Ramba Uchiongorora

Tsamba yemahara

Tora iyo yemazuva ese AI pfupiso

Nhatu dzakasimbiswa dzeAI nyaya mangwanani ega ega pakati pevhiki, dzakanyorwa neChirungu chakajeka. Yemahara zvachose, hapana ads.

Imwe email zuva rega rega revhiki. Bvisa kunyoresa kamwe chete. Hatimbotengese kana kugovera kero yako.

Zviedze iwe pachako

Take the Query Rewriting and Multi-Query Retrieval quiz

Mhinduro yepakarepo pamhinduro yega yega, uye chitupa chinogovaniswa chine ID inobatika kana wapedza kosi.

Tanga mibvunzo

Tsigira dzidzo yemahara yeAI. AI Understanding ndeye 501(c)(3) isingabatsiri - hapana ads, hapana paywall, zvachose. Ita chipo

Mibvunzo inowanzo bvunzwa

Chii chinonzi Query Rewriting uye Multi-Query Retrieval?

Kunyorazve mubvunzo uye kudzoreredza kwemibvunzo yakawanda inyanzvi dzeRAG dzinoshandura mubvunzo wemushandisi usati watsvaga, nekuudzokorora, kuutyora kuita mibvunzo midiki, kana kugadzira akati wandei nekubatanidza zvabuda. Izvo zvine basa nekuti vashandisi vanowanzo bvunza isina kujeka, yekukurukurirana kana yakawanda-chikamu mibvunzo ine mazwi asingaenderane nemagwaro, uye mubvunzo uri nani unogona kutaura ndima dzakakodzera kutsvaga kumwechete chaiko kungapotsa.

Sei kunyorazve mubvunzo kuchinyanya kukosha mu-multi-turn chat?

Kutevera senge "uye muna 2023?" inoda nhoroondo yenhaurirano kuti ive mubvunzo unobatsira wega.

Ndeipi nzira inopatsanura mubvunzo wekuenzanisa kuita kutsvaga kwakasiyana kwechinhu chimwe nechimwe chiri kuenzaniswa?

Decomposition inotyora mibvunzo yakaoma kana yakawanda-chikamu kuita mibvunzo midiki inodzoserwa zvakasiyana.

Chii chinonzi step-back kukurudzira?

Nhanho-shure yekukurudzira, kubva kuGoogle DeepMind vaongorori, inotora zvakajairika kumashure zvisati zvatsanangurwa.

Mukuwiriranisa chinzvimbo, zvibodzwa zvegwaro zvinoverengwa sei?

RRF inoverengera 1/(k + chinzvimbo) pamusoro pechinyorwa chega chega chine gwaro, magwaro emubairo akaiswa kumusoro mune akati wandei.

Nei RRF yakanakira kubatanidza vector yekutsvaga uye BM25 mhinduro?

Nekuti RRF inoshandisa zvinzvimbo chete, inogona kusanganisa zvinyorwa zvine zvibodzwa zvisina kuenzaniswa.