Ubuyobozi bwa tekiniki

Icyitegererezo

A reranker nicyiciro cya kabiri cyicyitegererezo cyongeye gutanga urutonde rwibisubizo byubushakashatsi kugirango bifitanye isano nikibazo, bikarishye gutumiza nyuma yo kugarura byihuse gukurura abakandida.

2 min somaIbiherutse kuvugururwa

Incamake

It is a key ingredient in modern search and retrieval-augmented generation (RAG).

Kwibira cyane

Sisitemu na RAG sisitemu ikora mubyiciro bibiri. Ubwa mbere, kugarura byihuse (akenshi ni vector / gushiramo gushakisha cyangwa ijambo ryibanze BM25) bikurura wenda 50-100 ibyangombwa byabakandida kuva miriyoni - byashyizwe mubikorwa byo kwibuka no kwihuta. Ariko iyo pass ya mbere itanga amanota kubibazo hamwe ninyandiko zitandukanye, bityo irashobora kubura nuance. A reranker nintambwe isobanutse: ifata ikibazo na buri mukandida hamwe hanyuma igatanga amanota meza yingirakamaro, hanyuma igahindura urutonde kugirango ibisubizo byiza bizamuke hejuru. Ubwubatsi bwiganje ni cross-encoder: igaburira ikibazo hamwe ninyandiko hamwe hamwe na transformateur, ikareka buri kimenyetso cyabajijwe kuri buri kimenyetso cyerekana. Iyi mikoranire yimbitse ituma rerankers isobanuka neza kuruta gushyiramo ibisa, kubiciro byo kwiruka rimwe kumukandida.

Ubushishozi

Itandukaniro ni bi-encoder na cross-encoder. Bi-encoder ikubiyemo ikibazo ninyandiko yigenga mubice, bityo rero guhuza ni ibicuruzwa byadomo bihendutse - byihuse kandi byoroshye, ariko bidakabije. Kwambukiranya-kodegisi ihuza ikibazo hamwe ninyandiko muburyo bumwe hanyuma ikoresha pasiporo yuzuye, itanga amanota imwe yingirakamaro hamwe nikimenyetso cyerekana urwego rwitondewe. Ntishobora kubarwa, kubwibyo igenewe guhinduranya urutonde ruto. Abanyamideli nka Cohere Rerank na BGE-reranker batanga urugero.

Ingaruka z'Ingamba

Igiciro na bije

Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.

Ibyemezo bisobanutse

Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.

Kugenzura ubuziranenge

Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.

Kazoza ka Reranking Model

Rerankers igenda iba isanzwe mumiyoboro ya RAG kuko gahunda yatunganijwe neza itezimbere ubwiza bwibisubizo bya LLM kandi bigabanya salusiyo. Tegereza urumuri rwihuta, rwihuta-kodegisi, indimi nyinshi na multimodal rerankers (inyandiko wongeyeho amashusho cyangwa imbonerahamwe), hamwe na Windows ndende ndende kugirango inyandiko zose zishobore gutangwa. LLM ishingiye kuri 'listwise' rerankers isuzuma umukandida wose washyizweho icyarimwe iragenda yiyongera, kandi sisitemu zimwe na zimwe zitandukanya imanza zambukiranya kodegisi zisubizwa mu bihendutse kugira ngo zisobanuke neza hafi yicyiciro cya mbere.

Gushyira mu bikorwa Isi

Ikiganiro cya RAG kigarura uduce 50 ushizemo gushakisha, hanyuma ugahitamo kugaburira gusa ibice 5 byambere byingenzi mubice bya LLM

E-ubucuruzi bwo gushakisha ibisubizo byibicuruzwa kugirango ibintu bihuze neza numuguzi wuzuye wibibazo bigaragara mbere

Cohere Rerank cyangwa BGE-reranker izamura ubusobanuro bwinyandiko zumushinga gushakisha hejuru ya PDF ibihumbi

Abakiriya-bunganira ubumenyi shingiro reranking yagaruwe yingingo zifasha kugirango umukozi agaragaze igisubizo kimwe cyingirakamaro hejuru

Ingaruka & Kurinda

Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.

Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.

Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.

Igishushanyo mbonera

1

Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.

2

Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.

3

Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.

4

Tegura inzira yo gusubiza ibyabaye mbere yo gupima.

Komeza Ubushakashatsi

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the Reranking Models quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Tangira ikibazo

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Ubuyobozi bukurikira

A / B Ikizamini cya ML Model

Ibibazo bikunze kubazwa

What is Reranking Models?

A reranker nicyiciro cya kabiri cyicyitegererezo cyongeye gutanga urutonde rwibisubizo byubushakashatsi kugirango bifitanye isano nikibazo, bikarishye gutumiza nyuma yo kugarura byihuse gukurura abakandida. Nibintu byingenzi mubushakashatsi bugezweho no kugarura-kongera ibisekuru (RAG).

Mubisanzwe mubyiciro bibiri byo kugarura ibintu, akazi ka reranker niki?

Kugarura byihuse kuzana abakandida; reranker noneho yongera gutanga amanota kurutonde kugirango asunike ibisubizo byingenzi hejuru.

Ni ubuhe bwubatsi abantu benshi bakoresha?

Rerankers mubisanzwe ikoresha cross-encoders, kugaburira ikibazo hamwe ninyandiko hamwe kugirango ubwitonzi bushobora kwerekana imikoranire yabo.

Kuberiki bidashobora gukoreshwa kode ya kodegisi ikoreshwa mugushakisha amamiriyoni yinyandiko?

Bitandukanye no gushiramo ibintu, kwambukiranya-kodegisi igomba gukora transiporo yuzuye kuri buri jambo, bityo ikabikwa kurutonde ruto.

Ni izihe nyungu nyamukuru za bi-encoder hejuru ya cross-encoder?

Bi-kodegisi yashizemo inyandiko yigenga kandi mbere, ituma ubushakashatsi bwihuta busa mubyegeranyo binini.

Nigute rerankers ifasha kugabanya salusiyo muri sisitemu ya RAG?

Byateganijwe neza, ibyingenzi bifatika biha LLM ishingiro ryukuri, rigabanya ibisubizo byahimbwe.