InoteveraGaidhi rinotevera
ColBERT Kunonoka Kudyidzana Kudzoreredza
Mutauro AI
Mutauro AI GUIDE
BM25 ndiyo yemhando yepamusoro-izwi-yakavakirwa chinzvimbo basa iro rinokwesha magwaro nekuti kakawanda sei mazwi emubvunzo anoonekwa, akagadziridzwa kushomeka kwenguva uye kureba kwegwaro.
Teerera kugwaro iriAI-yakarondedzerwa · ~2 min
Decades old, it remains a remarkably strong and ubiquitous baseline for search.
BM25 (Best Matching 25) ibhegi-re-mazwi rekuisa basa kubva kune probabilistic Okapi chimiro chemakore ekuma1990. Patemu yega yega yemubvunzo inosanganisa masaini matatu: frequency yenguva (kangani izwi rinowanikwa mugwaro, ine kudzoka kuri kudzikira kunodzorwa neparameter k1), inverse gwaro frequency (mazwi asingawanzo kuunganidzwa anoverengerwa zvakanyanya), uye gwaro-kureba normalization (parameter b, magwaro marefu haana kufarirwa zvisina kunaka). Pfupisa izvi pa-temu zvibodzwa uye iwe unowana chinzvimbo chegwaro. Izvo hazvidi kudzidziswa uye inomhanya zvakanyanya nekukurumidza kuburikidza inverted indexes, ndosaka injini dzekutsvaga seElasticsearch neLucene dzichishandisa nekukasira. Zvisinei nekukwira kwekutsvagisa neural, BM25 ichiri kuhwina kana hukama pamabhenji akawanda, kunyanya kune zvisingawanzo mazwi, zviziviso chaizvo, uye mibvunzo yekunze-kwe-domain.
Default inoenderana chinzvimbo muElasticsearch, OpenSearch, uye Apache Lucene/Solr.
Yekutanga-danho rekutsvagisa mumiriri inodyisa anononoka neural reranker mukutsvaga kwematanho maviri
Kodhi uye kutsvaga kwelogi uko zviziviso nemakodhi ezvikanganiso zvinofanirwa kuenderana chaizvo
Migodhi yakaoma isina kunaka mienzaniso kudzidzisa dzakaomarara dzinotora seDPR
BM25 haigone kunyangarika; pachinzvimbo chiri kuwedzera kupetwa neneural nzira mukudzoreredza yakasanganiswa, uko zvibodzwa zvelexical uye dense zvinosanganiswa (kazhinji kuburikidza nereciprocal rank fusion). Akadzidza sparse modhi senge SPLADE inosanganisa BM25-chimiro sparsity ine neural term uremu, uye BM25 inowanzo shanda seyekutanga-nhanho kudzoreredza pamberi peneural renkers. Kumhanya kwayo, kududzira, uye zero mutengo wekudzidzira unovimbisa basa risingaperi mukutsvaga kwekugadzira.
Tsamba yemahara
Nhatu dzakasimbiswa dzeAI nyaya mangwanani ega ega pakati pevhiki, dzakanyorwa neChirungu chakajeka. Yemahara zvachose, hapana ads.
Imwe email zuva rega rega revhiki. Bvisa kunyoresa kamwe chete. Hatimbotengese kana kugovera kero yako.
Zviedze iwe pachako
Mhinduro yepakarepo pamhinduro yega yega, uye chitupa chinogovaniswa chine ID inobatika kana wapedza kosi.
Tsigira dzidzo yemahara yeAI. AI Understanding ndeye 501(c)(3) isingabatsiri - hapana ads, hapana paywall, zvachose. Ita chipo
BM25 ndiyo yemhando yepamusoro-izwi-yakavakirwa chinzvimbo basa iro rinokwesha magwaro nekuti kakawanda sei mazwi emubvunzo anoonekwa, akagadziridzwa kushomeka kwenguva uye kureba kwegwaro. Makumi emakore ekare, inoramba iri nheyo yakasimba uye inowanikwa kwose kwose yekutsvaga.
BM25 inosanganisa temu frequency, inverse gwaro frequency (temu rarity), uye gwaro-kureba normalization kuita chiyero chakakosha.
IDF inopa mibairo mazwi asingawanzo kuunganidzwa uye pasi-huremu mazwi akajairika, sezvo machisi asingawanzo anonyanya kudzidzisa.
Pasina normalization, magwaro akareba aizounganidza mamwe matemu emitambo; iyo b parameter inogadzirisa kureba kuitira kuti kuenzanisa kuve kwakanaka.
Indekisi yakatenderedzwa inoita kuti BM25 iwane chete zvinyorwa zvine mazwi emubvunzo, zvichiita kuti kudzosa kuve nemazvo.
b controls the strength of length normalization; zero removes that adjustment while other scoring components remain.
Ramba uchidzidza
Mamwe madhairekitori akasarudzirwa nyaya iyi
InoteveraGaidhi rinotevera
ColBERT Kunonoka Kudyidzana Kudzoreredza
Mutauro AI