Mutauro AI GUIDE

BM25 uye Lexical Retrieval

BM25 ndiyo yemhando yepamusoro-izwi-yakavakirwa chinzvimbo basa iro rinokwesha magwaro nekuti kakawanda sei mazwi emubvunzo anoonekwa, akagadziridzwa kushomeka kwenguva uye kureba kwegwaro.

Teerera kugwaro iriAI-yakarondedzerwa · ~2 min

Pa peji ino2 min verenga
  1. Pfupiso
  2. Kudzika Kwakadzika
  3. Kuitwa muNyika yeChokwadi
  4. Ramangwana reBM25 uye Lexical Retrieval
  5. Kuzvishandisa
  6. Ramba Uchiongorora
  7. Mibvunzo inowanzo bvunzwa

Pfupiso

Decades old, it remains a remarkably strong and ubiquitous baseline for search.

Kudzika Kwakadzika

BM25 (Best Matching 25) ibhegi-re-mazwi rekuisa basa kubva kune probabilistic Okapi chimiro chemakore ekuma1990. Patemu yega yega yemubvunzo inosanganisa masaini matatu: frequency yenguva (kangani izwi rinowanikwa mugwaro, ine kudzoka kuri kudzikira kunodzorwa neparameter k1), inverse gwaro frequency (mazwi asingawanzo kuunganidzwa anoverengerwa zvakanyanya), uye gwaro-kureba normalization (parameter b, magwaro marefu haana kufarirwa zvisina kunaka). Pfupisa izvi pa-temu zvibodzwa uye iwe unowana chinzvimbo chegwaro. Izvo hazvidi kudzidziswa uye inomhanya zvakanyanya nekukurumidza kuburikidza inverted indexes, ndosaka injini dzekutsvaga seElasticsearch neLucene dzichishandisa nekukasira. Zvisinei nekukwira kwekutsvagisa neural, BM25 ichiri kuhwina kana hukama pamabhenji akawanda, kunyanya kune zvisingawanzo mazwi, zviziviso chaizvo, uye mibvunzo yekunze-kwe-domain.

Kuitwa muNyika yeChokwadi

Default inoenderana chinzvimbo muElasticsearch, OpenSearch, uye Apache Lucene/Solr.

Yekutanga-danho rekutsvagisa mumiriri inodyisa anononoka neural reranker mukutsvaga kwematanho maviri

Kodhi uye kutsvaga kwelogi uko zviziviso nemakodhi ezvikanganiso zvinofanirwa kuenderana chaizvo

Migodhi yakaoma isina kunaka mienzaniso kudzidzisa dzakaomarara dzinotora seDPR

Ramangwana reBM25 uye Lexical Retrieval

BM25 haigone kunyangarika; pachinzvimbo chiri kuwedzera kupetwa neneural nzira mukudzoreredza yakasanganiswa, uko zvibodzwa zvelexical uye dense zvinosanganiswa (kazhinji kuburikidza nereciprocal rank fusion). Akadzidza sparse modhi senge SPLADE inosanganisa BM25-chimiro sparsity ine neural term uremu, uye BM25 inowanzo shanda seyekutanga-nhanho kudzoreredza pamberi peneural renkers. Kumhanya kwayo, kududzira, uye zero mutengo wekudzidzira unovimbisa basa risingaperi mukutsvaga kwekugadzira.

Kuzvishandisa

Nei zvichikosha

  • Kumhanya uye chiyero. Mutauro workflows inogona kufamba nekukurumidza pasina kupira kuenderana.
  • Svika uye svika. Inopamhidzira kupinda mumitauro yese nemataera ekutaurirana.
  • Sarudzo dzakajeka. Zvikwata zvinogona kupedza nguva yakawanda pakutonga uku otomatiki ichibata kudzokorora.

Chenjera

  • Chokwadi chehuroyi chinogona kupinda chinyararire mishumo, kuyerera kwetsigiro, kana tsvakiridzo.
  • Kunzwa nekukasira kunogona kugadzira mhedzisiro isingaenderane pane zvikumbiro zvakafanana.
  • Sensitive text data inogona kuburitswa kana zvidhiraivho zvisina kusimba.

Matanho anotevera

  1. Tsanangura chimiro chekubuda, toni, uye mhando zviyero usati waburitsa.
  2. Mhinduro dzepasi neakavimbika masosi pese pazvine basa.
  3. Chengetedza ongororo yekuongorora yemunhu kune yakakwira-stake zvinobuda.
  4. Tevera maitiro ekutadza uye dzidzisazve kukurudzira kana mafambiro ebasa nguva nenguva.

Ramba Uchiongorora

Tsamba yemahara

Tora iyo yemazuva ese AI pfupiso

Nhatu dzakasimbiswa dzeAI nyaya mangwanani ega ega pakati pevhiki, dzakanyorwa neChirungu chakajeka. Yemahara zvachose, hapana ads.

Imwe email zuva rega rega revhiki. Bvisa kunyoresa kamwe chete. Hatimbotengese kana kugovera kero yako.

Zviedze iwe pachako

Take the BM25 and Lexical Retrieval quiz

Mhinduro yepakarepo pamhinduro yega yega, uye chitupa chinogovaniswa chine ID inobatika kana wapedza kosi.

Tanga mibvunzo

Tsigira dzidzo yemahara yeAI. AI Understanding ndeye 501(c)(3) isingabatsiri - hapana ads, hapana paywall, zvachose. Ita chipo

Mibvunzo inowanzo bvunzwa

What is BM25 and Lexical Retrieval?

BM25 ndiyo yemhando yepamusoro-izwi-yakavakirwa chinzvimbo basa iro rinokwesha magwaro nekuti kakawanda sei mazwi emubvunzo anoonekwa, akagadziridzwa kushomeka kwenguva uye kureba kwegwaro. Makumi emakore ekare, inoramba iri nheyo yakasimba uye inowanikwa kwose kwose yekutsvaga.

BM25 inonyanya kushandisa chii kuisa magwaro?

BM25 inosanganisa temu frequency, inverse gwaro frequency (temu rarity), uye gwaro-kureba normalization kuita chiyero chakakosha.

Ndeipi basa rinoitwa inverse gwaro frequency (IDF) muBM25?

IDF inopa mibairo mazwi asingawanzo kuunganidzwa uye pasi-huremu mazwi akajairika, sezvo machisi asingawanzo anonyanya kudzidzisa.

Sei BM25 ichishandisa gwaro-kureba normalization (iyo b parameter)?

Pasina normalization, magwaro akareba aizounganidza mamwe matemu emitambo; iyo b parameter inogadzirisa kureba kuitira kuti kuenzanisa kuve kwakanaka.

Ndechipi chimiro che data chinoita kuti BM25 ikurumidze pachiyero?

Indekisi yakatenderedzwa inoita kuti BM25 iwane chete zvinyorwa zvine mazwi emubvunzo, zvichiita kuti kudzosa kuve nemazvo.

In the standard BM25 formula, what effect does setting b to zero have?

b controls the strength of length normalization; zero removes that adjustment while other scoring components remain.