Ururimi AI

BM25 hamwe no gusubiramo amagambo

BM25 nijambo ryibanze ryibanze rishingiye kumurongo urutonde rutanga inyandiko nukuntu inshuro zibazwa zigaragara, zahinduwe kubijyanye nigihe gike nuburebure bwinyandiko.

Umva iki gitaboAI-byavuzwe · ~2 min

Kuriyi page2 min soma
  1. Incamake
  2. Kwibira cyane
  3. Gushyira mu bikorwa Isi
  4. Kazoza ka BM25 no Kugarura Amagambo
  5. Kubishyira mubikorwa
  6. Komeza Ubushakashatsi
  7. Ibibazo bikunze kubazwa

Incamake

Decades old, it remains a remarkably strong and ubiquitous baseline for search.

Kwibira cyane

BM25 (Guhuza Byiza 25) nigikapu-yamagambo yo gutondekanya ibikorwa uhereye kuri Okapi ya probabilistic yo mu myaka ya za 90. Kuri buri jambo ryibibazo rihuza ibimenyetso bitatu: inshuro zijambo (inshuro ijambo rigaragara mumyandiko, hamwe no kugabanuka kugaruka kugenzurwa na parameter k1), inshuro zinyuranye zinyandiko (amagambo adakunze kuboneka mubyegeranyo bibarwa cyane), hamwe nuburebure bwinyandiko zisanzwe (parameter b, inyandiko ndende ntabwo zishimirwa). Sum aya manota yigihembwe hanyuma ubone urwego rwinyandiko. Ntabwo ikeneye imyitozo kandi ikora byihuse ikoresheje indangagaciro zahinduwe, niyo mpamvu moteri zishakisha nka Elasticsearch na Lucene zikoresha muburyo budasanzwe. Nubwo kwiyongera kwimitekerereze, BM25 iracyatsinda cyangwa ihuza ibipimo byinshi, cyane cyane kumagambo adasanzwe, ibimuranga neza, hamwe nibibazo bitari hanze.

Gushyira mu bikorwa Isi

Urutonde rusanzwe rufite akamaro muri Elasticsearch, Gushakisha, na Apache Lucene / Solr

Icyiciro cya mbere cyabakandida kugarura kugaburira buhoro buhoro imitekerereze ya shakisha ibyiciro bibiri

Shakisha kode hamwe nogushakisha aho ibiranga neza na kode yamakosa bigomba guhura neza

Gucukura ingero zikomeye zo guhugura ibyinshi nka DPR

Kazoza ka BM25 no Kugarura Amagambo

BM25 ntabwo bishoboka ko yazimira; ahubgo biragenda bihuzwa nuburyo bwimitsi muburyo bwo kugarura imvange, aho amanota yamagambo kandi yuzuye ahujwe (akenshi binyuze murwego rwo gusubiranamo). Kwiga gake gake nka SPLADE ivanga imiterere ya BM25 hamwe nuburemere bwimyumvire, kandi BM25 ikora nk'icyiciro cya mbere cyo kugarura mbere yimitsi. Umuvuduko wacyo, gusobanurwa, hamwe namahugurwa ya zeru byemeza uruhare rurambye mugushakisha umusaruro.

Kubishyira mubikorwa

Impamvu ari ngombwa

  • Umuvuduko n'igipimo. Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.
  • Kugera no kugera. Yagura uburyo bwindimi nuburyo bwo gutumanaho.
  • Ibyemezo bisobanutse. Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.

Witondere

  • Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.
  • Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.
  • Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.

Intambwe ikurikira

  1. Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.
  2. Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.
  3. Komeza kugenzura abantu kugenzura ibisubizo byinshi.
  4. Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.

Komeza Ubushakashatsi

Ibaruwa y'amakuru y'ubuntu

Ibuka amakuru ya buri munsi ya AI

Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.

Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.

Isuzume

Take the BM25 and Lexical Retrieval quiz

Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.

Tangira ikibazo

Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano

Ibibazo bikunze kubazwa

What is BM25 and Lexical Retrieval?

BM25 nijambo ryibanze ryibanze rishingiye kumurongo urutonde rutanga inyandiko nukuntu inshuro zibazwa zigaragara, zahinduwe kubijyanye nigihe gike nuburebure bwinyandiko. Imyaka mirongo irashize, iracyakomeye bidasanzwe kandi igaragara hose gushakisha.

Niki BM25 ikoresha cyane cyane kurutonde rwinyandiko?

BM25 ikomatanya ijambo inshuro, inverse yinyandiko inshuro (ijambo gake), hamwe nuburebure bwinyandiko mubisanzwe mumanota yingirakamaro.

Ni uruhe ruhare inyandiko zinyuranye (IDF) zigira muri BM25?

IDF ihemba amagambo adakunze gukusanywa hamwe no kumanura-uburemere bw'amagambo asanzwe, kubera ko imikino idasanzwe iratanga amakuru.

Kuki BM25 ikoresha inyandiko-ndende isanzwe (b parameter)?

Hatariho ibisanzwe, inyandiko ndende zegeranya ibihe byinshi bihuye; b ibipimo bihindura uburebure kuburyo kugereranya birakwiye.

Ni ubuhe buryo bw'amakuru butuma BM25 yihuta ku gipimo?

Indangantego ihindagurika ireka BM25 itanga amanota gusa ibyangombwa bikubiyemo amagambo yibibazo, bigatuma kugarura neza.

In the standard BM25 formula, what effect does setting b to zero have?

b controls the strength of length normalization; zero removes that adjustment while other scoring components remain.