Maido da Wuta mai yawa
Matsakaicin Maidowa (DPR) yana samun rubutu mai dacewa ta hanyar kwatanta ma'anar tambaya da sassa a matsayin nau'i na lambobi, ba kalmomi masu dacewa ba.
Dubawa
It matters because it can retrieve correct answers even when the query and the document share zero vocabulary.
Zurfafa nutsewa
DPR, wanda Facebook AI ya gabatar a cikin 2020, yana amfani da rukunonin BERT guda biyu daban-daban: mai rikodin tambaya da madaidaicin hanya. Kowannensu yana juya rubutu zuwa tsayayyen tsayi mai tsayi (sau da yawa 768 girma). Dace samfurin ɗigo tsakanin sigar tambaya da vector na nassi, don haka maidowa ya zama binciken makwabci mafi kusa akan abubuwan da aka riga aka ƙididdige su. An horar da ƙirar tare da maƙasudi mai ban sha'awa: ja madaidaicin vector kusa da tambayar kuma ture waɗanda ba daidai ba, ta yin amfani da in-batch negatives da maƙarƙashiya da aka haƙa daga BM25. A kan buɗaɗɗen ma'auni na QA kamar Tambayoyin Halitta, DPR ta doke BM25 mai tsayi da yawa da manyan tazara, yana nuna cewa koyan ma'anar ma'anar ma'anar zai iya fin neman neman amsa tambayoyi.
Fahimtar Fasaha
DPR shine mai rikodi bi-biyu: yana ɓoye tambayar da kowane sashe da kansa, don haka ana lissafta duk hanyoyin nassi sau ɗaya kuma ana adana su a cikin fihirisar vector (misali, FAISS). A lokacin tambaya kawai kuna ɓoye tambayar, sannan ku gudanar da bincike kusan kusa. Horon ya dogara ne akan abubuwan da ke cikin batch - sauran sassa a cikin ƙaramin tsari iri ɗaya suna zama a matsayin misalan marasa kyau kusan kyauta, wanda ke ba da damar ingantattun guda biyu su samar da kwatancen kwatance da yawa yadda ya kamata.
Dabarun Tasiri
Gudu da sikelin
Gudun aikin harshe na iya tafiya da sauri ba tare da sadaukar da daidaito ba.
Shiga ku isa
Yana faɗaɗa damar shiga cikin harsuna da salon sadarwa.
Shawarwari masu haske
Ƙungiyoyi za su iya ciyar da ƙarin lokaci akan hukunci yayin da aiki da kai ke sarrafa maimaitawa.
Makomar Maidowa Mai Yawa
Maidowa mai yawa a yanzu yana arfafa mafi yawan bututun bututun da aka sake dawo dasu wanda ke ciyar da manyan nau'ikan harshe. Research is moving toward hybrid systems that fuse dense and lexical scores, late-interaction models like ColBERT that keep per-token vectors for finer matching, and instruction-tuned embeddings that adapt to many tasks. Yi tsammanin mai rahusa, yaruka da yawa, da madaidaitan bayanai masu tsayi, da ƙarin horon haɗin gwiwar masu dawo da janareta da suke yi.
Aiwatar da Gaskiyar Duniya
Tsarukan amsa tambayoyin yanki-bude-nade waɗanda ke jan goyan bayan sassan Wikipedia kafin LLM ya rubuta amsar
Binciken daftarin aiki na kasuwanci inda ma'aikata ke yin tambayoyi na halitta kuma suna samun sakin layi masu dacewa koda ba tare da takamaiman kalmomi ba
Bots goyon bayan abokin ciniki suna maido da ingantaccen labarin cibiyar taimako daga ƙarar da aka fayyace
Maidowa-ƙaramar chatbots suna ƙaddamar da martani a cikin tushen ilimi mai zaman kansa don rage hasashe
Hatsari & Tsare-tsare
Abubuwan da aka ruɗe suna iya shigar da rahotanni cikin nutsuwa, kwararar tallafi, ko abubuwan bincike.
Hankali na gaggawa na iya ƙirƙirar sakamako mara daidaituwa a cikin buƙatun iri ɗaya.
Za a iya fallasa bayanan rubutu mai ma'ana idan ikon samun dama yana da rauni.
Taswirar Hanya
Ƙayyade tsarin fitarwa, sautin, da ma'auni masu inganci kafin fitowa.
Amsa a ƙasa tare da amintattun tushe a duk lokacin da daidaito ya shafi mahimmanci.
Ajiye wurin binciken ɗan adam don abubuwan da ake samu masu girma.
Bibiyar tsarin gazawar kuma sake horar da tsokaci ko tafiyar aiki akai-akai.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Dense Passage Retrieval quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
ColBERT Late Ma'amala Maidowa
Tambayoyin da ake yawan yi
What is Dense Passage Retrieval?
Matsakaicin Maidowa (DPR) yana samun rubutu mai dacewa ta hanyar kwatanta ma'anar tambaya da sassa a matsayin nau'i na lambobi, ba kalmomi masu dacewa ba. Yana da mahimmanci saboda yana iya dawo da ingantattun amsoshi ko da lokacin da tambaya da daftarin aiki ba su da ƙamus.
Menene ainihin ra'ayin da ke bayan Mai da Wurin Wuta?
Taswirorin DPR duka biyun tambayoyi da saƙo zuwa cikin manyan ɓangarori masu yawa kuma suna auna dacewa ta kamanninsu (samfurin digo), suna ɗaukar ma'ana maimakon haɗuwa da kalma.
DPR tana amfani da gine-ginen 'bi-encoder'. Menene ma'anar hakan?
Mai rikodin rikodi guda biyu yana da masu rikodin masu zaman kansu don tambayoyi da sassa, don haka za'a iya ƙididdige ra'ayoyin ra'ayi da ƙididdigewa kafin lokaci.
Me yasa za'a iya ƙididdige ma'auni a gaba a DPR?
Tunda rufaffiyar hanyar ba ta dogara da tambayar ba, duk abubuwan da aka haɗa nassi za'a iya ƙididdige su da adana su, barin tambayar kawai don ɓoyewa a lokacin bincike.
Wane dabarar horarwa ce ke bawa DPR damar samar da misalan marasa kyau da yawa cikin arha?
In-batch negatives suna ɗaukar sauran sassan a cikin ƙaramin tsari azaman maras kyau ga tambayar da aka bayar, suna samar da nau'i-nau'i masu bambanta da yawa yadda ya kamata.
Wane kayan aiki ne aka saba amfani da shi don yin binciken makwabcin DPR da sauri a sikeli?
Ma'auni na vector kamar FAISS suna aiwatar da bincike na kusa-kusa da sauri sama da miliyoyin abubuwan da aka haɗa nassi.