Soo Celinta Marinka Cufan
Dib-u-soo-celinta Dense Passage Retrieval (DPR) waxay heshaa qoraal laxiriira iyadoo la barbardhigayo macnaha su'aasha iyo tuducyada sida tirooyin tirooyin ah, ee aan ahayn ereyo isku mid ah.
Dulmar
It matters because it can retrieve correct answers even when the query and the document share zero vocabulary.
quusid qoto dheer
DPR, oo ay soo bandhigtay Facebook AI sanadka 2020, waxay isticmaashaa laba cod-bixiyeyaal BERT ah oo kala duwan: su'aal codeeyaha iyo codeeyaha marinka. Mid kastaa wuxuu qoraalka u rogaa vector cufan oo dhererkiisu go'an yahay (badanaa 768 cabbir). Muhiimaddu waa sheyga dhibicda u dhaxaysa su'aasha su'aasha iyo marinka marinka, markaa dib u soo celintu waxay noqotaa raadinta deris-degdegga ah ee ugu dhow ee ku dhejinta marinka la sii xisaabiyay. Qaabka waxa lagu tababaray ujeedo ka duwan: U soo jiid marinka saxda ah vectorkiisa u dhaw su'aasha oo ka fogee kuwa khaldan, adigoo isticmaalaya dufcaddii taban iyo waxyaabo adag oo laga soo minguuriyay BM25. Marka la eego bartilmaameedyada furan ee QA-ga sida Su'aalaha Dabiiciga ah, DPR waxay ku garaacday BM25-ka dheer ee loo yaqaan 'margins', taasoo muujineysa in isbarbardhigga semantic-ka la bartay uu ka sarreyn karo raadinta ereyga muhiimka ah ee ka jawaabista su'aalaha.
Aragtida Farsamada
DPR waa bi-encoder: waxay u dejisaa su'aasha iyo tuduc kasta si madax-bannaan, markaa dhammaan marinnada marinnada ayaa la xisaabiyaa hal mar waxaana lagu kaydiyaa tusmada vector (tusaale, FAISS). Wakhtiga waydiinta waxa aad gelisaa su'aasha oo kaliya, ka bacdina wad raadinta deriska kuugu dhow. Tababarku wuxuu ku tiirsan yahay dufcaddii taban - tuducyada kale ee isla dufcaddii-yar-yar waxay u adeegaan tusaaleyaal taban oo bilaash ah, taas oo u oggolaanaysa hal lammaane oo togan inay si hufan u dhaliyaan isbarbardhigga isbarbardhigga.
Saamaynta Istiraatijiyadeed
Xawaaraha iyo miisaanka
Socodka shaqada luqaddu si dhakhso leh ayay u socon kartaa iyada oo aan la hurayn joogteynta.
Helitaanka iyo gaarsiinta
Waxay balaadhisaa gelitaanka luqadaha iyo qaababka isgaarsiinta.
Go'aamo cad
Kooxuhu waxay waqti badan ku qaadan karaan xukunka halka otomaatiggu uu qabanayo ku celcelinta.
Mustaqbalka Soo Celinta marinka cufan
Soo-celinta cufan hadda waxay taageertaa inta badan tubooyinka jiilka dib-u-soo-celinta lagu kordhiyo quudinta moodooyinka luqadaha waaweyn. Cilmi-baaristu waxay u socotaa hababka isku-dhafan ee isku dhafan dhibcaha cufan iyo kuwa qaamuuska ah, moodooyinka is-dhexgalka soo daahay sida ColBERT ee ilaalinaya calaamado kasta si ay isku mid noqdaan, iyo wax-ku-dhigid-habboon oo wax-ku-dhigis ah oo la qabsanaya hawlo badan. Filo cod-bixiyeyaal ka jaban, luqado badan, iyo kuwa dheer, oo ay weheliso isku-dubarid adag oo dib-u-soo-dejinaya koronto-dhaliyeyaasha ay u adeegaan.
Dhaqangelinta Adduunka-dhabta ah
Nidaamyada ka jawaabista su'aalaha domain-furan ee jiidaya taageerada tuducyada Wikipedia ka hor inta uusan LLM qorin jawaabta
Dukumeenti ganacsi raadinta halkaas oo shaqaaluhu ku weydiiyaan su'aalo dabiici ah oo ay helaan cutubyo khuseeya xitaa iyada oo aan lahayn ereyo muhiim ah
Bots-taageerada macaamiisha ka soo ceshanaya maqaalka xarunta-caawinta saxda ah cabasho la soo koobay
Dib-u-soo-celinta-lagu daray chatbots-ka jawaabaha salka ku haya aqoonta gaarka ah si loo yareeyo dhalanteedka
Khatarta & Dariiqyada Ilaalada
Xaqiiqooyinka dhalanteed waxay si deggan u geli karaan warbixinnada, taageerada socodka, ama natiijooyinka cilmi-baarista.
Dareenka degdega ahi wuxuu abuuri karaa natiijooyin aan iswaafaqayn codsiyada la midka ah.
Xogta qoraalka xasaasiga ah ayaa laga yaabaa in la kashifo haddii kontaroolada gelitaanka ay daciif yihiin.
Qorshe Hawleedka Dhaqangelinta
Qeex qaabka wax soo saarka, codka, iyo heerarka tayada ka hor inta aan la baahin.
Jawaabaha salka ku haya ilo lagu kalsoon yahay mar kasta oo saxnidu ay muhiim tahay.
Hayso isbaarada dib u eegista bini aadamka ee wax soo saarka sare.
Lasoco qaababka guuldarada oo dib u leyli dardargelinta ama socodka shaqada si joogto ah.
Sii wad Sahaminta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Dense Passage Retrieval quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Hagaha xiga
Soo Celinta Is-dhexgalka dambe ee ColBERT
Su'aalaha soo noqnoqda
What is Dense Passage Retrieval?
Dib-u-soo-celinta Dense Passage Retrieval (DPR) waxay heshaa qoraal laxiriira iyadoo la barbardhigayo macnaha su'aasha iyo tuducyada sida tirooyin tirooyin ah, ee aan ahayn ereyo isku mid ah. Waa muhiim sababtoo ah waxay soo celin kartaa jawaabaha saxda ah xitaa marka weydiinta iyo dukumeentiga ay wadaagaan erayo eber ah.
Waa maxay fikradda udub-dhexaadka ah ee ka danbeysa soo celinta marinka cufan?
Khariidadaha DPR ee su'aalaha iyo tuducyada labadaba waxay u geliyaan vectors cufan waxayna cabbiraan ku habboonaanta isku mid ahaanshahooda (wax soo saarka dhibcaha), iyagoo macne qaadanaya halkii ay ka ahaan lahaayeen isku-duubni kelmad.
DPR waxay isticmaashaa qaab dhismeedka 'bi-encoder' Taas macnaheedu waa maxay?
Labada-encoder-ku wuxuu leeyahay cod-bixiyeyaal madax-bannaan oo su'aalo iyo tuducyo ah, sidaa darteed faleebada marinnada waa la sii xisaabin karaa oo la tilmaami karaa wakhti ka hor.
Waa maxay sababta xididdada marinnada hore loogu xisaabin karo DPR?
Mar haddii cod-bixiyaha marinku aanu ku xidhnayn weydiinta, dhammaan tuducyada ku lifaaqan waa la xisaabin karaa oo la kaydin karaa, iyada oo loo daayo oo keliya su'aasha si loo codeeyo wakhtiga raadinta.
Waa maxay xeelad tababar oo u ogolaanaya DPR inay soo saarto tusaalooyin badan oo taban oo raqiis ah?
Dufcaddii-ku-jirta waxay ula dhaqmaan tuducyada kale ee dufcad-yar-yar sidii taban su'aal la bixiyay, iyagoo si hufan u soo saaraya lammaane badan oo isbarbar dhigaya.
Qalab noocee ah ayaa inta badan loo isticmaalaa in si degdeg ah loo baadho DPR deriskiisa dhow?
Tilmaanta tusmooyinka sida FAISS waxay si degdeg ah u raadiyaan qiyaasaha deriska- dhow ee malaayiinta marinnada la sii xisaabiyay.