Umusaraba-Encoders vs Bi-Encoders
Inzira ebyiri zerekana imiterere igereranya inyandiko: bi-encoders yashyizemo buri gice ukwacyo kugirango ushakishe byihuse, mugihe cross-encoders isoma ibyanditswe byombi kugirango bisobanuke neza.
Incamake
The choice shapes the speed-versus-precision tradeoff in every modern search and retrieval system.
Kwibira cyane
Ubwubatsi bwombi busubiza 'ni buryo ki inyandiko ebyiri zifitanye isano?', Ariko ziratandukanye iyo inyandiko zihuye. Bi-encoder ikoresha buri nteruro ibinyujije muri transformateur yigenga, itanga icyerekezo kimwe gihamye kuri buri nyandiko; ibisa noneho nibicuruzwa bihendutse cyangwa cosine hagati ya vectors. Kuberako ibice bishobora kubarwa mbere kandi bikabikwa, bi-kodegisi igera kuri miriyoni yinyandiko hamwe nububiko bwimbaraga. Kwambukiranya-kodegisi ahubwo ihuza inyandiko zombi ([CLS] ikibazo [SEP] inyandiko) hanyuma ikabagaburira binyuze murugero hamwe, kureka buri kimenyetso kikitabira ikindi kimenyetso mbere yo gutanga amanota yingirakamaro. Uku kwitondera kwuzuye gufata imikoranire myiza-bi-kodegisi yabuze, bityo kode-kodegisi iragaragara neza ariko ntishobora kugereranya ikintu cyose kandi igomba kwiruka rimwe kuri buri jambo.
Ubushishozi
Itandukaniro ryibanze ni urugero rwo kwitabwaho. Muri bi-kodegisi, kwiyitaho ntikwambukiranya hagati yinjiza zombi, kubwibyo gushyiramo inyandiko nibibazo byigenga kandi birashobora gukoreshwa. Muri kode-kodegisi, kwitondera bigenda bikurikirana, bigatuma amanota abaza-biterwa. Umunzani wibiciro ukurikije: gutondekanya inyandiko N ikeneye N impinduka ya transfert yuzuye ya cross-encoder na N ihendutse ya vector igereranya na bi-koderi nyuma yikibazo kimwe.
Ingaruka z'Ingamba
Umuvuduko n'igipimo
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.
Kugera no kugera
Yagura uburyo bwindimi nuburyo bwo gutumanaho.
Ibyemezo bisobanutse
Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.
Kazoza ka Cross-Encoders vs Bi-Encoders
Uburyo bwiganje ni Hybrid kugarura-hanyuma-rerank: bi-encoder izana abakandida amajana make miriyoni, hanyuma cross-encoder igasubiza ibisubizo byo hejuru. Moderi yatinze-imikoranire nka ColBERT yagabanije itandukaniro mukubika kuri buri kimenyetso, kandi distillation igenda ihugura bi-kodegisi yo kwigana imanza zambukiranya imipaka. Witegereze ko bihendutse kandi bihuze ibyiciro byombi muburyo bwo kugarura-kongera ingufu.
Gushyira mu bikorwa Isi
Ububiko bwa vector bukoresha bi-encoder kugirango igarure ibice 200 byambere byabakandida kuva miriyoni zinyandiko muri milisegonda
Kwambukiranya-kodegisi ya reranker isubiramo abo bakandida 200 mbere yo kugaburirwa kuri RAG chatbot, kunoza cyane igisubizo cyibisubizo
Amato-Guhindura amato amato yabanjirije bi-kodegisi (kubushakashatsi bwimbitse) hamwe na kodegisi (kubisubiramo no gutanga amanota ya STS)
Gukoporora-ibibazo gutahura kurubuga rwibibazo & QA ikoresha kode-kodegisi kugirango ihuze neza-ihuza byombi ihuza urutonde.
Ingaruka & Kurinda
Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.
Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.
Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.
Igishushanyo mbonera
Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.
Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.
Komeza kugenzura abantu kugenzura ibisubizo byinshi.
Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Cross-Encoders vs Bi-Encoders quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
BERT na Encoder Model
Ibibazo bikunze kubazwa
What is Cross-Encoders vs Bi-Encoders?
Inzira ebyiri zerekana imiterere igereranya inyandiko: bi-encoders yashyizemo buri gice ukwacyo kugirango ushakishe byihuse, mugihe cross-encoders isoma ibyanditswe byombi kugirango bisobanuke neza. Ihitamo ryerekana umuvuduko-uhwanye nubucuruzi muri sisitemu igezweho yo gushakisha no kugarura ibintu.
Ni irihe tandukaniro risobanura imyubakire hagati ya cross-encoder na bi-encoder?
Kwambukiranya-kodegisi ihuza inyongeramusaruro kandi ureke kwitondera bikurikiranye; bi-encoders ihuza buri nyandiko mu bwigunge mu bice bitandukanye.
Kuki bi-kodegisi igera kuri miriyoni zinyandiko neza?
Kuberako buri nyandiko ifite kodegisi yigenga, vector yayo irashobora gukoreshwa mubibazo byose kandi irashobora gutondekwa mbere yigihe.
Muburyo busanzwe bwo gushakisha umusaruro, ni gute imyubakire yombi ihuriweho?
Igipimo gisanzwe cyo kugarura-hanyuma-rerank ikoresha by-bioderi yihuta kugirango yibuke yagutse kandi yambukiranya neza kugirango ihindure urutonde.
Kuberiki bidashobora kwambukiranya kodegisi yerekana inyandiko zerekana?
Kubera ko amanota yatanzwe avuye kubaza-inyandiko ikurikiranye, ni ikibazo-gishingiye kandi kigomba kubarwa kuri buri jambo.
Niki bi-encoder isanzwe isohora inyandiko imwe yinjiza?
Bi-kodegisi ishushanya buri nyandiko kuri vector imwe; ibisa noneho bibarwa hagati ya vectors.