Ingamba zo Gukata Inyandiko
Gukata inyandiko nuburyo wagabanije inyandiko ndende mubice bisubirwamo mbere yo kuyishiramo gushakisha cyangwa RAG.
Incamake
The chunk size and boundaries quietly determine retrieval quality, so getting them right often matters more than picking a fancier model.
Kwibira cyane
Chunking ihindura inyandiko nini mubice bito-binini bihuza icyitegererezo cyo guhuza kandi bigahuza nuburyo ibibazo bibazwa. Ingano-nini yagabanijwe igabanijwe ku kimenyetso cyangwa kubara, akenshi hamwe no guhuzagurika bityo interuro ikurikirana imipaka ntabwo ari impfubyi. Gusubiramo inshuro nyinshi bigabanije kurwego rwabatandukanya (paragarafu, hanyuma interuro, hanyuma amagambo) kugirango bubahe imiterere karemano. Amatsinda asobanura amatsinda interuro mugushiramo ibintu bisa, kumena aho ingingo ihindukira. Inyandiko-izi neza gukurikiza imiterere ubwayo, igabanije kumutwe wa Markdown, tagi ya HTML, cyangwa imikorere ya code. Impagarara yibanze ni granularité: uduce duto dutanga guhuza neza ariko gutakaza imiterere ikikije, mugihe uduce twinshi dutwara imiterere ariko bigabanya akamaro kandi birashobora kurenga imipaka. Imiyoboro myinshi ibika uduce duto two kugarura nyamara kugaburira ibice byababyeyi byagutse kurugero.
Ubushishozi
Guhuzagurika nuburyo bworoshye bwo kwizerwa: gusubiramo hafi 10 kugeza kuri 20 ku ijana byikimenyetso hagati yimitwe yegeranye byerekana ko ukuri kugabanijwe kumupaka bikigaragara nkibice byibuze. Gutondagura ibisobanuro bigenda byiyongera mugushyiramo buri nteruro no gupima intera ya cosine hagati yabaturanyi, hanyuma ugaca aho intera izamuka hejuru yumuryango. Ibi bitanga umusaruro uhuza ibice byuburebure, kubiciro byinyongera byo kubara mugihe cyo kwerekana.
Ingaruka z'Ingamba
Umuvuduko n'igipimo
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.
Kugera no kugera
Yagura uburyo bwindimi nuburyo bwo gutumanaho.
Ibyemezo bisobanutse
Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.
Ejo hazaza h'ingamba zo gukuramo inyandiko
Chunking iri kuva mu ntambwe ihamye yo gutunganya ibintu igana ku kintu kijyanye no guhuza n'imiterere. Inzira nkubukererwe bwashizemo inyandiko yose mbere, hanyuma pisine ya chunk vectors kuburyo buri gice kigumana imiterere yisi. Imiterere-yimenya igereranya igenda ibika ameza, imitwe, nimibare aho kubitondekanya mumyandiko yuzuye urusaku. Mugihe imiterere ya Windows ikura, imiyoboro imwe nimwe igarura uduce duto ariko twinshi, nyamara ubwenge bwubwenge buguma nkenerwa kubiciro, gutinda, no kwerekana neza aho kubura.
Gushyira mu bikorwa Isi
Gutandukanya igitabo cyamapaji 200 yibicuruzwa kumutwe wacyo kugirango ikibazo kijyanye na 'garanti garanti' gikuramo icyo gice, ntabwo igitabo cyose.
Ukoresheje interuro ihuzagurika kugirango igisobanuro kigaragaza iherezo ryigika kimwe kandi intangiriro yubutaha iguma yuzuye byibuze igice kimwe.
Gutondagura igice cyubushakashatsi kugirango uburyo bwo kuganira nibisubizo bigabanuke bitandukanye, byuzuzanya.
Gukata codebase kumikorere cyangwa imbibi zicyiciro kugirango ikibazo cyuwitezimbere agarure igice cyuzuye, gishobora gukoreshwa aho kuba igice cyimikorere.
Ingaruka & Kurinda
Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.
Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.
Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.
Igishushanyo mbonera
Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.
Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.
Komeza kugenzura abantu kugenzura ibisubizo byinshi.
Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Document Chunking Strategies quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
HyDE Hypothetical Document Embeddings
Ibibazo bikunze kubazwa
What is Document Chunking Strategies?
Gukata inyandiko nuburyo wagabanije inyandiko ndende mubice bisubirwamo mbere yo kuyishiramo gushakisha cyangwa RAG. Ingano nini nimbibi bigena bucece ubuziranenge bwo kugarura, kubwibyo rero kubikemura akenshi bifite akamaro kuruta gutoranya moderi ya fancier.
Ni ukubera iki guhuzagurika akenshi byongewe hagati yibi bice byegeranye?
Guteranya gusubiramo igice cyibimenyetso hagati yabaturanyi kugirango amakuru akurikirana gutandukana ntagabanywe kabiri kandi yatakaye.
Ni ubuhe butumwa bukoreshwa mu guhitamo aho gutandukana?
Igice cya semantique gikubiyemo interuro kandi kigacika aho intera ya cosine hagati yabaturanyi itera, ikabyara ibice bifatika.
Ni ubuhe butumwa nyamukuru hagati yubuto buto kandi bunini cyane?
Uduce duto duhuye neza ariko twambure imiterere, mugihe uduce twinshi tubika imiterere ariko birashobora kugabanya akamaro kandi bigatera imipaka.
Nigute gusubiramo inshuro nyinshi guhitamo aho ugomba kumena inyandiko?
Gusubiramo inshuro nyinshi bigenda kurutonde rwabatandukanya kugirango bubahe imiterere karemano mugihe ugumye mubunini.
Ni ikihe gitekerezo kiri inyuma y '' gito-kinini-kinini 'cyangwa uburyo bwo kugarura ababyeyi?
Uhuza uduce duto kugirango tumenye neza, hanyuma wagure kubabyeyi bakikije inyandiko kugirango icyitegererezo kibone imiterere yuzuye.