Inyandiko
Kwinjiza inyandiko bihindura amagambo, interuro, cyangwa inyandiko murutonde rwimibare (vectors) ifata ibisobanuro, kuburyo inyandiko zifite ibisobanuro bisa zirangirira hamwe mumwanya.
Incamake
They are the foundation for semantic search, recommendations, clustering, and the retrieval behind many AI assistants.
Kwibira cyane
Mudasobwa ntishobora gutekereza ku buryo butaziguye ku nyandiko mbisi, bityo gushyiramo guhindura ururimi mu burebure-burebure bwimibare, akenshi ni magana make kugeza ku gihumbi. Umutungo wingenzi ni uko intera iri muri uyu mwanya wa vector yerekana ibisobanuro: "umunezero" n "" umunezero "ubutaka hafi yundi, mugihe" byishimo "na" asfalt "bitandukanye cyane. Ijambo ryambere ryashizwemo nka Word2Vec na GloVe ryahaye buri jambo icyerekezo kimwe gihamye, kizwi cyane kigereranya nkumwami ukuyemo umugabo wongeyeho umugore ugwa hafi yumwamikazi. Intambamyi zabo ni uko ijambo nka "banki" ryabonye icyerekezo kimwe cyaba risobanura inkombe z'umugezi cyangwa banki y'imari. Ibigezweho bigezweho biva muri moderi ya transformateur bikosora ibi utanga ijambo vector itandukanye bitewe ninteruro yayo. Interuro ninyandiko zishushanya zigana kure, guhuza ibice byose mubice bimwe bisobanura-bikungahaye ushobora gushakisha cyangwa cluster.
Ubushishozi
Kwinjiza ni vector yuzuye, kandi ibisa nubusanzwe bipimwa na cosine isa, igereranya inguni hagati yinzira ebyiri utitaye kuburebure. Word2Vec yize ibice mu guhanura amagambo ari hafi, niyo mpamvu amagambo afitanye isano hamwe. Kwinjiza interuro igezweho biva muri kodegisi ya transformateur, akenshi ikomatanya ibisubizo byerekana ibimenyetso muri vector imwe kandi bigahugurwa hamwe nintego zinyuranye zikurura imvugo hamwe no gusunika inyandiko zidafitanye isano. Ibisubizo bivamo nibyo bibikwa mububiko bwa vector kandi ugereranije mugihe cyo gushakisha ibisobanuro no kugarura-byongerewe ibisekuruza.
Ingaruka z'Ingamba
Umuvuduko n'igipimo
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.
Kugera no kugera
Yagura uburyo bwindimi nuburyo bwo gutumanaho.
Ibyemezo bisobanutse
Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.
Ejo hazaza h'inyandiko zanditse
Ibishushanyo birahinduka intera rusange kuri AI: umwanya umwe wa vector ugenda uzenguruka inyandiko, amashusho, amajwi, na code, bigafasha gushakisha uburyo butandukanye. Tegereza icyitegererezo kirimo inyandiko ndende mu budahemuka, gushyiramo indimi nyinshi zihuza ibisobanuro mu ndimi, hamwe na moderi ntoya, yihuta ikorera ku gikoresho cyo kwiherera. Imyitozo isanzwe nkibisanzwe hamwe na Matryoshka-yuburyo bwa troncatable yashyizwemo, ikwemerera kugabanya vector kugirango ubike ububiko hamwe nigihombo gito, kirimo gukwirakwira. Mugihe igaruka-ryongerewe ibisekuru bigenda byiyongera, gushyiramo ubuziranenge byerekana neza uburyo abafasha ba AI bafite ukuri kandi bashingiye, bigatuma aka gace gakora kandi gakomeye.
Gushyira mu bikorwa Isi
Imbaraga zishakisha ibisobanuro rero ikibazo gihuye ninyandiko mubisobanuro aho kuba ijambo ryibanze
Guteranya ibihumbi byabakiriya basubiramo insanganyamatsiko mugusubiramo amatsinda yashizwemo hamwe
Kwemeza ingingo cyangwa ibicuruzwa bisa mugushakisha ibintu byashyizwemo ibice byegeranye nimwe ukoresha
Gutahura amatike yingoboka cyangwa hafi-kwigana amatike yingoboka mugupima uko ibyo bashizemo biri hafi
Ingaruka & Kurinda
Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.
Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.
Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.
Igishushanyo mbonera
Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.
Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.
Komeza kugenzura abantu kugenzura ibisubizo byinshi.
Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Text Embeddings quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Ibirindiro byumwanya
Ibibazo bikunze kubazwa
What is Text Embeddings?
Kwinjiza inyandiko bihindura amagambo, interuro, cyangwa inyandiko murutonde rwimibare (vectors) ifata ibisobanuro, kuburyo inyandiko zifite ibisobanuro bisa zirangirira hamwe mumwanya. Nizo shingiro ryishakisha ryibisobanuro, ibyifuzo, guhuriza hamwe, hamwe no kugarura inyuma yabafasha benshi ba AI.
Kwandika ni iki?
Gushushanya amakarita yinyandiko kumurongo uhamye wububiko kugirango ibisobanuro bisa bibyara ibice byegeranye hamwe mumwanya.
Mu mwanya mwiza wo gushiramo, ni iki kigomba kuba ukuri ku magambo 'yishimye' na 'umunezero'?
Kuberako amagambo afite ibisobanuro bisa, gushyiramo ibice bigomba kwicara hamwe, mugihe amagambo adafitanye isano nka 'umunezero' na 'asfalt' agomba kuba atandukanye.
Ni izihe mbogamizi nyamukuru yo gushyiramo amagambo hakiri kare nka Word2Vec na GloVe?
Ijambo rihamye ryerekana icyerekezo kimwe kuri buri jambo, bityo ijambo rifite abagore benshi nka 'banki' ribona kimwe kimwe risobanura inkombe yinzuzi cyangwa ikigo cyimari.
Nigute uburyo bugezweho bwo gushiraho butezimbere kumagambo ahamye?
Guhindura bishingiye ku guhinduranya ibintu bitanga icyerekezo gishingiye ku miterere, bityo 'banki' mu nteruro y’imari itandukanye na 'banki' hafi yuruzi.
Ni ikihe gipimo gikunze gukoreshwa mugereranya ibyanditswe bibiri byanditse kugirango bisa?
Isano ya Cosine ipima inguni hagati ya vectors, ifata ibisa nicyerekezo (ibisobanuro) utitaye kubunini bwayo.