ELMo lëkkalekaay
ELMo (Embeddings from Language Models) ap jeego bu am solo la woon ci 2018 bu jox baat bu nekk ap misaal bu ñu defar ci frase bi, kon 'bànk' ci 'banku dex' wuute na ak 'bànk' ci 'banku dencukaay.' Dafa màndargaal coppite bi ñu joge ci vecteur yu baat yu taxaw dem ci PNL buy xam contexte.
Plongeur bu xóot
ELMo, bi Allen Institute ngir gëstukat yi dugal ci IA (Peters et al., 2018), dafay defar ay misaali baat ci doxal benn frase ci xeetu làkk bu xóot bu am ñaari yoon LSTM buñ tàggat ci benn corpus bu am ay miliyaar ciy baat. ELMo wuute na ak Word2Vec wala GloVe, ñoom ñooy jox benn vecteur fixe ci baat bu nekk, ELMo dafay xayma vecteur bu bees ci bepp xew-xew bu sukkandiko ci contexte bi ko wër. Lu am solo mooy ELMo dafay boole bépp couche LSTM bi ci biir jaaraleko ci poid yuñ jàng, liggéey bu amul benn couche bu gëna kawe. Layer yi gëna suufe dañuy jàpp syntax bi (wàllu kàddu, structure) waaye layer yi gëna kawe dañuy jàpp semantik bi ak lu baat bi di tekki. Yokk ELMo ci xeetu liggéey yi fi nekk jurna njariñ yu bari ci jiroom benn liggéey yu ñuy teg ay tegtal, lu ci melni tontu laaj, jàngat yëg-yëg, ak xàmmee entite bu tuddu.
Gis-gis xarala
ELMo dafay boole ñaari LSTM: benn xeetu làkk bu jëm kanam di wax luy waaja am ci baat bi ci topp ak beneen bu dellu ginaaw di wax luy waaja am ci baat bi ci njëkk, bu nekk ci kaw dugal CNN ci niveau araf (kon dafay jëfandikoo baat yiñ gisul). Ngir liggéey bu wàcci, ELMo dafay dindi misaali couche yi ci jëfandikoo poid yu softmax-normalisé boole ci benn scalar, lépp ñu jàngee ko ci fine-tuning. Loolu dafay tekki ni liggéey bu nekk mën na tànn limu bëgg ci siñaal syntactic ak semantic ci biLM biñ tàggat bu njëkk.
njeextalu pexe
Gaawaay ak yaatuwaay
Liggéeyukaay yi ci làkk yi mën nañu gëna gaaw te duñu yàq deggoo gi.
Dugg ak yegg
Dafay yaatal jëfandikoo gi ci làkk yi ak ci anam yi ñuy jokkoo.
dogal yu gëna leer
Ekip yi mën nañu gëna yàgg ci àtte ci jamono ji otomatisation di liggéey ci baamtu.
Ëlëgu ELMo
Xalaat bu mag bi ELMo, muy wane ci anamu làkk wi ñuy njëkka tàggat, nekkoon na lu am solo, waaye architecture LSTM bi ñuy baamtu dafa gaawa jeex ci model yu Transformer yu melni BERT ci 2018, biy jàng frase yu mat ci paralel ak scale bu gëna baax. Tay ELMo dafa gëna am solo ci taarix ak ci wàllu njàng, waaye xalaati dugal CNN ak xalaati layer-weighting ba leegi dañuy wéy di am njeexital ci liggéey bu yam ci làkk yu néew doole ak yu am morphologie.
Doxal ci àdduna dëgg
Yokkatal sistem yiy xàmmee mbir yu am tur yu wara wax ndax 'Washington' dafay wax ci nit, etaa, wala dëkk bu sukkandiko ci kàddu yi ko wër
Yokkatal cammbar yëg-yëg ci jàpp ni 'febar' moy lu ñaaw ci 'maa ngi yëg ni dama feebar' waaye lu baax ci argot 'loolu dafa feebar'
Yokkatal sistemu tontub laaj ci kaw benchmark SQuAD ci dugal vecteur token yu xarañ ci biir jàngkat bi
Di dindi lu bari luñuy tekki ci tekki masin, suko defee baat yu bari maana yu melni 'plant' tekki ci anam wu jaar yoon
Risk yi ak balustrade yi
Lépp lu jaarul yoon mën na dugg ci rapoor yi, jàppale ci liggéey bi, wala ci njariñu gëstu bi.
Sensibilite bu gaaw mën na jur njariñ yu wuute ci laajte yu noonu mel.
Done yu am solo mën nañu feeñ sudee seytu jëfandikoo gi néew doole.
Roadmap ngir samp gi
Mandargal formaa génne gi, melokaan bi, ak standard kalite yi laata ngay dugal ko.
Tontu yu am solo ak balluwaay yu wóor saa yu dëggu bi di am solo.
Fexeel am barabu xool nit ñi ngir am njariñ yu am solo.
Toppal anami gacce yi ak di faral di tàggataat ay laaj wala def-liggéey.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the ELMo Contextual Embeddings quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
Word
Laaj yi ñuy faral di laaj
What is ELMo Contextual Embeddings?
ELMo (Embeddings from Language Models) ap jeego bu am solo la woon ci 2018 bu jox baat bu nekk ap misaal bu ñu defar ci frase bi, kon 'bànk' ci 'banku dex' wuute na ak 'bànk' ci 'banku dencukaay.' Dafa màndargaal coppite bi ñu joge ci vecteur yu baat yu taxaw dem ci PNL buy xam contexte.
Lan mooy wuutale ELMo ak embedding yu njëkk yu melni Word2Vec?
ELMo dafay defar ay embedding contextuel: vecteur u baat bi dafay soppiku ci santaane bi ko wër, wuute na ak Word2Vec vecteur fixe bu benn baat bu nekk.
Ban architecture neuronal la ELMo di jëfandikoo ngir jàng mbind?
ELMo dafa tabax ci kaw LSTM bu xóot bu am ñaari yoon, ñu tàggat ko muy xeetu làkk, di toppalante ay yoon yu bari.
naka la ELMo di boole ay couche interne ngir liggéey buy wàcci?
ELMo dafay jàng liggéey bu jëm ci softmax-normalisé poid ngir boole bépp couche biLM, bàyyi liggéey bu nekk mu fësal syntax wala semantics ni ko soxlaa.
Lan la ELMo di jëfandikoo ngir jëfandikoo ay baat yuñu gisul?
ELMo dafay tabax ay dugal ay baat ci CNN bu am niveau de caractère, suko defee mu mëna fësal baat yu mu musul gis ci diiru tàggat yaram.
Lu tollu ci kañ lañu dugal ELMo ak kan moo ko dugal?
Peters ak ñeneen ñoo siiwal ELMo ci 2018. ci Daaray Allen ngir IA (AI2).