Liggéeyu tàmbali
Fonction activation mooy buntu yu ndaw yi nekkul ci biir neuron bu nekk, loolu mooy tax reso neuronal yi jàng motif yu xawa jafee xam, yu xawa sëgg, duñu nekk ligne yu jub kese.
Résumé
Without them, a deep network would collapse into a single linear equation.
Plongeur bu xóot
Neuron bu nekk dafay xayma limu dugal ci limu pondéree, waaye limu dugal ci ligneer la. Defar ay couche ligneaire yu bari, ci wàllu math, benn fonction ligneaire bu rëy kese ngay am, ak limu mëna doon. Fonction yiy aktive dañuy dindi lii ci def coppite bu amul ligne ci neuron bu nekk, loolu mooy tax reso yi mëna xayma bépp fonction. Li gëna siiw mooy ReLU, mooy génne dugal bi sudee positif la ak nul luko moy; Dafa gaaw te moytu yenn jafe-jafe tàggat ci fonction yu yàgg yi. Sigmoid ak tanh squash valeur ci rang yu yam te bariwoon nañu ci taarix waaye mën nañu am jafe-jafe gradient yuy réer ci reso yu xóot yi. Fonction softmax bi ñuy jëfandikoo ci génne gi, dafay soppi poñ yu bees yi ci séddale probabilite ci kaw klaas yi.
Gis-gis xarala
ReLU's appel mingi ci gradient bi: 1 la gën ngir duggal yu baax, kon du wàññi siñaalu njuumte bi ci backpropagation, di jàppale reso yu xóot yi ñu tàggat. Sigmoid ak tanh, ci beneen wàll bi, dañuy plat ci seen extrême, fu seen gradient jege zero, moo waral jafe-jafe gradient buy réer biy tere jàng ci stack yu xóot yi. Li baaxul ci ReLU mooy jafe-jafe ReLU biy dee, fu neuron yi tëju ci duggal yu baaxul yi génne nul ba fàww; variants yu melni Leaky ReLU ak GELU saafara jafe-jafe yii ci may tontu bu ndaw wala bu neex te amul benn.
njeextalu pexe
dogal yu gëna leer
Daf lay jàppale nga tàqale kàddu yu leer ci wàllu xarala ak làkku fësal njaay.
Njëgg ak budget
Mën nga laaj laaj yu gëna baax ci samp gi balaa ngay dugal xaalis wala sa jotu liggéey.
Ekip ak def liggéey
Ekip yi bokk xam-xam ñoo gëna mëna jël yenn dogal ci wàllu produit, politik ak jàng.
Ëlëgu fonction yiy tàmbali
ReLU ak cousin-am bu nooy bi GELU ñoo ëpp doole tay, GELU moo gëna am solo ci transformateur yi ndax courbe bu nooy bi dafay méngoo bu baax ak seen dynamique de formation. Gëstu dafay saytu li ñu jàng ak liñ tëj lu melni SwiGLU, leegi ñu bari ci xeeti làkk yu mag, ñuy jëfandikoo gating buy yokk ngir gëna fësal kàddu. Tendens bu yaatu bi mooy fonction yu nooy, yu am buntu yuy gëna baaxal debit gradient bi ak kalite model bi ci eskaal bi. Bi activations exotic feeñ saa yu nekk ci këyit, fonction yu yomb, yu baax dañuy gëna am ndam ci jëf ndax dañuy tàggat ci anam wu wóor ci model yu mag.
Doxal ci àdduna dëgg
Jëfandikoo ReLU ci biir ay layer yu nëbbu ci reso convolutionnel suko defee mu mëna jàng ay dogal yu xawa sëgg ngir xàmmee nataal
Jëfandikoo softmax ci couche bu mujj bi ngir soppi poñ yu ñor yi ci classifier bi ci probabilite classe yuy boole benn
Tann GELU yiy tàmbali liggéey ci biir xeetu làkk transformatër ngir gëna yomba def gradient
Weccoo ci Leaky ReLU sudee neuron yu bari ci reso bi dee nañu ba noppi bàyyi tontu
Risk yi ak balustrade yi
Ekip yu bari mën nañu jëfandikoo benn baat ci anam wu wuute, kon teela leeral yaatuwaayam.
Benchmark yi mën nañu nuru lu am doole waaye performance yi ci àdduna bi duñu tolloo.
Bëgg kalite done ak palaŋu jàngat dafay faral di jur njariñ yu yomba dagg.
Roadmap ngir samp gi
Tàmbaleel ci joxe leeral ci làkk wu leer ci njariñ li nga soxla.
Tannal benn metric bu baax ak benn anam bu baaxul balaa ngay saytu.
Doxal ab pilote bu ndaw ak ay done yu representatif, du ab demo bu leer.
Bindal fi Fonction Activation di jàppale ak fi pexe yu gëna yomba gëna baax.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Activation Functions quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
Fonction yuy ñàkk
Laaj yi ñuy faral di laaj
What is Activation Functions?
Fonction activation mooy buntu yu ndaw yi nekkul ci biir neuron bu nekk, loolu mooy tax reso neuronal yi jàng motif yu xawa jafee xam, yu xawa sëgg, duñu nekk ligne yu jub kese. Suñu leen amul, reso bu xóot bi dina daanu nekk benn equation lineaire.
Lan mooy dall reso bu xóot bu amul fonction activation?
Dajale ay couche ligneaire te amul nonlinearité dafay daanu ci wàllu math ci benn coppite ligneaire, kon reso bi mënul jàng motif yu jafee xam.
Lan mooy fonction aktivasioŋ ReLU biy génne ci duggal bu baaxul?
ReLU dafay genne liñu dugal sudee positif la, zero sudee negatif la, loolu moo tax xayma bi yomb te gaaw.
Lan mooy jafe-jafe gradient buy réer bi jëm ci sigmoid ak tanh?
Sigmoid ak tanh dañuy plat ci seen extrême, moo tax seen gradient dafay wàññeeku dem ci zero, di néewal doole siñaalu njuumte ci reso yu xóot yi.
Ban fonction activation lañuy gëna jëfandikoo ci couche de sortie bu classificateur multi-class?
Softmax dafay soppi poñ yu bees yi ci séddale probabilite ci kaw klaas yiy boole benn, lu baax ci génnug xaaj.
Luy jafe-jafe 'ReLU buy dee'?
Sudee ab neuron ReLU dafay jot ay done yu baaxul saa yu nekk, dafay génne zero ak gradient zero ba noppi dafay taxawal yeesal, moo tax 'dee.'