← Emuva kuyo yonke imibuzoImibuzo exhumene nomhlahlandlela • Kunzima Izinga • 6 Imibuzo

I-SwiGLU kanye ne-Gated Activations Quiz

Hlola ukuqonda kwakho ukusebenza kwesango nokuthi kungani i-SwiGLU ibe isendlalelo esijwayelekile sokuphakelayo kwe-transformer.

Izindlela zomhlahlandlela ezihlobeneIzenzo ze-Swiglu Futhi Gated

Umbuzo 1 kwe 6

Yimuphi umsebenzi owumongo ochaza i-Gated Linear Unit?