What is Presence Penalty? Definition | AI Understanding

Incazelo

Ukulungiselelwa kokukhipha amakhodi okunciphisa amathuba amathokheni avele nhlobo, okukhuthaza izihloko ezintsha.

Imigomo ehlobene

I-Frequency Penalty

Isilungiselelo sokukhipha amakhodi esinciphisa amathuba amathokheni ngokulingana nokuthi avele kangaki kuze kube manje.

Isijeziso Sokuphindaphinda

Isilungiselelo sokukhipha amakhodi esehlisa amathuba amathokheni imodeli esiwakhiqizile kakade ukuze kuncishiswe izihibe.

Isu lokukhipha amakhodi amasampula kuphela kusuka kumathokheni alandelayo okungenzeka ukuthi alandelayo.

Ukukhishwa Kwekhodi Okugadiwe

Isu lokukhiqiza elibophezela amathokheni okukhiphayo ezakhiweni ezivumelekile noma ukukhetha okuthobela inqubomgomo.

Ukuqopha Okucatshangelwayo

Indlela yokusheshisa okucatshangwayo lapho imodeli encane esalungiswa iphakamisa amathokheni imodeli enkulu ewaqinisekisa ngokuhambisana.

Inqolobane ye-KV

Ukhiye ogciniwe kanye nezilinganisi zenani ezivela kumathokheni wangaphambilini avumela ama-transformer ukuthi akhiqize amathokheni amasha ngaphandle kokubala kabusha ukunaka kwesikhathi esidlule.

Funda kabanzi kumhlahlandlela wethu wamahhala

Repetition Penalty and Decoding Controls

Bhekafuthi

Beam Search Parent-Document Retrieval Multi-Query Retrieval RAG-Fusion Self-Play Post-training Mid-training Watermarking

Phequlula Uhla lwamagama olugcwele lwe-AI Hlola yonke imihlahlandlela ye-AI yamahhala