Ajudement bu baax ci jouer sa bopp
Self-play fine-tuning dafay gëna suqali model bi ci fexe ba mu mëna joŋante wala mu jàngee ci ay génnam yu njëkk, ba noppi defar siñaalu tàggat boppam.
Résumé
It matters because it can push performance beyond the supervised data using little or no extra human labeling.
Plongeur bu xóot
Fowokaayu sa bopp amna ay reenam yu xóot ci jeu IA: AlphaGo Zero ak AlphaZero defnañu jeu bu ëpp doole ci fowee ay milioŋ ciy jeu ak seen bopp, te amul benn dokimaa ci jeu nit. Benn ngëm bi dafay feeñ leegi ci jëfandikoo làkk wi. Ci SPIN (Self-Play fIne-tuNing), model bi fi nekk mingi defar ay tontu ci ay laaj, te tàggat bi dafay push model bi mu wuutale tontu yi mu defar boppam ak yi nit bind, di jàppee boppam ni joueur bi ak noon bi. Luñuy baamtu yu toppalante, 'kontra' bi (point de contrôle bi njëkk) dafay gëna am doole, kon model bi dafa wara wéy di gëna dëgaral, di tëj ndànk-ndànk bërëb bi ak distribution biñ bëgga. Li gëna am solo mooy njariñu done yi: mën nañu gëna xëcc ay done yuñ saytu ngir am xaalis bu gëna bari te duñu dajale ay firnde wala tànneef yu bees ci nit ñi.
Gis-gis xarala
SPIN dafay wane fine-tuning ni jeu ñaari joueur ak DPO-style perte: model bi dañu ko tàggat ngir jox probabilite bu gëna rëy ci tontu nit ñi moo gën tontu boppam ci iteration bi njëkk. Ndax checkpoint bi njëkk dafa joxe negatif yi, jafe-jafe bi dafay yokk ci saasi lu model bi di gëna mëna dem. Ci sistemu jeu-playing, jeu-sa-bopp dafay boole seetlu (lu melni, MCTS) ak reso bu am solo, di defar njàngale bu amul àpp bu ay noon yuy gëna dëgër te amul ay done yu biti.
njeextalu pexe
dogal yu gëna leer
Daf lay jàppale nga tàqale kàddu yu leer ci wàllu xarala ak làkku fësal njaay.
Njëgg ak budget
Mën nga laaj laaj yu gëna baax ci samp gi balaa ngay dugal xaalis wala sa jotu liggéey.
Ekip ak def liggéey
Ekip yi bokk xam-xam ñoo gëna mëna jël yenn dogal ci wàllu produit, politik ak jàng.
Ëlëgu Self-Tuning
Self-play mooy kàndidaa bi gëna am solo ngir dindi miiru done yi, ndax dafay defar prograamu njàngaleem boppam moo gën ñuy wéeru ci etiketu nit ñi. Xaarandil yokkute ci wàll yiñ mëna saytu lu ci melni math, kod, ak firnde theorem, fu saytukat yi di joxe note ci jéem-jéem yi defar seen bopp. Risk yi bokkunaci piratage neexal ak daanu model ci tàggat ci génne synthetik bu bari, kon sistem yu ëlëg dina ñu jaxasoo self-play ak siñaal yu suuf, saytukat, ak feedback nit wala àdduna dëgg.
Doxal ci àdduna dëgg
AlphaGo Zero ak AlphaZero dem ba yegg ci Go bu ëpp nit, echec, ak shogi ci fo sa bopp te amul benn fo nit
SPIN dafay yokk poñ yi LLM mëna am ci di wuutale ay génnam ci tontu nit ñi
Math ak royuwaayi kodage defar ay jéem-jéem saafara, ginaaw ga tàggat ci ñooñu saytu otomatik wala test unitaire
Negociation ak dialogue agents ñu gëna suqali seen pexe ci di jouer ñaari wetu waxtaan ci seen bopp
Risk yi ak balustrade yi
Ekip yu bari mën nañu jëfandikoo benn baat ci anam wu wuute, kon teela leeral yaatuwaayam.
Benchmark yi mën nañu nuru lu am doole waaye performance yi ci àdduna bi duñu tolloo.
Bëgg kalite done ak palaŋu jàngat dafay faral di jur njariñ yu yomba dagg.
Roadmap ngir samp gi
Tàmbaleel ci joxe leeral ci làkk wu leer ci njariñ li nga soxla.
Tannal benn metric bu baax ak benn anam bu baaxul balaa ngay saytu.
Doxal ab pilote bu ndaw ak ay done yu representatif, du ab demo bu leer.
Bindal fi Self-Play Fine-Tuning di jàppale ak fi pexe yu gëna yomba gëna baax.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Self-Play Fine-Tuning quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
Akordement bu baax
Laaj yi ñuy faral di laaj
What is Self-Play Fine-Tuning?
Self-play fine-tuning dafay gëna suqali model bi ci fexe ba mu mëna joŋante wala mu jàngee ci ay génnam yu njëkk, ba noppi defar siñaalu tàggat boppam. Dafa am solo ndax mën na push performance bi weesu done yiñ saytu jëfandikoo tuuti wala amul benn etiketu nit.
Ban sistem bu siiw moo yegg ba yegg ci Go play bu ëpp nit, di jëfandikoo self-play rek te amul benn dokimaa ci jeu nit?
AlphaGo Zero mingi jàngee lépp ci jeu yi mu daan jouer ak boppam, tàmbalee ci jeu random ba noppi romb version yi njëkka tàggat ci jeu nit.
Ci SPIN, lan mooy liggéeyu 'konno' bi model bi wara daan?
SPIN dafay jàppe fine-tuning ni jeu self-play fu iteration bi njëkk génne boppam nekk negatif yi model bi jàng romb.
Lan mooy njariñu self-play ci wàllu njariñu done?
Self-play dafay defar siñaalu tàggat yaram boppam, suko defee benn set buñ saytu bu takku mën na joxe yeneen yokkute te du dajale ay wane yu bees.
Ci mébetu tàggat yaram bu SPIN, lan lañuy puus model bi mu def?
SPIN dafay jëfandikoo DPO-style loss buy neexal wuutale tontu nit (positif) ak tontu model bi njëkka defar boppam (negatifs).
Lan moo waral jafe-jafe bi ci self-play fine-tuning di yokk ci saasi ginaaw iterasioŋ yi?
Ndax te bépp iteration bu baaxul ci model bu njëkk bi gëna am doole lay joge, model bi dafay jànkoonte ak jafe-jafe yu gëna tar te amul jëmmal curriculum manuel.