Jàngale buy dooleel ay ndawu liggéey yu bari
Njàngale mu am doole ak nit ñu bari (MARL) dafay tàggat nit ñu bari ñuy jàng ñu bokk benn environmaa, ku nekk di méngale ak doxalinam, ñeneen ñi di méngale seen bopp itam.
Résumé
It matters because most real-world problems — traffic, markets, teams of robots — involve many decision-makers, not one.
Plongeur bu xóot
Ci njàngum dooleel benn ndawu liggéey, benn ndawu liggéey dafay jàng benn politik ci yokk neexal ci barab bu takku. MARL dafay yokk yeneen ndawu liggéey, te loolu dafay soppi lépp: ci wàllu ndawu liggéey bu nekk, environmaa bi du taxaw ndax ñeneen ñi dañuy wéy di soppi seen politik. Agent yi mën nañu nekk ñuy jëflante (séddoo neexal ci ekip bi, lu melni robot yuy fowee football), ñuy joŋante (amul benn xaalis, lu melni poker wala topp-réewu), wala ñu jaxasoo. Gëstukat yi dañuy jëfandikoo formalism yu melni jeux Markov (jeux stochastiques) yuy yamale Processus Decision Markov bu benn agent. Resultaa yi siiw ñooy AlphaStar bu DeepMind dem ba yegg ci Grandmaster ci StarCraft II ak juróomi ekipu Dota 2 yu am ndam, ñoom ñaar ñépp a ngi aju ci askanu ndawu liggéey yuñ tàggat seen biir ci fo seen bopp.
Gis-gis xarala
Jafe-jafe bi gëna mag mooy baña taxaw: ginaaw bi bépp ndawu liggéey di yeesal politikam, ñeneen ñi dañuy jànkoonte ak mébet buy toxu, kon jàng moom boppam bu naïf mën na ñàkka dajaloo. Benn ci saafara yiñ gëna xam mooy tàggat yaram buñ dajale ak def lu jaxasoo (CTDE), algorithm yu melni MADDPG ak QMIX dañu koy jëfandikoo. Ci diiru tàggat-yaram, jàngat bi dafay gis seetlu ak jëfi bépp ndawu liggéey ngir xayma ay gradient yu dëgër, waaye ci deploymaa bi, ndawu liggéey bu nekk dafay jëfandikoo seetlu boppam ci dëkk bi - boole jàng buñ boole ak liggéey bu mën jëfandikoo, moom boppam.
njeextalu pexe
dogal yu gëna leer
Daf lay jàppale nga tàqale kàddu yu leer ci wàllu xarala ak làkku fësal njaay.
Njëgg ak budget
Mën nga laaj laaj yu gëna baax ci samp gi balaa ngay dugal xaalis wala sa jotu liggéey.
Ekip ak def liggéey
Ekip yi bokk xam-xam ñoo gëna mëna jël yenn dogal ci wàllu produit, politik ak jàng.
Ëlëgu jàngat buy dooleel ay ndawu liggéey yu bari
MARL mingi jubal ci sistem yu gëna yaatu, yu gëna ubbeeku, fu ndawu liggéey yi di dugg ak génn, ak ci ekipu ndawu liggéey yu LLM yiy waxtaan, dénk, ak jëfandikoo jumtukaay ñoom ñaar. Xaarandil yokkute ci wàllu leble buñ mëna yokk (ku yelloo neexal ci ekip bu mag), protokol jokkoo yu jamp, ak gaaraati kaaraange ngir ndawu liggéey yiy joŋante. Bi oto yuy demal seen bopp, reso energie, ak sistemu njaay di gëna jëflante, koordinaasioŋ bu am doole ci diggante agent yu bari - ak moytu lëkkaloo wala destabiliser feedback loops - nekk na lu am solo ci jëfandikoo ak yamale.
Doxal ci àdduna dëgg
Koordineer ay flotu robot depo ngir ñu mëna yónnee koli yi te duñu mbëkkante wala tëju ci ale yi
Kontrôlu siñaalu dem bi ak dikk bi, fu bepp dajekat nekk ndawu liggéey buy jàng wàññi jafe-jafe yi ci dëkk bi yépp
Juroom (Dota 2) ak AlphaStar (StarCraft II) jaaraleko ci jeu sa bopp ci diggante ndawu liggéey yu bari
Xoolal tontub yeene ak laaj ci batëri yiñ séddale ak kër yi ci biir reso kuuraŋ bu xarañ
Risk yi ak balustrade yi
Ekip yu bari mën nañu jëfandikoo benn baat ci anam wu wuute, kon teela leeral yaatuwaayam.
Benchmark yi mën nañu nuru lu am doole waaye performance yi ci àdduna bi duñu tolloo.
Bëgg kalite done ak palaŋu jàngat dafay faral di jur njariñ yu yomba dagg.
Roadmap ngir samp gi
Tàmbaleel ci joxe leeral ci làkk wu leer ci njariñ li nga soxla.
Tannal benn metric bu baax ak benn anam bu baaxul balaa ngay saytu.
Doxal ab pilote bu ndaw ak ay done yu representatif, du ab demo bu leer.
Bindal fi jàng ak dooleel lu bari di jàppale ak fi pexe yu gëna yomba gëna baax.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Multi-Agent Reinforcement Learning quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
Jàng buy dooleel
Laaj yi ñuy faral di laaj
What is Multi-Agent Reinforcement Learning?
Njàngale mu am doole ak nit ñu bari (MARL) dafay tàggat nit ñu bari ñuy jàng ñu bokk benn environmaa, ku nekk di méngale ak doxalinam, ñeneen ñi di méngale seen bopp itam. Dafa am solo ndax jafe-jafe yi gëna bari ci àdduna bi — dem bi ak dikk bi, marse yi, ekipu robot yi — dañuy laaj ñu bari ñuy jël dogal, amul benn.
Lan moo tax environmaa bi 'dul taxaw' ci benn ndawu liggéey ci MARL?
Ndax bépp ndawu liggéey dafay yeesal ay sàrtam ci diiru tàggat-yaram, ndawu liggéey bu nekk dafay jànkoonte ak mébet buy toxu — dinaamiku environmaa bi dafay soppeeku lu ñeneen ñi di jàng.
Luy 'tàggat buñ dajale ak def lu jaxasoo' (CTDE)?
Pexem CTDE yu melni MADDPG ak QMIX dañuy jëfandikoo leeral yu àdduna bi yépp ngir jàng bu dëgër, fekk ndawu liggéey bu nekk dafay jëfandikoo seetlu boppam kese.
Ban kaadar math mooy yamale MDP bu benn ndawu liggéey ci ndawu liggéey yu bari?
Po mu Markov (ñu koy woowe itam po mu stochastic) dafay yokk MDPs ci am jëf yu ñu bokk ak neexal ci agent bu nekk ci ñiy jël dogal yu bari.
Ci biir MARL bu amul benn lëkkaloo, naka lañuy jagleel neexal bi?
Reglage cooperatif dafay may agent yi ñu bokk mébet, kon jafe-jafe bi mooy boole jëf yi ak jox credit ci biir ekip bi.
Ban pexe mooy may sistem yu melni OpenAI Juroom ak AlphaStar ñu gëna mëna dem te duñu soxla done yu nit ñi di def?
Self-play dafay tax agent yi di xeex ak seeni version yu bees, ñu defar ci saasi ay noon yuy gëna am doole.