Barashada Xoojinta Khadka Tooska ah
Xoojinta barashada khadka tooska ah waxay ka dhigtaa wakiilada kaliya xog go'an, oo hore loo soo ururiyay, iyada oo aan si toos ah ula macaamilayn deegaanka.
Dulmar
It matters because in healthcare, robotics, and recommendation, exploring by trial and error is too costly, slow, or dangerous.
quusid qoto dheer
Offline RL (oo sidoo kale loo yaqaan Dufcaddii RL) waxay ka bartaa siyaasad diiwaanka joogtada ah ee waayo-aragnimadii hore - gobolada, falalka, abaal-marinaha, iyo gobolada soo socda - iyada oo aan waligeed la qaadin ficilo cusub jawiga dhabta ah inta lagu jiro tababarka. Tani waxay RL u furaysaa goobaha sahaminta khadka tooska ah ay tahay mid aan badbaado lahayn ama qaali ah, sida barashada siyaasadaha daawaynta ee diiwaanada bukaanka ee taariikhiga ah ama xirfadaha robot ee xogta la galiyay. Dhibaatada qeexida waa wareejinta qaybinta oo ay weheliso qalad ka baxsan: hababka qiimaha ku salaysan ee caadiga ah waxay qiimeeyaan qiimaha ficillada qaybinta ka baxsan ee xogta waligiis isku dayin, iyo iyada oo aan lahayn jawi lagu saxo khaladaadkan, siyaasaddu waxay raacdaa abaal-marinno dhalanteed ah. Algorithms-yada casriga ah waxay ka hortagaan tan iyagoo ku sii dhowaanaya xogta, iyagoo isticmaalaya qiyaasaha qiimaha konserfatifka (CQL), xaddidaadaha siyaasadda (BCQ, BEAR), ama miisaan qarsoon (IQL).
Aragtida Farsamada
Habka fashilka xudunta u ah waa qiyaasta ficilada ka baxsan qaybinta: Q-function-ka la bartay waxa uu qiimeeyaa qiyamka sare ee doorashooyinka ficilka ee ka maqan xogta, iyo bootstrapping waxay faafisaa khaladaadkan iyada oo aan lahayn jawaab celin dhab ah si loo saxo. Konserfatifka Q-Learning (CQL) ayaa tan wax ka qabta isagoo ku daraya joogto ah oo hoos u riixaya Q-qiyamka ficillada aan la arkin iyadoo la ilaalinayo falalka xogta ku jira oo sarreeya, soo saaraya xad hoose oo qiimo run ah iyo siyaasad ka fogaanaysa aan la taageerin, doorashooyin rajo-xumo leh.
Saamaynta Istiraatijiyadeed
Qiimaha iyo miisaaniyada
Go'aamada qaab-dhismeedku waxay horseedaan waxqabadka iyo kharashka hawlgalka sannadaha.
Go'aamo cad
Waxbarashada farsamada waxay ka caawisaa kooxaha inay doortaan xidhmo sax ah, ma aha oo kaliya kan ugu cusub.
Xakamaynta tayada
Doorashooyinka injineernimada ee wanaagsan waxay yareeyaan shilalka la isku halleyn karo ee wax soo saarka.
Mustaqbalka Waxbarashada Xoojinta Khadka Tooska ah
RL-da khadka-la'aanta ah waxay la jaanqaadaysaa qaabaynta isku xigxiga - habab sida Go'aanka Transformer-ka ayaa dib ugu soo celiyay iyada oo saadaalinaysa ficillada ku xiran soo celinta la rabo - iyo tababbar ballaaran, oo awood u siinaya wakiillada loo tababaray kaydin badan oo diiwaansan ka dibna si toos ah khadka tooska ah loogu hagaajiyay. Filo kobaca daryeelka caafimaadka, wadista iskiis u madax bannaan, iyo talada halka ay si badbaado leh uga barato xogta jirta ay lama huraan tahay, oo ay weheliso agabka wanaagsan ee qiimaynta siyaasadda qad la'aanta si siyaasadaha la diro loo aamino ka hor intaanay waligood ku dhaqmin adduunka dhabta ah.
Dhaqangelinta Adduunka-dhabta ah
Barashada siyaasadaha daawaynta kiliinikada ee diiwaanada caafimaadka elektaroonigga ah ee taariikhiga ah
Robots-yada lagu tababaro kaydka xog-ururinta ee waaweyn iyada oo aan lahayn sahaminta tooska ah ee khatarta ah
Hagaajinta talooyinka iyo hababka xayeysiinta ee diiwaanka isdhexgalka ee hore
Hagaajinta siyaasadaha go'aaminta wadista iskeed u madax bannaan ee xogta maraakiibta la ururiyay
Khatarta & Dariiqyada Ilaalada
Hagaajinta hal bartilmaameed waxay qarin kartaa daciifnimada nidaamka ballaaran.
Kaabayaasha dhaqaalaha iyo dayactirka inta badan waa la dhayalsadaa.
Nabadgelyada iyo daldaloolada u fiirsashada ayaa kori kara marka nidaamyadu noqdaan kuwo aad u adag.
Qorshe Hawleedka Dhaqangelinta
Qeex daahida, tayada, iyo bartilmaameedyada qiimaha ka hor inta aan la hirgelin.
Benchmark marka la eego culeyska dhabta ah iyo xaaladaha xogta.
La socodka qalabka khaladaadka, leexashada, iyo saamaynta isticmaalaha.
U diyaari dib-u-noqoshada iyo dariiqyada jawaab-celinta dhacdada ka hor inta aanad miisaan.
Sii wad Sahaminta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Offline Reinforcement Learning quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Hagaha xiga
Xoojinta Barashada Jawaab celinta Aadanaha
Su'aalaha soo noqnoqda
What is Offline Reinforcement Learning?
Xoojinta barashada khadka tooska ah waxay ka dhigtaa wakiilada kaliya xog go'an, oo hore loo soo ururiyay, iyada oo aan si toos ah ula macaamilayn deegaanka. Waa arrin sababtoo ah daryeelka caafimaadka, robotics-ka, iyo la-talinta, sahaminta tijaabinta iyo khaladku waa mid aad qaali u ah, gaabis ah, ama khatar ah.
Maxaa qeexaya barashada xoojinta offline?
Offline RL waxa ay gabi ahaanba ka bartaa siyaasada xogta hore loo ururiyay waligeedna lama dhexgalin deegaanka inta lagu jiro tababarka.
Waa maxay caqabada dhexe ee farsamada ee RL offline?
Hababka qiimuhu waxay si xad dhaaf ah u qiimeeyaan falalka ka maqan kaydka xogta, oo aanay jirin deegaan lagu saxo khaladaadkan siyaasaddu waxay raacdaa abaal-marinno dhalanteed ah.
Waa maxay sababta RL offline ugu soo jiidanayso codsiyada daryeelka caafimaadka?
Baadhista tijaabinta-iyo-qallada ee bukaanku waa khatar, markaa barashada siyaasadaha daawaynta ee diiwaannada taariikhiga ah waxay ka fogaanaysaa inay dadka khatar galiyaan.
Sidee buu Conservative-ka Q-Learning (CQL) ula dagaallamo qiimaynta?
CQL waxay ku darsataa ganaax hoos u dhigaya Q-qiyamka ficilada aan ku jirin xogta iyadoo la ilaalinayo ficilada xogta sare, taasoo keenaysa muxaafid hoose oo ku xiran qiimaha.
Sidee ayuu Transformer-ku u habeeyaa khadka tooska ah ee RL?
Transformer-ka Go'aanku wuxuu ula dhaqmaa raad-raacyada sida isku xigxiga wuxuuna abuuraa ficillo shuruud ku ah soo noqoshada-ku-noqoshada yoolka, ka-hortagga tuurista sida saadaalinta isku xigxiga ee autoregressive.