Offline Kwongera imbaraga
Offline gushimangira imyigire itoza abakozi gusa uhereye kuri dataset ihamye, yakusanyirijwe hamwe, nta mikoranire nzima n'ibidukikije.
Incamake
It matters because in healthcare, robotics, and recommendation, exploring by trial and error is too costly, slow, or dangerous.
Kwibira cyane
Offline RL (nanone yitwa batch RL) yiga politiki uhereye kumurongo uhamye wubunararibonye - leta, ibikorwa, ibihembo, hamwe na leta zikurikira - utarigeze ukora ibikorwa bishya mubidukikije mugihe cy'amahugurwa. Ibi bifungura radiyo igenamigambi aho ubushakashatsi bwo kuri interineti butagira umutekano cyangwa buhenze, nko kwiga politiki yo kuvura uhereye ku mateka y’abarwayi cyangwa ubuhanga bwa robo buva mu makuru yinjiye. Gusobanura ingorane ni ugusaranganya guhinduranya hamwe n'ikosa rya extrapolation: uburyo busanzwe bushingiye ku gaciro burenze agaciro agaciro k'ibikorwa bitagabanijwe dataset itigeze igerageza, kandi nta bidukikije byo gukosora ayo makosa, politiki ikurikirana ibihembo bitari byo. Algorithms zigezweho zirwanya ibi mukuguma hafi yamakuru, ukoresheje igereranya ryagaciro (CQL), imbogamizi za politiki (BCQ, BEAR), cyangwa uburemere butagaragara (IQL).
Ubushishozi
Uburyo bwibanze bwo kunanirwa ni ugusuzugura ibikorwa bitagabanijwe: Q-imikorere yize igenera indangagaciro zo guhitamo ibikorwa bidahari kuri dataset, kandi bootstrapping ikwirakwiza aya makosa nta bitekerezo bifatika byo kubikosora. Kwiga Q-Kwiga (CQL) bikemura iki kibazo wongeyeho ibisanzwe bisunika Q-indangagaciro kubikorwa bitagaragara mugihe ukomeje ibikorwa-byamakuru hejuru, bigatanga imipaka iri munsi yagaciro nyako na politiki irinda amahitamo adashyigikiwe, arenze urugero.
Ingaruka z'Ingamba
Igiciro na bije
Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
Ibyemezo bisobanutse
Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
Kugenzura ubuziranenge
Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.
Kazoza ka Offline Gukomeza Kwiga
Offline RL irahuza hamwe no kwerekana icyitegererezo - inzira nka Decision Transformer yongeye kubisubiramo nko guhanura ibikorwa biteganijwe kugaruka - kandi hamwe no kwitegura kwinshi, gushoboza abakozi bahuguwe kumibare minini yinjiye hanyuma bagahitamo neza kumurongo. Tegereza iterambere mu buvuzi, gutwara ibinyabiziga byigenga, no gutanga inama aho kwigira neza ku makuru ariho ari ngombwa, hamwe n’ibikoresho byiza byo gusuzuma politiki ya interineti bityo politiki yoherejwe irashobora kwizerwa mbere yuko ikora ku isi.
Gushyira mu bikorwa Isi
Kwiga politiki yo kuvura ivuye mumateka yubuzima bwa elegitoroniki
Imyitozo ya robo kuva datasets nini zinjiye zidafite ubushakashatsi bubi
Kunonosora ibyifuzo hamwe na sisitemu yo gutanga amasoko kuva kera
Kunoza politiki yigenga-yo gutwara ibinyabiziga bivuye mu makuru yakusanyijwe
Ingaruka & Kurinda
Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.
Igishushanyo mbonera
Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
Tegura inzira yo gusubiza ibyabaye mbere yo gupima.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Offline Reinforcement Learning quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Gushimangira Kwiga Biturutse kubitekerezo byabantu
Ibibazo bikunze kubazwa
What is Offline Reinforcement Learning?
Offline gushimangira imyigire itoza abakozi gusa uhereye kuri dataset ihamye, yakusanyirijwe hamwe, nta mikoranire nzima n'ibidukikije. Nibyingenzi kuko mubuvuzi, robotike, hamwe nibyifuzo, gushakisha kubigeragezo no kwibeshya birahenze cyane, bitinda, cyangwa biteje akaga.
Niki gisobanura kwiga kumurongo (batch) gushimangira?
Offline RL yiga politiki rwose uhereye kumakuru yakusanyijwe kandi ntizigera ikorana nibidukikije mugihe cy'amahugurwa.
Ni ikihe kibazo nyamukuru cya tekiniki muri RL kumurongo?
Uburyo bw'agaciro busuzugura ibikorwa bidahari kuri dataset, kandi nta bidukikije byo gukosora ayo makosa politiki ikurikirana ibihembo bitari byo.
Ni ukubera iki umurongo wa interineti ushimishije kubisaba ubuvuzi?
Ubushakashatsi-bwo-kwibeshya ku barwayi ni akaga, bityo kwiga politiki yo kuvura uhereye ku mateka birinda gushyira abantu mu kaga.
Nigute Conservative Q-Kwiga (CQL) irwanya gukabya?
CQL yongeyeho igihano kigabanya Q-indangagaciro kubikorwa bitari mu makuru mugihe ukomeje ibikorwa-byamakuru hejuru, bitanga ibitekerezo byigenga bigabanya agaciro.
Nigute uhindura ibyemezo ahindura umurongo wa radiyo?
Guhindura Icyemezo gifata inzira nkurutonde kandi ikabyara ibikorwa bisabwa ku ntego yo kugaruka-gusubira, kugenzura nkigikorwa cya autoregressive.