Kedis ku xidhan hagaha · Adag Heerka
Xoojinta Kediska Barashada
Codso xoojinta fikradaha barashada sahaminta, soo celinta dhimista, abaal-marinaha daahsan, xaddidaadda jilitaanka iyo guul-darrooyinka ujeedooyinka abaal-marinta wakiillada.
Su'aal 1 ee 8
Robot bakhaar ayaa isku dayaya marin aan la aqoon si uu u ogaado in ay soo gaabinayso wakhtiga dhalmada iyo in kale. Waa kuwee dhinac ka ganacsiga sahaminta-ka faa'iidaysiga?
Horudhac su'aal kasta8 su'aalo
Jawaabaha iyo sharraxaadaha waxay soo baxayaan markaad qaadanayso kediska.
- Robot bakhaar ayaa isku dayaya marin aan la aqoon si uu u ogaado in ay soo gaabinayso wakhtiga dhalmada iyo in kale. Waa kuwee dhinac ka ganacsiga sahaminta-ka faa'iidaysiga?
- Exploration: testing an action whose value is uncertain
- Exploitation: choosing the currently highest-valued action
- Reward shaping: changing the objective after acting
- Imitation: copying a labeled action
- Abaalmarintu waxay timaadaa 2, 0 iyo 5 oo ah dhacdo saddex tallaabo ah. Iyada oo la raacayo qodobka dhimista 0.9, waa maxay ka soo noqoshada tallaabada koowaad?
- 7
- 6.05
- 6.5
- 4.05
- Naqshadeeye wuxuu kor u qaadaa gamma ujeedo soo noqosho la dhimay. Maxaa isbedelaya?
- The agent stops exploring
- The reward function becomes a probability distribution
- Future rewards count more relative to immediate rewards
- Past rewards are counted again
- Siyaasaddu waxay helaysaa abaal-marin keliya ka dib fal-celin dheer oo isdaba-joog ah. Waa kuwee su'aasha shaqo-dejinta ee soo baxda?
- Which input column has the longest name?
- Whether every action must receive the same reward
- Whether the final reward erases all prior observations
- Which earlier actions contributed to the eventual outcome
- Wakiilka ciyaaruhu wuxuu ku kasbaday dhibco isagoo ururinaya gunno aan waxyeello lahayn, ka dibna wuu iska indhatiraa howlgalka sababtoo ah gunnada way fududahay in lagu celiyo. Waa maxay guul-darradii tani muujinaysaa?
- Reward hacking: optimizing a proxy reward in a way that misses the intended goal
- Catastrophic forgetting
- Exploration collapse caused by gamma
- A transition model error
- A robot policy performs well in simulation. Why does it still need evaluation for its intended real deployment?
- Simulation success proves every real-world action is safe
- The simulator may rely on assumptions that fail outside it
- A simulation prevents all reward loopholes
- Real observations always match simulated ones
- A delivery task has delayed payoffs: a longer route now may prevent a costly delay later. Why does a one-step reward view miss the trade-off?
- It assumes every action is random
- It cannot represent observations
- It ignores consequences that arrive in later states
- It forces rewards to be positive
- A team changes the reward from “deliver safely” to “deliver quickly” and sees faster but riskier behavior. What should it conclude?
- A faster policy proves the original safety objective was met
- The discount factor alone guarantees safe behavior
- Human preferences are unnecessary once training converges
- Reward design affects behavior, so safety must be represented and evaluated explicitly