Kedis ku xidhan hagaha · Adag Heerka

Xoojinta Kediska Barashada

Codso xoojinta fikradaha barashada sahaminta, soo celinta dhimista, abaal-marinaha daahsan, xaddidaadda jilitaanka iyo guul-darrooyinka ujeedooyinka abaal-marinta wakiillada.

Wadooyinka haga ee la xidhiidhaXoojinta Waxbarashada
Su'aal 1 ee 8

Robot bakhaar ayaa isku dayaya marin aan la aqoon si uu u ogaado in ay soo gaabinayso wakhtiga dhalmada iyo in kale. Waa kuwee dhinac ka ganacsiga sahaminta-ka faa'iidaysiga?

Horudhac su'aal kasta8 su'aalo

Jawaabaha iyo sharraxaadaha waxay soo baxayaan markaad qaadanayso kediska.

  1. Robot bakhaar ayaa isku dayaya marin aan la aqoon si uu u ogaado in ay soo gaabinayso wakhtiga dhalmada iyo in kale. Waa kuwee dhinac ka ganacsiga sahaminta-ka faa'iidaysiga?
    • Exploration: testing an action whose value is uncertain
    • Exploitation: choosing the currently highest-valued action
    • Reward shaping: changing the objective after acting
    • Imitation: copying a labeled action
  2. Abaalmarintu waxay timaadaa 2, 0 iyo 5 oo ah dhacdo saddex tallaabo ah. Iyada oo la raacayo qodobka dhimista 0.9, waa maxay ka soo noqoshada tallaabada koowaad?
    • 7
    • 6.05
    • 6.5
    • 4.05
  3. Naqshadeeye wuxuu kor u qaadaa gamma ujeedo soo noqosho la dhimay. Maxaa isbedelaya?
    • The agent stops exploring
    • The reward function becomes a probability distribution
    • Future rewards count more relative to immediate rewards
    • Past rewards are counted again
  4. Siyaasaddu waxay helaysaa abaal-marin keliya ka dib fal-celin dheer oo isdaba-joog ah. Waa kuwee su'aasha shaqo-dejinta ee soo baxda?
    • Which input column has the longest name?
    • Whether every action must receive the same reward
    • Whether the final reward erases all prior observations
    • Which earlier actions contributed to the eventual outcome
  5. Wakiilka ciyaaruhu wuxuu ku kasbaday dhibco isagoo ururinaya gunno aan waxyeello lahayn, ka dibna wuu iska indhatiraa howlgalka sababtoo ah gunnada way fududahay in lagu celiyo. Waa maxay guul-darradii tani muujinaysaa?
    • Reward hacking: optimizing a proxy reward in a way that misses the intended goal
    • Catastrophic forgetting
    • Exploration collapse caused by gamma
    • A transition model error
  6. A robot policy performs well in simulation. Why does it still need evaluation for its intended real deployment?
    • Simulation success proves every real-world action is safe
    • The simulator may rely on assumptions that fail outside it
    • A simulation prevents all reward loopholes
    • Real observations always match simulated ones
  7. A delivery task has delayed payoffs: a longer route now may prevent a costly delay later. Why does a one-step reward view miss the trade-off?
    • It assumes every action is random
    • It cannot represent observations
    • It ignores consequences that arrive in later states
    • It forces rewards to be positive
  8. A team changes the reward from “deliver safely” to “deliver quickly” and sees faster but riskier behavior. What should it conclude?
    • A faster policy proves the original safety objective was met
    • The discount factor alone guarantees safe behavior
    • Human preferences are unnecessary once training converges
    • Reward design affects behavior, so safety must be represented and evaluated explicitly