가이드 연계 퀴즈 · 중간 레벨

조건부 계산 퀴즈의 게이팅 및 라우팅

입력 종속 전문가 라우팅, 활성 계산, 토큰 부하 분산, 전문가 용량, 오버플로 및 총 계산과 실행 계산을 테스트합니다.

관련 가이드 경로조건부 계산의 게이팅 및 라우팅
질문 1 의 8

What is conditional computation?

모든 질문 미리보기8 질문

퀴즈를 풀면 정답과 설명이 나타납니다.

  1. What is conditional computation?
    • The network selects which submodules to activate based on the input
    • Every network layer runs identically for every input
    • The model selects its training dataset after inference
    • A human routes every token manually
  2. In a mixture-of-experts layer, what does the router do?
    • Trains the ground-truth labels
    • Combines all parameters into one dense layer
    • Scores experts and sends an input or token to selected experts
    • Removes the expert outputs
  3. What is active parameter count?
    • The number of parameters stored on disk
    • The parameters used for a particular input, which can be fewer than total model parameters
    • The number of experts in the model
    • The count of training examples per expert
  4. Why can routing be computationally efficient?
    • The router removes all dense computations
    • Experts do not contain parameters
    • The model skips every output layer
    • Only selected experts process a given input rather than every expert
  5. What is expert load imbalance?
    • Every expert receives exactly the same number of tokens
    • The router has no parameters
    • Some experts receive many tokens while others receive few
    • Tokens are sorted by output length
  6. Why add a load-balancing objective?
    • To encourage a more even distribution of tokens among experts
    • To increase the total parameter count
    • To force every token through all experts
    • To make routing independent of input
  7. What can happen when an expert reaches a capacity limit?
    • The model automatically doubles the expert’s weights
    • Every other expert is disabled
    • The token becomes a training label
    • Tokens may be dropped or routed according to the system’s overflow policy
  8. Does a sparse model’s total parameter count equal its per-token compute?
    • Yes, every stored parameter runs on each token
    • No; only selected experts are active for a particular input
    • No; sparse models contain no parameters
    • Yes, if a router is used