quiz bu lëkkale ak tegtal · Diggante Niveau

Empirical Risk Minimization Quiz

Covers empirical versus true risk, sampling assumptions, overfitting, regularized objectives, and why held-out evaluation matters.

Yooni njiit yu jëm ciEmpirical Risk Minimization
Laaj 1 de 8

What does empirical risk minimization actually minimize during training?

Xoolaatal laaj bu nekk8 laaj

Sooy def quiz bi, tontu yi ak leeral yi dañuy feeñ.

  1. What does empirical risk minimization actually minimize during training?
    • The true risk over the entire data distribution
    • Limu parametre yi ci model bi
    • The average loss computed over a finite training sample
    • The variance of the model's predictions
  2. Why can't a model directly minimize true risk instead of empirical risk?
    • True risk is defined over the entire, usually infinite and unknown data distribution, which is inaccessible
    • True risk is always higher so it's not worth minimizing
    • True risk cannot be expressed mathematically
    • Models are only capable of computing averages
  3. As an IID sample grows, what classical result helps explain why its average loss can estimate expected loss for a fixed model?
    • Théorème de Bayes
    • The central limit theorem alone
    • Xeetu Newton
    • The law of large numbers along with uniform convergence bounds from VC theory
  4. During training, what does overfitting look like when empirical and true risk are compared?
    • When both empirical and true risk are equally high
    • When empirical risk is driven low, even to zero, while true risk remains high
    • When a model refuses to train
    • When the hypothesis class is too small to fit any data
  5. What role does regularization play in the ERM objective?
    • It removes the loss function entirely
    • It guarantees zero true risk
    • It adds a penalty term that trades slightly higher empirical risk for a hypothesis less prone to overfitting
    • It only affects the learning rate
  6. Which of the following is explicitly given as an implementation of the general ERM principle?
    • Only neural networks
    • Only linear regression
    • None of these; ERM is a distinct algorithm separate from these
    • Linear regression, logistic regression, SVMs, and neural network training, each with different loss functions
  7. What does structural risk minimization add beyond basic regularized ERM?
    • It explicitly balances empirical risk against a measure of hypothesis-class complexity rather than fixing the class size
    • Dina dindi soxla fonction perte
    • It guarantees the model will never overfit
    • It only applies to linear models
  8. In the ERM formula averaging L(h(x_i), y_i) over n examples, what does n represent?
    • The number of features in the model
    • Limu misaali tàggat yi
    • The number of hypothesis classes considered
    • Tolluwaayu jàng