Викторина, связанная с руководством · Средний Уровень
Викторина по минимизации эмпирического риска
Охватывает эмпирический и истинный риск, предположения о выборке, переоснащение, регуляризованные цели и почему важна отсроченная оценка.
Вопрос 1 из 8
What does empirical risk minimization actually minimize during training?
Предварительный просмотр каждого вопроса8 вопросы
Ответы и пояснения появляются по мере прохождения теста.
- What does empirical risk minimization actually minimize during training?
- The true risk over the entire data distribution
- Количество параметров в модели
- The average loss computed over a finite training sample
- The variance of the model's predictions
- Why can't a model directly minimize true risk instead of empirical risk?
- True risk is defined over the entire, usually infinite and unknown data distribution, which is inaccessible
- True risk is always higher so it's not worth minimizing
- True risk cannot be expressed mathematically
- Models are only capable of computing averages
- As an IID sample grows, what classical result helps explain why its average loss can estimate expected loss for a fixed model?
- Теорема Байеса
- The central limit theorem alone
- метод Ньютона
- The law of large numbers along with uniform convergence bounds from VC theory
- During training, what does overfitting look like when empirical and true risk are compared?
- When both empirical and true risk are equally high
- When empirical risk is driven low, even to zero, while true risk remains high
- When a model refuses to train
- When the hypothesis class is too small to fit any data
- What role does regularization play in the ERM objective?
- It removes the loss function entirely
- It guarantees zero true risk
- It adds a penalty term that trades slightly higher empirical risk for a hypothesis less prone to overfitting
- It only affects the learning rate
- Which of the following is explicitly given as an implementation of the general ERM principle?
- Only neural networks
- Only linear regression
- None of these; ERM is a distinct algorithm separate from these
- Linear regression, logistic regression, SVMs, and neural network training, each with different loss functions
- What does structural risk minimization add beyond basic regularized ERM?
- It explicitly balances empirical risk against a measure of hypothesis-class complexity rather than fixing the class size
- Это устраняет необходимость в функции потерь
- It guarantees the model will never overfit
- It only applies to linear models
- In the ERM formula averaging L(h(x_i), y_i) over n examples, what does n represent?
- Количество функций в модели
- Количество обучающих примеров
- The number of hypothesis classes considered
- Скорость обучения