引導式測驗 · 中等 等級
訓練、驗證和測試拆分最佳實踐測驗
選擇反映部署設定的資料分割區,防止跨組和跨時間的洩漏,並保留測試資料以供最終評估。
問題 1 的 8
How are validation data typically used during model development?
預覽每個問題8 問題
當您參加測驗時,就會出現答案和解釋。
- How are validation data typically used during model development?
- To fit the final model and report its unbiased score
- To replace training data
- To guarantee future performance
- To compare choices such as hyperparameters without using the final test set
- What happens if a test set is repeatedly used to choose model variants?
- It becomes more independent
- It becomes part of model selection and the reported test estimate can become optimistic
- It guarantees unbiased accuracy
- It prevents overfitting
- When is a group-aware split appropriate?
- Whenever data are already sorted alphabetically
- Only when every label is unique
- When related samples such as the same person or site must not appear across partitions
- When the model has no validation set
- Why use a time-based split for a future forecasting task?
- It trains on earlier observations and tests on later ones, matching temporal prediction
- It always increases sample size
- It randomly balances all dates
- It removes seasonality
- Where should a scaler be fitted during cross-validation?
- On all rows before splitting
- 僅在測試集上
- On a separate external dataset after evaluation
- On the training fold, then applied to its held-out fold
- How should augmented versions of one original image be split?
- Place every augmented version in the test set
- Split them independently at random
- Keep them in the same partition as their source image
- Delete the original and split the copies
- Is a 70/15/15 split universally best?
- Yes, for every data science task
- No; partition sizes and method depend on data volume and evaluation goal
- Yes, if a model is neural
- No, because splits are never useful
- What does a held-out test score estimate?
- Performance for the population and conditions represented by that test set
- Performance for every future population with certainty
- The probability that the model is fair
- 訓練速度