Gids-gekoppelde quiz · Moeilijk Niveau
Geneste kruisvalidatiequiz
Controleer de binnen- en buitenvouwrollen, voorverwerking van lekkage- en fit-count-berekeningen in een praktische geneste kruisvalidatieworkflow.
Vraag 1 van 8
Binnen één buitenste split, welke data mag de innerlijke hyperparameter‑zoekopdracht gebruiken?
Bekijk elke vraag8 vragen
Antwoorden en uitleg verschijnen terwijl je de quiz doet.
- Binnen één buitenste split, welke data mag de innerlijke hyperparameter‑zoekopdracht gebruiken?
- All examples, including the outer test fold
- Only the outer training data
- Only the outer test labels
- The full dataset after fitting preprocessing globally
- Waarom kan het rapporteren van de beste innerlijke validatiescore de modelprestaties overschatten?
- Inner cross-validation evaluates every candidate on its own training rows
- Averaging across folds removes all uncertainty from candidate rankings
- The best inner score already includes an independent outer evaluation
- Choosing the best setting also selects favorable variation in validation scores
- Vijf buitenste folds, drie innerlijke folds en tien kandidaat‑instellingen vereisen hoeveel innerlijke kandidaat‑fits in het voorbeeld van de gids?
- 150
- 18
- 50
- 30
- Een scaler wordt op de volledige dataset getraind voordat de geneste kruisvalidatie begint. Welk probleem blijft er nog bestaan?
- Using more outer folds automatically removes preprocessing leakage
- Unsupervised preprocessing cannot use information relevant to evaluation
- Preprocessing has already accessed held-out information
- A scaler can safely see test inputs whenever it does not see test labels
- Verschillende buitenste vouwen kiezen verschillende hyperparameters. Hoe moet dit worden geïnterpreteerd?
- It proves the cross-validation code is broken
- It can occur because each selection step sees different training data
- It means only the highest-scoring outer model is valid
- It requires replacing outer evaluation with training accuracy
- A dataset contains many rows per customer, and deployment targets unseen customers. Which design addresses that dependence?
- Shuffle all rows separately in the outer loop only
- Group customers only after evaluation is complete
- Fit the feature selector globally before splitting
- Keep customer groups separated in both inner and outer splits
- After evaluating a fixed nested procedure, how does the guide recommend obtaining a final model?
- Run the selection procedure on development data and fit the chosen configuration
- Deploy the outer-fold model with the highest observed test score
- Choose the configuration from the single best inner-fold result
- Choose final settings by comparing candidates on the reserved test set
- Why is the spread of outer-fold scores not automatically a confidence interval?
- Each outer score is an independent measurement from an unrelated training set
- The raw standard deviation of fold scores is itself a confidence interval
- The fitted models share much of their training data
- Averaging fold scores removes all sampling uncertainty