Gids-gekoppelde quiz · Moeilijk Niveau

Geneste kruisvalidatiequiz

Controleer de binnen- en buitenvouwrollen, voorverwerking van lekkage- en fit-count-berekeningen in een praktische geneste kruisvalidatieworkflow.

Gerelateerde gidspadenGeneste kruisvalidatie
Vraag 1 van 8

Binnen één buitenste split, welke data mag de innerlijke hyperparameter‑zoekopdracht gebruiken?

Bekijk elke vraag8 vragen

Antwoorden en uitleg verschijnen terwijl je de quiz doet.

  1. Binnen één buitenste split, welke data mag de innerlijke hyperparameter‑zoekopdracht gebruiken?
    • All examples, including the outer test fold
    • Only the outer training data
    • Only the outer test labels
    • The full dataset after fitting preprocessing globally
  2. Waarom kan het rapporteren van de beste innerlijke validatiescore de modelprestaties overschatten?
    • Inner cross-validation evaluates every candidate on its own training rows
    • Averaging across folds removes all uncertainty from candidate rankings
    • The best inner score already includes an independent outer evaluation
    • Choosing the best setting also selects favorable variation in validation scores
  3. Vijf buitenste folds, drie innerlijke folds en tien kandidaat‑instellingen vereisen hoeveel innerlijke kandidaat‑fits in het voorbeeld van de gids?
    • 150
    • 18
    • 50
    • 30
  4. Een scaler wordt op de volledige dataset getraind voordat de geneste kruisvalidatie begint. Welk probleem blijft er nog bestaan?
    • Using more outer folds automatically removes preprocessing leakage
    • Unsupervised preprocessing cannot use information relevant to evaluation
    • Preprocessing has already accessed held-out information
    • A scaler can safely see test inputs whenever it does not see test labels
  5. Verschillende buitenste vouwen kiezen verschillende hyperparameters. Hoe moet dit worden geïnterpreteerd?
    • It proves the cross-validation code is broken
    • It can occur because each selection step sees different training data
    • It means only the highest-scoring outer model is valid
    • It requires replacing outer evaluation with training accuracy
  6. A dataset contains many rows per customer, and deployment targets unseen customers. Which design addresses that dependence?
    • Shuffle all rows separately in the outer loop only
    • Group customers only after evaluation is complete
    • Fit the feature selector globally before splitting
    • Keep customer groups separated in both inner and outer splits
  7. After evaluating a fixed nested procedure, how does the guide recommend obtaining a final model?
    • Run the selection procedure on development data and fit the chosen configuration
    • Deploy the outer-fold model with the highest observed test score
    • Choose the configuration from the single best inner-fold result
    • Choose final settings by comparing candidates on the reserved test set
  8. Why is the spread of outer-fold scores not automatically a confidence interval?
    • Each outer score is an independent measurement from an unrelated training set
    • The raw standard deviation of fold scores is itself a confidence interval
    • The fitted models share much of their training data
    • Averaging fold scores removes all sampling uncertainty