Bramki walidacyjne modelu przed quizem dotyczącym wdrożenia

Odpowiedzi i wyjaśnienia pojawiają się w miarę rozwiązywania quizu.

1. Po co definiować progi bramki modelu przed przejrzeniem wyników kandydatów?
   • It reduces the risk of selecting criteria after seeing which ones the model passes
   • It allows acceptance thresholds to be changed after reviewing results
   • It makes small subgroup estimates precise by definition
   • It removes the need to compare against any baseline
2. Metryka podgrupy opiera się na bardzo niewielu przykładach. Jak brama powinna go traktować?
   • As a certain pass if its point estimate is high
   • As uncertain or inconclusive under a predefined sample rule
   • As proof the subgroup does not matter
   • As equal evidence to a large sample automatically
3. Co dodaje wdrożenie Canary po sprawdzeniu w trybie offline?
   • A replacement for model quality metrics
   • Proof that offline data were representative
   • A limited live exposure with monitoring and rollback criteria
   • A guarantee no user will be affected
4. Która kontrola jest techniczną twardą blokadą, a nie statystycznym progiem jakości?
   • The baseline has a slightly lower metric
   • The confidence interval is close to a target
   • A subgroup estimate is noisy
   • The artifact signature fails verification
5. Po co porównywać kandydata z wdrożonym modelem i wartością bazową?
   • To guarantee better performance on every future case
   • To determine whether it adds value or causes meaningful regression
   • To avoid defining evaluation data
   • To replace all slice checks
6. What should a gate report retain for reproducibility?
   • The deployment password
   • Only a green status icon
   • Data version, candidate digest, metric definitions and thresholds
   • A model name without build identity
7. What does passing a predeployment gate not certify?
   • A result on the reported evaluation data
   • Compliance with the specified release criteria
   • The exact artifact evaluated when its digest is recorded
   • Universal safety across all contexts and future populations
8. Why verify that the deployed artifact matches the evaluated candidate?
   • Otherwise the release may run different bytes from those that passed the gate
   • It changes the validation threshold
   • It ensures fairness automatically
   • It increases the model's sample size