Guide-linked quiz · Medium Level

Learning to Rank for Product Search Quiz

Test product-search LTR: pointwise, pairwise, and listwise learning; relevance labels; NDCG; click bias; hard constraints; and online guardrails.

Question 1 of 8

What does an LTR model produce for a query?

Preview every question8 questions

Answers and explanations appear as you take the quiz.

  1. What does an LTR model produce for a query?
    • A single product category for each catalog item
    • An ordered list of candidate products based on learned relevance signals
    • A new product description
    • A legal guarantee that the first item is best
  2. How does pairwise LTR frame training examples?
    • As a single label for the whole catalog
    • As an image segmentation mask
    • As a list of all possible product categories
    • As preferences indicating which of two items should rank higher
  3. Why can click data be biased as relevance labels?
    • Clicks depend on exposure and position as well as product relevance
    • Every product receives equal exposure
    • A click measures price accuracy only
    • Click logs contain no user behavior
  4. A shopper selects size medium. How should a ranker handle items available only in large?
    • Keep them if their margin is high
    • Lower their score but leave them as equivalent options
    • Filter them out before ranking results for that constraint
    • Let popularity override size
  5. Which metric discounts relevance lower in the search-result list?
    • BLEU
    • NDCG
    • Word error rate
    • Mean pixel error
  6. Why should the test split hold out queries or respect time?
    • To reduce leakage from near-duplicate queries or future interactions into training
    • To make the model score every item identically
    • To avoid measuring relevance
    • To increase the number of training labels
  7. What can a reranker not do if a relevant product was never retrieved?
    • Use a price feature
    • Reorder candidates
    • Apply a relevance score
    • Promote a candidate that is absent from the candidate set
  8. Which safeguard helps reveal the effect of a business feature such as margin?
    • Add the feature without logging it
    • Optimize margin alone
    • Run an ablation or controlled comparison and monitor relevance and exposure guardrails
    • Remove all human judgments

Keep testing yourself

More quizzes picked for your level.

View all quizzes