Kvíz spojený s průvodcem · Těžko úroveň
Automatická optimalizace výzvy a kvíz DSPy
Otestujte si, co víte o bodování výzev oproti metrice, jak APE a OPRO vyhledávají pokyny a jak fungují podpisy a optimalizátory DSPy.
Otázka 1 z 8
What must you supply for automatic prompt optimization to work?
Náhled každé otázky8 otázky
Odpovědi a vysvětlení se zobrazují, jak budete v kvízu.
- What must you supply for automatic prompt optimization to work?
- Only a longer prompt
- A task, a set of example inputs and a metric to score outputs
- A fine-tuned model and a GPU cluster
- A list of banned words
- In OPRO, what plays the role of the optimizer?
- A gradient descent step on the model's weights
- A human prompt engineer
- A random search with no feedback
- An LLM given a meta-prompt listing earlier instructions and their scores
- What does OPRO's "Take a deep breath and work on this problem step-by-step" result illustrate?
- Optimized wording can be unintuitive and specific to a model
- Breathing instructions work for every model
- Math tasks do not need prompts
- OPRO only works for writing tasks
- What is a DSPy signature?
- A cryptographic key for the API
- A model's version number
- A declaration of a step's inputs and outputs, such as "question, context -> answer"
- A watermark on generated text
- How does DSPy's BootstrapFewShot get its demonstrations?
- It downloads examples from the internet
- It runs the program on training inputs and keeps the traces where the metric passes
- It asks the user to label every intermediate step
- It uses the longest available examples
- Why should you keep a separate held-out set when optimizing prompts?
- To reduce the size of the prompt
- To make the optimizer run faster
- It is required by the API
- To check whether the optimized prompt has overfit the training examples
- What were DSPy's optimizers called earlier?
- Teleprompters
- Compilers
- Tokenizers
- Retrievers
- What approach did APE (Automatic Prompt Engineer) take?
- It fine-tuned model weights on instructions
- It hand-wrote prompts from expert interviews
- It had a model propose instructions from input-output examples and kept the highest-scoring ones
- It removed instructions entirely