Ikibazo gihuza ibibazo · Hagati Urwego
Imikorere ibangikanye Guhamagara Ikibazo
Gerageza uburyo parallel igikoresho cyo guhamagarwa gitangwa kandi gihujwe nindangamuntu, mugihe gukina ari umutekano ugereranije nuwishingiye, nuburyo bwo gukemura ibibazo byananiranye nigihe cyigihe.
Ikibazo 1 Bya 8
In a parallel function call, what does the model return in one response?
Reba buri kibazo8 ibibazo
Ibisubizo nibisobanuro bigaragara mugihe ufata ikibazo.
- In a parallel function call, what does the model return in one response?
- The model trains on several datasets at once
- The model requests several tool calls in a single response
- Two models answer the same question
- Tools call the model repeatedly
- Who actually executes the tools concurrently?
- The language model itself
- The application or harness
- The user's browser only
- The model provider's billing system
- Which pair of calls should NOT be issued in parallel?
- Weather lookups for three different cities
- Searching two unrelated topics
- Creating a folder and then writing a file into that folder
- Fetching orders and support tickets for one customer
- How should results be matched to their tool calls?
- By the order they finish
- By their position in the list
- By the call identifier
- By the length of each result
- Two of five parallel searches time out. What is the best response?
- Discard all five results
- Return the three successes and two clear errors so the model can retry the failures
- Crash the agent
- Pretend the failed searches returned empty results without saying so
- Why use Promise.allSettled or asyncio.gather with return_exceptions?
- So one failed call does not discard the other results
- To make calls run one at a time
- To encrypt tool outputs
- To reduce the number of tools
- Roughly how long does a parallel batch of independent calls take?
- The sum of all call durations
- About the duration of the slowest call
- Zero time
- Always exactly one second
- What helps prevent retries of side-effecting tools from duplicating actions?
- Idempotency keys
- Longer tool descriptions
- Higher model temperature
- Removing call identifiers