Paper proposes online method for choosing among LLM APIs under cost and feedback limits
A revised arXiv paper proposes a learning framework for deciding which LLM APIs to query and which generated answer to deploy when API costs vary and only the selected answer’s downstream reward is observed.