What Effort Level Should I Choose? On the Economics of Reasoning Effort in LLM Agents
Choosing reasoning effort in LLM agents is challenging: higher effort can increase accuracy but also cost and sometimes lose easy successes. Dynamic effort allocation offers better cost-effectiveness.