13:21
Tokens Should Have Jobs — Katelyn Lesse & Angela Jiang, Anthropic
Katelyn Lesse and Angela Jiang propose allocating agent tokens to distinct jobs: execution, advising, grading, and reflection into memory. They report financial-analysis experiments in which these strategies produce different results under a fixed token budget. They argue that strategy choice should reflect the cost of obtaining a fully correct answer and…
Katelyn Lesse · Angela Jiang