Tagged “budgeting”
-
Context budgets for multi-turn conversations
History grows every turn until it crowds out everything else. Window policies, structured state extraction, and why agent loops overflow fastest.
-
What to cut first when context overflows
A cut order for when the budget doesn't balance: which component gives up space first, why history usually loses to retrieval, and how to degrade visibly.
-
The context window is a budget
Five things compete for every request's window, including the answer. How to write down the allocation, and why the output reservation is the row people forget.