Your LiteLLM budgets can fail open

LiteLLM has real spend tracking and budget features. That is not the same as finance-grade enforcement.

A green dashboard only means spend was recorded. It does not prove the budget gate fired.

The fail-open pattern

One public LiteLLM issue showed tag-budget enforcement being skipped when tags arrived through the x-litellm-tags header path, while body tags enforced correctly. Spend tracking still happened after the call. Enforcement did not.

That is the dangerous pattern: the system looks configured, but the limit fails open.

What to test

• Tag budgets through every documented tag path: body, metadata, and header.
• Budgets with and without a database connected.
• Customer/end-user IDs that look like sessions instead of real customers.
• Gateway-reported cost versus the actual provider invoice.

What we do in audits

We reconcile one real provider bill against gateway logs, then try to bypass the budget on purpose. If the budget can be bypassed, the report says so plainly.

Rule: never trust a budget you have not tried to break.

No Monkey Business installs and operates sovereign/local AI infrastructure. If this problem sounds familiar, book a 30-minute assessment.