AI Agents Now Have a 'Spending Limit' to Protect Your Wallet
What if AI could accidentally drain your bank account? New tech puts a brake on it.
Fleets of LLM agents can cause irreversible harm—moving money, deleting data, or disclosing information—and current per-effect checks let individually authorized agents collectively overdraw their principal's risk while every local gate stays correct. The proposed “irreversibility budget” is a cumulative account of residual value-at-risk, maintained by a trusted runtime for each principal across agents, workflows, and tenants; the runtime charges each effect and denies the marginal one when the aggregate would overdraw. In a controlled study, per-effect gates admitted fleet-level overdraws up to 48 times the tenant's risk limit, while the budget held every correctly charged run within that limit—though getting the price right, with heterogeneous and adversarially declared effects, remains the key open problem.
- New tech limits total risk from AI agents (like shared bank account tracking), not just individual actions
- In tests, it prevented losses 48 times higher than older safety checks
- Biggest challenge: figuring out the right 'fee' for each AI mistake
Why It Matters
Keeps AI assistants from accidentally costing you thousands by acting without limits