T is for tokenization. AI models read and write text in small pieces called tokens, and providers bill by the token, for what the model reads and for what it writes. The conversations we are having with prospects and customers alike include discussions of being surprised by AI bills and the lack of awareness about token controls.
This sentiment tends to show up in a finance review or during venting sessions about AI spend, a few weeks after a team connected its agents to a dozen new tools and moved on to the next project. The delegating user innocently prompted agents to do tasks. Some agents looped when they shouldn't have, and the person who delegated the task had no idea it would burn enough tokens to make a bonfire.
Where AI budgets go to die
On each turn, an agent sends the model much more than the task at hand: its instructions, the conversation so far and a description of each tool it could call.
If an MCP (Model Context Protocol) server has 100 tools, the agent sends all 100 descriptions every turn, even when it uses one or none. You pay for every one of those tokens, on every turn, so the bill grows with the number of tools you connect rather than with the work the agent does.
Now add more agents and the people using them. Each model has its own price per token. The invoice only has one total bill amount.
How to see which agent and which request drove your AI spend
To set a sensible limit, you need to know what each team and each person actually uses. Provider dashboards group usage by model and total, so that detail is missing. Agent Trail records who started each agent and what it did, which gives you the numbers to size those limits.
How spend connects to access decisions
When people talk about AI tokens, they may mean two different things. Model tokens are the units an AI provider bills for, and they drive your spend. Access tokens are issued once an agent has signed in, and a service uses them to see who the agent is and who it acts for. Whether that agent can make a particular call is decided separately, with real-time authorization on each request. An agent's loop alternates between the two: a model call decides what to do next, a tool call does it, and the result feeds the next model call.
When a cost spike hits, you need to know who caused it. If every model call and every tool call carries the identity of the agent that made it and the employee it acts for, the spike traces straight to that person, that team and those tool calls. Then you can decide who gets which limits.
See who drives AI spend and limit it with Agent Authority
Agent Authority has visibility into both channels an agent spends through: the requests it sends to model providers and the tool calls it makes. Controlling cost takes both in place. LLM Authority covers the model side and attributes spend to the person, team and agent behind it. MCP Authority covers the tool side, where each tool call adds another model turn to the bill.
- Spend by team, person and model, plus seat utilization (LLM Authority). Usage from coding agents such as Claude Code, Codex, GitHub Copilot and Gemini CLI is attributed to the person and team behind it, so "who spent it" gets an answer with a name attached.
- Budgets and spend alerts (LLM Authority). Set model budgets by team or by person, and get an alert when someone starts using a new model or spend jumps overnight.
- Rate limits on tool calls (MCP Authority). Set a call budget per user, agent instance, MCP server or tool, so a looping agent hits a limit before it runs up the bill. Log-only mode shows what a limit would have stopped before it stops anything, which makes the first week of enforcement much quieter.
- One resource per agent. The connect dialog can give an agent a single resource, such as HubSpot, so it loads fewer tools. That also shrinks the tool tax.
- Webhooks, now available to all orgs. Audit events reach Slack, Microsoft Teams, PagerDuty or your SIEM as they happen, so a refused or throttled agent reaches the team channel before it reaches the quarterly review.
Beyond cost, Agent Authority makes a real-time authorization decision on each tool call, for each agent and the person it acts for, so the same record that explains the bill also shows what each agent was allowed to do.
Helpful questions to ponder before your next AI bill
- Which agents made the most model calls last month, and who owns them?
- Is your most expensive model making small yes-or-no decisions that a cheaper one could handle?
- What stops an agent that loops overnight?
- Can you test a limit in log-only mode before you turn it on?
Best of luck burning fewer tokens.
FAQ
What is a token in AI?
A token is a small piece of text, often part of a word, that an AI model reads or writes. Model providers bill by the token for both, so an agent that resends long instructions and tool descriptions on each turn pays for that text each time. LLM Authority shows token spend by team, person and model.
What is MCP?
MCP, the Model Context Protocol, is an open standard that lets AI agents connect to tools and data through MCP servers. Each server describes its tools to the agent, and those descriptions become part of what the model reads on each turn. For how a gateway puts your MCP servers behind one connection, see What is an MCP gateway?
What is a model provider?
A model provider is the company that hosts an AI model and bills for its use, such as OpenAI, Anthropic or Google. Your agents send requests to the provider's API, and the provider charges by the token. LLM Authority in Agent Authority covers models from OpenAI, Anthropic, Google Gemini, Azure OpenAI and Amazon Bedrock.
How do you control AI agent costs?
Controlling AI agent costs takes visibility into both channels an agent spends through: model calls and tool calls. In Agent Authority, LLM Authority attributes model spend to the person, team and agent behind it, and rate limits in MCP Authority cap tool calls, with a log-only mode to test a limit before you enforce it.
Can a spike in AI spend point to a security problem?
Yes. A stolen AI provider API key turns into charges on your account, so an unexplained spike can be an early sign of compromise. Your AI bill is a security signal covers how to baseline agent spend so a spike stands out.