What does tokens per solved task mean?
Tokens per solved task is every token a model reads and writes to finish one task, counted across all its turns and tool calls. Bandicot shows input, cached and output tokens on every turn, and its engine is measured this way on a fixed set of tasks before and after each change.
How it works in Bandicot
- 01Read the meter
The window's title strip shows tokens in, the share that was cached and tokens out.
- 02Compare runs
Every turn records what it spent, so two ways of doing a task can be compared.
- 03Judge by the task
A cheap turn that fails costs more than a dear one that finishes; count the whole task.
Words you will see on screen
- in
- cached
- out
People also ask it as
- How to see how many tokens an AI agent used
- AI agent cost per task
- Track token usage per chat turn on Mac
- Why is my AI agent so expensive