bandicot

Faster turns, and a tool search three times quicker

Each agent turn finishes sooner and uses less of your Mac, and a program finds the tools it needs in a third of the time.

Engine

Every answer from the model used to wait up to 25 ms before the next step started. It now continues the moment the answer arrives, so a turn on our test bench takes about a quarter of the time it did and half the processor.

A long session no longer re-reads its whole history at every turn, which takes another third off the processor work in long sessions.

A program that looks for a tool by name gets its answer about three times faster, with exactly the same results as before.

What changed for you

When a program prints a lot, its final answer still reaches the agent instead of being cut off. And when a connection fails, the message now says so, instead of claiming a time limit ran out.