bandicot

An S1 tab in AI Gateway, with the size a chat compacts at

System One has its own tab in AI Gateway, and you choose the size every chat compacts at, with a bar showing where the open chat stands.

Product

AI Gateway has a new S1 tab between Models and Agent. It holds System One: the decision model, what it keeps when a chat compacts, and the indexing it does between turns. The Agent tab keeps the tools and what the agent may reach.

Automatic compaction now has a setting of its own. Leave it on Automatic and each chat compacts where its model works best, or pick a size from 32k to 500k tokens. Sizes larger than the open chat's model can hold are not offered.

A bar under the setting shows where the open chat will compact and what share of its window that is.