Local models
A pinned catalog of small chat models that run on your Mac, with a fit check before every download.
Available now. A current user-facing path exists within the stated scope.
A catalog with a fit check
A pinned catalog of 8 small chat models, from Gemma 3 270M to SmolLM3 3B, each checked against the Mac's GPU memory budget before download. The catalog is pinned, so each entry is a known model rather than a link.
Models run on Apple Silicon Macs with llama.cpp.
What small models are for
Apple Silicon Macs; each model needs about 1.25 to 4 GB of memory. Small models are useful for private, light work, not a match for frontier models.
Use a local model for work that should stay on your Mac, and a hosted provider when the task needs more capability.
Mix local and hosted
A local model is one provider among others. Switch per session without rebuilding the project: sessions, approvals, versions and the token record carry over.