Can an AI agent run on a local model on a Mac?
Yes. Bandicot offers a pinned catalog of 8 small chat models for Apple Silicon Macs, from Gemma 3 270M to SmolLM3 3B, each checked against the Mac's GPU memory budget before download. You can switch between them and hosted providers without rebuilding the project. Remote providers receive the prompts sent to them.
How it works in Bandicot
- 01Pick from the catalog
Each local model is checked against the Mac's memory before it downloads.
- 02Keep light work local
Small models suit private, light work; they are not a match for frontier models.
- 03Connect a provider for big jobs
Hosted providers bill you directly, and Bandicot shows every token either way.
Words you will see on screen
- on this Mac
People also ask it as
- Run an AI agent offline on a Mac
- Local LLM agent for macOS
- Private AI assistant on Apple Silicon
- Switch between local and hosted models in one app