AnyRouter Relay

Apple Foundation Model is Apple's on-device language model for chat. It runs on a Mac, so prompts stay on that machine. It takes text input and streams text output.

Gemma 3n E2B is Google's Gemma model that runs on a user's own paired phone, with no server-side compute. It takes text in and gives text out. It supports chat and streaming responses.

Mistral 7B Instruct v0.3 is an open-weight 7B instruct-tuned chat model from Mistral. It takes text in and returns text, with function calling and streaming.

PPLX Decider Flash v1.2 is Perplexity's on-device decision model, run by the Decider for Mac app on your own paired Mac. It returns a probability distribution over a fixed set of answers to typed questions, not chat text. Only your own Mac serves your requests.

Qwen 2.5 Coder 0.5B is Qwen's open-weight small text model tuned for code generation and fixing. It takes text in and returns text out, and runs on a user's own paired machine with Ollama.

Qwen 2.5 Coder 32B is Alibaba's open-weight specialized coding model with 32B parameters. It targets code generation, completion and debugging across 92 programming languages, with function calling and streaming.