# Ollama models over Relay

> Qwen 2.5 Coder 0.5B and Mistral 7B Instruct v0.3 join the catalog as on-device listings served by your own Ollama over AnyRouter Relay at $0, and the existing Qwen 2.5 Coder 32B gains the same Ollama hop.

- Date: 2026-11-09
- HTML: https://anyrouter.dev/blog/releases/2026-11-09

## Models

- `qwen/qwen2.5-coder-0.5b-instruct` (Qwen 2.5 Coder 0.5B) — Qwen2.5-Coder-0.5B-Instruct via your own Ollama, relayed at $0 / $0, 32K context, text in/out, code generation and fixing with function calling.
- `mistral/mistral-7b-instruct-v0.3` (Mistral 7B Instruct v0.3) — Mistral-7B-Instruct-v0.3 via your own Ollama, relayed at $0 / $0, 32K context, text in/out with function calling.
- `qwen/qwen2.5-coder-32b-instruct` (Qwen 2.5 Coder 32B) — Existing listing gains an Ollama relay hop, so a paired machine serving qwen2.5-coder:32b answers at $0 / $0 alongside the BYOK routes.

## Notes

[`qwen/qwen2.5-coder-0.5b-instruct`](https://anyrouter.dev/model/qwen/qwen2.5-coder-0.5b-instruct) is Qwen2.5-Coder-0.5B-Instruct served from your own machine: run Ollama, start `anyr relay`, and the same `POST /api/v1/chat/completions` endpoint serves it at $0 in and out with a 32K-token context, tuned for code generation, reasoning and fixing with function calling. [`mistral/mistral-7b-instruct-v0.3`](https://anyrouter.dev/model/mistral/mistral-7b-instruct-v0.3) is Mistral-7B-Instruct-v0.3 the same way, also 32K and $0 with function calling. The existing [`qwen/qwen2.5-coder-32b-instruct`](https://anyrouter.dev/model/qwen/qwen2.5-coder-32b-instruct) keeps its BYOK routes and gains an Ollama relay hop, so a paired machine serving `qwen2.5-coder:32b` answers it too.

No server-side compute and no vendor key: your machine runs the weights and the request travels down the relay's outbound WebSocket. Callers without a paired device get the relay's 503, and devices that opt in can donate idle capacity through the shared pool.

```bash
anyr relay start --detach
anyr relay status
```

_Serve your local Ollama through Relay._

```ts
import { createAnyRouter } from "@anyr/ai-sdk-provider"
import { generateText } from "ai"

const anyrouter = createAnyRouter()
const { text } = await generateText({
  model: anyrouter("qwen/qwen2.5-coder-0.5b-instruct"),
  prompt: "Write a quick sort function.",
})
console.log(text)
```

_AI SDK (after anyr relay start)._

```bash
anyr claude --model "qwen/qwen2.5-coder-0.5b-instruct"
```

_Run it in the terminal with your coding agent._

Playbooks: [AI SDK](https://anyrouter.dev/use-cases/ai-sdk), [coding agents](https://anyrouter.dev/use-cases/coding-agents), [OpenAI SDK](https://anyrouter.dev/use-cases/openai-sdk).
