Ollama models over Relay

qwen/qwen2.5-coder-0.5b-instruct is Qwen2.5-Coder-0.5B-Instruct served from your own machine: run Ollama, start anyr relay, and the same POST /api/v1/chat/completions endpoint serves it at $0 in and out with a 32K-token context, tuned for code generation, reasoning and fixing with function calling. mistral/mistral-7b-instruct-v0.3 is Mistral-7B-Instruct-v0.3 the same way, also 32K and $0 with function calling. The existing qwen/qwen2.5-coder-32b-instruct keeps its BYOK routes and gains an Ollama relay hop, so a paired machine serving qwen2.5-coder:32b answers it too.

No server-side compute and no vendor key: your machine runs the weights and the request travels down the relay's outbound WebSocket. Callers without a paired device get the relay's 503, and devices that opt in can donate idle capacity through the shared pool.

anyr relay start --detach
anyr relay status

import { createAnyRouter } from "@anyr/ai-sdk-provider"
import { generateText } from "ai"

const anyrouter = createAnyRouter()
const { text } = await generateText({
  model: anyrouter("qwen/qwen2.5-coder-0.5b-instruct"),
  prompt: "Write a quick sort function.",
})
console.log(text)

anyr claude --model "qwen/qwen2.5-coder-0.5b-instruct"

Playbooks: AI SDK, coding agents, OpenAI SDK.