Skip to content
AnyRouter

Mistral 7B Instruct v0.3 (on-device)

Free
mistral/mistral-7b-instruct-v0.3

Text · 33K context · May 2024 · 1 upstreams

Mistral 7B Instruct v0.3, run on a user's own paired machine with Ollama and relayed to AnyRouter over an outbound WebSocket (no API key, no server-side compute). Ships $0 in/out — the user supplies their own hardware. Text in, text out, with function calling.

Runs on your Mac

Free

Run this on your Mac to serve it, and to share it with the pool and get Go.

See the setup steps

0 online now · 0 shared to the pool

Share your idle Mac and get Go

Requests your Mac serves earn no credits.

Add --no-pool to keep it private. Your plan shows on your Credits page.

Pair your own Mac

  1. 1
    Install the CLI
    bash
    curl -fsSL https://anyrouter.dev/setup.sh | bash
  2. 2
    Sign in, then start the relay
    bash
    anyr login

    Then run anyr relay start, the command at the top of this card.

More options

--model <id> serves one model and --all serves every detected model, skipping the picker.

anyr login --device signs in on a headless machine.

Send a test request:

bash
curl https://anyrouter.dev/api/v1/chat/completions \
  -H "Authorization: Bearer $ANYROUTER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model": "mistral/mistral-7b-instruct-v0.3", "messages": [{"role": "user", "content": "hi"}]}'

Read the local relay docs and the shared pool.

context
33K
input / 1M
$0
output / 1M
$0
routes
1
speed, 24h
No data yet

Upstreams

1
  1. 1AnyRouterPlatformFree

Quick start

curl
curl https://anyrouter.dev/api/v1/chat/completions \
  -H "Authorization: Bearer $ANYROUTER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
  "model": "mistral/mistral-7b-instruct-v0.3",
  "messages": [
    {
      "role": "user",
      "content": "Say hi in 3 words."
    }
  ]
}'

Details

Owner
Mistral AI
Kind
Chat
Released
May 2024
Context
33K
Data policy
Zero retention
Endpoint
/api/v1/chat/completions