Llama 3.1 70B Instruct on Vercel AI Gateway

Llama 3.1 70B Instruct through your own Vercel AI Gateway key. Price, speed and policy are this upstream's.

About Vercel AI Gateway

Base URL

Performance and pricing

Latency (TTFT): —
Throughput: —
Uptime: —
Input: $0 /M
Output: $0 /M
Context: 128K tokens

Billed by your own Vercel AI Gateway key. These rates show in your usage logs and are not charged to your AnyRouter credits.

Your key

Request example

curl https://anyrouter.dev/api/v1/chat/completions \
  -H "Authorization: Bearer $ANYROUTER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
  "model": "meta/llama-3.1-70b-instruct",
  "messages": [
    {
      "role": "user",
      "content": "Say hi in 3 words."
    }
  ],
  "provider": {
    "only": [
      "vercel-byok"
    ]
  }
}'

anyr claude --model meta/llama-3.1-70b-instruct

Uses your API key. Works with more tools

Performance over time

No history yet. Charts fill in as requests arrive.

Usage

Loading usage…

Usage over time

No usage yet.

Details

Max output: 8K tokens
Region: —
Upstream model name: meta/llama-3.1-70b
Billing: Your own key (BYOK)

Features

No ZDRToolsReasoning

Data policy

No ZDR — data may be retained