Skip to content
AnyRouter

Llama 3.1 8B Instruct

Tools
meta/llama-3.1-8b-instruct

Text · 131K context · Jul 2024 · 10 upstreams

Llama 3.1 8B Instruct is Meta's compact instruction-tuned model, optimized for fast inference and edge deployments. It supports chat, reasoning, coding, function calling, and streaming, with text in and text out.

Needs your own keyTo use Llama 3.1 8B Instruct, add a key from Hugging Face, OpenRouter, Vercel AI Gateway or 7 more. AnyRouter adds no fee.
context
131K
input / 1M (list)
$0.02
output / 1M (list)
$0.04
routes
10
speed, 24h
No data yet

Upstreams

10
  1. 1Hugging FaceYour keynot addedBilled to your key
  2. 2OpenRouterYour keynot addedBilled to your key
  3. 3Vercel AI GatewayYour keynot addedBilled to your key
  4. 4NovitaAIYour keynot addedBilled to your key
  5. 5Nous ResearchYour keynot addedBilled to your key
  6. 6RequestyYour keynot addedBilled to your key
  7. 7NanoGPTYour keynot addedBilled to your key
  8. 8FluenceYour keynot addedBilled to your key
  9. 9HeliconeYour keynot addedBilled to your key
  10. 10Jiekou.AIYour keynot addedBilled to your key

Benchmarks

GPQA Diamond
25.9%
LiveCodeBench
11.6%
AIME
7.7%
HLE
5.1%

Quick start

curl
curl https://anyrouter.dev/api/v1/chat/completions \
  -H "Authorization: Bearer $ANYROUTER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
  "model": "meta/llama-3.1-8b-instruct",
  "messages": [
    {
      "role": "user",
      "content": "Say hi in 3 words."
    }
  ]
}'

Details

Owner
Meta
Kind
Chat
Released
Jul 2024
Context
131K
Data policy
Provider retention
Endpoint
/api/v1/chat/completions