Decision 3.0

Decision 3.0 is a family of Apache 2.0 decision models from vLLM Semantic Router. They write no text: send a state, optionally with images and videos, plus typed questions (choice, noul or score) to POST /api/v1/decisions and get a calibrated probability for each answer in one pass. vllm-sr/d3-ultra (27B) also answers box questions and tracks a target through a video, and vllm-sr/d3-flash (9B) answers box questions too. vllm-sr/d3-turbo and vllm-sr/d3 are aliases of d3-ultra. The service logs requests and may train on them, so these models are skipped when Always enforce ZDR is on. You can also bring your own key from the Decision API.

const res = await fetch("https://anyrouter.dev/api/v1/decisions", {
  method: "POST",
  headers: {
    Authorization: "Bearer " + process.env.ANYROUTER_API_KEY,
    "Content-Type": "application/json",
  },
  body: JSON.stringify({
    state: "Refund request, order 12 days old, item unopened.",
    model: "vllm-sr/d3-flash",
    questions: {
      approve: { type: "noul", instructions: "Should this refund be approved?" },
    },
  }),
})
console.log(await res.json())

curl -fsSL https://anyrouter.dev/setup.sh | bash
anyr login
anyr decision --model vllm-sr/d3-flash

More: Decisions app · Decisions API reference · BYOK setup.