vLLM Semantic Router
About vLLM Semantic Router
- Base URL
Models
d3-edge is a 0.6B open-weight multimodal decision model from vLLM Semantic Router. It reads text, images, and videos, answers typed questions in one forward pass, and returns a calibrated probability for each answer with no generated text. Context is 131,072 tokens.
d3-flash is a 9B open-weight multimodal decision model from vLLM Semantic Router. It reads text, images, and videos, answers typed questions in one forward pass, and returns a calibrated probability for each answer with no generated text. Context is 131,072 tokens.
d3-lite is a 0.8B open-weight multimodal decision model from vLLM Semantic Router. It reads text, images, and videos, answers typed questions in one forward pass, and returns a calibrated probability for each answer with no generated text. Context is 131,072 tokens.
d3-mini is a 4B open-weight multimodal decision model from vLLM Semantic Router. It reads text, images, and videos, answers typed questions in one forward pass, and returns a calibrated probability for each answer with no generated text. Context is 131,072 tokens.
d3-nano is a 2B open-weight multimodal decision model from vLLM Semantic Router. It reads text, images, and videos, answers typed questions in one forward pass, and returns a calibrated probability for each answer with no generated text. Context is 131,072 tokens.
d3-ultra is a 27B open-weight decision model from vLLM Semantic Router. It reads text, images and videos and returns a calibrated probability per answer, with no generated text. Context is 131K tokens. It is the only Decision 3.0 model that tracks a target in video.