Decision-2.0-Eos

Decision-2.0-Eos-0.8B is the 0.8B model of Decision 2.0, the decision models of vLLM Semantic Router. Give it an input (text or JSON) and the questions you need answered: pick one of several options, say yes or no, or rate on a scale. It answers them all at once and returns a probability for every answer, without generating text.

Highlights

• Top JevArena score of its size: 53.9, ahead of the 3 other same-size models compared.
• Ahead of Decision 1.0 Eos: +11.4 on JevArena and +1.7 on the Jev Decision Index.
• Speed: a median of 6.0 ms per single-question request on a single GPU.
• Many questions, one pass: Choice, Yes / No and Score questions about the same input are answered together in one forward pass, with a probability for every option.

Quickstart

pip install "transformers>=5.17" torch safetensors

import json

from transformers import AutoModel

model = AutoModel.from_pretrained("vllm-sr/Decision-2.0-Eos-0.8B", trust_remote_code=True)
result = model.system_one(
    state="The order arrived damaged yesterday. The customer has a receipt and asks for a replacement today.",
    questions={
        "route": {
            "type": "choice",
            "instructions": "Which team should handle this request?",
            "criteria": {
                "returns": "Refunds, replacements and damaged deliveries",
                "billing": "Payments, invoices and charges",
                "technical": "Product setup and faults"
            }
        },
        "receipt": {
            "type": "noul",
            "instructions": "Does the customer have a receipt?"
        },
        "urgency": {
            "type": "score",
            "instructions": "How urgent is this request?",
            "criteria": [
                "Routine",
                "Soon",
                "Today"
            ]
        }
    },
)
print(json.dumps(result["answers"], indent=2))

# Or as a pipeline:
# transformers.pipeline("decision", model="vllm-sr/Decision-2.0-Eos-0.8B", trust_remote_code=True)(state=..., questions=...)

Evaluation

JevArena

Jev Decision Index

License

Apache-2.0 (LICENSE).

Citation

@misc{decision_2_0_eos_0_8b_2026,
  title        = {{Decision-2.0-Eos-0.8B}: A Decision 2.0 Model for Structured Decisions},
  author       = {{vLLM Semantic Router Team}},
  year         = {2026},
  howpublished = {\url{https://huggingface.co/vllm-sr/Decision-2.0-Eos-0.8B}}
}