Model reference · open weights
GLiDE is an open-weight language model from fastino. GLiDE (BF16) weighs 52.2 GB; the smallest configuration that runs it is H100 80 GB.
For self-hosting, compare this build's requirements below with the GPU you plan to rent.
Summary of the fastino/GLiDE model card, 2026-10-27
What it is
| Released by | fastino |
|---|---|
| Released | 2026-10-19 |
| Parameters | 26.1B |
| VRAM | 52.2 GB for the weights |
What it runs on
| Card | Requests at once | Context max | Memory | |
|---|---|---|---|---|
| 8K each | 32K each | |||
| RTX 3060 12 GB … L40S 48 GB 6 smaller cards | ||||
| A100 80 GB | 28 | 9 | all 256K | 78.2 GB |
| H100 80 GB | 21 | 7 | all 256K | 78.1 GB |
| RTX PRO 6000 Blackwell 96 GB | 40 | 13 | all 256K | 93.8 GB |
| DGX Spark (GB10) 128 GB unified | 56 | 19 | all 256K | 107 GB |
| H200 141 GB | 92 | 31 | all 256K | 138 GB |
| B200 180 GB | 136 | 46 | all 256K | 176 GB |
| 2× L40S 48 GB tensor parallel | 37 | 12 | all 256K | 44.0 GB a card |
| 4× RTX 4090 24 GB tensor parallel | 38 | 13 | all 256K | 23.4 GB a card |
| 4× RTX 3090 24 GB tensor parallel | 38 | 13 | all 256K | 23.4 GB a card |
| 4× RTX 5090 32 GB tensor parallel | 74 | 25 | all 256K | 31.0 GB a card |
| Requests at once | 8K tokens each | 32K tokens each |
|---|---|---|
| 1 | 55.2 GB | 56.8 GB |
| 5 | 58.6 GB | 66.6 GB |
| 8 | 61.1 GB | 74.0 GB |
| 16 | 67.9 GB | 93.7 GB |
| 32 | 81.4 GB | 133 GB |
| 64 | 108 GB | 212 GB |
One card, with vLLM's small-card settings.
From the model card
GLiDE is ranked #1 of 229 models on the Decision Index 0.4.1 (Thursday, 22 October 2026).
Inference provider: Fastino — use GLiDE through Fastino's hosted API (POST https://api.fastino.ai/v1/systemone, model fastino/GLiDE). Get an API key · API documentation
| Rank | Model | Full score |
|---|---|---|
| #1 | Fastino GLiDE V1.2 | 71.5 |
| #2 | Jeffan-31b-1710 | 69.8 |
| #3 | baselabs mammoth-1 (27B) | 68.4 |
GLiDE is a decision model from Fastino. Given a state (text or JSON, optionally with images) and one or more typed questions, it returns a probability for every option of every question.
Use GLiDE through Fastino’s hosted API for classification, routing, and scoring.
Send decision requests to POST https://api.fastino.ai/v1/systemone with model fastino/GLiDE.
The instructions below cover running this repository locally.
choice (one of up to 255 named options), noul (yes / no, returns P(yes)) and score (ordered levels).POST /v1/systemone).| Weights | bf16, 52.2 GB on disk: 51.2 GB language model, 0.92 GB vision encoder, 2.6 MB readout |
| GPU | one GPU with 80 GB or more |
| GPU memory | 52.2 GB after loading; 60.2 GB peak for a 39k-token question |
| Tested GPUs | NVIDIA RTX PRO 6000 Blackwell Server Edition (96 GB), NVIDIA B200 (180 GB), NVIDIA H100 80GB HBM3 |
| Load time | 30 to 60 s from network storage |
Weights are copied to the GPU tensor by tensor, so host memory use during loading stays low. Image preprocessing runs on the CPU.
pip install huggingface_hub
hf download fastino/GLiDE --local-dir GLiDE # needs a token with read access to the fastino org
cd GLiDE
pip install -r requirements.txt
torch==2.14.0 and transformers==5.17.0 (all pins are in requirements.txt).flash-linear-attention==0.5.2 is optional but recommended: it provides fast kernels for the linear-attention layers. Without it
transformers falls back to a much slower PyTorch implementation, which was not part of the validation. All numbers below were
measured with it installed.causal_conv1d is not installed and uses its PyTorch path. This is expected: the validated setup
does not use that package.glide/ package lives at the repository root: run from the repository directory or add it to PYTHONPATH.from glide import Glide
model = Glide.from_pretrained(
"GLiDE"
) # local directory, or the Hub repo id "fastino/GLiDE"
result = model.decide(
state={
"ticket": "I was charged twice for order #4821 and the second charge is still pending.",
"customer_tier": "gold",
},
questions={
"intent": {
"type": "choice",
"instructions": "What does the customer want?",
"criteria": {
"refund": "Get money back",
"cancel": "Cancel the order",
"track": "Track a delivery",
"other": "Something else",
},
},
"urgent": {
"type": "noul",
"instructions": "Should this ticket be escalated today?",
},
"priority": {
"type": "score",
"instructions": "What support priority should this ticket get?",
"criteria": [
"low: no impact on the customer",
"medium: the customer is inconvenienced",
"high: the customer has lost money or cannot use the service",
],
},
},
)
Result on an RTX PRO 6000 (rounded):
{
"model": "glide-v1.2",
"answers": {
"intent": {"type": "choice", "choice": "refund", "confidence": 0.9521, "probabilities": {"refund": 0.9751, "cancel": 0.0016, "track": 0.0004, "other": 0.0229}},
"urgent": {"type": "noul", "noul": 0.8267, "confidence": 0.6534},
"priority": {"type": "score", "score": 2, "expected_level": 1.9191, "confidence": 0.8527, "probabilities": {"0": 0.0048, "1": 0.0712, "2": 0.9239}}
},
"usage": {"input_tokens": 316, "output_tokens": 0}
}
With images (PIL images, file paths, bytes, base64 strings or data URLs):
from PIL import Image, ImageDraw
img = Image.new("RGB", (512, 512), "white")
ImageDraw.Draw(img).ellipse((128, 128, 384, 384), fill="red")
result = model.decide(
state="A product photo from the catalogue.",
questions={
"color": {
"type": "choice",
"instructions": "What color is the shape in the image?",
"criteria": {"red": "Red", "green": "Green", "blue": "Blue"},
},
"circle": {"type": "noul", "instructions": "Is the shape a circle?"},
},
images=[img],
)
{
"model": "glide-v1.2",
"answers": {
"color": {"type": "choice", "choice": "red", "confidence": 0.9997, "probabilities": {"red": 0.9998, "green": 0.0001, "blue": 0.0001}},
"circle": {"type": "noul", "noul": 0.9941, "confidence": 0.9882}
},
"usage": {"input_tokens": 653, "output_tokens": 0}
}
model.decide_batch([{"state": ..., "questions": ...}, ...]) scores several requests together and returns o
Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.