Model reference · open weights
UniAR-RL is an open-weight language model from ShareLab-SII. UniAR-RL (BF16) weighs 19.3 GB; the smallest configuration that runs it is RTX 4090 24 GB.
For self-hosting, compare this build's requirements below with the GPU you plan to rent.
Summary of the ShareLab-SII/UniAR-RL model card, 2026-10-01
What it is
| Released by | ShareLab-SII |
|---|---|
| Released | 2026-06-16 |
| Parameters | 9.6B |
| VRAM | 19.3 GB for the weights |
What it runs on
| Card | Requests at once | Context max | Memory | |
|---|---|---|---|---|
| 8K each | 32K each | |||
| RTX 3060 12 GB … RTX 4060 Ti 16 GB 2 smaller cards | ||||
| RTX 3090 24 GB | 1 | 13K | 23.4 GB | |
| RTX 4090 24 GB | 1 | 13K | 23.4 GB | |
| RTX 5090 32 GB | 8 | 2 | all 32K | 31.0 GB |
| L40S 48 GB | 18 | 4 | all 32K | 44.0 GB |
| A100 80 GB | 47 | 11 | all 32K | 78.2 GB |
| H100 80 GB | 43 | 10 | all 32K | 78.1 GB |
| RTX PRO 6000 Blackwell 96 GB | 56 | 14 | all 32K | 93.8 GB |
| DGX Spark (GB10) 128 GB unified | 67 | 16 | all 32K | 107 GB |
| H200 141 GB | 93 | 23 | all 32K | 138 GB |
| B200 180 GB | 124 | 31 | all 32K | 176 GB |
| 2× RTX 4060 Ti 16 GB tensor parallel | 6 | 1 | all 32K | 15.4 GB a card |
| 2× RTX 4090 24 GB tensor parallel | 19 | 4 | all 32K | 23.4 GB a card |
| 2× RTX 3090 24 GB tensor parallel | 19 | 4 | all 32K | 23.4 GB a card |
| Requests at once | 8K tokens each | 32K tokens each |
|---|---|---|
| 1 | 22.5 GB | 26.1 GB |
| 5 | 27.3 GB | 45.5 GB |
| 8 | 31.0 GB | 60.0 GB |
| 16 | 40.6 GB | 98.6 GB |
| 32 | 60.0 GB | 176 GB |
| 64 | 98.6 GB | 331 GB |
One card, with vLLM's small-card settings.