Model reference · open weights
llama3-llava-next is an open-weight language model from llava-hf. llama3-llava-next-8b-hf (FP16) weighs 16.7 GB; the smallest configuration that runs it is RTX 4090 24 GB.
For self-hosting, compare this build's requirements below with the GPU you plan to rent.
Summary of the llava-hf/llama3-llava-next-8b-hf model card, 2026-10-01
What it is
| Released by | llava-hf |
|---|---|
| Released | 2024-07-19 |
| Parameters | 8.4B |
| VRAM | 16.7 GB for the weights |
What it runs on
How much memory each request adds isn't estimated yet for this architecture. The weights need at least the cards below, plus room for the context.
| Card | Weights alone |
|---|---|
| RTX 3060 12 GB … RTX 4060 Ti 16 GB 2 smaller cards | does not fit |
| RTX 3090 24 GB | fits |
| RTX 4090 24 GB | fits |
| RTX 5090 32 GB | fits |
| L40S 48 GB | fits |
| A100 80 GB | fits |
| H100 80 GB | fits |
| RTX PRO 6000 Blackwell 96 GB | fits |
| DGX Spark (GB10) 128 GB unified | fits |
| H200 141 GB | fits |
| B200 180 GB | fits |