Model reference · open weights

llama3-llava-next

LLMs llava-hf Vision + text 1 build Open, with conditions 22k dl/mo

llama3-llava-next is an open-weight language model from llava-hf. llama3-llava-next-8b-hf (FP16) weighs 16.7 GB; the smallest configuration that runs it is RTX 4090 24 GB.

For self-hosting, compare this build's requirements below with the GPU you plan to rent.

  • llama3-llava-next is an 8.4B parameter multimodal model developed by llava-hf for image-text-to-text tasks such as image captioning and visual question answering.
  • It combines a pre-trained vision encoder with the Meta-Llama-3-8B-Instruct language backbone and supports a context length of 8192 tokens.
  • The model operates in English and is released under the llama3 licence.

Summary of the llava-hf/llama3-llava-next-8b-hf model card, 2026-10-01

What it is

Released byllava-hf
Released2024-07-19
Parameters8.4B
VRAM16.7 GB for the weights

What it runs on

Memory and cards for llama3-llava-next-8b-hf (FP16)

16.7 GBweights, file size
2.1 GBruntime overhead, at least
8,192 tokenscontext max

How much memory each request adds isn't estimated yet for this architecture. The weights need at least the cards below, plus room for the context.

CardWeights alone
RTX 3060 12 GB … RTX 4060 Ti 16 GB
2 smaller cards
does not fit
RTX 3090 24 GBfits
RTX 4090 24 GBfits
RTX 5090 32 GBfits
L40S 48 GBfits
A100 80 GBfits
H100 80 GBfits
RTX PRO 6000 Blackwell 96 GBfits
DGX Spark (GB10) 128 GB unifiedfits
H200 141 GBfits
B200 180 GBfits
© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms