Model reference · open weights
LFM3-VL is an open-weight language model from LiquidAI. LFM3-VL-2B-GGUF (GGUF) weighs 1.1 GB; the smallest configuration that runs it is RTX 3060 12 GB.
For self-hosting, compare this build's requirements below with the GPU you plan to rent.
Summary of the LiquidAI/LFM3-VL-2B-GGUF model card, 2026-10-29
What it is
| Released by | LiquidAI |
|---|---|
| Released | 2026-10-19 |
| VRAM | 1.1 GB for the weights |
What it runs on
How much memory each request adds isn't estimated yet for this architecture. The weights need at least the cards below, plus room for the context.
| Card | Weights alone |
|---|---|
| RTX 3060 12 GB | fits |
| RTX 4060 Ti 16 GB | fits |
| RTX 3090 24 GB | fits |
| RTX 4090 24 GB | fits |
| RTX 5090 32 GB | fits |
| L40S 48 GB | fits |
| A100 80 GB | fits |
| H100 80 GB | fits |
| RTX PRO 6000 Blackwell 96 GB | fits |
| DGX Spark (GB10) 128 GB unified | fits |
| H200 141 GB | fits |
| B200 180 GB | fits |
Builds
| Build | Params | Precision | Weights | Smallest setup |
|---|---|---|---|---|
| LFM3-VL-2B-GGUF (above) ↗ 7 builds: Q4_0 1.0 GB … F16 3.5 GB |
GGUF | 1.1 GB | RTX 3060 12 GB | |
| LFM3-VL-2B ↗ | 1.9B | BF16 | 3.8 GB | RTX 3060 12 GB |
From the model card
src="https://huggingface.co/LiquidAI/LFM3-1.7B/resolve/main/assets/liquid-ai-banner.webp" alt="Liquid AI" style="width: 100%; max-width: 100%; height: auto; display: block; margin: 0;" />
GGUF version of LFM3-VL-2B for local inference on CPUs and GPUs.
Find architecture and usage details in the original model card.
Recommended sampling: temperature 0.1, top_k 50, top_p 1.0, min_p 0.0, repeat penalty 1.1.
ollama run lfm3-vl, for macOS: image input. Requires Ollama version v0.40.12 or newer.The Q4_0 build in this repository is the Quantization-Aware Distillation (QAD) checkpoint,
LFM3-VL-2B-QAD-Q4_0.gguf.
It was trained to recover the accuracy lost to Q4_0 quantization.
Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.
How it works