NVIDIA-Nemotron-3.5-Super-VL

Description

NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16 is the full-precision release of NVIDIA Nemotron 3.5 Super VL, a vision-language model for reasoning, coding, tool use, document understanding, and video understanding. The BF16 weights support customization, domain adaptation, and full-precision evaluation. For optimized deployment, see the NVFP4 release.

The model combines interleaved Mamba-2, Mixture-of-Experts (MoE), and attention layers with a C-RADIO vision encoder and a vision-language connector. It has 120B total parameters and 12B active parameters and supports context lengths up to 1M tokens. Multi-Token Prediction (MTP) enables native speculative decoding.

This model is ready for commercial or non-commercial use.

Model Summary

Model Overview

Model Developer: NVIDIA Corporation

What is Nemotron?

NVIDIA Nemotron™ is a family of open models with open weights, training data, and recipes, delivering leading efficiency and accuracy for building specialized AI agents.

Quick Start

For efficient inference on DGX Spark or data center GPUs, see the NVFP4 card. The example below serves BF16 on 4× H100.

Nemotron 3.5 Super VL has configurable reasoning levels: off, on (medium), and on. Selecting on (medium) will reduce the number of tokens generated compared to on, but may impact accuracy. You can learn about the reasoning budget here!

Use Docker with NVIDIA GPU support and the vllm/vllm-openai:nightly-3f1bcfd82bb2e93fcd364fc7a5491718453a77e2 or (vllm/vllm-openai:v0.32.0) image. If the model requires authentication, set HF_TOKEN in your shell before launching the container.

export MODEL=nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16

vllm serve $MODEL \
  --served-model-name nemotron-3.5-super-vl \
  --tensor-parallel-size 4 \
  --trust-remote-code \
  --gpu-memory-utilization=0.85 \
  --allowed-local-media-path=/ \
  --max-num-seqs=32 \
  --limit-mm-per-prompt '{"video": 1, "image": 1}' \
  --video-pruning-rate 0.5 \
  --media-io-kwargs '{"video": {"fps": 2, "num_frames": 256}}' \
  --enable-auto-tool-choice \
  --tool-call-parser qwen3_coder \
  --reasoning-parser nemotron_v3 \
  --speculative_config.method mtp \
  --speculative_config.num_speculative_tokens 3

Wait for the server to finish loading the model and compiling kernels, then check the endpoint:

curl --fail http://localhost:8000/v1/models

All vLLM and SGLang examples use port 8000 and the API model name nemotron-3.5-super-vl. See the API Client for text, image, video, and tool-calling examples.

License/Terms of Use

Governing Download Terms: Use of this model is governed by the OpenMDW License Agreement, version 1.1.

Benchmarks

We evaluated our model on the following benchmarks: