Model reference · open weights

Ling-3.0-flash-Fin-fp4

LLMs inclusionAI Text gen 1 build Open weights 30 dl/mo

Ling-3.0-flash-Fin-fp4 is an open-weight language model from inclusionAI. Ling-3.0-flash-Fin-fp4 (FP8) weighs 70.4 GB; the smallest configuration that runs it is H100 80 GB.

For self-hosting, compare this build's requirements below with the GPU you plan to rent.

  • Ling-3.0-flash-Fin-fp4 is a text-generation model developed by inclusionAI, designed for financial research, valuation, and spreadsheet workflows.
  • It features 65.6B parameters and a 262144 token context length, and is released under the MIT licence.

Summary of the inclusionAI/Ling-3.0-flash-Fin-fp4 model card, 2026-10-01

What it is

Released byinclusionAI
Released2026-09-10
Parameters65.6B
VRAM70.4 GB for the weights

What it runs on

Memory and cards for Ling-3.0-flash-Fin-fp4 (FP8)

70.4 GBweights, file size
48 MBcache per 1K tokens
1.2 GBruntime overhead, at least
262,144 tokenscontext max
CardRequests at onceContext maxMemory
8K each32K each
RTX 3060 12 GB … L40S 48 GB
6 smaller cards
A100 80 GB
FP8 without its speed-up here
164132K78.2 GB
H100 80 GB112K78.1 GB
RTX PRO 6000 Blackwell 96 GB4110all 256K93.8 GB
DGX Spark (GB10) 128 GB unified7518all 256K107 GB
H200 141 GB15238all 256K138 GB
B200 180 GB24260all 256K176 GB
2× L40S 48 GB
tensor parallel
184151K44.0 GB a card
4× RTX 4090 24 GB
tensor parallel
11291K23.4 GB a card
4× RTX 3090 24 GB
tensor parallel · FP8 without its speed-up here
11292K23.4 GB a card
4× RTX 5090 32 GB
tensor parallel
307245K31.0 GB a card
2× H100 80 GB
tensor parallel
9022all 256K78.1 GB a card
2× A100 80 GB
tensor parallel · FP8 without its speed-up here
10526all 256K78.2 GB a card
Memory needed at each load
Requests at once8K tokens each32K tokens each
172.0 GB73.2 GB
573.6 GB79.6 GB
874.8 GB84.3 GB
1678.0 GB97.0 GB
3284.3 GB122 GB
6497.0 GB173 GB

One card, with vLLM's small-card settings.

From the model card

What inclusionAI says about Ling-3.0-flash-Fin-fp4

Read the model card

Introduction

Ling-3.0-flash-Fin is the first finance-enhanced model in the Ant Ling family. Developed by Ant Group with leading financial institutions and domain experts, it extends Ling-3.0-flash through continued training on high-quality financial data.

With 124B total parameters, 5.1B activated parameters, and a 256K context window, the model combines financial expertise with efficient inference for long-horizon agent workflows.

Highlights

  • End-to-end financial research: connects information retrieval, evidence review, calculation, modeling, and report preparation instead of treating them as isolated tasks.
  • Source-grounded financial search: Prioritizes authoritative sources to deliver accurate, complete, and traceable answers; FinFIRST is open-sourced alongside the model to enable transparent evaluation of these capabilities.
  • Multi-document financial reasoning: reconciles reporting periods, definitions, assumptions, and conflicting figures across annual reports, earnings releases, regulatory filings, and research materials.
  • Valuation and spreadsheet workflows: understands formulas, actual-versus-estimate updates, cross-sheet dependencies, balance checks, scenario analysis, and editable financial-model delivery.
  • Research-ready outputs: organizes facts, analysis, judgments, and charts into clear, reviewable materials for further editing and professional review.

Evaluation

Ling-3.0-flash-Fin was evaluated across FinFIRST, FinSearchComp Verified, FinCRAFT, Finance Agent, APEX-Agents, SpreadsheetBench, and τ³-Banking. These benchmarks cover source-grounded retrieval, investment research, long-horizon execution, valuation modeling, spreadsheet operations, and banking workflows. The model is competitive with both similarly sized models and substantially larger general-purpose models, with particular strength in source selection and tool-intensive financial tasks.

Local Serving

The current checkpoint is released in BF16. Because Ling-3.0-flash-Fin shares the same architecture as Ling-3.0-flash, it is compatible with the same SGLang and vLLM runtimes. For deployment instructions, see the Ling-3.0-flash deployment guide.

Important: Thinking mode is enabled by default. For optimal performance, we strongly recommend using temperature=1.0, top_p=0.95, and top_k=20 for general inference.

Quantized Models

We evaluate the quantized models using several datasets. The FP8 quantized model is applied via the blockwise quantization, and INT4 and FP4 models are applied via groupwise quantization with routed experts weights.

datasetBF16FP8INT4FP4
GPQA-diamond86.3085.2685.3984.38
SciCode41.8442.7041.4141.24
FinCRAFT54.2355.9154.4854.73
FSC-verified78.2877.4876.8676.77

Limitations and Future Work

As our first finance-enhanced release, Ling-3.0-flash-Fin still requires further validation in complex, long-horizon workflows. Key assumptions, valuation results, and investment conclusions require professional review and do not constitute investment advice.

Future releases will explore finance-enhanced models at larger scales to further improve complex reasoning and long-horizon task execution.

Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.

© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms