Model reference · open weights

Ling-3.0-flash-Fin

LLMs inclusionAI Text gen 3 builds Open weights 13 dl/mo

Ling-3.0-flash-Fin is an open-weight language model from inclusionAI. Ling-3.0-flash-Fin-int4 (INT4) weighs 77.0 GB; the smallest configuration that runs it is 2× L40S 48 GB.

For self-hosting, compare this build's requirements below with the GPU you plan to rent.

  • Ling-3.0-flash-Fin is a 127.5B parameter text-generation model developed by inclusionAI for financial research and analysis.
  • It features a 262144 token context window and is released under the MIT license.
  • The model is designed for end-to-end financial workflows, including source-grounded search, multi-document reasoning, and valuation modeling.

Summary of the inclusionAI/Ling-3.0-flash-Fin-int4 model card, 2026-10-01

What it is

Released byinclusionAI
Released2026-09-09
Parameters127.5B
VRAM77.0 GB for the weights

What it runs on

Memory and cards for Ling-3.0-flash-Fin-int4 (INT4)

77.0 GBweights, file size
48 MBcache per 1K tokens
1.2 GBruntime overhead, at least
262,144 tokenscontext max
CardRequests at onceContext maxMemory
8K each32K each
RTX 3060 12 GB … H100 80 GB
8 smaller cards
RTX PRO 6000 Blackwell 96 GB246195K93.8 GB
DGX Spark (GB10) 128 GB unified5814all 256K107 GB
H200 141 GB13533all 256K138 GB
B200 180 GB22556all 256K176 GB
2× L40S 48 GB
tensor parallel
10284K44.0 GB a card
4× RTX 4090 24 GB
tensor parallel
7157K23.4 GB a card
4× RTX 3090 24 GB
tensor parallel
7158K23.4 GB a card
4× RTX 5090 32 GB
tensor parallel
266212K31.0 GB a card
2× H100 80 GB
tensor parallel
8220all 256K78.1 GB a card
2× A100 80 GB
tensor parallel
9624all 256K78.2 GB a card
2× RTX PRO 6000 Blackwell 96 GB
tensor parallel
12130all 256K93.8 GB a card
Memory needed at each load
Requests at once8K tokens each32K tokens each
178.7 GB79.8 GB
580.2 GB86.2 GB
881.4 GB90.9 GB
1684.6 GB104 GB
3290.9 GB129 GB
64104 GB180 GB

One card, with vLLM's small-card settings.

Builds

Sizes, precisions & builds

BuildParamsPrecisionWeightsSmallest setup
Ling-3.0-flash-Fin-int4 (above) ↗ 127.5BINT4 77.0 GB2× L40S 48 GB
Ling-3.0-flash-Fin-fp8 ↗ 127.5BFP8 128 GBH200 141 GB
Ling-3.0-flash-Fin ↗ 127.5BBF16 255 GB2× H200 141 GB

From the model card

What inclusionAI says about Ling-3.0-flash-Fin

Read the model card

Introduction

Ling-3.0-flash-Fin is the first finance-enhanced model in the Ant Ling family. Developed by Ant Group with leading financial institutions and domain experts, it extends Ling-3.0-flash through continued training on high-quality financial data.

With 124B total parameters, 5.1B activated parameters, and a 256K context window, the model combines financial expertise with efficient inference for long-horizon agent workflows.

Highlights

  • End-to-end financial research: connects information retrieval, evidence review, calculation, modeling, and report preparation instead of treating them as isolated tasks.
  • Source-grounded financial search: Prioritizes authoritative sources to deliver accurate, complete, and traceable answers; FinFIRST is open-sourced alongside the model to enable transparent evaluation of these capabilities.
  • Multi-document financial reasoning: reconciles reporting periods, definitions, assumptions, and conflicting figures across annual reports, earnings releases, regulatory filings, and research materials.
  • Valuation and spreadsheet workflows: understands formulas, actual-versus-estimate updates, cross-sheet dependencies, balance checks, scenario analysis, and editable financial-model delivery.
  • Research-ready outputs: organizes facts, analysis, judgments, and charts into clear, reviewable materials for further editing and professional review.

Evaluation

Ling-3.0-flash-Fin was evaluated across FinFIRST, FinSearchComp Verified, FinCRAFT, Finance Agent, APEX-Agents, SpreadsheetBench, and τ³-Banking. These benchmarks cover source-grounded retrieval, investment research, long-horizon execution, valuation modeling, spreadsheet operations, and banking workflows. The model is competitive with both similarly sized models and substantially larger general-purpose models, with particular strength in source selection and tool-intensive financial tasks.

Local Serving

The current checkpoint is released in BF16. Because Ling-3.0-flash-Fin shares the same architecture as Ling-3.0-flash, it is compatible with the same SGLang and vLLM runtimes. For deployment instructions, see the Ling-3.0-flash deployment guide.

Important: Thinking mode is enabled by default. For optimal performance, we strongly recommend using temperature=1.0, top_p=0.95, and top_k=20 for general inference.

Quantized Models

We evaluate the quantized models using several datasets. The FP8 quantized model is applied via the blockwise quantization, and INT4 and FP4 models are applied via groupwise quantization with routed experts weights.

datasetBF16FP8INT4FP4
GPQA-diamond86.3085.2685.3984.38
SciCode41.8442.7041.4141.24
FinCRAFT54.2355.9154.4854.73
FSC-verified78.2877.4876.8676.77

Limitations and Future Work

As our first finance-enhanced release, Ling-3.0-flash-Fin still requires further validation in complex, long-horizon workflows. Key assumptions, valuation results, and investment conclusions require professional review and do not constitute investment advice.

Future releases will explore finance-enhanced models at larger scales to further improve complex reasoning and long-horizon task execution.

Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.

© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms