Model reference · open weights
flint is an open-weight language model from RecursiveSI. flint (BF16) weighs 79.6 GB; the smallest configuration that runs it is 2× L40S 48 GB.
For self-hosting, compare this build's requirements below with the GPU you plan to rent.
Summary of the RecursiveSI/flint model card, 2026-10-24
What it is
| Released by | RecursiveSI |
|---|---|
| Released | 2026-10-21 |
| Parameters | 39.8B |
| VRAM | 79.6 GB for the weights |
What it runs on
| Card | Requests at once | Context max | Memory | |
|---|---|---|---|---|
| 8K each | 32K each | |||
| RTX 3060 12 GB … H100 80 GB 8 smaller cards | ||||
| RTX PRO 6000 Blackwell 96 GB | 8 | 3 | 234K | 93.8 GB |
| DGX Spark (GB10) 128 GB unified | 23 | 9 | all 256K | 107 GB |
| H200 141 GB | 55 | 21 | all 256K | 138 GB |
| B200 180 GB | 94 | 23 | all 256K | 176 GB |
| 2× L40S 48 GB tensor parallel | 10 | 4 | 205K | 44.0 GB a card |
| 4× RTX 4090 24 GB tensor parallel | 15 | 7 | all 256K | 23.4 GB a card |
| 4× RTX 3090 24 GB tensor parallel | 16 | 7 | all 256K | 23.4 GB a card |
| 4× RTX 5090 32 GB tensor parallel | 64 | 30 | all 256K | 31.0 GB a card |
| 2× H100 80 GB tensor parallel | 69 | 27 | all 256K | 78.1 GB a card |
| 2× A100 80 GB tensor parallel | 118 | 56 | all 256K | 78.2 GB a card |
| 2× RTX PRO 6000 Blackwell 96 GB tensor parallel | 102 | 40 | all 256K | 93.8 GB a card |
| Requests at once | 8K tokens each | 32K tokens each |
|---|---|---|
| 1 | 81.2 GB | 81.9 GB |
| 5 | 83.7 GB | 87.2 GB |
| 8 | 85.6 GB | 91.2 GB |
| 16 | 90.6 GB | 102 GB |
| 32 | 101 GB | 123 GB |
| 64 | 121 GB | 166 GB |
One card, with vLLM's small-card settings.
Builds
| Build | Params | Precision | Weights | Smallest setup |
|---|---|---|---|---|
| flint (above) ↗ | 39.8B | BF16 | 79.6 GB | 2× L40S 48 GB |
| flint-GGUF ↗ packaged by unsloth 10 builds: IQ1_M 11.4 GB … BF16 79.6 GB |
GGUF | 25.1 GB | 2× RTX 4060 Ti 16 GB |
From the model card
Flint is Recursive’s mixture-of-experts language model for coding agents, with 39.8 billion total parameters and approximately 2.5 billion active per token. It is designed to investigate codebases, fix bugs, implement features, and write tests.
Flint supports text input and output, reasoning, and multi-turn tool use. In our release evaluations, it scores 54.9% on Terminal-Bench 2.1, 89.7% on SWE-bench Pro v2, and 74.2% on SWE-bench Verified.
This repository contains the BF16 checkpoint, model configuration, tokenizer, chat template, and an SGLang serving kit. Quantized variants are prepared separately for NVIDIA and Apple Silicon runtimes.
Flint results use temperature 1.0, top-p 0.95, and top-k 20. Terminal-Bench uses Terminus 2; SWE-bench uses mini-swe-agent. Agentic scores report average pass@1 over at least five attempts. † marks scores measured by Recursive; other comparison scores are developer-reported.
Evaluation setups vary across sources. Flint’s Terminal-Bench score counts solutions obtained through web retrieval as unsuccessful; developer-reported scores may not apply the same adjustment.
| Property | Flint |
|---|---|
| Developer | Recursive |
| Architecture | Decoder-only mixture-of-experts Transformer |
| Total parameters | 39.8B |
| Active parameters per token | Approximately 2.5B, including the output head¹ |
| Layers | 49: 2 dense layers followed by 47 MoE layers |
| Attention | 35 sliding-window layers and 14 full-attention layers |
| Sliding window | 513 tokens: the current token and 512 preceding tokens |
| Attention heads | 32 query heads and 4 key/value heads; head dimension 128 |
| Attention normalization | Per-head QK RMSNorm and learned per-head attention sinks |
| Position encoding | RoPE on sliding-window layers; no positional encoding on full-attention layers |
| Experts per MoE layer | 256 routed experts, with 6 selected per token, plus an always-active shared expert |
| Documented context configuration | 262,144 tokens, including prompt and generated output |
| Vocabulary | 150,144 tokens |
| Input / output | Text / text |
| Stated knowledge cutoff | June 2026 |
¹ The active-parameter convention includes the output head and excludes the full input embedding matrix. The active body alone is approximately 2.2B parameters. “40B-A2.5B” is the rounded model-size designation.
Flint runs on one B300 or H200 GPU per replica with the SGLang kit in sglang/. Transformers modeling code is not included yet.
pip install -U huggingface_hub openai
hf download RecursiveSI/flint --local-dir flint && cd flint # about 80 GB
docker build -t flint-sglang sglang
docker run -d --name flint --gpus '"device=0"' --ipc=host -p 127.0.0.1:30000:30000 \
-v "$PWD:/model" -e MODEL=/model flint-sglang bash /model/sglang/serve_b300.sh # H200: serve_h200.sh
until curl -sf localhost:30000/health_generate >/dev/null; do sleep 15; done # progress: docker logs -f flint
python3 sglang/example_client.py --base-url http://localhost:30000/v1 # reasoning and a tool call
from openai import OpenAI
client = OpenAI(base_url="http://localhost:30000/v1", api_key="unused")
response = client.chat.completions.create(
model="flint",
messages=[{"role": "user", "content": "Write a Python function that merges overlapping intervals."}],
max_tokens=32768,
)
print(response.choices[0].message.content)
sglang/README.md covers requirements, serve-script options, multi-GPU deployments, and API details.
| Setting | Value |
|---|---|
| Temperature | 1.0 |
| Top-p / top-k | 0.95 / 20 |
| Output budget for hard problems | At least 32768 tokens, including reasoning |
The server applies these sampling settings when a request omits them. Flint supports OpenAI-compatible tool calls. Use the checkpoint’s chat template and preserve returned reasoning_content in conversation history. Prompt and output share the context window.
Flint was trained from scratch through pretraining, mid-training, supervised fine-tuning, and reinforcement learning. Training includes text and code, instruction following, and agentic tasks.
Flint’s supervised fine-tuning included safety-oriented examples, but the model can still produce incorrect or harmful content, faulty code, or inappropriate tool calls. Test generated code and review consequential changes before applying them. Tool-using applications should enforce their own permissions and execution boundaries; structured tool-call grammar does not prevent the model from choosing an unsafe or incorrect action.
Long reasoning can increase latency and exhaust the output budget before an answer is complete. The context configuration is a capacity limit, not a guarantee of uniform accuracy across all sequence lengths or tasks. Results can vary with checkpoint precision and inference runtime; evaluate the specific checkpoint and runtime you intend to deploy.
Flint is released under the Apache 2.0 license. Hosted API terms and data practices are separate from the weight license.
For model and serving issues, contact support@recursive.com and include the checkpoint revision, runtime version, hardware, launch command, and a minimal reproduction. Report safety concerns or suspected misuse to safety@recursive.com, and security vulnerabilities to security@recursive.com.
Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.