Model reference · open weights
Agents-A1 is an open-weight language model from InternScience. Agents-A1 (BF16) weighs 70.2 GB; the smallest configuration that runs it is A100 80 GB.
For self-hosting, compare this build's requirements below with the GPU you plan to rent.
Summary of the InternScience/Agents-A1-4B model card, 2026-10-01. The estimate below is for another build of the family.
What it is
| Released by | InternScience |
|---|---|
| Released | 2026-07-13 |
| Parameters | 4.5B |
| VRAM | 70.2 GB for the weights |
What it runs on
| Card | Requests at once | Context max | Memory | |
|---|---|---|---|---|
| 8K each | 32K each | |||
| RTX 3060 12 GB … L40S 48 GB 6 smaller cards | ||||
| A100 80 GB | 18 | 6 | 255K | 78.2 GB |
| H100 80 GB | 78.1 GB | |||
| RTX PRO 6000 Blackwell 96 GB | 49 | 18 | all 256K | 93.8 GB |
| DGX Spark (GB10) 128 GB unified | 95 | 35 | all 256K | 107 GB |
| H200 141 GB | 198 | 73 | all 256K | 138 GB |
| B200 180 GB | 320 | 118 | all 256K | 176 GB |
| 2× L40S 48 GB tensor parallel | 42 | 15 | all 256K | 44.0 GB a card |
| 4× RTX 4090 24 GB tensor parallel | 28 | 9 | all 256K | 23.4 GB a card |
| 4× RTX 3090 24 GB tensor parallel | 29 | 9 | all 256K | 23.4 GB a card |
| 4× RTX 5090 32 GB tensor parallel | 94 | 29 | all 256K | 31.0 GB a card |
| 2× H100 80 GB tensor parallel | 229 | 85 | all 256K | 78.1 GB a card |
| 2× A100 80 GB tensor parallel | 273 | 101 | all 256K | 78.2 GB a card |
| Requests at once | 8K tokens each | 32K tokens each |
|---|---|---|
| 1 | 73.0 GB | 73.5 GB |
| 5 | 74.2 GB | 76.7 GB |
| 8 | 75.1 GB | 79.1 GB |
| 16 | 77.4 GB | 85.5 GB |
| 32 | 82.2 GB | 98.3 GB |
| 64 | 91.7 GB | 124 GB |
One card, with vLLM's small-card settings.
Builds
| Build | Params | Precision | Weights | Smallest setup |
|---|---|---|---|---|
| Agents-A1-4B ↗ | 4.5B | BF16 | 9.1 GB | RTX 3060 12 GB |
| Agents-A1 (above) ↗ | 35.1B | BF16 | 70.2 GB | A100 80 GB |
From the model card
[!Note] This repository contains model weights and configuration files for Agents-A1 in the Hugging Face Transformers format.
These artifacts are compatible with Hugging Face Transformers, vLLM, SGLang, etc.
2026.7.14: 🔥🔥 The 4B model has been released.
2026.7.8: 🔥🔥 By popular demand from the community, our 4B model is coming in the next few days — making it faster and easier to build your own local AI assistant.
2026.7.2: 🔥🔥 Based on Agents-A1, we have released a series of quantized model variants. Please refer to the Agents-A1 collection. Besides, we’d like to thank the mlx-community for providing quantized versions at multiple scales. Try running Agents-A1 on your Mac!
2026.6.26: 🔥🔥 We have open-sourced the Agents-A1 35B-A3B model, along with the evaluation code for selected domains and the technical report.
Agents‑A1 is a long-horizon agentic model from InternScience, built to scale heterogeneous agentic abilities across multiple domains including Long‑horizon Search, Engineering, Scientific Research, Instruction Following, and Tool-calling. We investigate agent-horizon scaling from two perspectives: scaling long-horizon trajectories and scaling heterogeneous agent abilities.
From the scaling of long-horizon trajectories, Agents‑A1 is trained with the assistance of a domain-grounded knowledge-action infrastructure that jointly constructs actions, observations, and verifier outcomes, turning the agent's process into a trainable target. From the scaling of heterogeneous agent abilities, Agents‑A1 presents a three-stage training paradigm for building scalable general-purpose agentic model. First, we perform full-domain supervised fine-tuning to align the base model with broad agentic behaviors. Second, we train domain-level teacher models to capture specialized expertise in each domain. Third, we propose multi-teacher multi-domain on-policy distillation with heterogeneity-aware optimization to improve knowledge transfer efficiency across different domains.
We welcome developers and enterprises to integrate and try Agents-A1 and share their feedback.
We release the dense model Agents-A1-4B with only 4B parameters, yet it delivers impressive performance across long-horizon search, engineering & research, instruction following, and general/scientific agentic tasks. It significantly outperforms similarly-sized models on BrowseComp (66.8), XBench-DS-2510 (90.0), GAIA (95.1), FrontierScience-Research (33.3), and IFEval (94.8), with some scores approaching or even surpassing larger MoE models like Nex-N2-mini and Qwen3.6. Compared to the flagship 35B Agents-A1, the 4B variant achieves strong competitiveness with a fraction of the parameters, demonstrating the series' excellent balance between efficiency and performance, and continuously narrowing the gap between small models and frontier systems.
🥇 Overall Best Performance Among Models in the Table
🧠 Dense Models (~4B)
🔀 MoE Models (35B-A3B)
SGLang is a fast serving framework for large language models and vision language models.
Install SGLang with uv:
uv venv --python 3.12 --seed --managed-python
source .venv/bin/activate
uv pip install sglang
See its documentation for more details.
The following commands create API endpoints at http://localhost:8000/v1:
Standard Version (1 GPUs, 262K context):
python -m sglang.launch_server \
--model-path InternScience/Agents-A1-4B \
--port 8000 \
--tp-size 1 \
--mem-fraction-static 0.8 \
--context-length 262144 \
--reasoning-parser qwen3
Tool Use:
python -m sglang.launch_server \
--model-path InternScience/Agents-A1-4B \
--port 8000 \
--tp-size 1 \
--mem-fraction-static 0.8 \
--context-length 262144 \
--reasoning-parser qwen3 \
--tool-call-parser qwen3_coder
vLLM is a high-throughput and memory-efficient inference and serving engine for LLMs.
Install vLLM from the main branch via uv:
uv venv --python 3.12 --seed --managed-python
source .venv/bin/activate
uv pip install vllm --torch-backend=auto
See its documentation for more details.
The following commands create API endpoints at http://localhost:8000/v1:
Standard Version (1 GPUs, 262K context):
vllm serve InternScience/Agents-A1-4B \
--port 8000 \
--tensor-parallel-size 1 \
--max-model-len 262144 \
--reasoning-parser qwen3
Tool Call:
vllm serve InternScience/Agents-A1-4B \
--port 8000 \
--tensor-parallel-size 1 \
--max-model-len 262144 \
--reasoning-parser qwen3 \
--enable-auto-tool-choice \
--tool-call-parser qwen3_coder
Text-Only (skips vision encoder to free KV cache memory):
vllm serve InternScience/Agents-A1-4B \
--port 8000 \
--tensor-parallel-size 1 \
--max-model-len 262144 \
--reasonin
Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.