Model reference · open weights

Axion-1.0

LLMs Axion1-0 Text gen 1 build Open weights 596 dl/mo

Axion-1.0 is an open-weight language model from Axion1-0. Axion-1.0-35B (BF16) weighs 70.2 GB; the smallest configuration that runs it is A100 80 GB.

For self-hosting, compare this build's requirements below with the GPU you plan to rent.

  • Axion-1.0 is a 35.1B parameter Mixture of Experts model designed for scientific reasoning, information seeking, and tool-augmented problem solving.
  • It supports a context length of 262,144 tokens and is released under the Apache 2.0 license.

Summary of the Axion1-0/Axion-1.0-35B model card, 2026-11-06

What it is

Released byAxion1-0
Released2026-10-16
Parameters35.1B
VRAM70.2 GB for the weights

What it runs on

Memory and cards for Axion-1.0-35B (BF16)

70.2 GBweights, file size
20 MBcache per 1K tokens
129 MBfixed state per request
2.5 GBruntime overhead, at least
262,144 tokenscontext max
CardRequests at onceContext maxMemory
8K each32K each
RTX 3060 12 GB … L40S 48 GB
6 smaller cards
A100 80 GB186all 256K78.2 GB
H100 80 GB78.1 GB
RTX PRO 6000 Blackwell 96 GB4918all 256K93.8 GB
DGX Spark (GB10) 128 GB unified9535all 256K107 GB
H200 141 GB19873all 256K138 GB
B200 180 GB320118all 256K176 GB
2× L40S 48 GB
tensor parallel
4315all 256K44.0 GB a card
4× RTX 4090 24 GB
tensor parallel
289all 256K23.4 GB a card
4× RTX 3090 24 GB
tensor parallel
299all 256K23.4 GB a card
4× RTX 5090 32 GB
tensor parallel
9429all 256K31.0 GB a card
2× H100 80 GB
tensor parallel
22985all 256K78.1 GB a card
2× A100 80 GB
tensor parallel
273101all 256K78.2 GB a card
Memory needed at each load
Requests at once8K tokens each32K tokens each
173.0 GB73.5 GB
574.2 GB76.7 GB
875.1 GB79.1 GB
1677.4 GB85.5 GB
3282.2 GB98.3 GB
6491.7 GB124 GB

One card, with vLLM's small-card settings.

From the model card

What Axion1-0 says about Axion-1.0

Read the model card

Paper · Project · Code · Training Data

This repository provides a reproduction checkpoint of Axion 1.0-35B, following the recipe described in Axion 1.0: Open Agent Foundation Models, Simplified. The model is designed for scientific reasoning, information seeking, and tool-augmented problem solving.

Model Overview

PropertyDetails
ModelAxion 1.0-35B
ReleaseReproduction checkpoint
ArchitectureMixture of Experts (MoE)
ParametersApproximately 35B total, 3B active
Weight precisionBF16

The training recipe combines approximately 18K SFT examples with three stages:

  1. Learn to reason: supervised fine-tuning on challenging, self-contained scientific problems constructed with model-aware feedback.
  2. Learn to investigate: supervised fine-tuning on verifiable tasks requiring external information and tool use.
  3. Learn through interaction: reinforcement learning over agent trajectories to refine reasoning and interaction with tools.

Performance

The table compares paper-reported results with the results of the reproduction checkpoint released in this repository. All scores are percentages; higher is better.

ModelHLEBMBSEAL‑0HiPhOFS OlympiadFS Research
Agents-A147.6—56.446.479.040.0
Kimi-K2.654.0—50.541.173.017.9
DeepSeek-V4-Pro (Preview)48.2—55.038.776.013.3
Apodex 1.1 (ReAct)53.223.5———55.0
Apodex 1.1 (Agent Team)56.135.3———63.3
GPT-5.552.2—42.343.378.026.7
GPT-5.6 Sol—47.153.242.979.063.3
GPT-6 Astra57.2—————
Muse-Spark-1.058.0————38.0
Gemini 3.1 Pro51.435.353.238.585.026.7
Claude Opus 563.649.4————
Claude Fable 563.846.1————
Axion 1.0-35B (Paper)52.235.362.245.786.056.7
Axion 1.0-35B (Reproduction)52.835.360.445.985.055.0

HLE denotes the full Humanity's Last Exam benchmark; BMB uses the human-difficult BioMysteryBench subset. FS denotes FrontierScience. A dash indicates an unreported result. Bold highlights the reproduction checkpoint released in this repository.

Usage

Following the repository's inference guide, serve the released checkpoint with vLLM:

vllm serve Axion1-0/Axion-1.0-35B \
  --served-model-name axion-35b \
  --host 127.0.0.1 --port 8000 \
  --tensor-parallel-size 8 --dtype bfloat16 \
  --max-model-len 131072 \
  --reasoning-parser qwen3 \
  --enable-auto-tool-choice --tool-call-parser qwen3_coder

This example uses eight GPUs. Adjust tensor parallelism and context capacity to fit your GPU memory.

Call the OpenAI-compatible endpoint:

curl --fail-with-body http://127.0.0.1:8000/v1/chat/completions \
  -H 'Content-Type: application/json' \
  -d '{
    "model": "axion-35b",
    "messages": [
      {"role": "user", "content": "What is 2 + 3?"}
    ],
    "max_tokens": 1024
  }'

Tool-using agent evaluation additionally requires a harness that executes tool calls. See the inference guide for details.

License

This model is released under the Apache License 2.0. See LICENSE for details.

Citation

@misc{jia2026axion,
  title         = {Axion 1.0: Open Agent Foundation Models, Simplified},
  author        = {Yuqi Jia and Yunjie Tian and Jiayu Zheng and Yijun Liang and Jingchen Sun and Mengyu Zhao and Di Fu},
  year          = {2026},
  eprint        = {2611.03233},
  archivePrefix = {arXiv},
  primaryClass  = {cs.AI},
  url           = {https://arxiv.org/abs/2611.03233}
}

Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.

© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms