Model reference · open weights

Muse-Spark-Open

LLMs meta-models Vision + text · MoE 6 builds Its own licence terms 815 dl/mo

Muse-Spark-Open is an open-weight language model from meta-models. Muse-Spark-Open-816B-A42B-NVFP4 (NVFP4) weighs 533 GB; the smallest configuration that runs it is 8× A100 80 GB.

For self-hosting, compare this build's requirements below with the GPU you plan to rent.

  • Muse Spark Open is an open weights multimodal model from Meta Superintelligence Labs designed for coding and agentic tasks.
  • It features 816 billion total parameters with 42 billion active, a 1 million token context window, and supports input in more than 100 languages.
  • The model is released under the Muse Model License.

Summary of the meta-models/Muse-Spark-Open-816B-A42B model card, 2026-10-17. The estimate below is for another build of the family.

What it is

Released bymeta-models
Released2026-09-15
Parameters822.0B
VRAM533 GB for the weights

What it runs on

Memory and cards for Muse-Spark-Open-816B-A42B-NVFP4 (NVFP4)

533 GBweights, file size
66 MBcache per 1K tokens
1.2 GBwindow cache per request
4.3 GBruntime overhead, at least
1,048,576 tokenscontext max
CardRequests at onceContext maxMemory
8K each32K each
RTX 3060 12 GB … 8× H100 80 GB
13 smaller cards
8× A100 80 GB
tensor parallel · FP4 without its speed-up here
3317842K78.2 GB a card
4× B200 180 GB
tensor parallel
328929K176 GB a card
8× H200 141 GB
tensor parallel · FP4 without its speed-up here
20676all 1024K138 GB a card
Memory needed at each load
Requests at once8K tokens each32K tokens each
1539 GB541 GB
5546 GB554 GB
8551 GB564 GB
16565 GB591 GB
32593 GB645 GB
64649 GB752 GB

One card, with vLLM's small-card settings.

Builds

Sizes, precisions & builds

BuildParamsPrecisionWeightsSmallest setup
Muse-Spark-Open-816B-A42B ↗ 822.0BBF16 1644 GBnone of the reference configurations
Muse-Spark-Open-816B-A42B-NVFP4 (above) ↗ 483.8BNVFP4 533 GB8× A100 80 GB
Muse-Spark-Open-816B-A42B-GGUF ↗
packaged by unsloth
9 builds: GGUF 796 MB … Q4_K_XL 506 GB
GGUF 275 GB2× B200 180 GB
Muse-Spark-Open-816B-A42B ↗
packaged by unsloth
BF16
Muse-Spark-Open-816B-A42B-DFlash2 ↗
packaged by nvidia
a draft head for speculative decoding that runs beside the full model
4.4BBF16 8.8 GB
Muse-Spark-Open-816B-A42B-NVFP4 ↗
packaged by unsloth
483.8BNVFP4 533 GB8× A100 80 GB

From the model card

What meta-models says about Muse-Spark-Open

Read the model card

Muse Spark Open

Authors: Meta Superintelligence Labs Model Release Date: October 2026 License: Muse Model License

Muse Spark Open is an 816B total/42B active parameter open weights model with a context window of 1M tokens. Built for coding and agentic work, Muse Spark Open is natively multimodal. This open weights version has additional safety post-training to make it more robust against misuse as a standalone model without system guardrails. We recommend deploying Muse Spark Open as part of a broader AI system, with additional guardrails suited to the specific use case.

The model can perform well across a wide variety of use cases including:

  1. Multi-Step Reasoning - chains reasoning over long horizons, sustaining coherent plans across complex, extended workflows.
  2. End to End Agentic Task Completion - multi-step planning, sequential tool invocation, failure recovery, and long-horizon task execution, working within scaffolds, write and debug code, and resolve multi-turn requests from start to finish.
  3. Coding Agents - writing, debugging, and resolving real-world software engineering tasks.
  4. Tool Use - tool invocation across extended multi-turn workflows, diagnosing error and retrying with tool call failures
  5. Multimodal Reasoning - interpreting screenshots, charts, documents, images, audio and video recordings, alongside conversation for agentic and information-rich environments.
  6. Synthetic Data Generation - generating high-quality training data for downstream model development.
  7. LLM-as-a-judge Evaluation - serving as an evaluator for other models' outputs.
Muse Spark Open Model Overview
NameMuse Spark Open
Model ProviderMeta Platforms, Inc. or Meta Platforms Ireland Limited
Date of ReleaseOctober 15th, 2026
LicenseMuse Model License
Parameters816B total / 42B active
TypeMixture-of-Experts Transformer, with Perception Encoder
Context Length1M at inference
Vocabulary Size202,048
ModalitiesInput: Text + Image + Video + Audio / Output: Text
LanguagesMultilingual, trained on data from more than 100 languages
Recommended inference parametersTemperature = 1.0 Top_p = 1.0 Top_k = disabled It is recommended to use Reasoning Effort of high or xhigh for complex problem solving, coding, and agentic tasks.
Language ModelHidden Dimension: 8192 Token Embedding: untied input/output embeddings, vocab × dim = 202,048 × 8192 ≈ ~1.66B Output layer (unembedding layer): vocab × dim = 202,048 × 8192 ≈ ~1.66B Number of Layers: 62 Gated Attention: Yes (output gate and output norm on the attention block; QK-norm enabled) Number of Attention Heads: 128 for Q and 16 for KV (grouped-query attention) Head Dimension: 64 Mixture of Experts: Yes Number of Experts: 256 Experts Activated per Token: 8 (top-k routing)
Perception EncoderArchitecture: 1.8B param, 50 layers, 1536 hidden dim, 16 heads, 14x14 patch size, 4096 output dim Learned Absolute + 2D RoPE for positional embedding, LayerNorm + GELU for FFN Sparse attention with factor 4 (every 4th + last layer are full attention)
Model Access and Best Practices

Access via API The model is available via API through third party inference providers.

Open Weights on your own system The weights are available for download through Hugging Face. The model is available in BF16 and NVFP4 versions. To run on your own system, the model requires a GPU with at least 700GB of VRAM for NVFP4 and 2TB for BF16. It also requires an inference deployment framework - supported frameworks are SGLang, vLLM, Hugging Face, TensorRT-LLM, Unsloth and Llama.cpp. It is also optimized to run on two Mac Studios with M5 Ultra using MLX.

Please see the developer documentation for more information on how to deploy and use the model.

Inference Parameters You can customize inference parameters to achieve the best performance for your use case.

  • Reasoning Effort: Reasoning effort controls how much the model thinks before it responds. Set it with the reasoning_effort request parameter, or with chat_template_kwargs={"reasoning_effort": ...}, to low, medium, high, or xhigh. The default is xhigh. Use high or xhigh for complex problem solving, coding, and agentic tasks, and low or medium for faster, shorter responses. Any other value returns an error.
  • Sampling Parameters: The following settings are recommended for most deployments: temperature = 1.0, top_p = 1.0, top_k = disabled
Training data

Training data includes text, images, audio, and video. It includes data drawn from public sources, crawled from the Internet, acquired from third parties, derived from Meta’s products and services, and synthetically generated, curated and enriched by external vendor networks and Meta personnel. Data curation methodologies include cleaning, processing, modifying, deduplication, and filtering, among others.

Benchmarks

We compare Muse Spark Open to other leading open-weight models of similar size and architecture. For Muse Spark Open we use xhigh reasoning effort, temperature = 1.0, top_p=1.0, top_k=disabled across benchmarks.

BenchmarkMuse Spark Open (xhigh)Inkling (xhigh)Nemotron 3 Ultra (thinking on)BeamMistral Large 4Qwen3.8-2.4T-A95B (xhigh)GLM 5.3 (max)Kimi K3 (max)
General
Artificial Analysis Intelligence Index392623-38404544
Agentic
JobBench61.831.127.2--52.761.454.3
MCP-Atlas89.276.063.178.7-84.584.282.3

Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.

How it works

How language models work

Your prompttext / messagesTransformerattention over tokensNext-token loopgenerate + streamResponsetext · tool callsA language model reads your tokens and predicts the next one, again and again, streaming the reply back.
© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms