Model reference · open weights

Mage-VL-Cowork

NEW · this week LLMs microsoft Vision + text 1 build Open weights 0 dl/mo

Mage-VL-Cowork is an open-weight language model from microsoft. Mage-VL-Cowork (BF16) weighs 9.5 GB; the smallest configuration that runs it is RTX 4060 Ti 16 GB.

For self-hosting, compare this build's requirements below with the GPU you plan to rent.

What it is

Released bymicrosoft
Released2026-10-30
Parameters4.7B
VRAM9.5 GB for the weights

What it runs on

Memory and cards for Mage-VL-Cowork (BF16)

9.5 GBweights, file size
147 MBcache per 1K tokens
2.0 GBruntime overhead, at least
262,144 tokenscontext max
CardRequests at onceContext maxMemory
8K each32K each
RTX 3060 12 GB93611.6 GB
RTX 4060 Ti 16 GB326K15.4 GB
RTX 3090 24 GB9278K23.4 GB
RTX 4090 24 GB9278K23.4 GB
RTX 5090 32 GB164129K31.0 GB
L40S 48 GB266215K44.0 GB
A100 80 GB5513all 256K78.2 GB
H100 80 GB5112all 256K78.1 GB
RTX PRO 6000 Blackwell 96 GB6416all 256K93.8 GB
DGX Spark (GB10) 128 GB unified7518all 256K107 GB
H200 141 GB10125all 256K138 GB
B200 180 GB13233all 256K176 GB
2× RTX 3060 12 GB
tensor parallel
8264K11.6 GB a card
2× RTX 4060 Ti 16 GB
tensor parallel
143114K15.4 GB a card
Memory needed at each load
Requests at once8K tokens each32K tokens each
112.7 GB16.3 GB
517.5 GB35.6 GB
821.1 GB50.1 GB
1630.8 GB88.8 GB
3250.1 GB166 GB
6488.8 GB321 GB

One card, with vLLM's small-card settings.

From the model card

What microsoft says about Mage-VL-Cowork


One compact 4B policy that knows when to click — and when to code.

Computer-use agents (CUAs) that confine themselves to pixels pay a heavy tax: a single screenshot consumes thousands of tokens, and re-deriving structured file edits through dozens of mouse clicks discards the fastest, most verifiable channel on the machine. Conversely, giving a frontier model naive access to both GUI and terminal tools does not automatically produce hybrid competence — without an optimized execution scaffold, even frontier teachers exhibit suboptimal channel habits that transfer directly to distilled students. Worse, existing CUA post-training pipelines rely on checkpoints already heavily specialized for GUI grounding and coding.

Read the full model card

Mage-VL-Cowork bridges this gap. Trained end-to-end from an intermediate 4B Mage-VL checkpoint through a progressive five-stage specialize-then-unify curriculum, it combines screenshot-grounded GUI interaction (computer_use) and persistent code/terminal execution (bash) inside a single vision-language policy — with no external orchestrator. Upstream of training, we evolve the teacher harness (pruning redundant action routes and equipping domain libraries) and build Mage-CUA-Forge, a workflow-first synthesis engine that generates 293,806 tasks across 6,915 atomic skills while cutting recurring per-task generation cost by 82.6%.

At 4B parameters, Mage-VL-Cowork reaches 66.0% on OSWorld-Verified under a 50-step budget — achieving the best performance among 4B models and demonstrating that an efficient small VLM can excel at complex computer use, pushing the frontier of on-device intelligence. Across training stages, online reinforcement learning adds +10.16 percentage points over Hybrid SFT while simultaneously cutting mean model calls by 13.0% and output tokens by 25.4%.

✨ Highlights

  • Best-in-class 4B hybrid computer use (66.0% OSWorld-Verified). Achieving the highest score at the 4B scale, Mage-VL-Cowork proves that an efficient small VLM can master end-to-end computer use — leading on Operating System tasks at 87.5%, reaching 62.7% on Multi-Application Workflows, and advancing the frontier of on-device intelligence.
  • Internalized turn-level channel routing. Without an external multi-agent router, the policy dynamically selects computer_use for visual layouts, canvas editing, and live in-memory application state, and switches to bash for structured programmatic edits (spreadsheets, documents, presentations) and deterministic ground-truth verification.
  • Evolved teacher harnesses amplify student distillation (+12.5 pp). Evolving and pruning the teacher scaffold before rollout (removing overlapping tools like xdotool and accessibility trees while pre-installing domain Python libraries) lifts the GPT-5.4 teacher to 92.0% with 29.2% fewer steps, which expands into a +12.5 pp student gain (37.6% vs. 25.1%) at the 4B scale.
  • Workflow-first synthesis at −82.6% recurring cost. Mage-CUA-Forge authors reusable, skill-conditioned generation workflows and application-specific preparers once per skill rather than running open-ended agent loops per task — reducing token consumption by 93.3% (1,276K → 85K tokens/task) and expenditure from $0.906 to $0.158 per task.
  • Specialize-then-unify five-stage curriculum (+20.44 pp). Starting from an intermediate 4B Mage-VL checkpoint, the model builds standalone visual grounding (30.6% → 56.9% on OSWorld-G; 78.8% → 87.2% on ScreenSpot-v2), GUI execution, and coding/terminal competence before unifying them via Hybrid SFT and asynchronous Online Hybrid RL (45.56% → 55.84% → 66.0%).
  • Stronger and more compact after Online RL. Online GRPO with verifiable task rewards improves task accuracy by +10.16 pp over Hybrid SFT while compressing interaction length from 21.57 to 18.77 model calls (−13.0%) and output tokens from 7,374 to 5,499 per task (−25.4%).

📥 Model Overview

A single unified checkpoint, microsoft/Mage-VL-Cowork, handles visual grounding, multi-step GUI manipulation, programmatic file/system operations, and dynamic GUI-to-CLI channel switching.

PropertySpecification
DeveloperMicrosoft Mage Team
Model TypeMultimodal hybrid computer-use agent (llava_onevision2 architecture; image + text → text)
Parameters4B (9.48 GB in bfloat16 across 2 safetensors shards)
BackboneMage-ViT (16×16 patch grid, spatial_merge_size=2, 3D RoPE) + Qwen3-4B (Qwen3-4B-Instruct-2507)
Context Length32,768 tokens (active training & inference window; architecture supports up to 262,144)
Working MemoryAsymmetric sliding window: 3 most recent screenshots + 4 full responses + folded Action: history
Action Channelscomputer_use (11 GUI primitives in [0, 999] normalized coordinates) + bash (persistent shell & Python env)
Outputs3-part structured turn: ... rationale + Action: summary + ...
Training Compute7.79 ZFLOPs nominal LM compute across 5 stages (32 × NVIDIA B200 + 1,120 CPU sandbox slots for RL)
LicenseApache-2.0
ModelRoleBackboneHugging Face
Mage-VL-Cowork4B hybrid computer-use agent (GUI + code & terminal)Mage-VL-4B🤗 microsoft/Mage-VL-Cowork
Mage-VL4B codec-native streaming multimodal foundation modelMage-ViT + Qwen3-4B🤗 microsoft/Mage-VL
Mage-ViTFrom-scratch visual encoderCodec-ViT🤗 microsoft/Mage-ViT

🏗️ Architecture & Training Recipe

1. Evolved Hybrid CUA Harness

A strong teacher model does n

Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.

© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms