Model reference · open weights
Mage-VL-Cowork is an open-weight language model from microsoft. Mage-VL-Cowork (BF16) weighs 9.5 GB; the smallest configuration that runs it is RTX 4060 Ti 16 GB.
For self-hosting, compare this build's requirements below with the GPU you plan to rent.
What it is
| Released by | microsoft |
|---|---|
| Released | 2026-10-30 |
| Parameters | 4.7B |
| VRAM | 9.5 GB for the weights |
What it runs on
| Card | Requests at once | Context max | Memory | |
|---|---|---|---|---|
| 8K each | 32K each | |||
| RTX 3060 12 GB | 936 | 11.6 GB | ||
| RTX 4060 Ti 16 GB | 3 | 26K | 15.4 GB | |
| RTX 3090 24 GB | 9 | 2 | 78K | 23.4 GB |
| RTX 4090 24 GB | 9 | 2 | 78K | 23.4 GB |
| RTX 5090 32 GB | 16 | 4 | 129K | 31.0 GB |
| L40S 48 GB | 26 | 6 | 215K | 44.0 GB |
| A100 80 GB | 55 | 13 | all 256K | 78.2 GB |
| H100 80 GB | 51 | 12 | all 256K | 78.1 GB |
| RTX PRO 6000 Blackwell 96 GB | 64 | 16 | all 256K | 93.8 GB |
| DGX Spark (GB10) 128 GB unified | 75 | 18 | all 256K | 107 GB |
| H200 141 GB | 101 | 25 | all 256K | 138 GB |
| B200 180 GB | 132 | 33 | all 256K | 176 GB |
| 2× RTX 3060 12 GB tensor parallel | 8 | 2 | 64K | 11.6 GB a card |
| 2× RTX 4060 Ti 16 GB tensor parallel | 14 | 3 | 114K | 15.4 GB a card |
| Requests at once | 8K tokens each | 32K tokens each |
|---|---|---|
| 1 | 12.7 GB | 16.3 GB |
| 5 | 17.5 GB | 35.6 GB |
| 8 | 21.1 GB | 50.1 GB |
| 16 | 30.8 GB | 88.8 GB |
| 32 | 50.1 GB | 166 GB |
| 64 | 88.8 GB | 321 GB |
One card, with vLLM's small-card settings.
From the model card
One compact 4B policy that knows when to click — and when to code.
Computer-use agents (CUAs) that confine themselves to pixels pay a heavy tax: a single screenshot consumes thousands of tokens, and re-deriving structured file edits through dozens of mouse clicks discards the fastest, most verifiable channel on the machine. Conversely, giving a frontier model naive access to both GUI and terminal tools does not automatically produce hybrid competence — without an optimized execution scaffold, even frontier teachers exhibit suboptimal channel habits that transfer directly to distilled students. Worse, existing CUA post-training pipelines rely on checkpoints already heavily specialized for GUI grounding and coding.
Mage-VL-Cowork bridges this gap. Trained end-to-end from an intermediate 4B Mage-VL checkpoint through a progressive five-stage specialize-then-unify curriculum, it combines screenshot-grounded GUI interaction (computer_use) and persistent code/terminal execution (bash) inside a single vision-language policy — with no external orchestrator. Upstream of training, we evolve the teacher harness (pruning redundant action routes and equipping domain libraries) and build Mage-CUA-Forge, a workflow-first synthesis engine that generates 293,806 tasks across 6,915 atomic skills while cutting recurring per-task generation cost by 82.6%.
At 4B parameters, Mage-VL-Cowork reaches 66.0% on OSWorld-Verified under a 50-step budget — achieving the best performance among 4B models and demonstrating that an efficient small VLM can excel at complex computer use, pushing the frontier of on-device intelligence. Across training stages, online reinforcement learning adds +10.16 percentage points over Hybrid SFT while simultaneously cutting mean model calls by 13.0% and output tokens by 25.4%.
Mage-VL-Cowork proves that an efficient small VLM can master end-to-end computer use — leading on Operating System tasks at 87.5%, reaching 62.7% on Multi-Application Workflows, and advancing the frontier of on-device intelligence.computer_use for visual layouts, canvas editing, and live in-memory application state, and switches to bash for structured programmatic edits (spreadsheets, documents, presentations) and deterministic ground-truth verification.xdotool and accessibility trees while pre-installing domain Python libraries) lifts the GPT-5.4 teacher to 92.0% with 29.2% fewer steps, which expands into a +12.5 pp student gain (37.6% vs. 25.1%) at the 4B scale.Mage-VL checkpoint, the model builds standalone visual grounding (30.6% → 56.9% on OSWorld-G; 78.8% → 87.2% on ScreenSpot-v2), GUI execution, and coding/terminal competence before unifying them via Hybrid SFT and asynchronous Online Hybrid RL (45.56% → 55.84% → 66.0%).A single unified checkpoint, microsoft/Mage-VL-Cowork, handles visual grounding, multi-step GUI manipulation, programmatic file/system operations, and dynamic GUI-to-CLI channel switching.
| Property | Specification |
|---|---|
| Developer | Microsoft Mage Team |
| Model Type | Multimodal hybrid computer-use agent (llava_onevision2 architecture; image + text → text) |
| Parameters | 4B (9.48 GB in bfloat16 across 2 safetensors shards) |
| Backbone | Mage-ViT (16×16 patch grid, spatial_merge_size=2, 3D RoPE) + Qwen3-4B (Qwen3-4B-Instruct-2507) |
| Context Length | 32,768 tokens (active training & inference window; architecture supports up to 262,144) |
| Working Memory | Asymmetric sliding window: 3 most recent screenshots + 4 full responses + folded Action: history |
| Action Channels | computer_use (11 GUI primitives in [0, 999] normalized coordinates) + bash (persistent shell & Python env) |
| Outputs | 3-part structured turn: ... rationale + Action: summary + ... |
| Training Compute | 7.79 ZFLOPs nominal LM compute across 5 stages (32 × NVIDIA B200 + 1,120 CPU sandbox slots for RL) |
| License | Apache-2.0 |
| Model | Role | Backbone | Hugging Face |
|---|---|---|---|
Mage-VL-Cowork | 4B hybrid computer-use agent (GUI + code & terminal) | Mage-VL-4B | 🤗 microsoft/Mage-VL-Cowork |
Mage-VL | 4B codec-native streaming multimodal foundation model | Mage-ViT + Qwen3-4B | 🤗 microsoft/Mage-VL |
Mage-ViT | From-scratch visual encoder | Codec-ViT | 🤗 microsoft/Mage-ViT |
A strong teacher model does n
Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.