Model reference · open weights
title is an open-weight language model from desert-ant-labs. Built for Apple silicon (MLX). It does not run on NVIDIA GPUs.
Summary of the desert-ant-labs/title model card, 2026-10-01
What it is
| Released by | desert-ant-labs |
|---|---|
| Released | 2026-08-09 |
| Parameters | 352M |
| VRAM | 286 MB for the weights |
What it runs on
| Card | Requests at once | Context max | Memory | |
|---|---|---|---|---|
| 8K each | 32K each | |||
| RTX 3060 12 GB | 45 | 11 | all 32K | 11.6 GB |
| RTX 4060 Ti 16 GB | 61 | 15 | all 32K | 15.4 GB |
| RTX 3090 24 GB | 96 | 24 | all 32K | 23.4 GB |
| RTX 4090 24 GB | 95 | 23 | all 32K | 23.4 GB |
| RTX 5090 32 GB | 128 | 32 | all 32K | 31.0 GB |
| L40S 48 GB | 183 | 45 | all 32K | 44.0 GB |
| A100 80 GB | 329 | 82 | all 32K | 78.2 GB |
| H100 80 GB | 314 | 78 | all 32K | 78.1 GB |
| RTX PRO 6000 Blackwell 96 GB | 381 | 95 | all 32K | 93.8 GB |
| DGX Spark (GB10) 128 GB unified | 439 | 109 | all 32K | 107 GB |
| H200 141 GB | 569 | 142 | all 32K | 138 GB |
| B200 180 GB | 731 | 182 | all 32K | 176 GB |
| Requests at once | 8K tokens each | 32K tokens each |
|---|---|---|
| 1 | 1.1 GB | 1.8 GB |
| 5 | 2.0 GB | 5.5 GB |
| 8 | 2.7 GB | 8.4 GB |
| 16 | 4.6 GB | 15.9 GB |
| 32 | 8.4 GB | 30.9 GB |
| 64 | 15.9 GB | 61.0 GB |
One card, with vLLM's small-card settings.
From the model card
Suggest a title and description for any text.
On-device titles and descriptions: a short factual title and a one- to two-sentence description for any passage of text.
| Platforms | iOS, macOS, tvOS, visionOS |
| Weights | v0.1.0 |
Swift (requirements)
.package(url: "https://github.com/Desert-Ant-Labs/desert-ant-core.git", from: "3.1.0",
traits: ["MLX"])
Then add the Title product to your target. The MLX trait is required: without it the module compiles as a stub.
Get a title and a one or two sentence description for any passage of text, on device.
Fine-tuned on transcript clips, but it works on any prose. The register is deliberately plain, with no emoji, no hashtags and no clickbait, and a description is meant to identify this passage rather than its topic.
An MLX model directory. Load the folder, not a single file.
| File | Contents |
|---|---|
model.safetensors | 6-bit quantized weights |
model.safetensors.index.json | shard index; present even for one shard, because the loader reads it |
config.json | architecture and quantization config |
generation_config.json | decode defaults |
tokenizer.json, tokenizer_config.json | byte-level BPE with merges |
chat_template.jinja | the chat template the fine-tune was trained against |
The chat template is not incidental. A different template is a different task to this model.
The model was fine-tuned against one specific instruction, and a paraphrase is a different
task to it. It lives in Titles.prompt in the SDK; use that wording. The reply is two labelled
lines:
TITLE:
DESC:
Parse tolerantly. A card model that drifts off format should degrade to a usable title rather than throw.
MLX runs on Apple silicon and nowhere else, so there is no Android, Linux or Windows artifact here and no manifest promising one. A Core ML export exists in the training repository and is kept as evidence rather than as a candidate: on short autoregressive decode the Neural Engine is bandwidth-bound, and the Core ML arm lost on first token, throughput, load time and resident memory.
Internal testing, and less settled than that phrase usually implies. This card carries no quality figures: no independent review has been completed, and a known open issue is that the model sometimes opens a description with a stock phrase its own instruction forbids. Treat the output as needing a read before it reaches a user.
ibm-granite/granite-4.0-350m ,
the base model this is fine-tuned from.Desert Ant Labs Source-Available License. Free for most apps, and a commercial license is required at scale. Full terms are at the link. Licensing: .
@software{title_2026,
title = {Title: On-device titles and descriptions: a short factual title and a one- to two-sentence description for any passage of text},
author = {Desert Ant Labs},
year = {2026},
url = {https://huggingface.co/desert-ant-labs/title},
}
© 2026 Desert Ant Labs ·
Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.
Running it
Built for Apple silicon (MLX). It does not run on NVIDIA GPUs.