Model reference · open weights
Hy-Memory is an open-weight language model from tencent. Hy-Memory-30B-A3B-FP8 (FP8) weighs 30.6 GB; the smallest configuration that runs it is L40S 48 GB.
For self-hosting, compare this build's requirements below with the GPU you plan to rent.
Summary of the tencent/Hy-Memory-30B-A3B model card, 2026-10-17. The estimate below is for another build of the family.
What it is
| Released by | tencent |
|---|---|
| Released | 2026-10-15 |
| Parameters | 30.1B |
| VRAM | 30.6 GB for the weights |
What it runs on
| Card | Requests at once | Context max | Memory | |
|---|---|---|---|---|
| 8K each | 32K each | |||
| RTX 3060 12 GB … RTX 5090 32 GB 5 smaller cards | ||||
| L40S 48 GB | 29 | 7 | 236K | 44.0 GB |
| A100 80 GB FP8 without its speed-up here | 114 | 28 | all 256K | 78.2 GB |
| H100 80 GB | 99 | 24 | all 256K | 78.1 GB |
| RTX PRO 6000 Blackwell 96 GB | 138 | 34 | all 256K | 93.8 GB |
| DGX Spark (GB10) 128 GB unified | 171 | 42 | all 256K | 107 GB |
| H200 141 GB | 247 | 61 | all 256K | 138 GB |
| B200 180 GB | 333 | 83 | all 256K | 176 GB |
| 2× RTX 4090 24 GB tensor parallel | 32 | 8 | all 256K | 23.4 GB a card |
| 2× RTX 3090 24 GB tensor parallel · FP8 without its speed-up here | 33 | 8 | all 256K | 23.4 GB a card |
| 2× RTX 5090 32 GB tensor parallel | 70 | 17 | all 256K | 31.0 GB a card |
| Requests at once | 8K tokens each | 32K tokens each |
|---|---|---|
| 1 | 32.4 GB | 33.6 GB |
| 5 | 34.1 GB | 40.1 GB |
| 8 | 35.3 GB | 44.9 GB |
| 16 | 38.5 GB | 57.8 GB |
| 32 | 44.9 GB | 83.6 GB |
| 64 | 57.8 GB | 135 GB |
One card, with vLLM's small-card settings.
Builds
| Build | Params | Precision | Weights | Smallest setup |
|---|---|---|---|---|
| Hy-Memory-30B-A3B ↗ | 30.1B | BF16 | 60.1 GB | H100 80 GB |
| Hy-Memory-30B-A3B-FP8 (above) ↗ | 30.1B | FP8 | 30.6 GB | L40S 48 GB |
| Hy-Memory-30B-A3B-GGUF ↗ 2 builds: Q8_0 32.0 GB … GGUF 42.9 GB |
GGUF | 42.9 GB | L40S 48 GB |
From the model card
Hy-Memory-30B-A3B is a compact long-term-memory writer model (~3B active parameters) developed by Tencent Hunyuan to execute the write path inside external memory frameworks. It directly replaces the general-purpose LLM inside Mem0, MemOS, and Hy-Memory (covering Chat, Working, and Coding scenarios), deciding what information to retain, how precisely to represent it, and how new evidence should update the persistent memory bank. The model is trained in two stages—Memory On-Policy Distillation (OPD) followed by Attributed Memory Reinforcement Learning—and transfers directly to unseen memory frameworks such as EverMemOS.
The evaluation changes only the memory writer. For each comparison, the harness version and prompts are fixed, retrieval configuration is fixed, and the answer model, judge, and other framework-side components are held fixed. Throughout this report, every reference to a DeepSeek Flash endpoint denotes DeepSeek V4.1 Flash. Decoding settings are matched where APIs permit, each writer builds its own bank from an empty state, and test examples and scoring rules are identical.
For computational efficiency, every benchmark in the main four-harness matrix is evaluated on a fixed 20% subsample. Each harness score is the equal-weight average of six metrics: LoCoMo Judge, LongMemEval (LME), PersonaMem-v2 (PM-v2), Travel SPS, Shopping PS, and Code Memory Bench (CMB). CMB is itself the equal-weight average of two repository QA evaluations. The overall score is the equal-weight average of the four harness scores.
| Memory writer | Mem0 | Hy-Mem. | MemOS | EverMem. | Avg. |
|---|---|---|---|---|---|
| Hy-Memory-30B-A3B | 54.02 | 60.55 | 50.51 | 56.89 | 55.49 |
| Claude Opus 5 | 53.43 | 60.53 | 50.50 | 54.04 | 54.62 |
| DeepSeek V4.1 Flash | 49.73 | 60.20 | 49.17 | 55.47 | 53.64 |
| Hy3 | 45.99 | 58.06 | 50.19 | 52.30 | 51.63 |
| Qwen3.6-35B-A3B | 47.51 | 55.87 | 47.36 | 50.75 | 50.37 |
| Hy3-A3B Base | 40.20 | 50.39 | 49.05 | 50.98 | 47.66 |
| Qwen3-30B-A3B | 39.81 | 45.67 | 45.44 | 46.57 | 44.37 |
Table 1: Six-metric means on fixed 20% benchmark subsamples. The macro average weights the four harnesses equally.
Tables 2–5 report the six benchmark scores used to compute each harness mean in Table 1 on the same fixed 20% benchmark subsamples.
| Writer | LoCoMo | LME | PM-v2 | Travel | Shop. | CMB | Avg. |
|---|---|---|---|---|---|---|---|
| Hy-Memory-30B-A3B | 59.54 | 73.00 | 51.62 | 54.51 | 18.33 | 67.13 | 54.02 |
| Claude Opus 5 | 69.47 | 66.00 | 53.58 | 42.98 | 17.78 | 70.74 | 53.43 |
| DeepSeek V4.1 Flash | 58.78 | 69.39 | 49.56 | 35.07 | 16.67 | 68.92 | 49.73 |
| Hy3 | 41.22 | 62.00 | 44.44 | 46.87 | 17.22 | 64.16 | 45.99 |
| Qwen3.6-35B-A3B | 50.00 | 69.00 | 49.38 | 36.39 | 20.00 | 60.30 | 47.51 |
| Hy3-A3B Base | 50.00 | 47.00 | 40.82 | 37.91 | 14.44 | 51.03 | 40.20 |
| Qwen3-30B-A3B | 46.18 | 56.00 | 42.32 | 31.98 | 16.67 | 45.68 | 39.81 |
| Writer | LoCoMo | LME | PM-v2 | Travel | Shop. | CMB | Avg. |
|---|---|---|---|---|---|---|---|
| Hy-Memory-30B-A3B | 73.28 | 89.00 | 51.54 | 57.65 | 21.11 | 70.73 | 60.55 |
| Claude Opus 5 | 74.43 | 89.69 | 48.71 | 51.34 | 23.33 | 75.70 | 60.53 |
| DeepSeek V4.1 Flash | 72.90 | 85.86 | 49.00 | 53.46 | 22.78 | 77.18 | 60.20 |
| Hy3 | 69.47 | 89.00 | 52.76 | 49.01 | 21.67 | 66.44 | 58.06 |
| Qwen3.6-35B-A3B | 70.99 | 84.85 | 43.56 | 49.82 | 20.00 | 65.98 | 55.87 |
| Hy3-A3B Base | 66.41 | 87.00 | 49.84 | 31.36 | 17.78 | 49.97 | 50.39 |
| Qwen3-30B-A3B | 64.12 | 82.00 | 41.06 | 32.83 | 18.89 | 35.10 | 45.67 |
| Writer | LoCoMo | LME | PM-v2 | Travel | Shop. | CMB | Avg. |
|---|---|---|---|---|---|---|---|
| Hy-Memory-30B-A3B | 62.98 | 73.00 | 51.92 | 24.15 | 21.11 | 69.91 | 50.51 |
| Claude Opus 5 | 63.74 | 79.38 | 52.84 | 22.14 | 19.44 | 65.46 | 50.50 |
| DeepSeek V4.1 Flash | 61.07 | 73.00 | 50.68 | 18.61 | 21.67 | 69.97 | 49.17 |
| Hy3 | 62.98 | 81.00 | 49.64 | 18.87 | 18.89 | 69.78 | 50.19 |
| Qwen3.6-35B-A3B | 55.34 | 79.00 | 51.34 | 20.08 | 15.56 | 62.82 | 47.36 |
| Hy3-A3B Base | 58.40 | 73.00 | 50.86 | 26.05 | 21.11 | 64.88 | 49.05 |
| Qwen3-30B-A3B | 59.16 | 73.00 | 48.28 | 23.03 | 16.67 | 52.49 | 45.44 |
| Writer | LoCoMo | LME | PM-v2 | Travel | Shop. | CMB | Avg. |
|---|---|---|---|---|---|---|---|
| Hy-Memory-30B-A3B | 73.28 | 76.00 | 53.28 | 56.56 | 19.05 | 63.19 | 56.89 |
| Claude Opus 5 | 73.28 | 80.41 | 51.19 | 45.91 | 23.89 | 49.53 | 54.04 |
| DeepSeek V4.1 Flash | 72.52 | 82.83 | 49.74 | 59.47 | 18.89 | 49.38 | 55.47 |
| Hy3 | 68.70 | 83.00 | 48.68 | 46.52 | 19.44 | 47.44 | 52.30 |
| Qwen3.6-35B-A3B | 69.08 | 79.00 | 50.60 | 43.53 | 18.77 | 43.52 | 50.75 |
| Hy3-A3B Base | 64.50 | 81.00 | 52.14 | 41.74 | 20.56 | 45.93 | 50.98 |
| Qwen3-30B-A3B | 67.94 | 60.00 | 47.10 | 44.80 | 18.33 | 41.27 | 46.57 |
Deploy the model with vLLM (tested with v0.31.0) using --served-model-name hy-memory, then call the OpenAI-compatible API. The example below extracts user facts and preferences with no-think mode enabled.
from openai import OpenAI
client = OpenAI(
base_url="http://127.0.0.1:8000/v1",
api_key="EMPTY",
)
response = client.chat.completions.create(
model="hy-memory",
messages=[
{
"role": "system",
"content": (
"Extract explicit Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.