Model reference · open weights
Hy-Memory is an open-weight language model from tencent. Hy-Memory-30B-A3B-GGUF (GGUF) weighs 42.9 GB; the smallest configuration that runs it is L40S 48 GB.
For self-hosting, compare this build's requirements below with the GPU you plan to rent.
Summary of the tencent/Hy-Memory-30B-A3B model card, 2026-10-17. The estimate below is for another build of the family.
What it is
| Released by | tencent |
|---|---|
| Released | 2026-10-15 |
| Parameters | 30.1B |
| VRAM | 42.9 GB for the weights |
What it runs on
How much memory each request adds isn't estimated yet for this architecture. The weights need at least the cards below, plus room for the context.
| Card | Weights alone |
|---|---|
| RTX 3060 12 GB … RTX 5090 32 GB 5 smaller cards | does not fit |
| L40S 48 GB | tight |
| A100 80 GB | fits |
| H100 80 GB | fits |
| RTX PRO 6000 Blackwell 96 GB | fits |
| DGX Spark (GB10) 128 GB unified | fits |
| H200 141 GB | fits |
| B200 180 GB | fits |
| 2× RTX 5090 32 GB split by layers (llama.cpp) | fits |
| 2× L40S 48 GB split by layers (llama.cpp) | fits |
| 4× RTX 4090 24 GB split by layers (llama.cpp) | fits |
| 4× RTX 3090 24 GB split by layers (llama.cpp) | fits |
Builds
| Build | Params | Precision | Weights | Smallest setup |
|---|---|---|---|---|
| Hy-Memory-30B-A3B ↗ | 30.1B | BF16 | 60.1 GB | H100 80 GB |
| Hy-Memory-30B-A3B-FP8 ↗ | 30.1B | FP8 | 30.6 GB | L40S 48 GB |
| Hy-Memory-30B-A3B-GGUF (above) ↗ 2 builds: Q8_0 32.0 GB … GGUF 42.9 GB |
GGUF | 42.9 GB | L40S 48 GB |
From the model card
Hy-Memory-30B-A3B is a compact long-term-memory writer model (~3B active parameters) developed by Tencent Hunyuan to execute the write path inside external memory frameworks. It directly replaces the general-purpose LLM inside Mem0, MemOS, and Hy-Memory (covering Chat, Working, and Coding scenarios), deciding what information to retain, how precisely to represent it, and how new evidence should update the persistent memory bank. The model is trained in two stages—Memory On-Policy Distillation (OPD) followed by Attributed Memory Reinforcement Learning—and transfers directly to unseen memory frameworks such as EverMemOS.
The evaluation changes only the memory writer. For each comparison, the harness version and prompts are fixed, retrieval configuration is fixed, and the answer model, judge, and other framework-side components are held fixed. Throughout this report, every reference to a DeepSeek Flash endpoint denotes DeepSeek V4.1 Flash. Decoding settings are matched where APIs permit, each writer builds its own bank from an empty state, and test examples and scoring rules are identical.
For computational efficiency, every benchmark in the main four-harness matrix is evaluated on a fixed 20% subsample. Each harness score is the equal-weight average of six metrics: LoCoMo Judge, LongMemEval (LME), PersonaMem-v2 (PM-v2), Travel SPS, Shopping PS, and Code Memory Bench (CMB). CMB is itself the equal-weight average of two repository QA evaluations. The overall score is the equal-weight average of the four harness scores.
| Memory writer | Mem0 | Hy-Mem. | MemOS | EverMem. | Avg. |
|---|---|---|---|---|---|
| Hy-Memory-30B-A3B | 54.02 | 60.55 | 50.51 | 56.89 | 55.49 |
| Claude Opus 5 | 53.43 | 60.53 | 50.50 | 54.04 | 54.62 |
| DeepSeek V4.1 Flash | 49.73 | 60.20 | 49.17 | 55.47 | 53.64 |
| Hy3 | 45.99 | 58.06 | 50.19 | 52.30 | 51.63 |
| Qwen3.6-35B-A3B | 47.51 | 55.87 | 47.36 | 50.75 | 50.37 |
| Hy3-A3B Base | 40.20 | 50.39 | 49.05 | 50.98 | 47.66 |
| Qwen3-30B-A3B | 39.81 | 45.67 | 45.44 | 46.57 | 44.37 |
Table 1: Six-metric means on fixed 20% benchmark subsamples. The macro average weights the four harnesses equally.
Tables 2–5 report the six benchmark scores used to compute each harness mean in Table 1 on the same fixed 20% benchmark subsamples.
| Writer | LoCoMo | LME | PM-v2 | Travel | Shop. | CMB | Avg. |
|---|---|---|---|---|---|---|---|
| Hy-Memory-30B-A3B | 59.54 | 73.00 | 51.62 | 54.51 | 18.33 | 67.13 | 54.02 |
| Claude Opus 5 | 69.47 | 66.00 | 53.58 | 42.98 | 17.78 | 70.74 | 53.43 |
| DeepSeek V4.1 Flash | 58.78 | 69.39 | 49.56 | 35.07 | 16.67 | 68.92 | 49.73 |
| Hy3 | 41.22 | 62.00 | 44.44 | 46.87 | 17.22 | 64.16 | 45.99 |
| Qwen3.6-35B-A3B | 50.00 | 69.00 | 49.38 | 36.39 | 20.00 | 60.30 | 47.51 |
| Hy3-A3B Base | 50.00 | 47.00 | 40.82 | 37.91 | 14.44 | 51.03 | 40.20 |
| Qwen3-30B-A3B | 46.18 | 56.00 | 42.32 | 31.98 | 16.67 | 45.68 | 39.81 |
| Writer | LoCoMo | LME | PM-v2 | Travel | Shop. | CMB | Avg. |
|---|---|---|---|---|---|---|---|
| Hy-Memory-30B-A3B | 73.28 | 89.00 | 51.54 | 57.65 | 21.11 | 70.73 | 60.55 |
| Claude Opus 5 | 74.43 | 89.69 | 48.71 | 51.34 | 23.33 | 75.70 | 60.53 |
| DeepSeek V4.1 Flash | 72.90 | 85.86 | 49.00 | 53.46 | 22.78 | 77.18 | 60.20 |
| Hy3 | 69.47 | 89.00 | 52.76 | 49.01 | 21.67 | 66.44 | 58.06 |
| Qwen3.6-35B-A3B | 70.99 | 84.85 | 43.56 | 49.82 | 20.00 | 65.98 | 55.87 |
| Hy3-A3B Base | 66.41 | 87.00 | 49.84 | 31.36 | 17.78 | 49.97 | 50.39 |
| Qwen3-30B-A3B | 64.12 | 82.00 | 41.06 | 32.83 | 18.89 | 35.10 | 45.67 |
| Writer | LoCoMo | LME | PM-v2 | Travel | Shop. | CMB | Avg. |
|---|---|---|---|---|---|---|---|
| Hy-Memory-30B-A3B | 62.98 | 73.00 | 51.92 | 24.15 | 21.11 | 69.91 | 50.51 |
| Claude Opus 5 | 63.74 | 79.38 | 52.84 | 22.14 | 19.44 | 65.46 | 50.50 |
| DeepSeek V4.1 Flash | 61.07 | 73.00 | 50.68 | 18.61 | 21.67 | 69.97 | 49.17 |
| Hy3 | 62.98 | 81.00 | 49.64 | 18.87 | 18.89 | 69.78 | 50.19 |
| Qwen3.6-35B-A3B | 55.34 | 79.00 | 51.34 | 20.08 | 15.56 | 62.82 | 47.36 |
| Hy3-A3B Base | 58.40 | 73.00 | 50.86 | 26.05 | 21.11 | 64.88 | 49.05 |
| Qwen3-30B-A3B | 59.16 | 73.00 | 48.28 | 23.03 | 16.67 | 52.49 | 45.44 |
| Writer | LoCoMo | LME | PM-v2 | Travel | Shop. | CMB | Avg. |
|---|---|---|---|---|---|---|---|
| Hy-Memory-30B-A3B | 73.28 | 76.00 | 53.28 | 56.56 | 19.05 | 63.19 | 56.89 |
| Claude Opus 5 | 73.28 | 80.41 | 51.19 | 45.91 | 23.89 | 49.53 | 54.04 |
| DeepSeek V4.1 Flash | 72.52 | 82.83 | 49.74 | 59.47 | 18.89 | 49.38 | 55.47 |
| Hy3 | 68.70 | 83.00 | 48.68 | 46.52 | 19.44 | 47.44 | 52.30 |
| Qwen3.6-35B-A3B | 69.08 | 79.00 | 50.60 | 43.53 | 18.77 | 43.52 | 50.75 |
| Hy3-A3B Base | 64.50 | 81.00 | 52.14 | 41.74 | 20.56 | 45.93 | 50.98 |
| Qwen3-30B-A3B | 67.94 | 60.00 | 47.10 | 44.80 | 18.33 | 41.27 | 46.57 |
Deploy the model with vLLM (tested with v0.31.0) using --served-model-name hy-memory, then call the OpenAI-compatible API. The example below extracts user facts and preferences with no-think mode enabled.
from openai import OpenAI
client = OpenAI(
base_url="http://127.0.0.1:8000/v1",
api_key="EMPTY",
)
response = client.chat.completions.create(
model="hy-memory",
messages=[
{
"role": "system",
"content": (
"Extract explicit Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.