Model reference · open weights

Hy-Memory

LLMs tencent Text gen · MoE 3 builds Open weights 0 dl/mo

Hy-Memory is an open-weight language model from tencent. Hy-Memory-30B-A3B (BF16) weighs 60.1 GB; the smallest configuration that runs it is H100 80 GB.

For self-hosting, compare this build's requirements below with the GPU you plan to rent.

  • Hy-Memory is a text-generation model developed by Tencent that serves as a long-term-memory writer for external memory frameworks.
  • It features 30.1 billion parameters with approximately 3 billion active, supports a context length of 262,144 tokens, and operates in English and Chinese under the Apache 2.0 license.

Summary of the tencent/Hy-Memory-30B-A3B model card, 2026-10-17

What it is

Released bytencent
Released2026-10-15
Parameters30.1B
VRAM60.1 GB for the weights

What it runs on

Memory and cards for Hy-Memory-30B-A3B (BF16)

60.1 GBweights, file size
98 MBcache per 1K tokens
1.5 GBruntime overhead, at least
262,144 tokenscontext max
CardRequests at onceContext maxMemory
8K each32K each
RTX 3060 12 GB … L40S 48 GB
6 smaller cards
A100 80 GB205164K78.2 GB
H100 80 GB123102K78.1 GB
RTX PRO 6000 Blackwell 96 GB328all 256K93.8 GB
DGX Spark (GB10) 128 GB unified4912all 256K107 GB
H200 141 GB8721all 256K138 GB
B200 180 GB13032all 256K176 GB
2× L40S 48 GB
tensor parallel
307247K44.0 GB a card
4× RTX 4090 24 GB
tensor parallel
348all 256K23.4 GB a card
4× RTX 3090 24 GB
tensor parallel
348all 256K23.4 GB a card
4× RTX 5090 32 GB
tensor parallel
7218all 256K31.0 GB a card
2× H100 80 GB
tensor parallel
10025all 256K78.1 GB a card
Memory needed at each load
Requests at once8K tokens each32K tokens each
162.4 GB64.8 GB
565.6 GB77.7 GB
868.0 GB87.4 GB
1674.5 GB113 GB
3287.4 GB165 GB
64113 GB268 GB

One card, with vLLM's small-card settings.

Builds

Sizes, precisions & builds

BuildParamsPrecisionWeightsSmallest setup
Hy-Memory-30B-A3B (above) ↗ 30.1BBF16 60.1 GBH100 80 GB
Hy-Memory-30B-A3B-FP8 ↗ 30.1BFP8 30.6 GBL40S 48 GB
Hy-Memory-30B-A3B-GGUF ↗
2 builds: Q8_0 32.0 GB … GGUF 42.9 GB
GGUF 42.9 GBL40S 48 GB

From the model card

What tencent says about Hy-Memory

Read the model card

Model Introduction

Hy-Memory-30B-A3B is a compact long-term-memory writer model (~3B active parameters) developed by Tencent Hunyuan to execute the write path inside external memory frameworks. It directly replaces the general-purpose LLM inside Mem0, MemOS, and Hy-Memory (covering Chat, Working, and Coding scenarios), deciding what information to retain, how precisely to represent it, and how new evidence should update the persistent memory bank. The model is trained in two stages—Memory On-Policy Distillation (OPD) followed by Attributed Memory Reinforcement Learning—and transfers directly to unseen memory frameworks such as EverMemOS.


Two-Stage Training


Experiments

Evaluation Principles

The evaluation changes only the memory writer. For each comparison, the harness version and prompts are fixed, retrieval configuration is fixed, and the answer model, judge, and other framework-side components are held fixed. Throughout this report, every reference to a DeepSeek Flash endpoint denotes DeepSeek V4.1 Flash. Decoding settings are matched where APIs permit, each writer builds its own bank from an empty state, and test examples and scoring rules are identical.

For computational efficiency, every benchmark in the main four-harness matrix is evaluated on a fixed 20% subsample. Each harness score is the equal-weight average of six metrics: LoCoMo Judge, LongMemEval (LME), PersonaMem-v2 (PM-v2), Travel SPS, Shopping PS, and Code Memory Bench (CMB). CMB is itself the equal-weight average of two repository QA evaluations. The overall score is the equal-weight average of the four harness scores.

Final Cross-Harness Results

Memory writerMem0Hy-Mem.MemOSEverMem.Avg.
Hy-Memory-30B-A3B54.0260.5550.5156.8955.49
Claude Opus 553.4360.5350.5054.0454.62
DeepSeek V4.1 Flash49.7360.2049.1755.4753.64
Hy345.9958.0650.1952.3051.63
Qwen3.6-35B-A3B47.5155.8747.3650.7550.37
Hy3-A3B Base40.2050.3949.0550.9847.66
Qwen3-30B-A3B39.8145.6745.4446.5744.37

Table 1: Six-metric means on fixed 20% benchmark subsamples. The macro average weights the four harnesses equally.

Detailed Benchmark Results

Tables 2–5 report the six benchmark scores used to compute each harness mean in Table 1 on the same fixed 20% benchmark subsamples.

Table 2: Detailed results on the Mem0 harness
WriterLoCoMoLMEPM-v2TravelShop.CMBAvg.
Hy-Memory-30B-A3B59.5473.0051.6254.5118.3367.1354.02
Claude Opus 569.4766.0053.5842.9817.7870.7453.43
DeepSeek V4.1 Flash58.7869.3949.5635.0716.6768.9249.73
Hy341.2262.0044.4446.8717.2264.1645.99
Qwen3.6-35B-A3B50.0069.0049.3836.3920.0060.3047.51
Hy3-A3B Base50.0047.0040.8237.9114.4451.0340.20
Qwen3-30B-A3B46.1856.0042.3231.9816.6745.6839.81
Table 3: Detailed results on the Hy-Memory harness
WriterLoCoMoLMEPM-v2TravelShop.CMBAvg.
Hy-Memory-30B-A3B73.2889.0051.5457.6521.1170.7360.55
Claude Opus 574.4389.6948.7151.3423.3375.7060.53
DeepSeek V4.1 Flash72.9085.8649.0053.4622.7877.1860.20
Hy369.4789.0052.7649.0121.6766.4458.06
Qwen3.6-35B-A3B70.9984.8543.5649.8220.0065.9855.87
Hy3-A3B Base66.4187.0049.8431.3617.7849.9750.39
Qwen3-30B-A3B64.1282.0041.0632.8318.8935.1045.67
Table 4: Detailed results on the MemOS harness
WriterLoCoMoLMEPM-v2TravelShop.CMBAvg.
Hy-Memory-30B-A3B62.9873.0051.9224.1521.1169.9150.51
Claude Opus 563.7479.3852.8422.1419.4465.4650.50
DeepSeek V4.1 Flash61.0773.0050.6818.6121.6769.9749.17
Hy362.9881.0049.6418.8718.8969.7850.19
Qwen3.6-35B-A3B55.3479.0051.3420.0815.5662.8247.36
Hy3-A3B Base58.4073.0050.8626.0521.1164.8849.05
Qwen3-30B-A3B59.1673.0048.2823.0316.6752.4945.44
Table 5: Detailed results on the held-out EverMemOS harness
WriterLoCoMoLMEPM-v2TravelShop.CMBAvg.
Hy-Memory-30B-A3B73.2876.0053.2856.5619.0563.1956.89
Claude Opus 573.2880.4151.1945.9123.8949.5354.04
DeepSeek V4.1 Flash72.5282.8349.7459.4718.8949.3855.47
Hy368.7083.0048.6846.5219.4447.4452.30
Qwen3.6-35B-A3B69.0879.0050.6043.5318.7743.5250.75
Hy3-A3B Base64.5081.0052.1441.7420.5645.9350.98
Qwen3-30B-A3B67.9460.0047.1044.8018.3341.2746.57

Quickstart

Deploy the model with vLLM (tested with v0.31.0) using --served-model-name hy-memory, then call the OpenAI-compatible API. The example below extracts user facts and preferences with no-think mode enabled.

from openai import OpenAI

client = OpenAI(
    base_url="http://127.0.0.1:8000/v1",
    api_key="EMPTY",
)

response = client.chat.completions.create(
    model="hy-memory",
    messages=[
        {
            "role": "system",
            "content": (
                "Extract explicit 

Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.

© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms