Model reference · open weights

Hy-Memory

LLMs tencent Text gen · MoE 3 builds Open weights 0 dl/mo

Hy-Memory is an open-weight language model from tencent. Hy-Memory-30B-A3B-GGUF (GGUF) weighs 42.9 GB; the smallest configuration that runs it is L40S 48 GB.

For self-hosting, compare this build's requirements below with the GPU you plan to rent.

  • Hy-Memory is a text-generation model developed by Tencent that serves as a long-term-memory writer for external memory frameworks.
  • It features 30.1 billion parameters with approximately 3 billion active, supports a context length of 262,144 tokens, and operates in English and Chinese under the Apache 2.0 license.

Summary of the tencent/Hy-Memory-30B-A3B model card, 2026-10-17. The estimate below is for another build of the family.

What it is

Released bytencent
Released2026-10-15
Parameters30.1B
VRAM42.9 GB for the weights

What it runs on

Memory and cards for Hy-Memory-30B-A3B-GGUF (GGUF)

42.9 GBweights, file size
651 MBruntime overhead, at least
262,144 tokenscontext max

How much memory each request adds isn't estimated yet for this architecture. The weights need at least the cards below, plus room for the context.

CardWeights alone
RTX 3060 12 GB … RTX 5090 32 GB
5 smaller cards
does not fit
L40S 48 GBtight
A100 80 GBfits
H100 80 GBfits
RTX PRO 6000 Blackwell 96 GBfits
DGX Spark (GB10) 128 GB unifiedfits
H200 141 GBfits
B200 180 GBfits
2× RTX 5090 32 GB
split by layers (llama.cpp)
fits
2× L40S 48 GB
split by layers (llama.cpp)
fits
4× RTX 4090 24 GB
split by layers (llama.cpp)
fits
4× RTX 3090 24 GB
split by layers (llama.cpp)
fits

Builds

Sizes, precisions & builds

BuildParamsPrecisionWeightsSmallest setup
Hy-Memory-30B-A3B ↗ 30.1BBF16 60.1 GBH100 80 GB
Hy-Memory-30B-A3B-FP8 ↗ 30.1BFP8 30.6 GBL40S 48 GB
Hy-Memory-30B-A3B-GGUF (above) ↗
2 builds: Q8_0 32.0 GB … GGUF 42.9 GB
GGUF 42.9 GBL40S 48 GB

From the model card

What tencent says about Hy-Memory

Read the model card

Model Introduction

Hy-Memory-30B-A3B is a compact long-term-memory writer model (~3B active parameters) developed by Tencent Hunyuan to execute the write path inside external memory frameworks. It directly replaces the general-purpose LLM inside Mem0, MemOS, and Hy-Memory (covering Chat, Working, and Coding scenarios), deciding what information to retain, how precisely to represent it, and how new evidence should update the persistent memory bank. The model is trained in two stages—Memory On-Policy Distillation (OPD) followed by Attributed Memory Reinforcement Learning—and transfers directly to unseen memory frameworks such as EverMemOS.


Two-Stage Training


Experiments

Evaluation Principles

The evaluation changes only the memory writer. For each comparison, the harness version and prompts are fixed, retrieval configuration is fixed, and the answer model, judge, and other framework-side components are held fixed. Throughout this report, every reference to a DeepSeek Flash endpoint denotes DeepSeek V4.1 Flash. Decoding settings are matched where APIs permit, each writer builds its own bank from an empty state, and test examples and scoring rules are identical.

For computational efficiency, every benchmark in the main four-harness matrix is evaluated on a fixed 20% subsample. Each harness score is the equal-weight average of six metrics: LoCoMo Judge, LongMemEval (LME), PersonaMem-v2 (PM-v2), Travel SPS, Shopping PS, and Code Memory Bench (CMB). CMB is itself the equal-weight average of two repository QA evaluations. The overall score is the equal-weight average of the four harness scores.

Final Cross-Harness Results

Memory writerMem0Hy-Mem.MemOSEverMem.Avg.
Hy-Memory-30B-A3B54.0260.5550.5156.8955.49
Claude Opus 553.4360.5350.5054.0454.62
DeepSeek V4.1 Flash49.7360.2049.1755.4753.64
Hy345.9958.0650.1952.3051.63
Qwen3.6-35B-A3B47.5155.8747.3650.7550.37
Hy3-A3B Base40.2050.3949.0550.9847.66
Qwen3-30B-A3B39.8145.6745.4446.5744.37

Table 1: Six-metric means on fixed 20% benchmark subsamples. The macro average weights the four harnesses equally.

Detailed Benchmark Results

Tables 2–5 report the six benchmark scores used to compute each harness mean in Table 1 on the same fixed 20% benchmark subsamples.

Table 2: Detailed results on the Mem0 harness
WriterLoCoMoLMEPM-v2TravelShop.CMBAvg.
Hy-Memory-30B-A3B59.5473.0051.6254.5118.3367.1354.02
Claude Opus 569.4766.0053.5842.9817.7870.7453.43
DeepSeek V4.1 Flash58.7869.3949.5635.0716.6768.9249.73
Hy341.2262.0044.4446.8717.2264.1645.99
Qwen3.6-35B-A3B50.0069.0049.3836.3920.0060.3047.51
Hy3-A3B Base50.0047.0040.8237.9114.4451.0340.20
Qwen3-30B-A3B46.1856.0042.3231.9816.6745.6839.81
Table 3: Detailed results on the Hy-Memory harness
WriterLoCoMoLMEPM-v2TravelShop.CMBAvg.
Hy-Memory-30B-A3B73.2889.0051.5457.6521.1170.7360.55
Claude Opus 574.4389.6948.7151.3423.3375.7060.53
DeepSeek V4.1 Flash72.9085.8649.0053.4622.7877.1860.20
Hy369.4789.0052.7649.0121.6766.4458.06
Qwen3.6-35B-A3B70.9984.8543.5649.8220.0065.9855.87
Hy3-A3B Base66.4187.0049.8431.3617.7849.9750.39
Qwen3-30B-A3B64.1282.0041.0632.8318.8935.1045.67
Table 4: Detailed results on the MemOS harness
WriterLoCoMoLMEPM-v2TravelShop.CMBAvg.
Hy-Memory-30B-A3B62.9873.0051.9224.1521.1169.9150.51
Claude Opus 563.7479.3852.8422.1419.4465.4650.50
DeepSeek V4.1 Flash61.0773.0050.6818.6121.6769.9749.17
Hy362.9881.0049.6418.8718.8969.7850.19
Qwen3.6-35B-A3B55.3479.0051.3420.0815.5662.8247.36
Hy3-A3B Base58.4073.0050.8626.0521.1164.8849.05
Qwen3-30B-A3B59.1673.0048.2823.0316.6752.4945.44
Table 5: Detailed results on the held-out EverMemOS harness
WriterLoCoMoLMEPM-v2TravelShop.CMBAvg.
Hy-Memory-30B-A3B73.2876.0053.2856.5619.0563.1956.89
Claude Opus 573.2880.4151.1945.9123.8949.5354.04
DeepSeek V4.1 Flash72.5282.8349.7459.4718.8949.3855.47
Hy368.7083.0048.6846.5219.4447.4452.30
Qwen3.6-35B-A3B69.0879.0050.6043.5318.7743.5250.75
Hy3-A3B Base64.5081.0052.1441.7420.5645.9350.98
Qwen3-30B-A3B67.9460.0047.1044.8018.3341.2746.57

Quickstart

Deploy the model with vLLM (tested with v0.31.0) using --served-model-name hy-memory, then call the OpenAI-compatible API. The example below extracts user facts and preferences with no-think mode enabled.

from openai import OpenAI

client = OpenAI(
    base_url="http://127.0.0.1:8000/v1",
    api_key="EMPTY",
)

response = client.chat.completions.create(
    model="hy-memory",
    messages=[
        {
            "role": "system",
            "content": (
                "Extract explicit 

Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.

© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms