Xing4.0

[!Note] This repository provides the model weights and configuration files for Xing4.0-29B-A4B in Hugging Face Transformers format, compatible with Transformers, vLLM, SGLang, KTransformers, and other mainstream inference frameworks.

Xing4.0-29B-A4B is a next-generation large language model in the Xing series (formerly TeleChat), developed by China Telecom Artificial Intelligence Technology Co., Ltd. With 29B total parameters and only 4B activated per token, it natively supports a 256K context length, extensible to 512K. It is the first model of this scale trained entirely on the Ascend NPU platform with the MindSpore framework, and deeply optimized for complex engineering tasks.

For more information, please refer to our GitHub repository.

Highlights

• Agent-Oriented Architecture: Built on the mHC + MLA + MTP architecture, supporting multi-step planning, tool calling, and complex reasoning chain execution, ensuring task coherence and execution stability under long contexts.
• Deep Co-optimization with Ascend NPU: Adapted for Ascend 910C clusters using MindSpore/MindFormers, including feature adaptation for mHC and fused operator development, enabling stable and efficient training on the Ascend platform.
• Significant Training Efficiency Gains: Through multi-level co-optimization — including fine-grained MoE communication optimization, selective recomputation, DVM automatic graph-operator fusion, and Ascend C mHC fused operators — overall training throughput was improved by approximately 96% over out-of-the-box performance.
• Full Open-Source Ecosystem Compatibility: Supports LLaMA-Factory and MindFormers for fine-tuning; SGLang, vLLM, and KTransformers for inference and deployment; with targeted adaptation and format alignment for agent frameworks such as OpenCode, Claude Code, OpenClaw, and Hermes, enabling seamless integration into existing workflows.
• Easy Adaptation for Domain-Specific Scenarios: The model is well-suited for downstream task fine-tuning, allowing lightweight customization on proprietary data for vertical domains such as intent classification, table understanding, contract auditing, and knowledge-based QA, enabling rapid domain capability development and deployment at low cost.

Model Overview

Benchmark

Quickstart

Inference

Xing4.0-29B-A4B can be accessed via an OpenAI-compatible API.

from openai import OpenAI

client = OpenAI(
    base_url="your-base-url",
    api_key="your-api-key",
)

completion = client.chat.completions.create(
    model="Xing4.0-29B-A4B",
    messages=[{"role": "user", "content": "Briefly explain the basic principles of quantum computing."}],
    temperature=1.0,
    top_p=0.95,
    extra_body={
        "repetition_penalty": 1.05,
        "skip_special_tokens": False,
        "spaces_between_special_tokens": False,
        "chat_template_kwargs": {
            "enable_thinking": True,  # Set to False to disable thinking
        },
    },
)

print(completion.choices[0].message.content)

Serving

Xing4.0-29B-A4B supports deployment with vLLM, SGLang, and KTransformers. For detailed launch instructions, please refer to our GitHub repository.

Recommended Parameters

Footnotes

• SWE-bench Verified: We evaluate Xing4.0-29B-A4B using the SWE-agent harness with temperature=1.0, top_p=0.95, repetition_penalty=1.05 and a 210K context window.
• Terminal-Bench 2.1: We evaluate in terminus-2 with temperature=0.8, top_p=0.95, repetition_penalty=1.05, max_tokens=64K and a 24-hour timeout. We report the average score over 3 runs.
• SWE-bench Multilingual: We evaluate Xing4.0-29B-A4B using the SWE-agent harness with temperature=1.0, top_p=0.95, repetition_penalty=1.05 and a 210K context window.
• Claw-Eval: We evaluate using the official harness with temperature=0.8, top_p=0.95, repetition_penalty=1.05, max_tokens=16384 and a 256K context window. We report the average score over 3 runs.
• Tau3-Bench: We evaluate using the official harness with temperature=0.8, top_p=0.95, repetition_penalty=1.05, max_tokens=16384. We report the average pass^1 over 4 runs.
• DeepresearchBII: We evaluate using the OpenCode harness with `temperature=0.8, top_p=0.95,