Model reference · open weights
glm-edge-v is an open-weight language model from zai-org. glm-edge-v-5b-gguf (GGUF) weighs 2.6 GB; the smallest configuration that runs it is RTX 3060 12 GB.
For self-hosting, compare this build's requirements below with the GPU you plan to rent.
Summary of the zai-org/glm-edge-v-5b-gguf model card, 2026-10-01
What it is
| Released by | zai-org |
|---|---|
| Released | 2024-11-27 |
| VRAM | 2.6 GB for the weights |
What it runs on
How much memory each request adds isn't estimated yet for this architecture. The weights need at least the cards below, plus room for the context.
| Card | Weights alone |
|---|---|
| RTX 3060 12 GB | fits |
| RTX 4060 Ti 16 GB | fits |
| RTX 3090 24 GB | fits |
| RTX 4090 24 GB | fits |
| RTX 5090 32 GB | fits |
| L40S 48 GB | fits |
| A100 80 GB | fits |
| H100 80 GB | fits |
| RTX PRO 6000 Blackwell 96 GB | fits |
| DGX Spark (GB10) 128 GB unified | fits |
| H200 141 GB | fits |
| B200 180 GB | fits |
From the model card
中文阅读, 点击这里
The code for adapting this model is actively being integrated into the official llama.cpp. You can test it using the
following adapted version:
git clone https://github.com/piDack/llama.cpp -b support_glm_edge_model
cmake -B build -DGGML_CUDA=ON # Or enable other acceleration hardware
cmake --build build -- -j
After installation, you can start the GLM-Edge Chat model using the following command:
llama-cli -m /model.gguf -p "\nhi\n" -ngl 999
In the command-line interface, you can interact with the model by entering your requests, and the model will provide the corresponding responses.
The usage of this model’s weights is subject to the terms outlined in the LICENSE.
Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.
How it works