Model reference · open weights
gudio is an open-weight audio or speech model from gguf-org. gudio (BF16) weighs 1.0 GB; the smallest configuration that runs it is RTX 3060 12 GB.
For self-hosting, compare this build's requirements below with the GPU you plan to rent.
Summary of the gguf-org/gudio model card, 2026-10-01
What it is
| Released by | gguf-org |
|---|---|
| Released | 2025-06-26 |
| VRAM | 1.0 GB for the weights |
What it runs on
| Card | One stream | Memory |
|---|---|---|
| RTX 3060 12 GB | fits | 11.6 GB |
| RTX 4060 Ti 16 GB | fits | 15.4 GB |
| RTX 3090 24 GB | fits | 23.4 GB |
| RTX 4090 24 GB | fits | 23.4 GB |
| RTX 5090 32 GB | fits | 31.0 GB |
| L40S 48 GB | fits | 44.0 GB |
| A100 80 GB | fits | 78.2 GB |
| H100 80 GB | fits | 78.1 GB |
| RTX PRO 6000 Blackwell 96 GB | fits | 93.8 GB |
| DGX Spark (GB10) 128 GB unified | fits | 107 GB |
| H200 141 GB | fits | 138 GB |
| B200 180 GB | fits | 176 GB |
From the model card
ggc g2
| Prompt | Audio Sample |
|---|---|
Hey Connector, why your appearance looks so stupid?``Oh, really? maybe I ate too much smart beans.``Wow. Amazing.``Let's go to get some more smart beans and you will become stupid as well. | 🎧 audio-sample-1 |
Hey, why you folks always act together like a wolf pack?``Oh, really? we just hang out for good food and share the bills.``Wow, amazing, a pig pack then!``You are the smartest joke maker in this universe. | 🎧 audio-sample-2 |
Suddenly the plane's engines began failing, and the pilot says there isn't much time, and he'll keep the plane in the air as long as he can and told his two passengers to take the only two parachutes on board and bail out. The world's smartest man immediately took a parachute and said "I'm the world's smartest man! The world needs me, so I can't die here!", and then jumped out of the plane. The pilot tells the hippie to hurry up and take the other parachute, because there aren't any more. And the hippie says "Relax man. We'll be fine. The world's smartest man took my backpack." | 🎧 audio-sample-3 |
ggc g2) above in console/terminalmodel and a clip gguf in the current directory to interact with (see example below)Using device: cuda (auto-detection; based on your system/setting)
GGUF file(s) available. Select which one for MODEL (t3):
- model_t3-f16-tts-q2_k.gguf
- model_t3-f16-tts-q3_k_m.gguf
- model_t3-f16-tts-q4_k_m.gguf (recommended)
- model_t3-f16-tts-q5_k_m.gguf
- model_t3-f16-tts-q6_k.gguf
- s3_clip-bf16.gguf
- s3_clip-f16.gguf
- s3_clip-f32.gguf
Enter your choice (1 to 8): 3
t3 file: model_t3-f16-tts-q4_k_m.gguf is selected!
GGUF file(s) available. Select which one for CLIP (s3):
- model_t3-f16-tts-q2_k.gguf
- model_t3-f16-tts-q3_k_m.gguf
- model_t3-f16-tts-q4_k_m.gguf
- model_t3-f16-tts-q5_k_m.gguf
- model_t3-f16-tts-q6_k.gguf
- s3_clip-bf16.gguf (recommended)
- s3_clip-f16.gguf (for non-cuda user)
- s3_clip-f32.gguf
Enter your choice (1 to 8): _
Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.
How it works