Model reference · open weights

gudio

Audio gguf-org Text→speech 1 build Open weights 718 dl/mo

gudio is an open-weight audio or speech model from gguf-org. gudio (BF16) weighs 1.0 GB; the smallest configuration that runs it is RTX 3060 12 GB.

For self-hosting, compare this build's requirements below with the GPU you plan to rent.

  • gudio is a text-to-speech model developed by gguf-org and released under the MIT license.
  • It supports English and is designed to be run using the gguf-connector tool, which allows users to select specific GGUF model and clip files for synthesis.
  • The card provides instructions for executing the model via a console command and notes that it can be accessed through a local web interface.

Summary of the gguf-org/gudio model card, 2026-10-01

What it is

Released bygguf-org
Released2025-06-26
VRAM1.0 GB for the weights

What it runs on

Memory and cards for gudio (BF16)

1.0 GBweights, file size
1.6 GBruntime overhead
CardOne streamMemory
RTX 3060 12 GBfits11.6 GB
RTX 4060 Ti 16 GBfits15.4 GB
RTX 3090 24 GBfits23.4 GB
RTX 4090 24 GBfits23.4 GB
RTX 5090 32 GBfits31.0 GB
L40S 48 GBfits44.0 GB
A100 80 GBfits78.2 GB
H100 80 GBfits78.1 GB
RTX PRO 6000 Blackwell 96 GBfits93.8 GB
DGX Spark (GB10) 128 GB unifiedfits107 GB
H200 141 GBfits138 GB
B200 180 GBfits176 GB

From the model card

What gguf-org says about gudio

Read the model card
  • text-to-speech synthesis

run it with gguf-connector

ggc g2
PromptAudio Sample
Hey Connector, why your appearance looks so stupid?``Oh, really? maybe I ate too much smart beans.``Wow. Amazing.``Let's go to get some more smart beans and you will become stupid as well.🎧 audio-sample-1
Hey, why you folks always act together like a wolf pack?``Oh, really? we just hang out for good food and share the bills.``Wow, amazing, a pig pack then!``You are the smartest joke maker in this universe.🎧 audio-sample-2
Suddenly the plane's engines began failing, and the pilot says there isn't much time, and he'll keep the plane in the air as long as he can and told his two passengers to take the only two parachutes on board and bail out. The world's smartest man immediately took a parachute and said "I'm the world's smartest man! The world needs me, so I can't die here!", and then jumped out of the plane. The pilot tells the hippie to hurry up and take the other parachute, because there aren't any more. And the hippie says "Relax man. We'll be fine. The world's smartest man took my backpack."🎧 audio-sample-3

review/reference

  • simply execute the command (ggc g2) above in console/terminal
  • opt a model and a clip gguf in the current directory to interact with (see example below)

Using device: cuda (auto-detection; based on your system/setting)

GGUF file(s) available. Select which one for MODEL (t3):

  1. model_t3-f16-tts-q2_k.gguf
  2. model_t3-f16-tts-q3_k_m.gguf
  3. model_t3-f16-tts-q4_k_m.gguf (recommended)
  4. model_t3-f16-tts-q5_k_m.gguf
  5. model_t3-f16-tts-q6_k.gguf
  6. s3_clip-bf16.gguf
  7. s3_clip-f16.gguf
  8. s3_clip-f32.gguf

Enter your choice (1 to 8): 3

t3 file: model_t3-f16-tts-q4_k_m.gguf is selected!

GGUF file(s) available. Select which one for CLIP (s3):

  1. model_t3-f16-tts-q2_k.gguf
  2. model_t3-f16-tts-q3_k_m.gguf
  3. model_t3-f16-tts-q4_k_m.gguf
  4. model_t3-f16-tts-q5_k_m.gguf
  5. model_t3-f16-tts-q6_k.gguf
  6. s3_clip-bf16.gguf (recommended)
  7. s3_clip-f16.gguf (for non-cuda user)
  8. s3_clip-f32.gguf

Enter your choice (1 to 8): _

  • run it from local URL: http://127.0.0.1:7860 with lazy webui
  • gguf-connector (pypi|repo)

Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.

How it works

How audio & music work

Audio or textinputAudio modelrecognise / synthesiseText or audiooutputSpeech-to-text turns audio into text; text-to-speech and music models turn text into audio.
© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms