Model reference · open weights

real-nepali-kala

Audio ampixa Text→speech 1 build Open weights 2k dl/mo

real-nepali-kala is an open-weight audio or speech model from ampixa. real-nepali-v0.2-kala (BF16) weighs 935 MB; the smallest configuration that runs it is RTX 3060 12 GB.

For self-hosting, compare this build's requirements below with the GPU you plan to rent.

  • real-nepali-kala is a multi-speaker text-to-speech model for the Nepali language, developed by ampixa.
  • It utilizes a custom grapheme-to-phoneme frontend and a VITS architecture to generate audio at 22050 Hz.
  • The model is distributed under the CC-BY-SA-4.0 license and runs in real time on CPU hardware.

Summary of the ampixa/real-nepali-v0.2-kala model card, 2026-10-01

What it is

Released byampixa
Released2026-05-04
VRAM935 MB for the weights

What it runs on

Memory and cards for real-nepali-v0.2-kala (BF16)

935 MBweights, file size
1.6 GBruntime overhead
CardOne streamMemory
RTX 3060 12 GBfits11.6 GB
RTX 4060 Ti 16 GBfits15.4 GB
RTX 3090 24 GBfits23.4 GB
RTX 4090 24 GBfits23.4 GB
RTX 5090 32 GBfits31.0 GB
L40S 48 GBfits44.0 GB
A100 80 GBfits78.2 GB
H100 80 GBfits78.1 GB
RTX PRO 6000 Blackwell 96 GBfits93.8 GB
DGX Spark (GB10) 128 GB unifiedfits107 GB
H200 141 GBfits138 GB
B200 180 GBfits176 GB

From the model card

What ampixa says about real-nepali-kala

Read the model card

The first open-source Nepali TTS model built on a hand-crafted G2P — no eSpeak.

Kala is a multi-speaker VITS model trained with the real_nepali G2P frontend: a rule-and-lexicon system grounded in Khatiwada 2009 and tuned to mainstream Kathmandu Nepali phonology. The ONNX model runs on CPU in real time (RTF ≈ 0.02 — 50× faster than real time on a laptop).


Why a new G2P?

eSpeak-ng's ne voice was designed for phoneme coverage, not phonological accuracy. It maps Nepali affricates to alveolar labels (ts, tsh) that do not match how Kathmandu speakers produce च and छ. It silently loses gemination and does not handle Latin code-switching at all.

The real_nepali frontend:

FeatureeSpeak nereal_nepali
च / छts / tsh (alveolar)ch / chh (palatal)
Geminationoften lostexplicit : tokens
Schwa deletionheuristicrule-based, audited
Latin code-switchundefinedletter-by-letter or override lexicon
Phone inventory~3548 phones + geminated variants
Lexiconnone48 000-entry curated lexicon

On the NepTTS-Bench minimal-pairs test (365 sentences), the frontend reaches 99.5 % minimal-pair contrast preservation against the reference IPA transcriptions.


Available speakers

SpeakerIDData typeTraining hours
kala2human studio0.37 h
barsha1human recording1.62 h
slr143_F3corpus (OpenSLR-143)1.01 h
slr43_05464corpus (OpenSLR-43)0.62 h
slr43_20995corpus (OpenSLR-43)0.51 h

Recommended speaker: kala for demo and production use. The corpus speakers (slr143_F, slr43_*) have good prosody but recording conditions vary; barsha is the second-best human voice.


Quick start (Python)

pip install kala-tts
import kala_tts

# Returns WAV bytes (16-bit PCM, 22050 Hz mono)
wav = kala_tts.synthesize("नमस्कार, कसरी हुनुहुन्छ?", speaker="kala")

# Write directly to a file
kala_tts.synthesize_to_file(
    "नेपाल सुन्दर देश हो।",
    "output.wav",
    speaker="kala",
)

# List available speakers
print(kala_tts.list_speakers())
# ('kala', 'barsha', 'slr143_F', 'slr43_0546', 'slr43_2099')
# CLI
kala-tts "नमस्कार, कसरी हुनुहुन्छ?" --speaker kala -o out.wav
kala-tts --list-speakers

The first call downloads the ONNX model (~60 MB) from this repo and caches it locally via huggingface_hub.


Manual inference (no pip)

Download the ONNX and config files from this repo, then:

git clone https://github.com/Ampixa/nepa-newa-text-frontend
cd nepa-newa-text-frontend
pip install onnxruntime huggingface_hub numpy
python -m kala_tts "नमस्कार" -o out.wav

Or use piper directly:

pip install piper-tts
echo "नमस्कार, कसरी हुनुहुन्छ?" | \
  piper --model real_nepali_v02_kala.fp32.onnx --speaker_id 2 --output_file out.wav

ONNX model details

PropertyValue
Filereal_nepali_v02_kala.fp32.onnx
FormatFP32 ONNX (VITS encoder + decoder fused)
Sample rate22050 Hz
Inputsinput (int64 phone IDs), input_lengths, scales, sid
Speakers6 (use sid to select)
RTF on laptop CPU~0.02 (50× real-time)

Training details

ItemValue
Base checkpointpiper-plus multilingual (302 MB)
ArchitectureVITS + monotonic attention
Total training rows4 338
Total training hours8.61 h
Training epochs1 000
Frameworkpiper-plus (patched for Nepali)
HardwareNVIDIA L40S 46 GB

Checkpoint SHA-256:

2b36b27f42e8549658676f953704573a31e2155fc95ec5d6407561e9fc4797fa

Training data

SpeakerSourceRowsHoursLicense
algenibGemini-Flash synthetic (excluded from v0.2 public release)1 9844.47 hinternal
barshaHuman recital8081.62 hCC-BY-SA-4.0
kalaHuman studio2000.37 hCC-BY-SA-4.0
slr143_FOpenSLR-1435661.01 hCC-BY-SA-4.0
slr43_0546OpenSLR-435050.62 hCC-BY-SA-4.0
slr43_2099OpenSLR-432750.51 hCC-BY-SA-4.0

Known limitations

  • Naturalness gap: Trained on only 200 utterances for the Kala voice; prosody can be flat on long sentences.
  • Punctuation awareness: Periods, commas, and question marks are handled via deterministic pause insertion — the model does not learn intonation contours from punctuation tokens.
  • OOV words: Unknown Devanagari words fall back to letter-by-letter rules. The 48 000-entry lexicon covers ~95% of common vocabulary.
  • Numbers: Digits are read in Nepali word order; mixed Nepali/English numerals may produce unexpected output.

Citation

@misc{ampixa2026kala,
  title  = {Kala: CPU-native Nepali Text-to-Speech with a hand-crafted G2P},
  author = {Ampixa},
  year   = {2026},
  url    = {https://huggingface.co/ampixa/real-nepali-v0.2-kala},
}

Phonological foundation: Khatiwada (2009), Nepali, Journal of the International Phonetic Association, 39(3), 373–380.


License

Model weights and code: CC-BY-SA 4.0 Training corpus (OpenSLR-143, OpenSLR-43): CC-BY-SA 4.0 G2P lexicon seed (google/language-resources ne/): CC-BY 4.0

Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.

How it works

How audio & music work

Audio or textinputAudio modelrecognise / synthesiseText or audiooutputSpeech-to-text turns audio into text; text-to-speech and music models turn text into audio.
© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms