gipformer1.5-rnnt

Source code: github.com/ggroup-ai-lab/gipformer

Demo: Try gipformer in your browser

Highlights

• State-of-the-art accuracy — Demonstrates top-tier performance across major Vietnamese ASR benchmarks, delivering highly precise and reliable transcription quality.
• Robust handling of telephonic domains — Excels in processing challenging, noisy real-world call center recordings across all major Vietnamese regional accents.
• Domain-leading accuracy — Best WER on the technology, finance, education, public administration and medical benchmarks.
• Outstanding parameter efficiency — Ranks among the smallest ASR models currently available.
• Seamless edge deployment — Its naturally low resource requirements enable ultra-fast inference on mobile and embedded systems, making it perfectly suited for offline, on-device applications.
• Built-in data privacy — By supporting full local execution, the model ensures sensitive audio data is processed securely on-device, eliminating the need for third-party cloud services.
• gipformer1.5-68M-rnnt is based on the Zipformer Transducer architecture.

Benchmark Results (WER%)

Lower is better; bold = best in each column.

Normalization: Both predictions and labels are normalized before computing WER — lowercased, punctuation removed, and numbers converted to spoken form.

Dataset Descriptions

Private test sets (call center domain):

• tele-medium — Call center recordings with medium difficulty
• tele-hard-north — Low-quality call center audio, hard-to-hear speakers — Northern Vietnamese accent
• tele-hard-middle — Low-quality call center audio, hard-to-hear speakers — Central Vietnamese accent
• tele-hard-south — Low-quality call center audio, hard-to-hear speakers — Southern Vietnamese accent

Public test sets:

• vi-asr-tech-test — Technology: consumer electronics reviews, software tutorials, programming and IT walkthroughs
• vi-asr-edu-test — Education: study-abroad consulting, exam guidance, university and training-course introductions
• vi-asr-finance-test — Finance: stock market commentary, trading platforms, banking and crypto
• vi-asr-pubadmin-test — Public administration: administrative procedures, licensing guidance, civil records
• vivos — Vietnamese read speech corpus
• Common-Voice — Mozilla Common Voice, Vietnamese subset
• vlsp-t1 — VLSP 2020 ASR Shared Task 1
• VietMed — Vietnamese medical domain
• MultiMED — Multi-domain medical conversations
• LSVSC — Large-Scale Vietnamese Speech Corpus
• Fleurs — Google's Few-shot Learning Evaluation of Universal Representations of Speech, Vietnamese subset
• ViMD — Vietnamese Multi-Domain

Call Center Domain: Where It Matters Most

Call center ASR is one of the most challenging real-world domains — noisy phone lines, overlapping speech, diverse regional accents, and spontaneous conversation. The gipformer family holds the best result on all four call center test sets, and no other model comes within 9