Model reference · open weights

rubert-cased-sentence

Embeddings DeepPavlov Embeddings 1 build Licence not stated 13k dl/mo

rubert-cased-sentence is an open-weight embedding model from DeepPavlov. rubert-base-cased-sentence (BF16) weighs 711 MB; the smallest configuration that runs it is RTX 3060 12 GB.

For self-hosting, compare this build's requirements below with the GPU you plan to rent.

  • rubert-cased-sentence is a feature-extraction model developed by DeepPavlov for generating sentence representations in Russian.
  • The model consists of 12 layers with 768 hidden units and 12 attention heads, totaling 180 million parameters.
  • It supports a context length of 512 tokens and uses mean-pooled token embeddings to create sentence encodings.

Summary of the DeepPavlov/rubert-base-cased-sentence model card, 2026-10-01

What it is

Released byDeepPavlov
Released2022-03-02
VRAM711 MB for the weights

What it runs on

Memory and cards for rubert-base-cased-sentence (BF16)

711 MBweights, file size
1.1 GBruntime overhead
CardRunsMemory
RTX 3060 12 GBfits11.6 GB
RTX 4060 Ti 16 GBfits15.4 GB
RTX 3090 24 GBfits23.4 GB
RTX 4090 24 GBfits23.4 GB
RTX 5090 32 GBfits31.0 GB
L40S 48 GBfits44.0 GB
A100 80 GBfits78.2 GB
H100 80 GBfits78.1 GB
RTX PRO 6000 Blackwell 96 GBfits93.8 GB
DGX Spark (GB10) 128 GB unifiedfits107 GB
H200 141 GBfits138 GB
B200 180 GBfits176 GB

From the model card

What DeepPavlov says about rubert-cased-sentence

Read the model card

Sentence RuBERT (Russian, cased, 12-layer, 768-hidden, 12-heads, 180M parameters) is a representation‑based sentence encoder for Russian. It is initialized with RuBERT and fine‑tuned on SNLI[1] google-translated to russian and on russian part of XNLI dev set[2]. Sentence representations are mean pooled token embeddings in the same manner as in Sentence‑BERT[3].

[1]: S. R. Bowman, G. Angeli, C. Potts, and C. D. Manning. (2015) A large annotated corpus for learning natural language inference. arXiv preprint arXiv:1508.05326

[2]: Williams A., Bowman S. (2018) XNLI: Evaluating Cross-lingual Sentence Representations. arXiv preprint arXiv:1809.05053

[3]: N. Reimers, I. Gurevych (2019) Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks. arXiv preprint arXiv:1908.10084

Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.

© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms