AxForge
Sign in Get started

Model reference · open weights

openchat_v2_openorca

LLMs openchat Text gen 1 build Its own licence terms 0 dl/mo

openchat_v2_openorca is an open-weight language model from openchat. openchat_v2_openorca_preview (BF16) weighs 26.0 GB; the smallest configuration that runs it is RTX 5090 32 GB.

Request Rent a GPU

For self-hosting, compare this build's requirements below with the GPU you plan to rent.

  • openchat_v2_openorca is a text-generation model developed by openchat and published as a beta preview.
  • It was trained for two epochs on the full OpenOrca dataset and is intended for limited testing purposes.
  • The model uses a specific conversation template with an end-of-turn token and is compatible with the OpenChat V2 vLLM server.

Summary of the openchat/openchat_v2_openorca_preview model card, 2026-10-01

Hugging Face ↗

What it is

Released byopenchat
Released2023-07-14
VRAM26.0 GB for the weights

What it runs on

Memory and cards for openchat_v2_openorca_preview (BF16)

26.0 GBweights, file size
762 MBruntime overhead, at least

How much memory each request adds isn't estimated yet for this architecture. The weights need at least the cards below, plus room for the context.

CardWeights alone
RTX 3060 12 GB … RTX 4090 24 GB
4 smaller cards		does not fit
RTX 5090 32 GBtight
L40S 48 GBfits
A100 80 GBfits
H100 80 GBfits
RTX PRO 6000 Blackwell 96 GBfits
DGX Spark (GB10) 128 GB unifiedfits
H200 141 GBfits
B200 180 GBfits

How it works

How language models work

Your prompttext / messagesTransformerattention over tokensNext-token loopgenerate + streamResponsetext · tool callsA language model reads your tokens and predicts the next one, again and again, streaming the reply back.
© 2026 AxForge · EU-hosted AI infrastructure Pricing Docs Trust Privacy Terms