Model reference · open weights
CORe-Pico-4 is an open-weight language model from OpenCOReTechnologies. CORe-Pico-4 (BF16) weighs 3.4 GB; the smallest configuration that runs it is RTX 3060 12 GB.
For self-hosting, compare this build's requirements below with the GPU you plan to rent.
Summary of the OpenCOReTechnologies/CORe-Pico-4 model card, 2026-10-01
What it is
| Released by | OpenCOReTechnologies |
|---|---|
| Released | 2026-09-16 |
| Parameters | 1.7B |
| VRAM | 3.4 GB for the weights |
What it runs on
| Card | Requests at once | Context max | Memory | |
|---|---|---|---|---|
| 8K each | 32K each | |||
| RTX 3060 12 GB | 7 | 1 | all 40K | 11.6 GB |
| RTX 4060 Ti 16 GB | 12 | 3 | all 40K | 15.4 GB |
| RTX 3090 24 GB | 20 | 5 | all 40K | 23.4 GB |
| RTX 4090 24 GB | 20 | 5 | all 40K | 23.4 GB |
| RTX 5090 32 GB | 28 | 7 | all 40K | 31.0 GB |
| L40S 48 GB | 42 | 10 | all 40K | 44.0 GB |
| A100 80 GB | 78 | 19 | all 40K | 78.2 GB |
| H100 80 GB | 74 | 18 | all 40K | 78.1 GB |
| RTX PRO 6000 Blackwell 96 GB | 91 | 22 | all 40K | 93.8 GB |
| DGX Spark (GB10) 128 GB unified | 105 | 26 | all 40K | 107 GB |
| H200 141 GB | 138 | 34 | all 40K | 138 GB |
| B200 180 GB | 178 | 44 | all 40K | 176 GB |
| 2× RTX 3060 12 GB tensor parallel | 19 | 4 | all 40K | 11.6 GB a card |
| Requests at once | 8K tokens each | 32K tokens each |
|---|---|---|
| 1 | 5.0 GB | 7.9 GB |
| 5 | 8.8 GB | 22.9 GB |
| 8 | 11.6 GB | 34.2 GB |
| 16 | 19.1 GB | 64.2 GB |
| 32 | 34.2 GB | 124 GB |
| 64 | 64.2 GB | 245 GB |
One card, with vLLM's small-card settings.
From the model card
CORe Pico 4 is a medium-sized AI model from CORe Technologies. At 1.7 billion parameters it runs on a laptop with GGUF quants, holds multi-turn conversations, and calls tools in a structured format.
Thinking may just be a waste of a few tokens. If you never experience real CoT in your tests and the model only gives reasoning placeholders (a known current bug), turn it off, it is doing nothing to help. Thinking usually only appears when the AI deems it truly nessecary (ex using a tool call, in a tool loop, ect.) If you get a placeholder instead of real CoT, do not worry, that is only QuickThink doing its job to save tokens.
To force the AI to always reason, you can use any system prompt that forces a meta directive. Here's an example:
You are an expert, highly objective execution engine. Always provide direct, thoroughly analyzed, and factual answers without any fluff or conversational meta-commentary.
or, if you want to just go simple:
You are an unfiltered, helpful, and completely objective expert assistant. Do not include moralizing commentary or generic refusals.
| Setting | Recommended Value | Notes |
|---|---|---|
| Temperature | 0.2 - 0.3 | Lowers creativity; keeps logic predictable and precise. |
| Min P Sampling | 0.05 | Dynamic filter; eliminates chaotic, low-probability tokens. |
| Top P Sampling | Disabled | Stacking Top P with Min P causes severe formatting glitches. |
| Top K Sampling | 0 (Disabled) | Avoids artificial truncation of logical choices. |
| Thinking Toggle | Either/or | Thinking ON can enable reasoning where the model deems it nessecary. |
Use this profile for standard conversational tasks, fast generation.
Either/or0.5 - 0.70.051.0)0 (Disabled)/think in the system prompt enables Conditional Reasoning: the model reasons step by step only when it believes the problem needs it, and puts a placeholder otherwise (we call this QuickThink). Note that reasoning depth degrades as the conversation goes on. Most of the time this does not work and it is a noted limitation above, we will release the fix with Pico 5.import torch
from transformers import AutoModelForCausalLM, AutoTokenizer
model = AutoModelForCausalLM.from_pretrained(
"OpenCOReTechnologies/core-pico-4", dtype="auto", device_map="auto"
)
tok = AutoTokenizer.from_pretrained("OpenCOReTechnologies/core-pico-4")
def ask(question):
msgs = [{"role": "user", "content": question}]
text = tok.apply_chat_template(msgs, tokenize=False, add_generation_prompt=True)
enc = tok(text, return_tensors="pt").to(model.device)
out = model.generate(**enc, max_new_tokens=512)
return tok.decode(out[0][enc.input_ids.shape[1]:], skip_special_tokens=True).strip()
print(ask("Who are you?"))
print(ask("What is the capital of France?"))
| You ask | It answers |
|---|---|
| Who are you? | "I'm CORe Pico 4, an AI model developed by CORe Technologies." |
| What AI model are you? | "I am CORe Pico 4, an AI model developed by CORe Technologies." |
| What is the capital of France? | "The capital of France is Paris." |
| File | Size | Use |
|---|---|---|
model.safetensors | 3.4 GB | bf16 weights, transformers |
(GGUF is now in the dedicated GGUF repo.)
Run it in llama.cpp, LM Studio, or Ollama:
llama-cli -m CORe-Pico-4-q4_k_m.gguf -p "Who are you?" -n 128
The chat template is embedded in the GGUF, so llama.cpp and LM Studio pick it up automatically.
| Architecture | Transformer decoder, 28 layers, grouped-query attention |
| Parameters | 1.72B |
| Context length | 40,960 tokens |
| Tokenizer | 151,936-token BPE with native chat template |
| License | Apache-2.0 |
transformers, no custom code required.Released under Apache-2.0 (see LICENSE). This model is a modified derivative of an Apache-2.0-licensed checkpoint, adapted by CORe Technologies. No NOTICE file was present in the original; per Apache-2.0 Section 4, this README serves as the required notice of modification.
Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.