Model reference · open weights
Foundation-Sec-Reasoning is an open-weight language model from fdtn-ai. Foundation-Sec-8B-Reasoning (BF16) weighs 16.1 GB; the smallest configuration that runs it is 2× RTX 3060 12 GB.
For self-hosting, compare this build's requirements below with the GPU you plan to rent.
Summary of the fdtn-ai/Foundation-Sec-8B-Reasoning model card, 2026-10-01
What it is
| Released by | fdtn-ai |
|---|---|
| Released | 2025-11-06 |
| Parameters | 8.0B |
| VRAM | 16.1 GB for the weights |
What it runs on
| Card | Requests at once | Context max | Memory | |
|---|---|---|---|---|
| 8K each | 32K each | |||
| RTX 3060 12 GB … RTX 4060 Ti 16 GB 2 smaller cards | ||||
| RTX 3090 24 GB | 6 | 1 | 49K | 23.4 GB |
| RTX 4090 24 GB | 6 | 1 | 48K | 23.4 GB |
| RTX 5090 32 GB | 13 | 3 | 105K | 31.0 GB |
| L40S 48 GB | 25 | 6 | all 128K | 44.0 GB |
| A100 80 GB | 57 | 14 | all 128K | 78.2 GB |
| H100 80 GB | 53 | 13 | all 128K | 78.1 GB |
| RTX PRO 6000 Blackwell 96 GB | 67 | 16 | all 128K | 93.8 GB |
| DGX Spark (GB10) 128 GB unified | 80 | 20 | all 128K | 107 GB |
| H200 141 GB | 109 | 27 | all 128K | 138 GB |
| B200 180 GB | 143 | 35 | all 128K | 176 GB |
| 2× RTX 3060 12 GB tensor parallel | 5 | 1 | 42K | 11.6 GB a card |
| 2× RTX 4060 Ti 16 GB tensor parallel | 12 | 3 | 98K | 15.4 GB a card |
| 2× RTX 4090 24 GB tensor parallel | 27 | 6 | all 128K | 23.4 GB a card |
| 2× RTX 3090 24 GB tensor parallel | 27 | 6 | all 128K | 23.4 GB a card |
| Requests at once | 8K tokens each | 32K tokens each |
|---|---|---|
| 1 | 17.9 GB | 21.1 GB |
| 5 | 22.2 GB | 38.3 GB |
| 8 | 25.4 GB | 51.2 GB |
| 16 | 34.0 GB | 85.5 GB |
| 32 | 51.2 GB | 154 GB |
| 64 | 85.5 GB | 292 GB |
One card, with vLLM's small-card settings.
From the model card
Llama-3.1-FoundationAI-SecurityLLM-8B-Reasoning (Foundation-Sec-8B-Reasoning) is an open-weight, 8-billion parameter instruction-tuned language model specialized for cybersecurity applications. It extends the Foundation-Sec-8B base model with instruction-following and reasoning capabilities. It leverages prior training to understand security concepts, terminology, and practices across multiple security domains. Further reasoning training enables the model to reason about problems before presenting a solution. Foundation-Sec-8B-Reasoning enables organizations to build AI-driven security tools that can be deployed locally, reducing dependency on cloud-based AI services while maintaining high performance on security-related tasks.
Foundation-Sec-8B-Reasoning is designed for security practitioners, researchers, and developers building AI-powered security workflows and applications. Foundation-Sec-8B-Reasoning is optimized for three core use case categories:
The model is intended for local deployment in environments prioritizing data security, regulatory compliance, and operational control.
Foundation-Sec-8B-Reasoning can be used directly for security-related chat use cases. Example downstream applications include:
For questions or assistance with fine-tuning Foundation-Sec-8B-Reasoning, please reach out to the team.
The following uses are out-of-scope and are neither recommended nor intended use cases:
Use the code below to get started with the model. The cookbook provides example use cases, code samples for adoption, and references.
# Import the required libraries
import torch
from transformers import AutoTokenizer, AutoModelForCausalLM
# Load the model and tokenizer
tokenizer = AutoTokenizer.from_pretrained("fdtn-ai/Foundation-Sec-8B-Reasoning")
model = AutoModelForCausalLM.from_pretrained("fdtn-ai/Foundation-Sec-8B-Reasoning")
prompt = "CVE-2015-10011 is a vulnerability about OpenDNS OpenResolve improper log output neutralization. What is the corresponding CWE?"
messages = [
{"role": "user", "content": prompt}
]
model_inputs = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tokenizer(model_inputs, return_tensors="pt", add_special_tokens=False)
output = model.generate(**inputs, temperature=0.1, max_new_tokens=1024)
resp = tokenizer.batch_decode(output)[0]
print(resp.replace(model_inputs, ""))
For production deployment
Quoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.