Model reference · open weights
Foundation-Sec-1.1 is an open-weight language model from fdtn-ai. Foundation-Sec-1.1-8B-Instruct (BF16) weighs 16.1 GB; the smallest configuration that runs it is 2× RTX 3060 12 GB.
For self-hosting, compare this build's requirements below with the GPU you plan to rent.
Summary of the fdtn-ai/Foundation-Sec-1.1-8B-Instruct model card, 2026-10-01
What it is
| Released by | fdtn-ai |
|---|---|
| Released | 2025-11-18 |
| Parameters | 8.0B |
| VRAM | 16.1 GB for the weights |
What it runs on
| Card | Requests at once | Context max | Memory | |
|---|---|---|---|---|
| 8K each | 32K each | |||
| RTX 3060 12 GB … RTX 4060 Ti 16 GB 2 smaller cards | ||||
| RTX 3090 24 GB | 6 | 1 | 49K | 23.4 GB |
| RTX 4090 24 GB | 6 | 1 | 48K | 23.4 GB |
| RTX 5090 32 GB | 13 | 3 | all 64K | 31.0 GB |
| L40S 48 GB | 25 | 6 | all 64K | 44.0 GB |
| A100 80 GB | 57 | 14 | all 64K | 78.2 GB |
| H100 80 GB | 53 | 13 | all 64K | 78.1 GB |
| RTX PRO 6000 Blackwell 96 GB | 67 | 16 | all 64K | 93.8 GB |
| DGX Spark (GB10) 128 GB unified | 80 | 20 | all 64K | 107 GB |
| H200 141 GB | 109 | 27 | all 64K | 138 GB |
| B200 180 GB | 143 | 35 | all 64K | 176 GB |
| 2× RTX 3060 12 GB tensor parallel | 5 | 1 | 42K | 11.6 GB a card |
| 2× RTX 4060 Ti 16 GB tensor parallel | 12 | 3 | all 64K | 15.4 GB a card |
| 2× RTX 4090 24 GB tensor parallel | 27 | 6 | all 64K | 23.4 GB a card |
| 2× RTX 3090 24 GB tensor parallel | 27 | 6 | all 64K | 23.4 GB a card |
| Requests at once | 8K tokens each | 32K tokens each |
|---|---|---|
| 1 | 17.9 GB | 21.1 GB |
| 5 | 22.2 GB | 38.3 GB |
| 8 | 25.4 GB | 51.2 GB |
| 16 | 34.0 GB | 85.5 GB |
| 32 | 51.2 GB | 154 GB |
| 64 | 85.5 GB | 292 GB |
One card, with vLLM's small-card settings.
From the model card
Llama-3.1-FoundationAI-SecurityLLM-1.1-8B-Instruct (Foundation-Sec-1.1-8B-Instruct) is an open-weight, 8-billion parameter instruction-tuned language model specialized for cybersecurity applications. It extends the Foundation-Sec-1.1-8B base model with instruction-following capabilities and extended 64k context window support. It leverages prior training to understand security concepts, terminology, and practices across multiple security domains. Further instruction-tuning allows the model to interact with human users in a chat-like interface. Foundation-Sec-1.1-8B-Instruct enables organizations to build AI-driven security tools that can be deployed locally, reducing dependency on cloud-based AI services while maintaining high performance on security-related tasks.
Foundation-Sec-1.1-8B-Instruct is designed for security practitioners, researchers, and developers building AI-powered security workflows and applications. Foundation-Sec-1.1-8B-Instruct is optimized for three core use case categories:
The model is intended for local deployment in environments prioritizing data security, regulatory compliance, and operational control.
Foundation-Sec-1.1-8B-Instruct can be used directly for security-related chat use cases. Example downstream applications include:
For questions or assistance with fine-tuning Foundation-Sec-1.1-8B-Instruct, please reach out to the team.
The following uses are out-of-scope and are neither recommended nor intended use cases:
Use the code below to get started with the model. The cookbook provides example use cases, code samples for adoption, and references.
# Import the required libraries
import torch
from transformers import AutoTokenizer, AutoModelForCausalLM
# Load the model and tokenizer
tokenizer = AutoTokenizer.from_pretrained("fdtn-ai/Foundation-Sec-1.1-8B-Instruct")
model = AutoModelForCausalLM.from_pretrained("fdtn-ai/Foundation-Sec-1.1-8B-Instruct")
prompt = "CVE-2015-10011 is a vulnerability about OpenDNS OpenResolve improper log output neutralization. What is the corresponding CWE?"
messages = [
{"role": "user", "content": prompt}
]
model_inputs = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tokenQuoted from the model card on Hugging Face. The full card is behind the Hugging Face link above.