Mistral Small 4 119B A6B (2603)
Hugging Face (mistralai) Open weights
The catch: Despite the name it is a 119B model: the card's vLLM command spreads it over two GPUs, and Ollama's library has no Mistral Small 4 tag.
| Access | Open weights |
|---|---|
| Free limits | Free to download and self-host; you pay only for your own compute. Apache 2.0, so no user cap. 119B total parameters, 6.5B active per token (mixture of experts, 128 experts, 4 active). |
| Modality | text, code, image |
| Credit card | Not required |
| Commercial use | Allowed |
| Trains on your data | – |
| Licence or terms | Apache-2.0 |
| Context window | 262,144 tokens |
| Model id | mistralai/Mistral-Small-4-119B-2603 |
| Base URL | – |
| Last checked | 2 Oct 2026 |
How to use Mistral Small 4 119B A6B
Download the weights and serve them yourself; the quickstart below shows one way. Licence: Apache-2.0.
Quickstart
vllm serve mistralai/Mistral-Small-4-119B-2603 --max-model-len 262144 --tensor-parallel-size 2 --tool-call-parser mistral --enable-auto-tool-choice --reasoning-parser mistral
Paste into Claude Code
I want to run the open-weight model "Mistral Small 4 119B A6B" (mistralai/Mistral-Small-4-119B-2603) for my project. Please: 1. Check the model card and tell me the hardware it needs and the simplest way to serve it (vLLM, SGLang, Ollama or a hosted endpoint). 2. Give me a minimal working setup and a test request. 3. Tell me the licence terms for commercial use. 4. If a cheaper or smaller variant would do the job, mention it.
Before you ship on it
- Despite the name it is a 119B model: the card's vLLM command spreads it over two GPUs, and Ollama's library has no Mistral Small 4 tag.
- Apache 2.0; the HF model card says it is an open-source licence for both commercial and non-commercial use.
- Free to run means you pay for the GPUs, the serving stack and the on-call.
Questions
Is Mistral Small 4 119B A6B (2603) free?
Yes. Open weights offers it as open weights, with these limits: Self-host free · Apache-2.0. No credit card is needed.
Can I use Mistral Small 4 119B A6B (2603) commercially?
Yes, under Apache-2.0. Check the current terms before you ship.
How do I start with Mistral Small 4 119B A6B (2603)?
Download the weights and serve them yourself; the quickstart below shows one way. Licence: Apache-2.0.
Source: huggingface.co/mistralai/Mistral-Small-4-119B-2603, checked 2 Oct 2026.