Back to Models

Mistral Small 4

mistralmistral/mistral-small-4

Mistral's 2026-03 unified small model (119B MoE, 6B active). Combines Magistral (reasoning), Pixtral (multimodal), and Devstral (agentic coding) capabilities into a single model.

Mistral Small 4 is a 119-billion-parameter Mixture-of-Experts (MoE) model released on March 16, 2026, under Apache 2.0. With only 6.5 billion active parameters per token (out of 128 experts with 4 active per token), it unifies four previously separate Mistral model families β€” Magistral (reasoning), Pixtral (multimodal), Devstral (agentic coding), and Mistral Small (instruct) β€” into a single deployable model. This is Mistral's first model to consolidate their entire non-flagship stack into one architecture, dramatically simplifying routing logic for production deployments.

For a TheRouter operator, Mistral Small 4 is the cost-effective 'Swiss Army knife' β€” it handles vision, tool calling, reasoning, and coding from a single endpoint at $0.20/M input tokens (via TheRouter). The configurable reasoning_effort parameter (none/high) lets you dial compute per-request, making it equally suitable for fast chat and deep step-by-step reasoning without maintaining separate model deployments. It supports 256K token context (upstream) and is self-hostable on modest multi-GPU setups (4Γ— H100 or 2Γ— H200 minimum).

Best for
  • β€’ Unified chat + reasoning + coding β€” a single model that handles quick Q&A, image-based document analysis, step-by-step math reasoning, and code generation, eliminating the need for separate fast/reasoning deployments
  • β€’ Cost-sensitive production pipelines β€” at 6.5B active parameters per token and MoE efficiency, Mistral Small 4 delivers strong quality-per-cost ratio for high-throughput applications like content generation, summarization, and RAG pipelines
  • β€’ Self-hosted fallback β€” Apache 2.0 license enables fully private deployments on your own hardware with vLLM, SGLang, or llama.cpp, with the same model id switching seamlessly between TheRouter API and self-hosted endpoints
  • β€’ Multi-modal document analysis β€” vision support (text + image input) enables structured extraction from PDFs, screenshots, and scanned documents at commodity pricing
Reach for something else if
  • β€’ Competition-level math reasoning β€” while configurable reasoning is strong, dedicated reasoning models (DeepSeek V3.2, GPT-5.2 thinking) outperform on AIME 2025 and similar hard benchmarks
  • β€’ Very high-throughput single-task β€” if 100% of traffic is simple text-only chat without vision/reasoning/coding, a dedicated Ministral 8B or 3B at $0.15-$0.10/M input may be more cost-effective
  • β€’ Audio output β€” Mistral Small 4 is text/image-in, text-out only. For voice synthesis tasks route to mistral/voxtral-tts or fishaudio/fish-speech-1.5
Context Length
131K
Max Output
16K
Input Priceper 1M tokens
$0.162/ 1M tokens
Output Priceper 1M tokens
$0.648/ 1M tokens

Modalities

textimage→text

Capabilities

Vision

Pricing Breakdown

TypeRate
Input$0.162 / 1M tokens
Output$0.648 / 1M tokens

Supported Parameters

temperaturemax_tokenstop_ptoolstool_choiceresponse_formatreasoningstop

Specifications

Release date2026-03-16mistral.ai β†—verified
Architecture119B total / 6.5B active β€” MoE (128 experts, 4 active per token); Transformer with grouped-query attention (GQA)docs.mistral.ai β†—verified
Upstream context length262,144 tokens (256K); TheRouter serves 131,072 per standard-models.yamlhuggingface.co β†—verified
Training cutoffNot publicly disclosedunknown
LicenseApache 2.0 (commercial use permitted, no usage caps)huggingface.co β†—verified
Supported inference backendsvLLM, SGLang, llama.cpp, Transformers, NVIDIA NIMhuggingface.co β†—verified
Minimum self-host hardware4Γ— NVIDIA HGX H100, 2Γ— HGX H200, or 1Γ— DGX B200mistral.ai β†—to verify

Benchmarks

BenchmarkDistributionScoreSource
AA LCR
Academic Agent LiveCodeBench Reasoning. Score achieved with ~1.6K characters output β€” notably concise vs comparable Qwen models needing 5.8-6.1K chars for similar scores
0.72mistral.ai β†—
LiveCodeBench
Mistral-reported; beats GPT-OSS 120B while producing 20% less output
Outperforms GPT-OSS 120Bmistral.ai β†—
AIME 2025
American Invitational Mathematics Examination 2025 β€” matches GPT-OSS 120B with shorter output
Matches GPT-OSS 120Bmistral.ai β†—

API Usage Examples

Use the global api.therouter.ai endpoint shown below for new integrations; the legacy China accelerated endpoint is retired.

cURL
curl https://api.therouter.ai/v1/chat/completions   -H "Content-Type: application/json"   -H "Authorization: Bearer $THE_ROUTER_API_KEY"   -d '{
    "model": "mistral/mistral-small-4",
    "messages": [
      {"role": "user", "content": "Summarize the key points from this input."}
    ]
  }'

Chat completion

Basic chat completion to test the endpoint or run conversation tasks.

cURL
curl https://api.therouter.ai/v1/chat/completions \
  -H "Authorization: Bearer $THEROUTER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "mistral/mistral-small-4",
    "messages": [
      {"role": "user", "content": "Explain the difference between MoE and dense transformer models"}
    ]
  }'

More from mistral

Similar models

Cross-provider sibling models

News & changes

2026-03-16

Introducing Mistral Small 4

Mistral AI released Mistral Small 4 (mistral-small-2603), a 119B MoE model unifying Magistral reasoning, Pixtral multimodal, Devstral coding, and Mistral Small instruct capabilities into a single open-weight (Apache 2.0) deployment. Key features include configurable reasoning_effort, 256K context, and self-hostability on 4Γ— H100 GPUs.

re-authored by TheRoutermistral.ai/news β†—

Frequently asked

What makes Mistral Small 4 different from Mistral Small 3?

Mistral Small 4 is a fundamentally different architecture: it is a 119B MoE with 6.5B active parameters, not a dense 24B model. It unifies four previously separate Mistral model families (Magistral, Pixtral, Devstral, Mistral Small) into one. It adds vision support, configurable reasoning_effort, and a 256K context window. Mistral claims 40% lower latency and 3Γ— higher throughput vs Small 3.

re-authored by TheRoutermistral.ai β†—
Can I use Mistral Small 4 via the standard OpenAI Python/TypeScript SDK?

Yes β€” TheRouter provides full OpenAI-compatible endpoints at api.therouter.ai/v1. Just set the baseURL and your TheRouter API key, and specify model: 'mistral/mistral-small-4'. The reasoning_effort parameter is passed as a top-level request field β€” some SDKs may need @ts-expect-error if they don't forward unknown keys.

Is Mistral Small 4 open-source? Can I run it on my own hardware?

The model weights are released under Apache 2.0 license β€” this is open-weight, meaning you can deploy, fine-tune, and redistribute the weights without restrictions. It requires at least 4Γ— NVIDIA H100, 2Γ— HGX H200, or 1Γ— DGX B200 for self-hosting. Supported serving frameworks include vLLM, SGLang, llama.cpp, and Transformers.

re-authored by TheRouterhuggingface.co β†—
How does the reasoning_effort parameter work?

Set reasoning_effort to 'none' for fast, direct responses (comparable to Mistral Small 3.2 speed). Set it to 'high' to activate step-by-step reasoning equivalent to Magistral-level depth. This eliminates the need to maintain separate fast and reasoning model deployments β€” one model handles both modes. The parameter is passed as a top-level field in the chat completion request body.

re-authored by TheRouterdocs.mistral.ai β†—
What are the benchmark scores for Mistral Small 4?

Mistral reports that Small 4 achieves AA LCR score of 0.72 (with notably concise output ~1.6K chars vs 5.8-6.1K for comparable Qwen models). It outperforms GPT-OSS 120B on LiveCodeBench while producing 20% less output, and matches GPT-OSS 120B on AIME 2025. More detailed third-party benchmark data is expected as independent evaluators publish their results.

re-authored by TheRoutermistral.ai β†—
Fact ledger β€” every claim on this page traces here
sourceURLretrieved
Release datemistral.ai β†—2026-05-27verified
Architecturedocs.mistral.ai β†—2026-05-27verified
Upstream context lengthhuggingface.co β†—2026-05-27verified
Training cutoffβ€”β€”unknown
Licensehuggingface.co β†—2026-05-27verified
Supported inference backendshuggingface.co β†—2026-05-27verified
Minimum self-host hardwaremistral.ai β†—2026-05-27to verify
AA LCRmistral.ai β†—2026-05-27to verify
LiveCodeBenchmistral.ai β†—2026-05-27to verify
AIME 2025mistral.ai β†—2026-05-27to verify
Introducing Mistral Small 4mistral.ai/news β†—2026-05-27verified
What makes Mistral Small 4 different from Mistral Small 3?mistral.ai β†—2026-05-27to verify
Can I use Mistral Small 4 via the standard OpenAI Python/TypeScript SDK?docs.therouter.ai β†—2026-05-27to verify
Is Mistral Small 4 open-source? Can I run it on my own hardware?huggingface.co β†—2026-05-27to verify
How does the reasoning_effort parameter work?docs.mistral.ai β†—2026-05-27to verify
What are the benchmark scores for Mistral Small 4?mistral.ai β†—2026-05-27to verify
Customer Support