Back to Models

Mistral Large 3

mistralmistral/mistral-large-3

API guide

Chat completion

Standard chat through TheRouter's OpenAI-compatible surface. Mistral Large 3 is a general-purpose chat model; the OpenAI SDK works with only a baseURL swap.

cURL
curl https://api.therouter.ai/v1/chat/completions \
  -H "Authorization: Bearer $THEROUTER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "mistral/mistral-large-3",
    "messages": [{"role": "user", "content": "Explain sparse MoE architectures to a junior developer."}]
  }'

Streaming

Stream tokens for chat UIs. Large 3's MoE architecture keeps first-token latency competitive even at the full 256K context.

cURL
curl https://api.therouter.ai/v1/chat/completions \
  -H "Authorization: Bearer $THEROUTER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "mistral/mistral-large-3",
    "stream": true,
    "messages": [{"role": "user", "content": "Write a 50-word haiku about GPU clusters."}]
  }'

Tool use

Mistral Large 3 supports OpenAI-shape function calling and tool_choice via TheRouter's normalised surface.

cURL
curl https://api.therouter.ai/v1/chat/completions \
  -H "Authorization: Bearer $THEROUTER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "mistral/mistral-large-3",
    "messages": [{"role": "user", "content": "What is the weather in Paris?"}],
    "tools": [{
      "type": "function",
      "function": {
        "name": "get_weather",
        "parameters": {"type": "object", "properties": {"city": {"type": "string"}}}
      }
    }]
  }'

Structured JSON

Constrain output to JSON via response_format. Large 3 follows explicit shape contracts reliably.

cURL
curl https://api.therouter.ai/v1/chat/completions \
  -H "Authorization: Bearer $THEROUTER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "mistral/mistral-large-3",
    "response_format": {"type": "json_object"},
    "messages": [
      {"role": "system", "content": "Return JSON with fields: name, age, department."},
      {"role": "user", "content": "Extract employee info from this email..."}
    ]
  }'

Self-host

Large 3 weights are downloadable from Hugging Face under Apache 2.0. NVFP4 quantization and Blackwell-optimised kernels enable deployment on a single 8Γ—GPU node. Reference inference via vLLM or SGLang.

cURL
# Reference vLLM launch. See HF model card for exact tensor-parallel sizing.
python -m vllm.entrypoints.openai.api_server \
  --model mistralai/Mistral-Large-3 \
  --tensor-parallel-size 8 \
  --port 8000

# Then call it through TheRouter as model="mistral/mistral-large-3"
# with TheRouter configured to use your self-hosted endpoint as the upstream.
Fact ledger β€” every claim on this page traces here
sourceURLretrieved
Architecturedocs.mistral.ai β†—2026-05-28verified
Context windowdocs.mistral.ai β†—2026-05-28verified
Licensemistral.ai β†—2026-05-28verified
Training infrastructuremistral.ai β†—2026-05-28verified
Languageswww.digitalapplied.com β†—2026-05-28to verify
Quantization / self-host efficiencymistral.ai β†—2026-05-28verified
MMLU (8-language)mistral.ai β†—2026-05-28verified
HumanEval (Pass@1)www.digitalapplied.com β†—2026-05-28verified
MATH-500www.digitalapplied.com β†—2026-05-28verified
MMLU-Prowww.digitalapplied.com β†—2026-05-28to verify
GPQA Diamondwww.digitalapplied.com β†—2026-05-28to verify
LMArena (open-source non-reasoning)mistral.ai β†—2026-05-28verified
Mistral AI releases Mistral 3 family β€” Mistral Large 3 (675B MoE) under Apache 2.0mistral.ai/news β†—2026-05-28verified
Mistral Large 3 model card published on docs.mistral.ai and Hugging Facedocs.mistral.ai β†—2026-05-28verified
What is the difference between Mistral Large 3 (675B) and the smaller Mistral models?mistral.ai β†—2026-05-28to verify
Can I self-host Mistral Large 3?huggingface.co β†—2026-05-28to verify
What is the licensing for Mistral Large 3?mistral.ai β†—2026-05-28to verify
Does Mistral Large 3 support image input?docs.mistral.ai β†—2026-05-28to verify
Help & contact