Back to Models

Nemotron 3 Nano is NVIDIA's flagship open-weight small model in the Nemotron 3 family, released December 15, 2025. With 31.6B total parameters and only 3.6B active per token (including embeddings), it is a hybrid Mamba-2-Transformer Mixture-of-Experts (MoE) architecture optimised for agentic AI workloads β€” tool calling, structured outputs, multi-turn reasoning, and long-context processing. It supports a native 1M-token context window enabled by its efficient hybrid backbone, where Mamba-2 state-space layers handle long-range dependencies cheaply while sparse Transformer layers preserve relational precision.

For TheRouter operators, Nemotron 3 Nano is the most throughput-efficient open model in its parameter class. NVIDIA claims 3.3x higher throughput than Qwen3-30B-A3B and 2.2x higher than GPT-OSS-20B on a single H200 (8K/16K setting). It matches or exceeds comparable small MoE models on coding, math, and instruction-following benchmarks while costing only $0.06/M input tokens via TheRouter. The model comes with fully open weights (FP8 and BF16), training recipes, datasets (Nemotron-CC-v2.1), and the NeMo Gym RL environment suite β€” making it one of the most transparently documented models at its scale.

Best for
  • β€’ Agentic AI pipelines: tool calling, structured outputs, multi-step planning, and multi-agent coordination at low latency and high throughput.
  • β€’ High-throughput chatbot deployments where latency-per-token matters more than raw reasoning depth β€” the 3.6B active parameter count keeps inference fast even on modest hardware.
  • β€’ Edge / local deployment on NVIDIA Jetson and consumer GPUs, thanks to the compact active parameter count and FP8 quantisation support.
  • β€’ Long-context retrieval-augmented generation (RAG) β€” the 1M-token window with Mamba-2 layers handles large document sets without positional embedding fragmentation.
Reach for something else if
  • β€’ Complex multi-step math reasoning at competition level β€” while strong, deeper models like Nemotron Super (120B/12B active) deliver higher AIME/GPQA final scores.
  • β€’ Multimodal tasks (vision, audio, video) β€” this is a text-only model. For multimodal at a similar size, see Nemotron-3-Nano-Omni or Google Gemini / Qwen-VL.
  • β€’ High-throughput multilingual workloads β€” the training data is English-heavy. Models like Qwen3 or DeepSeek-V3 have stronger multilingual support.
Context Length
1M
Max Output
262K
Input Priceper 1M tokens
$0.0648/ 1M tokens
Output Priceper 1M tokens
$0.2592/ 1M tokens

Modalities

text→text

Pricing Breakdown

TypeRate
Input$0.0648 / 1M tokens
Output$0.2592 / 1M tokens

Supported Parameters

temperaturemax_tokenstop_ptoolstool_choiceresponse_formatstop

Specifications

Release date2025-12-15research.nvidia.com β†—verified
ArchitectureHybrid Mamba-2-Transformer MoEresearch.nvidia.com β†—verified
Total parameters31.6Bresearch.nvidia.com β†—verified
Active parameters3.2B (3.6B with embeddings)research.nvidia.com β†—verified
Training data cutoffJune 25, 2025 (pre-training); November 28, 2025 (post-training)build.nvidia.com β†—verified
LicenseNVIDIA Open Model License (open weights, training recipe, and data released)huggingface.co β†—verified

Benchmarks

BenchmarkDistributionScoreSource
MMLU-Pro
Nemotron 3 Nano (Post-trained, CoT EM, 5-shot) β€” vs Qwen3-30B-A3B-Thinking-2507 at comparable settings
65.05%%research.nvidia.com β†—
AGIEval-En
Post-trained, CoT accuracy, 3/5-shot
68.32%%research.nvidia.com β†—
HumanEval
0-shot pass@1
78.05%%research.nvidia.com β†—
MBPP-Sanitized
3-shot pass@1
75.49%%research.nvidia.com β†—
GSM8K
8-shot, accuracy
92.34%%research.nvidia.com β†—
MATH
4-shot accuracy. Significantly ahead of comparable small MoE models (e.g. Qwen3-30B-A3B at 61.14%)
82.88%%research.nvidia.com β†—
AIME 2025
Without tool assistance β€” surpasses Qwen3-30B-A3B (85.0%), slightly behind GPT-OSS-20B (91.7%)
89.1%%research.nvidia.com β†—
GPQA Diamond
Measured by Awesome Agents / public synthetic test (February 2026)
84.2%%awesomeagents.ai β†—
RULER (64K)
Long-context retrieval accuracy at 64K tokens β€” hybrid Mamba architecture advantage for long documents
87.5%%llm-stats.com β†—

API Usage Examples

Use the global api.therouter.ai endpoint shown below for new integrations; the legacy China accelerated endpoint is retired.

cURL
curl https://api.therouter.ai/v1/chat/completions   -H "Content-Type: application/json"   -H "Authorization: Bearer $THE_ROUTER_API_KEY"   -d '{
    "model": "nvidia/nemotron-nano-30b",
    "messages": [
      {"role": "user", "content": "Summarize the key points from this input."}
    ]
  }'

Chat completion

Standard OpenAI-compatible chat completion β€” the simplest way to call Nemotron Nano via TheRouter.

cURL
curl https://api.therouter.ai/v1/chat/completions \
  -H "Authorization: Bearer $THEROUTER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "nvidia/nemotron-nano-30b",
    "messages": [
      {"role": "user", "content": "What are the key design goals of the Nemotron 3 architecture?"}
    ]
  }'

More from nvidia

Similar models

Cross-provider sibling models

News & changes

2025-12-15

NVIDIA Nemotron 3 family announced β€” Nano, Super, Ultra

NVIDIA released the Nemotron 3 family of open models, led by Nano (31.6B total / 3.6B active) with a hybrid Mamba-2-Transformer MoE architecture, 1M-token context, and fully open weights, data, and training recipes.

re-authored by TheRouterresearch.nvidia.com β†—
2026-01-12

NVIDIA Technical Blog: Inside Nemotron 3 β€” Techniques, Tools, and Data

NVIDIA published a detailed technical blog covering the hybrid MoE architecture, NeMo Gym multi-environment RL training, 1M-token context handling, and the transparent dataset pipelines that power Nemotron 3.

re-authored by TheRouterdeveloper.nvidia.com β†—
2026-04-27

Nemotron-3-Nano-Omni released β€” multimodal variant with audio+video understanding

NVIDIA released the Omni variant of Nemotron-3-Nano, adding video comprehension, speech understanding, GUI interaction, and OCR capabilities while maintaining the compact 30B-A3B MoE footprint.

re-authored by TheRouterhuggingface.co/nvidia β†—
2026-04-08

Nemotron-Cascade 2 β€” 30B open MoE runs one GPU, beats 120B models

Built on Nemotron 3 Nano's architecture, Cascade 2 uses cascading agent pipelines to achieve GPT-OSS-120B-level results on coding and reasoning tasks while running entirely on a single consumer GPU.

re-authored by TheRouterawesomeagents.ai β†—

Frequently asked

What makes Nemotron 3 Nano different from other small MoE models?

Nemotron 3 Nano uses a hybrid Mamba-2-Transformer backbone instead of a pure Transformer. This lets it handle long contexts (up to 1M tokens) with far less memory overhead than dense attention, while the MoE layers keep the active parameter count at just 3.6B per token. The result is a model that rivals much larger models on benchmarks while being deployable on edge hardware.

re-authored by TheRouterdeveloper.nvidia.com β†—
How does Nemotron 3 Nano compare to Qwen3-30B-A3B and GPT-OSS-20B?

On MATH (4-shot), Nemotron 3 Nano scores 82.88% vs 61.14% for Qwen3-30B-A3B. On AIME 2025, it reaches 89.1% vs 85.0% for Qwen3 and 91.7% for GPT-OSS-20B. NVIDIA claims 3.3x higher throughput than Qwen3-30B-A3B and 2.2x vs GPT-OSS-20B on a single H200. Overall, Nemotron is the strongest in math and throughput efficiency while GPT-OSS-20B leads slightly on competition-level math.

re-authored by TheRouterresearch.nvidia.com β†—
Is Nemotron Nano good for agentic / tool-use applications?

Yes. This was a primary design goal. The model was post-trained using RL across multiple interactive environments in NVIDIA's NeMo Gym β€” covering tool calling, multi-step planning, code execution, and structured output generation. TheRouter's supported_params include tools, tool_choice, and response_format, confirming full function calling capability.

re-authored by TheRouterdeveloper.nvidia.com β†—
Is the Nemotron Nano model and its training data open source?

Yes. NVIDIA released the model weights (FP8 and BF16), the base pre-trained checkpoint, the Nemotron-CC-v2.1 dataset (2.5 trillion tokens), Nemotron-CC-Code-v1 (428B code tokens), and the NeMo Gym RL environment suite under the NVIDIA Open Model License.

re-authored by TheRouterresearch.nvidia.com β†—
What pricing does TheRouter offer for Nemotron Nano?

$0.06 per million input tokens and $0.16 per million output tokens. This is one of the lowest price points among supported models on TheRouter, reflecting the model's MoE efficiency (only 3.6B active parameters per token).

re-authored by TheRouterwww.therouter.ai β†—
Fact ledger β€” every claim on this page traces here
sourceURLretrieved
Release dateresearch.nvidia.com β†—2026-05-28verified
Architectureresearch.nvidia.com β†—2026-05-28verified
Total parametersresearch.nvidia.com β†—2026-05-28verified
Active parametersresearch.nvidia.com β†—2026-05-28verified
Training data cutoffbuild.nvidia.com β†—2026-05-28verified
Licensehuggingface.co β†—2026-05-28verified
MMLU-Proresearch.nvidia.com β†—2026-05-28verified
AGIEval-Enresearch.nvidia.com β†—2026-05-28verified
HumanEvalresearch.nvidia.com β†—2026-05-28verified
MBPP-Sanitizedresearch.nvidia.com β†—2026-05-28verified
GSM8Kresearch.nvidia.com β†—2026-05-28verified
MATHresearch.nvidia.com β†—2026-05-28verified
AIME 2025research.nvidia.com β†—2026-05-28verified
GPQA Diamondawesomeagents.ai β†—2026-05-28to verify
RULER (64K)llm-stats.com β†—2026-05-28to verify
NVIDIA Nemotron 3 family announced β€” Nano, Super, Ultraresearch.nvidia.com β†—2026-05-28verified
NVIDIA Technical Blog: Inside Nemotron 3 β€” Techniques, Tools, and Datadeveloper.nvidia.com β†—2026-05-28verified
Nemotron-3-Nano-Omni released β€” multimodal variant with audio+video understandinghuggingface.co/nvidia β†—2026-05-28verified
Nemotron-Cascade 2 β€” 30B open MoE runs one GPU, beats 120B modelsawesomeagents.ai β†—2026-05-28verified
What makes Nemotron 3 Nano different from other small MoE models?developer.nvidia.com β†—2026-05-28to verify
How does Nemotron 3 Nano compare to Qwen3-30B-A3B and GPT-OSS-20B?research.nvidia.com β†—2026-05-28to verify
Is Nemotron Nano good for agentic / tool-use applications?developer.nvidia.com β†—2026-05-28to verify
Is the Nemotron Nano model and its training data open source?research.nvidia.com β†—2026-05-28to verify
What pricing does TheRouter offer for Nemotron Nano?www.therouter.ai β†—2026-05-28to verify
Help & contact