Back to Models

Ling Flash 2.0

inclusionaiinclusionai/ling-flash-2

InclusionAI Ling Flash 2.0 β€” fast inference model for general-purpose tasks.

Ling Flash 2.0 is a mixture-of-experts (MoE) language model built by InclusionAI, open-sourced on July 23, 2025. It carries 100B total parameters but activates only 6.1B per token (4.8B non-embedding), guided by the Ling Scaling Laws (arxiv 2507.17702). The model was trained on 20T+ tokens of high-quality data and refined with supervised fine-tuning plus multi-stage reinforcement learning.

Thanks to its 1/32 activation ratio, Ling Flash 2.0 delivers roughly 7Γ— efficiency gains over a comparable dense architecture and achieves 200+ tokens/s on H20 hardware β€” 3Γ— faster than 36B dense peers. With YaRN extrapolation the context window extends to 128K tokens. The model targets complex reasoning, multi-step code generation, frontend development, and regulated-domain tasks (finance and healthcare).

Best for
  • β€’ Complex multi-step reasoning tasks (GPQA-Diamond, MMLU-Pro level difficulty) where throughput matters β€” the MoE activation keeps cost per token very low while retaining ~40B-dense quality.
  • β€’ Code generation and frontend development β€” strong LiveCodeBench v6 and CodeForces scores make it a solid choice for agentic coding pipelines routed through TheRouter.
  • β€’ Finance and healthcare reasoning with domain-specific benchmarks (FinanceReasoning, HealthBench), where a SOTA open-source model with low per-token cost is preferable to a closed API.
Reach for something else if
  • β€’ Multimodal or image-understanding tasks β€” Ling Flash 2.0 is text-only; route to google/gemini-2.5-flash or meta/llama-4-scout instead.
  • β€’ Ultra-low latency real-time applications (< 50 ms TTFT targets) β€” despite fast throughput, the MoE architecture still requires loading expert weights; consider openai/gpt-4o-mini or google/gemini-2.0-flash-001 for strict latency budgets.

How TheRouter serves this differently from the vendor

As the vendor operates it

InclusionAI publishes Ling Flash 2.0 as an MIT-licensed open-weight Hugging Face model with local deployment guidance, 32K native context, and optional 128K YaRN extrapolation.

On TheRouter

TheRouter exposes inclusionai/ling-flash-2 through its OpenAI-compatible chat route. Operational pricing, context length, regions, and supported parameters come from the live TheRouter model catalog rather than the Hugging Face checkpoint card.

Context Length
131K
Max Output
33K
Input Priceper 1M tokens
$0.1512/ 1M tokens
Output Priceper 1M tokens
$0.6156/ 1M tokens

Modalities

text→text

Pricing Breakdown

TypeRate
Input$0.1512 / 1M tokens
Output$0.6156 / 1M tokens

Supported Parameters

temperaturemax_tokenstop_pstop

Specifications

Release date2025-07-23huggingface.co β†—verified
ArchitectureMoE β€” 100B total / 6.1B activated (4.8B non-embedding), 1/32 activation ratiohuggingface.co β†—verified
Training data20T+ tokens of high-quality datahuggingface.co β†—verified
Training cutoffNot publicly disclosedunknown
LicenseMIThuggingface.co β†—verified
Inference throughput (H20)200+ tokens/s β€” 3Γ— faster than 36B dense models in typical usehuggingface.co β†—verified
Context length32K native; 128K with YaRN extrapolationhuggingface.co β†—verified

Benchmarks

BenchmarkDistributionScoreSource
MMLU-Pro
SOTA vs dense <40B at launchhuggingface.co β†—
GPQA-Diamond
Competitive vs Qwen3-32B-Non-Thinking and GPT-OSS-120B/lowhuggingface.co β†—
LiveCodeBench v6
Strong β€” outperforms 36B dense modelshuggingface.co β†—
AIME 2025
Strong advanced math performancehuggingface.co β†—
ARC-Prize
Reported competitive on logical reasoning trackhuggingface.co β†—

API Usage Examples

Use the global api.therouter.ai endpoint shown below for new integrations; the legacy China accelerated endpoint is retired.

cURL
curl https://api.therouter.ai/v1/chat/completions   -H "Content-Type: application/json"   -H "Authorization: Bearer $THE_ROUTER_API_KEY"   -d '{
    "model": "inclusionai/ling-flash-2",
    "messages": [
      {"role": "user", "content": "Summarize the key points from this input."}
    ]
  }'

API guide

Chat completion

cURL
curl https://api.therouter.ai/v1/chat/completions \
  -H "Authorization: Bearer $THEROUTER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"inclusionai/ling-flash-2","messages":[{"role":"user","content":"Explain the Ling 2.0 MoE architecture in one paragraph."}]}'

More from inclusionai

Similar models

Cross-provider sibling models

News & changes

2025-07-23

InclusionAI open-sources Ling Flash 2.0 β€” 100B MoE matching 40B dense quality at 3Γ— speed

InclusionAI released Ling Flash 2.0 on HuggingFace under an MIT license. The model activates just 6.1B of its 100B parameters per inference step, enabling 200+ tokens/s on H20 GPUs while matching or outperforming dense models up to 40B on GPQA-Diamond, LiveCodeBench v6, AIME 2025, and FinanceReasoning benchmarks.

re-authored by TheRouterhuggingface.co β†—

Frequently asked

How does Ling Flash 2.0 achieve 40B-dense quality with only 6B active parameters?

The model uses a 1/32 activation-ratio MoE architecture designed under the Ling Scaling Laws research programme. Key architectural choices β€” expert granularity, shared-expert ratio, aux-loss-free sigmoid routing, MTP layers, QK-Norm, and Partial-RoPE β€” allow a small active slice to leverage a much larger parameter pool. According to InclusionAI, this yields roughly 7Γ— efficiency gains over a comparable dense model at the same quality level.

re-authored by TheRouterhuggingface.co β†—
What is the maximum context length supported?

32K tokens natively. With YaRN extrapolation (add a rope_scaling field to config.json) the window extends to 128K tokens. As output length grows, the speedup advantage over dense peers increases to 7Γ— or more due to the model's small activation footprint.

Fact ledger β€” every claim on this page traces here
sourceURLretrieved
Release datehuggingface.co β†—2026-08-13verified
Architecturehuggingface.co β†—2026-08-13verified
Training datahuggingface.co β†—2026-08-13verified
Training cutoffβ€”β€”unknown
Licensehuggingface.co β†—2026-08-13verified
Inference throughput (H20)huggingface.co β†—2026-08-13verified
Context lengthhuggingface.co β†—2026-08-13verified
MMLU-Prohuggingface.co β†—2026-08-13verified
GPQA-Diamondhuggingface.co β†—2026-08-13verified
LiveCodeBench v6huggingface.co β†—2026-08-13verified
AIME 2025huggingface.co β†—2026-08-13verified
ARC-Prizehuggingface.co β†—2026-08-13verified
InclusionAI open-sources Ling Flash 2.0 β€” 100B MoE matching 40B dense quality at 3Γ— speedhuggingface.co β†—2026-08-13verified
How does Ling Flash 2.0 achieve 40B-dense quality with only 6B active parameters?huggingface.co β†—2026-08-13to verify
What is the maximum context length supported?huggingface.co β†—2026-08-13to verify
Help & contact