Provider profile: Groq - Groq builds custom LPU (Language Processing Unit) silicon for AI inference — custom hardware built for very low-latency serving of open-weight models. TheRouter currently routes no models through Groq: Groq shut down llama-3.1-8b-instant and llama-3.3-70b-versatile for free and developer tiers on 2026-08-16, and the models it lists today are served on TheRouter through other providers.
Groq
US0 modelsLPU-powered inference — custom hardware built for very low latency
Groq builds custom LPU (Language Processing Unit) silicon for AI inference — custom hardware built for very low-latency serving of open-weight models. TheRouter currently routes no models through Groq: Groq shut down llama-3.1-8b-instant and llama-3.3-70b-versatile for free and developer tiers on 2026-08-16, and the models it lists today are served on TheRouter through other providers.
- ✓Ultra-fast inference
- ✓Open source models
- ✓Tool use
- ✓Low latency