DeepSeek V4 Pro vs GLM-5.1 vs Grok 4.20 (Non-Reasoning)
No independent capability benchmark covers every model here yet. The score uses price and context window.No independent capability benchmark covers every model here yet. The score uses context window.
DeepSeek
DeepSeek V4 Pro
42/100- ECI150.2
- Price$1.60 / $3.33
- Context1M
Z.ai (Zhipu)
GLM-5.1
34/100- ECI150.7
- Price$1.40 / $4.40
- Context200K
xAI
Grok 4.20 (Non-Reasoning)
46/100- ECI—
- Price$1.25 / $2.50
- Context1M
DeepSeek
DeepSeek V4 Pro
64/100- ECI150.2
- Price$1.60 / $3.33
- Context1M
Z.ai (Zhipu)
GLM-5.1
39/100- ECI150.7
- Price$1.40 / $4.40
- Context200K
xAI
Grok 4.20 (Non-Reasoning)
64/100- ECI—
- Price$1.25 / $2.50
- Context1M
Capability evidence is incomplete
There is not enough shared capability evidence to name an overall winner. The scores (Grok 4.20 (Non-Reasoning) 46/100, DeepSeek V4 Pro 42/100, GLM-5.1 34/100) compare the available specifications and price. The score weighs price 71%, context window 29%. None of the shared benchmarks cover every model here yet, so capability is left out of this verdict.There is not enough shared capability evidence to name an overall winner. The scores (DeepSeek V4 Pro 64/100, Grok 4.20 (Non-Reasoning) 64/100, GLM-5.1 39/100) compare the available specifications only. The score weighs context window 100%. None of the shared benchmarks cover every model here yet, so capability is left out of this verdict.
- CapabilityNot enough dataNo independent benchmark covers every model here yet
- Lowest priceGrok 4.20 (Non-Reasoning)Grok 4.20 (Non-Reasoning) $1.56 · DeepSeek V4 Pro $2.03 · GLM-5.1 $2.15 per 1M tokens (3:1 blend)
- Longest contextDeepSeek V4 Pro and Grok 4.20 (Non-Reasoning)DeepSeek V4 Pro 1,000,000 · Grok 4.20 (Non-Reasoning) 1,000,000 · GLM-5.1 200,000 tokens
- Widest inputsGrok 4.20 (Non-Reasoning)DeepSeek V4 Pro: Text · GLM-5.1: Text · Grok 4.20 (Non-Reasoning): Text, Images, PDFs
- Self-hostingDeepSeek V4 Pro and GLM-5.1Publishes downloadable weights
| Measure | Weight | DeepSeek V4 Pro | GLM-5.1 | Grok 4.20 (Non-Reasoning) |
|---|---|---|---|---|
| Price | 71% | 34 | 33 | 39 |
| Context window | 29% | 64 | 39 | 64 |
| Specs & price only | 100% | 42/100 | 34/100 | 46/100 |
Left out because at least one model lacks the data: capability and inputs & features. The remaining weights were rescaled.
| Measure | Weight | DeepSeek V4 Pro | GLM-5.1 | Grok 4.20 (Non-Reasoning) |
|---|---|---|---|---|
| Context window | 100% | 64 | 39 | 64 |
| Specs only | 100% | 64/100 | 39/100 | 64/100 |
Left out because at least one model lacks the data: capability and inputs & features. The remaining weights were rescaled.
Every spec in one table
Highlighted cells lead their row. Unavailable specifications are marked “Not published”. Publisher results include their evaluation settings and source.
| Specification | |||
|---|---|---|---|
| Capability | |||
| Capabilities Index (ECI) | 150.2 | 150.7 (best) | Not published |
| ECI rank | #68 of 159 | #67 of 159 (best) | Not published |
| ECI confidence interval | 148.4–152.0 | 148.7–152.8 | Not published |
| ECI evaluation date | Apr 24, 2026 | Apr 7, 2026 | Not published |
| Documented capabilities | Open MoE flagship with million-token context for coding and long agent runs | Strong GLM coding model for agentic engineering, terminals, and repository generation | Grok model for agentic tool use, reasoning, coding, and live assistance |
| Model parameters | Not published | Not published | Not published |
| Output modalities | Text | Text | Text |
| GPQA DiamondGraduate-level science questions | 90.9%high (best) | 89.9% | Not published |
| FrontierMath Tiers 1–3Research-level mathematics | 45.3%max (best) | 36.8% | Not published |
| OTIS Mock AIME 2024–2025Competition mathematics | 96.7%max (best) | 93.3% | Not published |
| SWE-bench VerifiedFixing real GitHub issues | 77.6%max (best) | 74.2% | Not published |
| SimpleQA VerifiedShort factual questions | 47.0%max (best) | 34.0% | Not published |
| Publisher-reported benchmarks | |||
| SWE-Bench VerifiedPublisher-reported result | 80.6resolvedReported result | Not published | Not published |
| Artificial Analysis Coding Agent Indexhigh | 50.1average pass@1Reported result | Not published | Not published |
| SWE-Atlas Codebase QnAhigh | 67.8pass@1Reported result | Not published | Not published |
| SWE-Bench Pro · hard-aahigh | 18pass@1Reported result | Not published | Not published |
| Terminal-Bench 2.1high | 64.7pass@1Reported result | Not published | Not published |
| MMLU-Propreview checkpoint; max effort | 87.5EMReported result | Not published | Not published |
| SimpleQA-Verifiedpreview checkpoint; max effort | 57.9pass@1Reported result | Not published | Not published |
| Chinese SimpleQApreview checkpoint; max effort | 84.4pass@1Reported result | Not published | Not published |
| GPQA Diamondpreview checkpoint; max effort | 90.1pass@1Reported result | Not published | Not published |
| Humanity's Last Exampreview checkpoint; max effort; without tools | 37.7pass@1Reported result | Not published | Not published |
| LiveCodeBenchpreview checkpoint; max effort | 93.5pass@1Reported result | Not published | Not published |
| Codeforcespreview checkpoint; max effort | 3206ratingReported result | Not published | Not published |
| HMMT · February 2026preview checkpoint; max effort | 95.2pass@1Reported result | Not published | Not published |
| IMOAnswerBenchpreview checkpoint; max effort | 89.8pass@1Reported result | Not published | Not published |
| MathArena Apexpreview checkpoint; max effort | 38.3pass@1Reported result | Not published | Not published |
| MathArena Apex Shortlistpreview checkpoint; max effort | 90.2pass@1Reported result | Not published | Not published |
| MRCR · 1M contextpreview checkpoint; max effort | 83.5MMRReported result | Not published | Not published |
| CorpusQA · 1M contextpreview checkpoint; max effort | 62accuracyReported result | Not published | Not published |
| Terminal-Bench 2.0preview checkpoint; max effort | 67.9accuracyReported result | Not published | Not published |
| SWE-Bench Propreview checkpoint; max effort | 55.4resolvedReported result | Not published | Not published |
| SWE-Bench Multilingualpreview checkpoint; max effort | 76.2resolvedReported result | Not published | Not published |
| BrowseComppreview checkpoint; max effort | 83.4pass@1Reported result | Not published | Not published |
| Humanity's Last Exampreview checkpoint; max effort; with tools | 48.2pass@1Reported result | Not published | Not published |
| MCP Atlas · publicpreview checkpoint; max effort | 73.6pass@1Reported result | Not published | Not published |
| GDPval-AApreview checkpoint; max effort | 1554EloReported result | Not published | Not published |
| Toolathlonpreview checkpoint; max effort | 51.8pass@1Reported result | Not published | Not published |
| Artificial Analysis Coding Agent IndexPublisher-reported result | Not published | 52.7average pass@1Reported result | Not published |
| SWE-Atlas Codebase QnAPublisher-reported result | Not published | 73.2pass@1Reported result | Not published |
| SWE-Bench Pro · hard-aaPublisher-reported result | Not published | 19.8pass@1Reported result | Not published |
| Terminal-Bench 2.1Publisher-reported result | Not published | 65.1pass@1Reported result | Not published |
| Price per million tokens | |||
| Input | $1.60 | $1.40 | $1.25 (best) |
| Output | $3.33 | $4.40 | $2.50 (best) |
| Cached input | Not published | $0.26 | $0.20 (best) |
| Blended (3:1) | $2.03 | $2.15 | $1.56 (best) |
| Long-context rate | Same rate | Same rate | Over 200K: $2.50 / $5.00 |
| Price source | Median of 65 providers | Official Z.AI API | Official xAI API |
| Limits | |||
| Context window | 1,000,000 tokens (best) | 200,000 tokens | 1,000,000 tokens (best) |
| Max input | Not published | Not published | Not published |
| Max output | 384,000 tokens (best) | 131,072 tokens | 30,000 tokens |
| Inputs and features | |||
| Text | Yes | Yes | Yes |
| Images | No | No | Yes |
| PDFs | No | No | Yes |
| Audio | No | No | No |
| Video | No | No | No |
| Reasoning | Yes | Yes | No |
| Tool calling | Yes | Yes | Yes |
| Structured output | Not published | Yes | Yes |
| File attachments | No | No | Yes |
| Temperature control | Yes | Yes | Yes |
| Reasoning control | always | toggle | Not published |
| Availability | |||
| Weights | Open | Open | Proprietary |
| API model ID | Not published | glm-5.1 | grok-4.20-0309-non-reasoning |
| API providers | 67 (best) | 45 | 13 |
| Released | Apr 24, 2026 | Apr 7, 2026 | Mar 9, 2026 |
| Knowledge cutoff | May 2025 | Not published | Not published |
| Publisher documentation | Model weights | Publisher documentation · Model weights | Publisher documentation |
| Source metadata updated | Apr 24, 2026 | Apr 7, 2026 | Mar 9, 2026 |
| Data sources | models.dev · Epoch AI | models.dev · Epoch AI | models.dev · Epoch AI |
| Catalog checked | Nov 22, 2026 | Nov 22, 2026 | Nov 22, 2026 |
What would a month cost?
Enter your expected volume in millions of tokens. List prices only; caching and batch discounts would lower these.
DeepSeek V4 Pro$22.66
GLM-5.1$22.80
Grok 4.20 (Non-Reasoning)$17.50
Which should you choose?
Which is better: DeepSeek V4 Pro, GLM-5.1 or Grok 4.20 (Non-Reasoning)?
There is not enough shared capability evidence to name an overall winner. The scores (Grok 4.20 (Non-Reasoning) 46/100, DeepSeek V4 Pro 42/100, GLM-5.1 34/100) compare the available specifications and price. The score weighs price 71%, context window 29%. None of the shared benchmarks cover every model here yet, so capability is left out of this verdict.There is not enough shared capability evidence to name an overall winner. The scores (DeepSeek V4 Pro 64/100, Grok 4.20 (Non-Reasoning) 64/100, GLM-5.1 39/100) compare the available specifications only. The score weighs context window 100%. None of the shared benchmarks cover every model here yet, so capability is left out of this verdict.
Which is cheaper, DeepSeek V4 Pro, GLM-5.1 or Grok 4.20 (Non-Reasoning)?
Grok 4.20 (Non-Reasoning) is cheaper at $1.25 input / $2.50 output per million tokens (official xAI API price). DeepSeek V4 Pro costs $1.60 input / $3.33 output per million tokens (median across 65 API providers); GLM-5.1 costs $1.40 input / $4.40 output per million tokens (official Z.AI API price). At a typical mix of three input tokens to one output token, that is $1.56 per million tokens for Grok 4.20 (Non-Reasoning) versus $2.03 for DeepSeek V4 Pro (1.3× as much) and $2.15 for GLM-5.1 (1.4× as much).
Which scores higher on benchmarks?
There is no independent benchmark that covers all three models yet. DeepSeek V4 Pro has an ECI of 150.2, GLM-5.1 has an ECI of 150.7 and Grok 4.20 (Non-Reasoning) has not been scored yet.
Which is better for coding?
There are no published SWE-bench Verified results for Grok 4.20 (Non-Reasoning) yet, so there is no like-for-like coding score. Test both on a sample of your own tasks. All three support tool calling for agent workflows.
Which has the bigger context window?
DeepSeek V4 Pro and Grok 4.20 (Non-Reasoning) have the largest context windows (1,000,000 and 1,000,000 tokens), against 200,000 for GLM-5.1. Maximum output per response: DeepSeek V4 Pro up to 384,000, GLM-5.1 up to 131,072, Grok 4.20 (Non-Reasoning) up to 30,000 tokens.
Which can read images, PDFs, audio or video?
DeepSeek V4 Pro accepts text; GLM-5.1 accepts text; Grok 4.20 (Non-Reasoning) accepts text, images and PDFs. Grok 4.20 (Non-Reasoning) handles the widest range of inputs.
Are any of these open source?
DeepSeek V4 Pro and GLM-5.1 publishes its weights and can be self-hosted; Grok 4.20 (Non-Reasoning) is proprietary.
Which is newer?
DeepSeek V4 Pro is the newest, released Apr 24, 2026. GLM-5.1 came out Apr 7, 2026; Grok 4.20 (Non-Reasoning) came out Mar 9, 2026. Knowledge cutoff: DeepSeek V4 Pro May 2025.
How do you decide the winner?
This rating uses price (71%, blended price per million tokens (3 input : 1 output), log scale); context window (29%, maximum tokens per request, log scale). Dimensions missing for any model are dropped and the remaining weights rescaled, so every model is judged on the same evidence. Specs and prices come from public model listings and the labs’ own API pages; capability scores come from independent benchmark runs. Data updated Nov 22, 2026.This rating uses context window (100%, maximum tokens per request, log scale). Dimensions missing for any model are dropped and the remaining weights rescaled, so every model is judged on the same evidence. Specs and prices come from public model listings and the labs’ own API pages; capability scores come from independent benchmark runs. Data updated Nov 22, 2026.