Gemma 4 31B IT vs Grok 4.20 (Non-Reasoning) vs Qwen3.5 Flash
No independent capability benchmark covers every model here yet. The score uses inputs & features and context window.
Price in rating: Excluded · Include price
Google
Gemma 4 31B IT
59/100- ECI144.1
- Price$0.142 / $0.40
- Context262K
xAI
Grok 4.20 (Non-Reasoning)
68/100- ECI—
- Price$1.25 / $2.50
- Context1M
Alibaba (Qwen)
Qwen3.5 Flash
74/100- ECI143.9
- Price$0.10 / $0.40
- Context1M
Capability evidence is incomplete
There is not enough shared capability evidence to name an overall winner. The scores (Qwen3.5 Flash 74/100, Grok 4.20 (Non-Reasoning) 68/100, Gemma 4 31B IT 59/100) compare the available specifications only. The score weighs inputs & features 60%, context window 40%. None of the shared benchmarks cover every model here yet, so capability is left out of this verdict.
- CapabilityNot enough dataNo independent benchmark covers every model here yet
- Lowest priceQwen3.5 FlashQwen3.5 Flash $0.175 · Gemma 4 31B IT $0.206 · Grok 4.20 (Non-Reasoning) $1.56 per 1M tokens (3:1 blend)
- Longest contextGrok 4.20 (Non-Reasoning) and Qwen3.5 FlashGrok 4.20 (Non-Reasoning) 1,000,000 · Qwen3.5 Flash 1,000,000 · Gemma 4 31B IT 262,144 tokens
- Widest inputsGrok 4.20 (Non-Reasoning) and Qwen3.5 FlashGemma 4 31B IT: Text, Images · Grok 4.20 (Non-Reasoning): Text, Images, PDFs · Qwen3.5 Flash: Text, Images, Video
- Self-hostingGemma 4 31B ITPublishes downloadable weights
| Measure | Weight | Gemma 4 31B IT | Grok 4.20 (Non-Reasoning) | Qwen3.5 Flash |
|---|---|---|---|---|
| Inputs & features | 60% | 70 | 70 | 80 |
| Context window | 40% | 43 | 64 | 64 |
| Specs only | 100% | 59/100 | 68/100 | 74/100 |
Left out because at least one model lacks the data: capability. The remaining weights were rescaled.
Every spec in one table
Highlighted cells lead their row. Dashes mean the data is not published.
| Specification | |||
|---|---|---|---|
| Capability | |||
| Capabilities Index (ECI) | 144.1 (best) | — | 143.9 |
| ECI rank | #94 of 158 (best) | — | #97 of 158 |
| GPQA DiamondGraduate-level science questions | 75.8% | — | 82.3% (best) |
| FrontierMath Tiers 1–3Research-level mathematics | — | — | 18.3% |
| OTIS Mock AIME 2024–2025Competition mathematics | 73.3% | — | 84.4% (best) |
| SimpleQA VerifiedShort factual questions | 10.4% | — | 20.3% (best) |
| Price per million tokens | |||
| Input | $0.142 | $1.25 | $0.10 (best) |
| Output | $0.40 (best) | $2.50 | $0.40 (best) |
| Cached input | — | $0.20 | $0.01 (best) |
| Blended (3:1) | $0.206 | $1.56 | $0.175 (best) |
| Long-context rate | Same rate | Over 200K: $2.50 / $5.00 | Same rate |
| Price source | Median of 42 providers | Official xAI API | Official Alibaba API |
| Limits | |||
| Context window | 262,144 tokens | 1,000,000 tokens (best) | 1,000,000 tokens (best) |
| Max output | 32,768 tokens | 30,000 tokens | 65,536 tokens (best) |
| Inputs and features | |||
| Text | Yes | Yes | Yes |
| Images | Yes | Yes | Yes |
| PDFs | No | Yes | No |
| Audio | No | No | No |
| Video | No | No | Yes |
| Reasoning | Yes | No | Yes |
| Tool calling | Yes | Yes | Yes |
| Structured output | Yes | Yes | Yes |
| Availability | |||
| Weights | Open | Proprietary | Proprietary |
| API model ID | gemma-4-31b-it | grok-4.20-0309-non-reasoning | qwen3.5-flash |
| API providers | 52 (best) | 13 | 10 |
| Released | Apr 2, 2026 | Mar 9, 2026 | Feb 23, 2026 |
| Knowledge cutoff | Jan 2025 | — | — |
What would a month cost?
Enter your expected volume in millions of tokens. List prices only; caching and batch discounts would lower these.
Gemma 4 31B IT$2.22
Grok 4.20 (Non-Reasoning)$17.50
Qwen3.5 Flash$1.80
Which should you choose?
Which is better: Gemma 4 31B IT, Grok 4.20 (Non-Reasoning) or Qwen3.5 Flash?
There is not enough shared capability evidence to name an overall winner. The scores (Qwen3.5 Flash 74/100, Grok 4.20 (Non-Reasoning) 68/100, Gemma 4 31B IT 59/100) compare the available specifications only. The score weighs inputs & features 60%, context window 40%. None of the shared benchmarks cover every model here yet, so capability is left out of this verdict.
Which is cheaper, Gemma 4 31B IT, Grok 4.20 (Non-Reasoning) or Qwen3.5 Flash?
Qwen3.5 Flash is cheaper at $0.10 input / $0.40 output per million tokens (official Alibaba API price). Gemma 4 31B IT costs $0.142 input / $0.40 output per million tokens (median across 42 API providers; free on Google); Grok 4.20 (Non-Reasoning) costs $1.25 input / $2.50 output per million tokens (official xAI API price). At a typical mix of three input tokens to one output token, that is $0.175 per million tokens for Qwen3.5 Flash versus $0.206 for Gemma 4 31B IT (1.2× as much) and $1.56 for Grok 4.20 (Non-Reasoning) (8.9× as much).
Which scores higher on benchmarks?
There is no independent benchmark that covers all three models yet. Gemma 4 31B IT has an ECI of 144.1, Grok 4.20 (Non-Reasoning) has not been scored yet and Qwen3.5 Flash has an ECI of 143.9.
Which is better for coding?
There are no published SWE-bench Verified results for Gemma 4 31B IT, Grok 4.20 (Non-Reasoning) and Qwen3.5 Flash yet, so there is no like-for-like coding score. Test both on a sample of your own tasks. All three support tool calling for agent workflows.
Which has the bigger context window?
Grok 4.20 (Non-Reasoning) and Qwen3.5 Flash have the largest context windows (1,000,000 and 1,000,000 tokens), against 262,144 for Gemma 4 31B IT. Maximum output per response: Gemma 4 31B IT up to 32,768, Grok 4.20 (Non-Reasoning) up to 30,000, Qwen3.5 Flash up to 65,536 tokens.
Which can read images, PDFs, audio or video?
Gemma 4 31B IT accepts text and images; Grok 4.20 (Non-Reasoning) accepts text, images and PDFs; Qwen3.5 Flash accepts text, images and video. Grok 4.20 (Non-Reasoning) handles the widest range of inputs.
Are any of these open source?
Gemma 4 31B IT publishes its weights and can be self-hosted; Grok 4.20 (Non-Reasoning) and Qwen3.5 Flash is proprietary.
Which is newer?
Gemma 4 31B IT is the newest, released Apr 2, 2026. Grok 4.20 (Non-Reasoning) came out Mar 9, 2026; Qwen3.5 Flash came out Feb 23, 2026. Knowledge cutoff: Gemma 4 31B IT Jan 2025.
How do you decide the winner?
This rating uses inputs & features (60%, image, PDF, audio and video input, tool calling, structured output and reasoning); context window (40%, maximum tokens per request, log scale). Dimensions missing for any model are dropped and the remaining weights rescaled, so every model is judged on the same evidence. Specs and prices come from public model listings and the labs’ own API pages; capability scores come from independent benchmark runs. Data updated Nov 18, 2026.