ZMIME
Comparison · 3 models · Updated Nov 18, 2026

Gemma 4 31B IT vs Grok 4.20 (Non-Reasoning) vs Qwen3.5 Flash

No independent capability benchmark covers every model here yet. The score uses price, inputs & features and context window.

Price in rating: Included · Exclude price

  1. Google

    Gemma 4 31B IT

    Released Apr 2, 2026

    69/100
    • ECI144.1
    • Price$0.142 / $0.40
    • Context262K
  2. xAI

    Grok 4.20 (Non-Reasoning)

    Released Mar 9, 2026

    53/100
    • ECI—
    • Price$1.25 / $2.50
    • Context1M
  3. Alibaba (Qwen)

    Qwen3.5 Flash

    Released Feb 23, 2026

    78/100
    • ECI143.9
    • Price$0.10 / $0.40
    • Context1M
01 — Verdict

Capability evidence is incomplete

There is not enough shared capability evidence to name an overall winner. The scores (Qwen3.5 Flash 78/100, Gemma 4 31B IT 69/100, Grok 4.20 (Non-Reasoning) 53/100) compare the available specifications and price. The score weighs price 50%, inputs & features 30%, context window 20%. None of the shared benchmarks cover every model here yet, so capability is left out of this verdict.

  • CapabilityNot enough dataNo independent benchmark covers every model here yet
  • Lowest priceQwen3.5 FlashQwen3.5 Flash $0.175 · Gemma 4 31B IT $0.206 · Grok 4.20 (Non-Reasoning) $1.56 per 1M tokens (3:1 blend)
  • Longest contextGrok 4.20 (Non-Reasoning) and Qwen3.5 FlashGrok 4.20 (Non-Reasoning) 1,000,000 · Qwen3.5 Flash 1,000,000 · Gemma 4 31B IT 262,144 tokens
  • Widest inputsGrok 4.20 (Non-Reasoning) and Qwen3.5 FlashGemma 4 31B IT: Text, Images · Grok 4.20 (Non-Reasoning): Text, Images, PDFs · Qwen3.5 Flash: Text, Images, Video
  • Self-hostingGemma 4 31B ITPublishes downloadable weights
How the score is built
MeasureWeightGemma 4 31B ITGrok 4.20 (Non-Reasoning)Qwen3.5 Flash
Price50%793982
Inputs & features30%707080
Context window20%436464
Specs & price only100%69/10053/10078/100

Left out because at least one model lacks the data: capability. The remaining weights were rescaled.

02 — Side by side

Every spec in one table

Highlighted cells lead their row. Dashes mean the data is not published.

Gemma 4 31B IT vs Grok 4.20 (Non-Reasoning) vs Qwen3.5 Flash specifications side by side
SpecificationGemma 4 31B ITGoogleGrok 4.20 (Non-Reasoning)xAIQwen3.5 FlashAlibaba (Qwen)
Capability
Capabilities Index (ECI)144.1 (best)—143.9
ECI rank#94 of 158 (best)—#97 of 158
GPQA DiamondGraduate-level science questions75.8%—82.3% (best)
FrontierMath Tiers 1–3Research-level mathematics——18.3%
OTIS Mock AIME 2024–2025Competition mathematics73.3%—84.4% (best)
SimpleQA VerifiedShort factual questions10.4%—20.3% (best)
Price per million tokens
Input$0.142$1.25$0.10 (best)
Output$0.40 (best)$2.50$0.40 (best)
Cached input—$0.20$0.01 (best)
Blended (3:1)$0.206$1.56$0.175 (best)
Long-context rateSame rateOver 200K: $2.50 / $5.00Same rate
Price sourceMedian of 42 providersOfficial xAI APIOfficial Alibaba API
Limits
Context window262,144 tokens1,000,000 tokens (best)1,000,000 tokens (best)
Max output32,768 tokens30,000 tokens65,536 tokens (best)
Inputs and features
TextYesYesYes
ImagesYesYesYes
PDFsNoYesNo
AudioNoNoNo
VideoNoNoYes
ReasoningYesNoYes
Tool callingYesYesYes
Structured outputYesYesYes
Availability
WeightsOpenProprietaryProprietary
API model IDgemma-4-31b-itgrok-4.20-0309-non-reasoningqwen3.5-flash
API providers52 (best)1310
ReleasedApr 2, 2026Mar 9, 2026Feb 23, 2026
Knowledge cutoffJan 2025——
03 — Cost

What would a month cost?

Enter your expected volume in millions of tokens. List prices only; caching and batch discounts would lower these.

  • Gemma 4 31B IT$2.22
  • Grok 4.20 (Non-Reasoning)$17.50
  • Qwen3.5 Flash$1.80
04 — Questions

Which should you choose?

Which is better: Gemma 4 31B IT, Grok 4.20 (Non-Reasoning) or Qwen3.5 Flash?

There is not enough shared capability evidence to name an overall winner. The scores (Qwen3.5 Flash 78/100, Gemma 4 31B IT 69/100, Grok 4.20 (Non-Reasoning) 53/100) compare the available specifications and price. The score weighs price 50%, inputs & features 30%, context window 20%. None of the shared benchmarks cover every model here yet, so capability is left out of this verdict.

Which is cheaper, Gemma 4 31B IT, Grok 4.20 (Non-Reasoning) or Qwen3.5 Flash?

Qwen3.5 Flash is cheaper at $0.10 input / $0.40 output per million tokens (official Alibaba API price). Gemma 4 31B IT costs $0.142 input / $0.40 output per million tokens (median across 42 API providers; free on Google); Grok 4.20 (Non-Reasoning) costs $1.25 input / $2.50 output per million tokens (official xAI API price). At a typical mix of three input tokens to one output token, that is $0.175 per million tokens for Qwen3.5 Flash versus $0.206 for Gemma 4 31B IT (1.2× as much) and $1.56 for Grok 4.20 (Non-Reasoning) (8.9× as much).

Which scores higher on benchmarks?

There is no independent benchmark that covers all three models yet. Gemma 4 31B IT has an ECI of 144.1, Grok 4.20 (Non-Reasoning) has not been scored yet and Qwen3.5 Flash has an ECI of 143.9.

Which is better for coding?

There are no published SWE-bench Verified results for Gemma 4 31B IT, Grok 4.20 (Non-Reasoning) and Qwen3.5 Flash yet, so there is no like-for-like coding score. Test both on a sample of your own tasks. All three support tool calling for agent workflows.

Which has the bigger context window?

Grok 4.20 (Non-Reasoning) and Qwen3.5 Flash have the largest context windows (1,000,000 and 1,000,000 tokens), against 262,144 for Gemma 4 31B IT. Maximum output per response: Gemma 4 31B IT up to 32,768, Grok 4.20 (Non-Reasoning) up to 30,000, Qwen3.5 Flash up to 65,536 tokens.

Which can read images, PDFs, audio or video?

Gemma 4 31B IT accepts text and images; Grok 4.20 (Non-Reasoning) accepts text, images and PDFs; Qwen3.5 Flash accepts text, images and video. Grok 4.20 (Non-Reasoning) handles the widest range of inputs.

Are any of these open source?

Gemma 4 31B IT publishes its weights and can be self-hosted; Grok 4.20 (Non-Reasoning) and Qwen3.5 Flash is proprietary.

Which is newer?

Gemma 4 31B IT is the newest, released Apr 2, 2026. Grok 4.20 (Non-Reasoning) came out Mar 9, 2026; Qwen3.5 Flash came out Feb 23, 2026. Knowledge cutoff: Gemma 4 31B IT Jan 2025.

How do you decide the winner?

This rating uses price (50%, blended price per million tokens (3 input : 1 output), log scale); inputs & features (30%, image, PDF, audio and video input, tool calling, structured output and reasoning); context window (20%, maximum tokens per request, log scale). Dimensions missing for any model are dropped and the remaining weights rescaled, so every model is judged on the same evidence. Specs and prices come from public model listings and the labs’ own API pages; capability scores come from independent benchmark runs. Data updated Nov 18, 2026.