ZMIME
Comparison · 3 models · Updated Nov 18, 2026

Gemini 3.5 Flash vs GPT-5.4 vs Grok 4.5

Too close to call on our weighted score (Gemini 3.5 Flash 84, GPT-5.4 81, Grok 4.5 76). The right pick depends on what you value most.

Price in rating: Excluded · Include price

  1. Google

    Gemini 3.5 Flash

    Released May 19, 2026

    84/100
    • ECI155.4
    • Price$1.50 / $9.00
    • Context1.05M
  2. OpenAI

    GPT-5.4

    Released Mar 5, 2026

    81/100
    • ECI157.9
    • Price$2.50 / $15.00
    • Context1.05M
  3. xAI

    Grok 4.5

    Released Jul 8, 2026

    76/100
    • ECI155.0
    • Price$2.00 / $6.00
    • Context500K
01 — Verdict

Too close to call

It is close. Our weighted score puts them within 2 points (Gemini 3.5 Flash 84/100, GPT-5.4 81/100, Grok 4.5 76/100), so choose by what matters most for your work: GPT-5.4 for raw capability and Grok 4.5 on price. The score weighs capability 67%, inputs & features 20%, context window 13%.

  • CapabilityGPT-5.4Capabilities Index (ECI): GPT-5.4 157.9 · Gemini 3.5 Flash 155.4 · Grok 4.5 155.0
  • Lowest priceGrok 4.5Grok 4.5 $3.00 · Gemini 3.5 Flash $3.38 · GPT-5.4 $5.63 per 1M tokens (3:1 blend)
  • Longest contextGPT-5.4 and Gemini 3.5 FlashGPT-5.4 1,050,000 · Gemini 3.5 Flash 1,048,576 · Grok 4.5 500,000 tokens
  • Widest inputsGemini 3.5 FlashGemini 3.5 Flash: Text, Images, PDFs, Audio, Video · GPT-5.4: Text, Images, PDFs · Grok 4.5: Text, Images
  • Self-hostingNo confirmed open weightsAll three are available only through APIs
How the score is built
MeasureWeightGemini 3.5 FlashGPT-5.4Grok 4.5
CapabilityCapabilities Index (ECI)67%828582
Inputs & features20%1008070
Context window13%656553
Overall100%84/10081/10076/100
02 — Side by side

Every spec in one table

Highlighted cells lead their row. Dashes mean the data is not published.

Gemini 3.5 Flash vs GPT-5.4 vs Grok 4.5 specifications side by side
SpecificationGemini 3.5 FlashGoogleGPT-5.4OpenAIGrok 4.5xAI
Capability
Capabilities Index (ECI)155.4157.9 (best)155.0
ECI rank#44 of 158#28 of 158 (best)#47 of 158
GPQA DiamondGraduate-level science questions92.8%93.3%93.4% (best)
FrontierMath Tiers 1–3Research-level mathematics62.8%78.6% (best)57.2%
OTIS Mock AIME 2024–2025Competition mathematics95.6%97.8% (best)97.8% (best)
SWE-bench VerifiedFixing real GitHub issues79.3% (best)76.9%—
SimpleQA VerifiedShort factual questions66.2% (best)45.1%48.3%
Price per million tokens
Input$1.50 (best)$2.50$2.00
Output$9.00$15.00$6.00 (best)
Cached input$0.15 (best)$0.25$0.30
Blended (3:1)$3.38$5.63$3.00 (best)
Long-context rateSame rateOver 272K: $5.00 / $22.50Over 200K: $4.00 / $12.00
Price sourceOfficial Google APIOfficial OpenAI APIOfficial xAI API
Limits
Context window1,048,576 tokens1,050,000 tokens (best)500,000 tokens
Max output65,536 tokens128,000 tokens500,000 tokens (best)
Inputs and features
TextYesYesYes
ImagesYesYesYes
PDFsYesYesNo
AudioYesNoNo
VideoYesNoNo
ReasoningYesminimal · low · medium · highYeslow · medium · high · xhighYeslow · medium · high · xhigh
Tool callingYesYesYes
Structured outputYesYesYes
Availability
WeightsProprietaryProprietaryProprietary
API model IDgemini-3.5-flashgpt-5.4grok-4.5
API providers3450 (best)27
ReleasedMay 19, 2026Mar 5, 2026Jul 8, 2026
Knowledge cutoffJan 2025Aug 31, 2025—
03 — Cost

What would a month cost?

Enter your expected volume in millions of tokens. List prices only; caching and batch discounts would lower these.

  • Gemini 3.5 Flash$33.00
  • GPT-5.4$55.00
  • Grok 4.5$32.00
04 — Questions

Which should you choose?

Which is better: Gemini 3.5 Flash, GPT-5.4 or Grok 4.5?

It is close. Our weighted score puts them within 2 points (Gemini 3.5 Flash 84/100, GPT-5.4 81/100, Grok 4.5 76/100), so choose by what matters most for your work: GPT-5.4 for raw capability and Grok 4.5 on price. The score weighs capability 67%, inputs & features 20%, context window 13%.

Which is cheaper, Gemini 3.5 Flash, GPT-5.4 or Grok 4.5?

Grok 4.5 is cheaper at $2.00 input / $6.00 output per million tokens (official xAI API price). Gemini 3.5 Flash costs $1.50 input / $9.00 output per million tokens (official Google API price); GPT-5.4 costs $2.50 input / $15.00 output per million tokens (official OpenAI API price). At a typical mix of three input tokens to one output token, that is $3.00 per million tokens for Grok 4.5 versus $3.38 for Gemini 3.5 Flash (1.1× as much) and $5.63 for GPT-5.4 (1.9× as much).

Which scores higher on benchmarks?

GPT-5.4 scores higher on the Capabilities Index (ECI): GPT-5.4 157.9 (#28 of 158), Gemini 3.5 Flash 155.4 (#44 of 158) and Grok 4.5 155.0 (#47 of 158). The confidence ranges of the top two overlap (156.0–160.0 vs 153.5–157.4), so treat the gap as small. On individual benchmarks: GPQA Diamond — Grok 4.5 93.4%, GPT-5.4 93.3%, Gemini 3.5 Flash 92.8%; FrontierMath Tiers 1–3 — GPT-5.4 78.6%, Gemini 3.5 Flash 62.8%, Grok 4.5 57.2%; OTIS Mock AIME 2024–2025 — GPT-5.4 97.8%, Grok 4.5 97.8%, Gemini 3.5 Flash 95.6%; SimpleQA Verified — Gemini 3.5 Flash 66.2%, Grok 4.5 48.3%, GPT-5.4 45.1%.

Which is better for coding?

There are no published SWE-bench Verified results for Grok 4.5 yet, so there is no like-for-like coding score. On overall capability, GPT-5.4 leads, which tends to carry over to coding, but test on your own codebase. All three support tool calling for agent workflows.

Which has the bigger context window?

GPT-5.4 and Gemini 3.5 Flash have the largest context windows (1,050,000 and 1,048,576 tokens), against 500,000 for Grok 4.5. Maximum output per response: Gemini 3.5 Flash up to 65,536, GPT-5.4 up to 128,000, Grok 4.5 up to 500,000 tokens.

Which can read images, PDFs, audio or video?

Gemini 3.5 Flash accepts text, images, PDFs, audio and video; GPT-5.4 accepts text, images and PDFs; Grok 4.5 accepts text and images. Gemini 3.5 Flash handles the widest range of inputs.

Are any of these open source?

No. Gemini 3.5 Flash, GPT-5.4 and Grok 4.5 are proprietary and only available through APIs and apps.

Which is newer?

Grok 4.5 is the newest, released Jul 8, 2026. Gemini 3.5 Flash came out May 19, 2026; GPT-5.4 came out Mar 5, 2026. Knowledge cutoff: Gemini 3.5 Flash Jan 2025, GPT-5.4 Aug 31, 2025.

How do you decide the winner?

This rating uses capability (67%, independent benchmark results); inputs & features (20%, image, PDF, audio and video input, tool calling, structured output and reasoning); context window (13%, maximum tokens per request, log scale). Dimensions missing for any model are dropped and the remaining weights rescaled, so every model is judged on the same evidence. Specs and prices come from public model listings and the labs’ own API pages; capability scores come from independent benchmark runs. Data updated Nov 18, 2026.