ZMIME
Comparison · 3 models · Updated Nov 22, 2026

Gemini 3.1 Pro Preview vs Claude Fable 5.1 vs GPT-5.4

Too close to call on our weighted score (Gemini 3.1 Pro Preview 68, Claude Fable 5.1 65, GPT-5.4 65). The right pick depends on what you value most.Too close to call on our weighted score (Claude Fable 5.1 87, Gemini 3.1 Pro Preview 84, GPT-5.4 82). The right pick depends on what you value most.

  1. Google

    Gemini 3.1 Pro Preview

    Released Feb 19, 2026Latest

    68/100
    • ECI156.3
    • Price$2.00 / $12.00
    • Context1.05M
  2. Anthropic

    Claude Fable 5.1

    Released Sep 1, 2026

    65/100
    • ECI167.1
    • Price$10.00 / $50.00
    • Context1M
  3. OpenAI

    GPT-5.4

    Released Mar 5, 2026

    65/100
    • ECI157.9
    • Price$2.50 / $15.00
    • Context1.05M
  4. Google

    Gemini 3.1 Pro Preview

    Released Feb 19, 2026Latest

    84/100
    • ECI156.3
    • Price$2.00 / $12.00
    • Context1.05M
  5. Anthropic

    Claude Fable 5.1

    Released Sep 1, 2026

    87/100
    • ECI167.1
    • Price$10.00 / $50.00
    • Context1M
  6. OpenAI

    GPT-5.4

    Released Mar 5, 2026

    82/100
    • ECI157.9
    • Price$2.50 / $15.00
    • Context1.05M
01 — Verdict

Too close to call

It is close. Our weighted score puts them within 2 points (Gemini 3.1 Pro Preview 68/100, Claude Fable 5.1 65/100, GPT-5.4 65/100), so choose by what matters most for your work: Claude Fable 5.1 for raw capability and Gemini 3.1 Pro Preview on price. The score weighs capability 50%, price 25%, inputs & features 15%, context window 10%.It is close. Our weighted score puts them within 3 points (Claude Fable 5.1 87/100, Gemini 3.1 Pro Preview 84/100, GPT-5.4 82/100), so choose by what matters most for your work: Claude Fable 5.1 for raw capability and Gemini 3.1 Pro Preview on price. The score weighs capability 67%, inputs & features 20%, context window 13%.

  • CapabilityClaude Fable 5.1Capabilities Index (ECI): Claude Fable 5.1 167.1 · GPT-5.4 157.9 · Gemini 3.1 Pro Preview 156.3
  • Lowest priceGemini 3.1 Pro PreviewGemini 3.1 Pro Preview $4.50 · GPT-5.4 $5.63 · Claude Fable 5.1 $20.00 per 1M tokens (3:1 blend)
  • Longest contextGPT-5.4 and Gemini 3.1 Pro PreviewGPT-5.4 1,050,000 · Gemini 3.1 Pro Preview 1,048,576 · Claude Fable 5.1 1,000,000 tokens
  • Widest inputsGemini 3.1 Pro PreviewGemini 3.1 Pro Preview: Text, Images, PDFs, Audio, Video · Claude Fable 5.1: Text, Images, PDFs · GPT-5.4: Text, Images, PDFs
  • Self-hostingNo confirmed open weightsAll three are available only through APIs
How the score is built
MeasureWeightGemini 3.1 Pro PreviewClaude Fable 5.1GPT-5.4
CapabilityCapabilities Index (ECI)50%849485
Price25%18014
Inputs & features15%1008080
Context window10%656465
Overall100%68/10065/10065/100
How the score is built
MeasureWeightGemini 3.1 Pro PreviewClaude Fable 5.1GPT-5.4
CapabilityCapabilities Index (ECI)67%849485
Inputs & features20%1008080
Context window13%656465
Overall100%84/10087/10082/100
02 — Side by side

Every spec in one table

Highlighted cells lead their row. Unavailable specifications are marked “Not published”. Publisher results include their evaluation settings and source.

Gemini 3.1 Pro Preview vs Claude Fable 5.1 vs GPT-5.4 specifications side by side
SpecificationGemini 3.1 Pro PreviewGoogleClaude Fable 5.1AnthropicGPT-5.4OpenAI
Capability
Capabilities Index (ECI)156.3167.1 (best)157.9
ECI rank#41 of 159#8 of 159 (best)#29 of 159
ECI confidence interval154.5–158.2164.4–170.1156.0–160.0
ECI evaluation dateFeb 19, 2026Sep 1, 2026Mar 5, 2026
Documented capabilitiesReasoning-first Gemini preview for agentic coding and complex problem solvingClaude model for demanding reasoning and long-horizon agentic workAgent-ready GPT for coding and computer-use workflows at a lower cost
Model parametersNot publishedNot publishedNot published
Output modalitiesTextTextText
GPQA DiamondGraduate-level science questions94.4%high (best)Not published93.3%xhigh
FrontierMath Tiers 1–3Research-level mathematics59.7%90.2%max (best)78.6%xhigh
OTIS Mock AIME 2024–2025Competition mathematics95.6%100%max (best)97.8%high
SWE-bench VerifiedFixing real GitHub issues75.6%Not published76.9%high (best)
SimpleQA VerifiedShort factual questions73.5%high (best)70.8%max45.1%xhigh
Publisher-reported benchmarks
SWE-Bench ProPublisher-reported result54.2resolve rateReported resultMay 28, 2026Not publishedNot published
Terminal-Bench 2.1Publisher-reported result70.3success rateReported resultMay 28, 2026Not publishedNot published
SWE-Bench Pro · publicPublisher-reported result46.1resolve rateReported resultNot published59.1resolve rateReported result
SWE-Atlas Codebase QnAPublisher-reported result13.5scoreReported resultNot published40.8scoreReported result
SWE-Atlas RefactoringPublisher-reported result33.81scoreReported resultNot published44.29scoreReported result
SWE-Atlas Test WritingPublisher-reported result29.84scoreReported resultNot published44.36scoreReported result
Artificial Analysis Coding Agent Indexhigh43average pass@1Reported resultNot publishedNot published
SWE-Atlas Codebase QnAhigh45.6pass@1Reported resultNot publishedNot published
SWE-Bench Pro · hard-aahigh15.1pass@1Reported resultNot publishedNot published
Terminal-Bench 2.1high68.3pass@1Reported resultNot publishedNot published
GPQA DiamondPublisher-reported result94.3accuracyReported resultApr 23, 2026Not published92.8accuracyReported resultApr 23, 2026
Humanity's Last Exam · full set, text + MMPublisher-reported result44.4accuracyReported resultMay 19, 2026Not publishedNot published
ARC-AGI-2Publisher-reported result77.1accuracyReported resultMay 19, 2026Not publishedNot published
MMMU Prono tools80.5accuracyReported resultMay 19, 2026Not published81.2accuracyReported resultApr 23, 2026
MCP AtlasPublisher-reported result78.2success rateReported resultMay 19, 2026Not publishedNot published
OSWorld-VerifiedPublisher-reported result76.2success rateReported resultMay 19, 2026Not published75success rateReported resultApr 23, 2026
CharXiv Reasoningno tools83.3accuracyReported resultMay 19, 2026Not publishedNot published
GDPval-AAPublisher-reported result1314EloReported resultMay 19, 2026Not publishedNot published
Terminal-Bench-Science 0.1production safeguards with fallbackNot published52.6scoreReported resultSep 1, 2026Not published
Terminal-Bench 4.0production safeguards with fallbackNot published55.8scoreReported resultSep 1, 2026Not published
GDPval-AA 2production safeguards with fallbackNot published1853EloReported resultSep 1, 2026Not published
OSWorld 2.0 · August 2026 task releaseproduction safeguards; interventions score zero; no fallbackNot published77.9partial scoreReported resultSep 1, 2026Not published
OSWorld 2.0 · August 2026 task releaseproduction safeguards; interventions score zero; no fallbackNot published41.7strict success rateReported resultSep 1, 2026Not published
Humanity's Last Examwithout tools; production safeguards with fallbackNot published60.9scoreReported resultSep 1, 2026Not published
Humanity's Last Examwith tools; production safeguards with fallbackNot published65scoreReported resultSep 1, 2026Not published
AutomationBenchproduction safeguards with fallbackNot published31.4pass rateReported resultSep 1, 2026Not published
CursorBench 3.2.0max effort; production safeguards with fallbackNot published73.4scoreReported resultSep 1, 2026Not published
Artificial Analysis Coding Agent IndexmediumNot publishedNot published53.6average pass@1Reported result
SWE-Atlas Codebase QnAmediumNot publishedNot published72.4pass@1Reported result
SWE-Bench Pro · hard-aamediumNot publishedNot published18.4pass@1Reported result
Terminal-Bench 2.1mediumNot publishedNot published69.8pass@1Reported result
Terminal-Bench 2.0Publisher-reported resultNot publishedNot published75.1success rateReported resultApr 23, 2026
Humanity's Last Examno toolsNot publishedNot published39.8accuracyReported resultApr 23, 2026
Humanity's Last Examwith toolsNot publishedNot published52.1accuracyReported resultApr 23, 2026
BrowseCompPublisher-reported resultNot publishedNot published82.7accuracyReported resultApr 23, 2026
GDPvalPublisher-reported resultNot publishedNot published83wins or tiesReported resultApr 23, 2026
ARC-AGI-2VerifiedNot publishedNot published73.3accuracyReported resultApr 23, 2026
FrontierMath · Tier 1-3Publisher-reported resultNot publishedNot published47.6accuracyReported resultApr 23, 2026
FrontierMath · Tier 4Publisher-reported resultNot publishedNot published27.1accuracyReported resultApr 23, 2026
Price per million tokens
Input$2.00 (best)$10.00$2.50
Output$12.00 (best)$50.00$15.00
Cached input$0.20 (best)$0.25$0.25
Blended (3:1)$4.50 (best)$20.00$5.63
Long-context rateOver 200K: $4.00 / $18.00Same rateOver 272K: $5.00 / $22.50
Price sourceOfficial Google APIOfficial Anthropic APIOfficial OpenAI API
Limits
Context window1,048,576 tokens1,000,000 tokens1,050,000 tokens (best)
Max inputNot publishedNot published922,000 tokens
Max output65,536 tokens128,000 tokens (best)128,000 tokens (best)
Inputs and features
TextYesYesYes
ImagesYesYesYes
PDFsYesYesYes
AudioYesNoNo
VideoYesNoNo
ReasoningYeslow · medium · highYeslow · medium · high · xhigh · maxYeslow · medium · high · xhigh
Tool callingYesYesYes
Structured outputYesYesYes
File attachmentsYesYesYes
Temperature controlYesNoYes
Reasoning controleffortefforteffort
Availability
WeightsProprietaryProprietaryProprietary
API model IDgemini-3.1-pro-previewclaude-fable-5-1gpt-5.4
API providers4051 (best)50
ReleasedFeb 19, 2026Sep 1, 2026Mar 5, 2026
Knowledge cutoffJan 2025Jun 2026Aug 31, 2025
Publisher documentationPublisher documentationPublisher documentationPublisher documentation
Source metadata updatedFeb 19, 2026Sep 1, 2026Mar 5, 2026
Data sourcesmodels.dev · Epoch AImodels.dev · Epoch AImodels.dev · Epoch AI
Catalog checkedNov 22, 2026Nov 22, 2026Nov 22, 2026
03 — Cost

What would a month cost?

Enter your expected volume in millions of tokens. List prices only; caching and batch discounts would lower these.

  • Gemini 3.1 Pro Preview$44.00
  • Claude Fable 5.1$200.00
  • GPT-5.4$55.00
04 — Questions

Which should you choose?

Which is better: Gemini 3.1 Pro Preview, Claude Fable 5.1 or GPT-5.4?

It is close. Our weighted score puts them within 2 points (Gemini 3.1 Pro Preview 68/100, Claude Fable 5.1 65/100, GPT-5.4 65/100), so choose by what matters most for your work: Claude Fable 5.1 for raw capability and Gemini 3.1 Pro Preview on price. The score weighs capability 50%, price 25%, inputs & features 15%, context window 10%.It is close. Our weighted score puts them within 3 points (Claude Fable 5.1 87/100, Gemini 3.1 Pro Preview 84/100, GPT-5.4 82/100), so choose by what matters most for your work: Claude Fable 5.1 for raw capability and Gemini 3.1 Pro Preview on price. The score weighs capability 67%, inputs & features 20%, context window 13%.

Which is cheaper, Gemini 3.1 Pro Preview, Claude Fable 5.1 or GPT-5.4?

Gemini 3.1 Pro Preview is cheaper at $2.00 input / $12.00 output per million tokens (official Google API price). GPT-5.4 costs $2.50 input / $15.00 output per million tokens (official OpenAI API price); Claude Fable 5.1 costs $10.00 input / $50.00 output per million tokens (official Anthropic API price). At a typical mix of three input tokens to one output token, that is $4.50 per million tokens for Gemini 3.1 Pro Preview versus $5.63 for GPT-5.4 (1.3× as much) and $20.00 for Claude Fable 5.1 (4.4× as much).

Which scores higher on benchmarks?

Claude Fable 5.1 scores higher on the Capabilities Index (ECI): Claude Fable 5.1 167.1 (#8 of 159), GPT-5.4 157.9 (#29 of 159) and Gemini 3.1 Pro Preview 156.3 (#41 of 159). Their confidence ranges do not overlap (164.4–170.1 vs 156.0–160.0), so the gap is a real one. On individual benchmarks: FrontierMath Tiers 1–3 — Claude Fable 5.1 90.2%, GPT-5.4 78.6%, Gemini 3.1 Pro Preview 59.7%; OTIS Mock AIME 2024–2025 — Claude Fable 5.1 100%, GPT-5.4 97.8%, Gemini 3.1 Pro Preview 95.6%; SimpleQA Verified — Gemini 3.1 Pro Preview 73.5%, Claude Fable 5.1 70.8%, GPT-5.4 45.1%.

Which is better for coding?

There are no published SWE-bench Verified results for Claude Fable 5.1 yet, so there is no like-for-like coding score. On overall capability, Claude Fable 5.1 leads, which tends to carry over to coding, but test on your own codebase. All three support tool calling for agent workflows.

Which has the bigger context window?

GPT-5.4 and Gemini 3.1 Pro Preview have the largest context windows (1,050,000 and 1,048,576 tokens), against 1,000,000 for Claude Fable 5.1. Maximum output per response: Gemini 3.1 Pro Preview up to 65,536, Claude Fable 5.1 up to 128,000, GPT-5.4 up to 128,000 tokens.

Which can read images, PDFs, audio or video?

Gemini 3.1 Pro Preview accepts text, images, PDFs, audio and video; Claude Fable 5.1 accepts text, images and PDFs; GPT-5.4 accepts text, images and PDFs. Gemini 3.1 Pro Preview handles the widest range of inputs.

Are any of these open source?

No. Gemini 3.1 Pro Preview, Claude Fable 5.1 and GPT-5.4 are proprietary and only available through APIs and apps.

Which is newer?

Claude Fable 5.1 is the newest, released Sep 1, 2026. GPT-5.4 came out Mar 5, 2026; Gemini 3.1 Pro Preview came out Feb 19, 2026. Knowledge cutoff: Gemini 3.1 Pro Preview Jan 2025, Claude Fable 5.1 Jun 2026, GPT-5.4 Aug 31, 2025.

How do you decide the winner?

This rating uses capability (50%, independent benchmark results); price (25%, blended price per million tokens (3 input : 1 output), log scale); inputs & features (15%, image, PDF, audio and video input, tool calling, structured output and reasoning); context window (10%, maximum tokens per request, log scale). Dimensions missing for any model are dropped and the remaining weights rescaled, so every model is judged on the same evidence. Specs and prices come from public model listings and the labs’ own API pages; capability scores come from independent benchmark runs. Data updated Nov 22, 2026.This rating uses capability (67%, independent benchmark results); inputs & features (20%, image, PDF, audio and video input, tool calling, structured output and reasoning); context window (13%, maximum tokens per request, log scale). Dimensions missing for any model are dropped and the remaining weights rescaled, so every model is judged on the same evidence. Specs and prices come from public model listings and the labs’ own API pages; capability scores come from independent benchmark runs. Data updated Nov 22, 2026.