ZMIME
Comparison · 3 models · Updated Nov 22, 2026

GPT-5.4 vs Claude Fable 5.1 vs Gemini 3.1 Pro Preview

Too close to call on our weighted score (Gemini 3.1 Pro Preview 68, Claude Fable 5.1 65, GPT-5.4 65). The right pick depends on what you value most.Too close to call on our weighted score (Claude Fable 5.1 87, Gemini 3.1 Pro Preview 84, GPT-5.4 82). The right pick depends on what you value most.

  1. OpenAI

    GPT-5.4

    Released Mar 5, 2026

    65/100
    • ECI157.9
    • Price$2.50 / $15.00
    • Context1.05M
  2. Anthropic

    Claude Fable 5.1

    Released Sep 1, 2026

    65/100
    • ECI167.1
    • Price$10.00 / $50.00
    • Context1M
  3. Google

    Gemini 3.1 Pro Preview

    Released Feb 19, 2026Latest

    68/100
    • ECI156.3
    • Price$2.00 / $12.00
    • Context1.05M
  4. OpenAI

    GPT-5.4

    Released Mar 5, 2026

    82/100
    • ECI157.9
    • Price$2.50 / $15.00
    • Context1.05M
  5. Anthropic

    Claude Fable 5.1

    Released Sep 1, 2026

    87/100
    • ECI167.1
    • Price$10.00 / $50.00
    • Context1M
  6. Google

    Gemini 3.1 Pro Preview

    Released Feb 19, 2026Latest

    84/100
    • ECI156.3
    • Price$2.00 / $12.00
    • Context1.05M
01 — Verdict

Too close to call

It is close. Our weighted score puts them within 2 points (Gemini 3.1 Pro Preview 68/100, Claude Fable 5.1 65/100, GPT-5.4 65/100), so choose by what matters most for your work: Claude Fable 5.1 for raw capability and Gemini 3.1 Pro Preview on price. The score weighs capability 50%, price 25%, inputs & features 15%, context window 10%.It is close. Our weighted score puts them within 3 points (Claude Fable 5.1 87/100, Gemini 3.1 Pro Preview 84/100, GPT-5.4 82/100), so choose by what matters most for your work: Claude Fable 5.1 for raw capability and Gemini 3.1 Pro Preview on price. The score weighs capability 67%, inputs & features 20%, context window 13%.

  • CapabilityClaude Fable 5.1Capabilities Index (ECI): Claude Fable 5.1 167.1 · GPT-5.4 157.9 · Gemini 3.1 Pro Preview 156.3
  • Lowest priceGemini 3.1 Pro PreviewGemini 3.1 Pro Preview $4.50 · GPT-5.4 $5.63 · Claude Fable 5.1 $20.00 per 1M tokens (3:1 blend)
  • Longest contextGPT-5.4 and Gemini 3.1 Pro PreviewGPT-5.4 1,050,000 · Gemini 3.1 Pro Preview 1,048,576 · Claude Fable 5.1 1,000,000 tokens
  • Widest inputsGemini 3.1 Pro PreviewGPT-5.4: Text, Images, PDFs · Claude Fable 5.1: Text, Images, PDFs · Gemini 3.1 Pro Preview: Text, Images, PDFs, Audio, Video
  • Self-hostingNo confirmed open weightsAll three are available only through APIs
How the score is built
MeasureWeightGPT-5.4Claude Fable 5.1Gemini 3.1 Pro Preview
CapabilityCapabilities Index (ECI)50%859484
Price25%14018
Inputs & features15%8080100
Context window10%656465
Overall100%65/10065/10068/100
How the score is built
MeasureWeightGPT-5.4Claude Fable 5.1Gemini 3.1 Pro Preview
CapabilityCapabilities Index (ECI)67%859484
Inputs & features20%8080100
Context window13%656465
Overall100%82/10087/10084/100
02 — Side by side

Every spec in one table

Highlighted cells lead their row. Unavailable specifications are marked “Not published”. Publisher results include their evaluation settings and source.

GPT-5.4 vs Claude Fable 5.1 vs Gemini 3.1 Pro Preview specifications side by side
SpecificationGPT-5.4OpenAIClaude Fable 5.1AnthropicGemini 3.1 Pro PreviewGoogle
Capability
Capabilities Index (ECI)157.9167.1 (best)156.3
ECI rank#29 of 159#8 of 159 (best)#41 of 159
ECI confidence interval156.0–160.0164.4–170.1154.5–158.2
ECI evaluation dateMar 5, 2026Sep 1, 2026Feb 19, 2026
Documented capabilitiesAgent-ready GPT for coding and computer-use workflows at a lower costClaude model for demanding reasoning and long-horizon agentic workReasoning-first Gemini preview for agentic coding and complex problem solving
Model parametersNot publishedNot publishedNot published
Output modalitiesTextTextText
GPQA DiamondGraduate-level science questions93.3%xhighNot published94.4%high (best)
FrontierMath Tiers 1–3Research-level mathematics78.6%xhigh90.2%max (best)59.7%
OTIS Mock AIME 2024–2025Competition mathematics97.8%high100%max (best)95.6%
SWE-bench VerifiedFixing real GitHub issues76.9%high (best)Not published75.6%
SimpleQA VerifiedShort factual questions45.1%xhigh70.8%max73.5%high (best)
Publisher-reported benchmarks
SWE-Bench Pro · publicPublisher-reported result59.1resolve rateReported resultNot published46.1resolve rateReported result
SWE-Atlas Codebase QnAPublisher-reported result40.8scoreReported resultNot published13.5scoreReported result
SWE-Atlas RefactoringPublisher-reported result44.29scoreReported resultNot published33.81scoreReported result
SWE-Atlas Test WritingPublisher-reported result44.36scoreReported resultNot published29.84scoreReported result
Artificial Analysis Coding Agent Indexmedium53.6average pass@1Reported resultNot publishedNot published
SWE-Atlas Codebase QnAmedium72.4pass@1Reported resultNot publishedNot published
SWE-Bench Pro · hard-aamedium18.4pass@1Reported resultNot publishedNot published
Terminal-Bench 2.1medium69.8pass@1Reported resultNot publishedNot published
Terminal-Bench 2.0Publisher-reported result75.1success rateReported resultApr 23, 2026Not publishedNot published
GPQA DiamondPublisher-reported result92.8accuracyReported resultApr 23, 2026Not published94.3accuracyReported resultApr 23, 2026
Humanity's Last Examno tools39.8accuracyReported resultApr 23, 2026Not publishedNot published
Humanity's Last Examwith tools52.1accuracyReported resultApr 23, 2026Not publishedNot published
OSWorld-VerifiedPublisher-reported result75success rateReported resultApr 23, 2026Not published76.2success rateReported resultMay 19, 2026
BrowseCompPublisher-reported result82.7accuracyReported resultApr 23, 2026Not publishedNot published
GDPvalPublisher-reported result83wins or tiesReported resultApr 23, 2026Not publishedNot published
ARC-AGI-2Verified73.3accuracyReported resultApr 23, 2026Not publishedNot published
FrontierMath · Tier 1-3Publisher-reported result47.6accuracyReported resultApr 23, 2026Not publishedNot published
FrontierMath · Tier 4Publisher-reported result27.1accuracyReported resultApr 23, 2026Not publishedNot published
MMMU Prono tools81.2accuracyReported resultApr 23, 2026Not published80.5accuracyReported resultMay 19, 2026
Terminal-Bench-Science 0.1production safeguards with fallbackNot published52.6scoreReported resultSep 1, 2026Not published
Terminal-Bench 4.0production safeguards with fallbackNot published55.8scoreReported resultSep 1, 2026Not published
GDPval-AA 2production safeguards with fallbackNot published1853EloReported resultSep 1, 2026Not published
OSWorld 2.0 · August 2026 task releaseproduction safeguards; interventions score zero; no fallbackNot published77.9partial scoreReported resultSep 1, 2026Not published
OSWorld 2.0 · August 2026 task releaseproduction safeguards; interventions score zero; no fallbackNot published41.7strict success rateReported resultSep 1, 2026Not published
Humanity's Last Examwithout tools; production safeguards with fallbackNot published60.9scoreReported resultSep 1, 2026Not published
Humanity's Last Examwith tools; production safeguards with fallbackNot published65scoreReported resultSep 1, 2026Not published
AutomationBenchproduction safeguards with fallbackNot published31.4pass rateReported resultSep 1, 2026Not published
CursorBench 3.2.0max effort; production safeguards with fallbackNot published73.4scoreReported resultSep 1, 2026Not published
SWE-Bench ProPublisher-reported resultNot publishedNot published54.2resolve rateReported resultMay 28, 2026
Terminal-Bench 2.1Publisher-reported resultNot publishedNot published70.3success rateReported resultMay 28, 2026
Artificial Analysis Coding Agent IndexhighNot publishedNot published43average pass@1Reported result
SWE-Atlas Codebase QnAhighNot publishedNot published45.6pass@1Reported result
SWE-Bench Pro · hard-aahighNot publishedNot published15.1pass@1Reported result
Terminal-Bench 2.1highNot publishedNot published68.3pass@1Reported result
Humanity's Last Exam · full set, text + MMPublisher-reported resultNot publishedNot published44.4accuracyReported resultMay 19, 2026
ARC-AGI-2Publisher-reported resultNot publishedNot published77.1accuracyReported resultMay 19, 2026
MCP AtlasPublisher-reported resultNot publishedNot published78.2success rateReported resultMay 19, 2026
CharXiv Reasoningno toolsNot publishedNot published83.3accuracyReported resultMay 19, 2026
GDPval-AAPublisher-reported resultNot publishedNot published1314EloReported resultMay 19, 2026
Price per million tokens
Input$2.50$10.00$2.00 (best)
Output$15.00$50.00$12.00 (best)
Cached input$0.25$0.25$0.20 (best)
Blended (3:1)$5.63$20.00$4.50 (best)
Long-context rateOver 272K: $5.00 / $22.50Same rateOver 200K: $4.00 / $18.00
Price sourceOfficial OpenAI APIOfficial Anthropic APIOfficial Google API
Limits
Context window1,050,000 tokens (best)1,000,000 tokens1,048,576 tokens
Max input922,000 tokensNot publishedNot published
Max output128,000 tokens (best)128,000 tokens (best)65,536 tokens
Inputs and features
TextYesYesYes
ImagesYesYesYes
PDFsYesYesYes
AudioNoNoYes
VideoNoNoYes
ReasoningYeslow · medium · high · xhighYeslow · medium · high · xhigh · maxYeslow · medium · high
Tool callingYesYesYes
Structured outputYesYesYes
File attachmentsYesYesYes
Temperature controlYesNoYes
Reasoning controleffortefforteffort
Availability
WeightsProprietaryProprietaryProprietary
API model IDgpt-5.4claude-fable-5-1gemini-3.1-pro-preview
API providers5051 (best)40
ReleasedMar 5, 2026Sep 1, 2026Feb 19, 2026
Knowledge cutoffAug 31, 2025Jun 2026Jan 2025
Publisher documentationPublisher documentationPublisher documentationPublisher documentation
Source metadata updatedMar 5, 2026Sep 1, 2026Feb 19, 2026
Data sourcesmodels.dev · Epoch AImodels.dev · Epoch AImodels.dev · Epoch AI
Catalog checkedNov 22, 2026Nov 22, 2026Nov 22, 2026
03 — Cost

What would a month cost?

Enter your expected volume in millions of tokens. List prices only; caching and batch discounts would lower these.

  • GPT-5.4$55.00
  • Claude Fable 5.1$200.00
  • Gemini 3.1 Pro Preview$44.00
04 — Questions

Which should you choose?

Which is better: GPT-5.4, Claude Fable 5.1 or Gemini 3.1 Pro Preview?

It is close. Our weighted score puts them within 2 points (Gemini 3.1 Pro Preview 68/100, Claude Fable 5.1 65/100, GPT-5.4 65/100), so choose by what matters most for your work: Claude Fable 5.1 for raw capability and Gemini 3.1 Pro Preview on price. The score weighs capability 50%, price 25%, inputs & features 15%, context window 10%.It is close. Our weighted score puts them within 3 points (Claude Fable 5.1 87/100, Gemini 3.1 Pro Preview 84/100, GPT-5.4 82/100), so choose by what matters most for your work: Claude Fable 5.1 for raw capability and Gemini 3.1 Pro Preview on price. The score weighs capability 67%, inputs & features 20%, context window 13%.

Which is cheaper, GPT-5.4, Claude Fable 5.1 or Gemini 3.1 Pro Preview?

Gemini 3.1 Pro Preview is cheaper at $2.00 input / $12.00 output per million tokens (official Google API price). GPT-5.4 costs $2.50 input / $15.00 output per million tokens (official OpenAI API price); Claude Fable 5.1 costs $10.00 input / $50.00 output per million tokens (official Anthropic API price). At a typical mix of three input tokens to one output token, that is $4.50 per million tokens for Gemini 3.1 Pro Preview versus $5.63 for GPT-5.4 (1.3× as much) and $20.00 for Claude Fable 5.1 (4.4× as much).

Which scores higher on benchmarks?

Claude Fable 5.1 scores higher on the Capabilities Index (ECI): Claude Fable 5.1 167.1 (#8 of 159), GPT-5.4 157.9 (#29 of 159) and Gemini 3.1 Pro Preview 156.3 (#41 of 159). Their confidence ranges do not overlap (164.4–170.1 vs 156.0–160.0), so the gap is a real one. On individual benchmarks: FrontierMath Tiers 1–3 — Claude Fable 5.1 90.2%, GPT-5.4 78.6%, Gemini 3.1 Pro Preview 59.7%; OTIS Mock AIME 2024–2025 — Claude Fable 5.1 100%, GPT-5.4 97.8%, Gemini 3.1 Pro Preview 95.6%; SimpleQA Verified — Gemini 3.1 Pro Preview 73.5%, Claude Fable 5.1 70.8%, GPT-5.4 45.1%.

Which is better for coding?

There are no published SWE-bench Verified results for Claude Fable 5.1 yet, so there is no like-for-like coding score. On overall capability, Claude Fable 5.1 leads, which tends to carry over to coding, but test on your own codebase. All three support tool calling for agent workflows.

Which has the bigger context window?

GPT-5.4 and Gemini 3.1 Pro Preview have the largest context windows (1,050,000 and 1,048,576 tokens), against 1,000,000 for Claude Fable 5.1. Maximum output per response: GPT-5.4 up to 128,000, Claude Fable 5.1 up to 128,000, Gemini 3.1 Pro Preview up to 65,536 tokens.

Which can read images, PDFs, audio or video?

GPT-5.4 accepts text, images and PDFs; Claude Fable 5.1 accepts text, images and PDFs; Gemini 3.1 Pro Preview accepts text, images, PDFs, audio and video. Gemini 3.1 Pro Preview handles the widest range of inputs.

Are any of these open source?

No. GPT-5.4, Claude Fable 5.1 and Gemini 3.1 Pro Preview are proprietary and only available through APIs and apps.

Which is newer?

Claude Fable 5.1 is the newest, released Sep 1, 2026. GPT-5.4 came out Mar 5, 2026; Gemini 3.1 Pro Preview came out Feb 19, 2026. Knowledge cutoff: GPT-5.4 Aug 31, 2025, Claude Fable 5.1 Jun 2026, Gemini 3.1 Pro Preview Jan 2025.

How do you decide the winner?

This rating uses capability (50%, independent benchmark results); price (25%, blended price per million tokens (3 input : 1 output), log scale); inputs & features (15%, image, PDF, audio and video input, tool calling, structured output and reasoning); context window (10%, maximum tokens per request, log scale). Dimensions missing for any model are dropped and the remaining weights rescaled, so every model is judged on the same evidence. Specs and prices come from public model listings and the labs’ own API pages; capability scores come from independent benchmark runs. Data updated Nov 22, 2026.This rating uses capability (67%, independent benchmark results); inputs & features (20%, image, PDF, audio and video input, tool calling, structured output and reasoning); context window (13%, maximum tokens per request, log scale). Dimensions missing for any model are dropped and the remaining weights rescaled, so every model is judged on the same evidence. Specs and prices come from public model listings and the labs’ own API pages; capability scores come from independent benchmark runs. Data updated Nov 22, 2026.