ZMIME
Comparison · 3 models · Updated Nov 22, 2026

Mistral Large 2407 vs Phi-4-mini vs GPT-4o

No independent capability benchmark covers every model here yet. The score uses price and context window.No independent capability benchmark covers every model here yet. The score uses context window.

  1. Mistral AI

    Mistral Large 2407

    Released Jul 24, 2024

    28/100
    • ECI126.4
    • Price$2.00 / $6.00
    • Context131K
  2. Microsoft

    Phi-4-mini

    Released Feb 26, 2025

    72/100
    • ECI—
    • Price$0.075 / $0.30
    • Context128K
  3. OpenAI

    GPT-4o

    Released May 13, 2024

    22/100
    • ECI128.1
    • Price$2.50 / $10.00
    • Context128K
  4. Mistral AI

    Mistral Large 2407

    Released Jul 24, 2024

    32/100
    • ECI126.4
    • Price$2.00 / $6.00
    • Context131K
  5. Microsoft

    Phi-4-mini

    Released Feb 26, 2025

    32/100
    • ECI—
    • Price$0.075 / $0.30
    • Context128K
  6. OpenAI

    GPT-4o

    Released May 13, 2024

    32/100
    • ECI128.1
    • Price$2.50 / $10.00
    • Context128K
01 — Verdict

Capability evidence is incomplete

There is not enough shared capability evidence to name an overall winner. The scores (Phi-4-mini 72/100, Mistral Large 2407 28/100, GPT-4o 22/100) compare the available specifications and price. The score weighs price 71%, context window 29%. None of the shared benchmarks cover every model here yet, so capability is left out of this verdict.There is not enough shared capability evidence to name an overall winner. The scores (Mistral Large 2407 32/100, Phi-4-mini 32/100, GPT-4o 32/100) compare the available specifications only. The score weighs context window 100%. None of the shared benchmarks cover every model here yet, so capability is left out of this verdict.

  • CapabilityNot enough dataNo independent benchmark covers every model here yet
  • Lowest pricePhi-4-miniPhi-4-mini $0.131 · Mistral Large 2407 $3.00 · GPT-4o $4.38 per 1M tokens (3:1 blend)
  • Longest contextMistral Large 2407Mistral Large 2407 131,072 · Phi-4-mini 128,000 · GPT-4o 128,000 tokens
  • Widest inputsGPT-4oMistral Large 2407: Text, PDFs · Phi-4-mini: Text · GPT-4o: Text, Images, PDFs
  • Self-hostingMistral Large 2407 and Phi-4-miniPublishes downloadable weights
How the score is built
MeasureWeightMistral Large 2407Phi-4-miniGPT-4o
Price71%268819
Context window29%323232
Specs & price only100%28/10072/10022/100

Left out because at least one model lacks the data: capability and inputs & features. The remaining weights were rescaled.

How the score is built
MeasureWeightMistral Large 2407Phi-4-miniGPT-4o
Context window100%323232
Specs only100%32/10032/10032/100

Left out because at least one model lacks the data: capability and inputs & features. The remaining weights were rescaled.

02 — Side by side

Every spec in one table

Highlighted cells lead their row. Unavailable specifications are marked “Not published”. Publisher results include their evaluation settings and source.

Mistral Large 2407 vs Phi-4-mini vs GPT-4o specifications side by side
SpecificationMistral Large 2407Mistral AIPhi-4-miniMicrosoftGPT-4oOpenAI
Capability
Capabilities Index (ECI)126.4Not published128.1 (best)
ECI rank#144 of 159Not published#140 of 159 (best)
ECI confidence interval123.1–129.4Not published125.4–130.7
ECI evaluation dateJul 24, 2024Not publishedMay 13, 2024
Documented capabilitiesFlagship Mistral model for advanced reasoning, coding, and multilingual workCompact Microsoft instruction model tuned for efficient coding assistance, reasoning, and low-latency agent tasksOmni-era GPT for multimodal chat, practical coding, and general assistants
Model parametersNot publishedNot publishedNot published
Output modalitiesTextTextText
GPQA DiamondGraduate-level science questions49.0% (best)Not published48.9%
OTIS Mock AIME 2024–2025Competition mathematics8.5% (best)Not published6.3%
Publisher-reported benchmarks
MMLUPublisher-reported resultNot published67.3accuracyReported resultNot published
Aider PolyglotPublisher-reported resultNot publishedNot published23.1percent correctReported resultDec 30, 2024
Price per million tokens
Input$2.00$0.075 (best)$2.50
Output$6.00$0.30 (best)$10.00
Cached inputNot publishedNot published$1.25
Blended (3:1)$3.00$0.131 (best)$4.38
Long-context rateSame rateSame rateSame rate
Price sourceMedian of 5 providersOfficial Azure APIOfficial OpenAI API
Limits
Context window131,072 tokens (best)128,000 tokens128,000 tokens
Max inputNot publishedNot publishedNot published
Max output104,857 tokens (best)4,096 tokens16,384 tokens
Inputs and features
TextYesYesYes
ImagesNoNoYes
PDFsYesNoYes
AudioNoNoNo
VideoNoNoNo
ReasoningNoNoNo
Tool callingYesYesYes
Structured outputNot publishedNot publishedYes
File attachmentsYesNoYes
Temperature controlYesYesYes
Reasoning controlNot publishedNot publishedNot published
Availability
WeightsOpenOpenProprietary
API model IDNot publishedphi-4-minigpt-4o
API providers5227 (best)
ReleasedJul 24, 2024Feb 26, 2025May 13, 2024
Knowledge cutoffMar 31, 2024Jun 2024Sep 2023
Publisher documentationModel weightsPublisher documentation · Model weightsPublisher documentation
Source metadata updatedJul 24, 2024Feb 26, 2025Aug 6, 2024
Data sourcesmodels.dev · Epoch AImodels.dev · Epoch AImodels.dev · Epoch AI
Catalog checkedNov 22, 2026Nov 22, 2026Nov 22, 2026
03 — Cost

What would a month cost?

Enter your expected volume in millions of tokens. List prices only; caching and batch discounts would lower these.

  • Mistral Large 2407$32.00
  • Phi-4-mini$1.35
  • GPT-4o$45.00
04 — Questions

Which should you choose?

Which is better: Mistral Large 2407, Phi-4-mini or GPT-4o?

There is not enough shared capability evidence to name an overall winner. The scores (Phi-4-mini 72/100, Mistral Large 2407 28/100, GPT-4o 22/100) compare the available specifications and price. The score weighs price 71%, context window 29%. None of the shared benchmarks cover every model here yet, so capability is left out of this verdict.There is not enough shared capability evidence to name an overall winner. The scores (Mistral Large 2407 32/100, Phi-4-mini 32/100, GPT-4o 32/100) compare the available specifications only. The score weighs context window 100%. None of the shared benchmarks cover every model here yet, so capability is left out of this verdict.

Which is cheaper, Mistral Large 2407, Phi-4-mini or GPT-4o?

Phi-4-mini is cheaper at $0.075 input / $0.30 output per million tokens (official Azure API price). Mistral Large 2407 costs $2.00 input / $6.00 output per million tokens (median across 5 API providers); GPT-4o costs $2.50 input / $10.00 output per million tokens (official OpenAI API price). At a typical mix of three input tokens to one output token, that is $0.131 per million tokens for Phi-4-mini versus $3.00 for Mistral Large 2407 (23× as much) and $4.38 for GPT-4o (33× as much).

Which scores higher on benchmarks?

There is no independent benchmark that covers all three models yet. Mistral Large 2407 has an ECI of 126.4, Phi-4-mini has not been scored yet and GPT-4o has an ECI of 128.1.

Which is better for coding?

There are no published SWE-bench Verified results for Mistral Large 2407, Phi-4-mini and GPT-4o yet, so there is no like-for-like coding score. Test both on a sample of your own tasks. All three support tool calling for agent workflows.

Which has the bigger context window?

Mistral Large 2407 has the largest context window at 131,072 tokens, against 128,000 for Phi-4-mini and 128,000 for GPT-4o. Maximum output per response: Mistral Large 2407 up to 104,857, Phi-4-mini up to 4,096, GPT-4o up to 16,384 tokens.

Which can read images, PDFs, audio or video?

Mistral Large 2407 accepts text and PDFs; Phi-4-mini accepts text; GPT-4o accepts text, images and PDFs. GPT-4o handles the widest range of inputs.

Are any of these open source?

Mistral Large 2407 and Phi-4-mini publishes its weights and can be self-hosted; GPT-4o is proprietary.

Which is newer?

Phi-4-mini is the newest, released Feb 26, 2025. Mistral Large 2407 came out Jul 24, 2024; GPT-4o came out May 13, 2024. Knowledge cutoff: Mistral Large 2407 Mar 31, 2024, Phi-4-mini Jun 2024, GPT-4o Sep 2023.

How do you decide the winner?

This rating uses price (71%, blended price per million tokens (3 input : 1 output), log scale); context window (29%, maximum tokens per request, log scale). Dimensions missing for any model are dropped and the remaining weights rescaled, so every model is judged on the same evidence. Specs and prices come from public model listings and the labs’ own API pages; capability scores come from independent benchmark runs. Data updated Nov 22, 2026.This rating uses context window (100%, maximum tokens per request, log scale). Dimensions missing for any model are dropped and the remaining weights rescaled, so every model is judged on the same evidence. Specs and prices come from public model listings and the labs’ own API pages; capability scores come from independent benchmark runs. Data updated Nov 22, 2026.