GPT-4o vs Mistral Large 2407 vs Phi-4-mini
No independent capability benchmark covers every model here yet. The score uses price and context window.No independent capability benchmark covers every model here yet. The score uses context window.
OpenAI
GPT-4o
22/100- ECI128.1
- Price$2.50 / $10.00
- Context128K
Mistral AI
Mistral Large 2407
28/100- ECI126.4
- Price$2.00 / $6.00
- Context131K
Microsoft
Phi-4-mini
72/100- ECI—
- Price$0.075 / $0.30
- Context128K
OpenAI
GPT-4o
32/100- ECI128.1
- Price$2.50 / $10.00
- Context128K
Mistral AI
Mistral Large 2407
32/100- ECI126.4
- Price$2.00 / $6.00
- Context131K
Microsoft
Phi-4-mini
32/100- ECI—
- Price$0.075 / $0.30
- Context128K
Capability evidence is incomplete
There is not enough shared capability evidence to name an overall winner. The scores (Phi-4-mini 72/100, Mistral Large 2407 28/100, GPT-4o 22/100) compare the available specifications and price. The score weighs price 71%, context window 29%. None of the shared benchmarks cover every model here yet, so capability is left out of this verdict.There is not enough shared capability evidence to name an overall winner. The scores (Mistral Large 2407 32/100, GPT-4o 32/100, Phi-4-mini 32/100) compare the available specifications only. The score weighs context window 100%. None of the shared benchmarks cover every model here yet, so capability is left out of this verdict.
- CapabilityNot enough dataNo independent benchmark covers every model here yet
- Lowest pricePhi-4-miniPhi-4-mini $0.131 · Mistral Large 2407 $3.00 · GPT-4o $4.38 per 1M tokens (3:1 blend)
- Longest contextMistral Large 2407Mistral Large 2407 131,072 · GPT-4o 128,000 · Phi-4-mini 128,000 tokens
- Widest inputsGPT-4oGPT-4o: Text, Images, PDFs · Mistral Large 2407: Text, PDFs · Phi-4-mini: Text
- Self-hostingMistral Large 2407 and Phi-4-miniPublishes downloadable weights
| Measure | Weight | GPT-4o | Mistral Large 2407 | Phi-4-mini |
|---|---|---|---|---|
| Price | 71% | 19 | 26 | 88 |
| Context window | 29% | 32 | 32 | 32 |
| Specs & price only | 100% | 22/100 | 28/100 | 72/100 |
Left out because at least one model lacks the data: capability and inputs & features. The remaining weights were rescaled.
| Measure | Weight | GPT-4o | Mistral Large 2407 | Phi-4-mini |
|---|---|---|---|---|
| Context window | 100% | 32 | 32 | 32 |
| Specs only | 100% | 32/100 | 32/100 | 32/100 |
Left out because at least one model lacks the data: capability and inputs & features. The remaining weights were rescaled.
Every spec in one table
Highlighted cells lead their row. Unavailable specifications are marked “Not published”. Publisher results include their evaluation settings and source.
| Specification | |||
|---|---|---|---|
| Capability | |||
| Capabilities Index (ECI) | 128.1 (best) | 126.4 | Not published |
| ECI rank | #140 of 159 (best) | #144 of 159 | Not published |
| ECI confidence interval | 125.4–130.7 | 123.1–129.4 | Not published |
| ECI evaluation date | May 13, 2024 | Jul 24, 2024 | Not published |
| Documented capabilities | Omni-era GPT for multimodal chat, practical coding, and general assistants | Flagship Mistral model for advanced reasoning, coding, and multilingual work | Compact Microsoft instruction model tuned for efficient coding assistance, reasoning, and low-latency agent tasks |
| Model parameters | Not published | Not published | Not published |
| Output modalities | Text | Text | Text |
| GPQA DiamondGraduate-level science questions | 48.9% | 49.0% (best) | Not published |
| OTIS Mock AIME 2024–2025Competition mathematics | 6.3% | 8.5% (best) | Not published |
| Publisher-reported benchmarks | |||
| Aider PolyglotPublisher-reported result | 23.1percent correctReported resultDec 30, 2024 | Not published | Not published |
| MMLUPublisher-reported result | Not published | Not published | 67.3accuracyReported result |
| Price per million tokens | |||
| Input | $2.50 | $2.00 | $0.075 (best) |
| Output | $10.00 | $6.00 | $0.30 (best) |
| Cached input | $1.25 | Not published | Not published |
| Blended (3:1) | $4.38 | $3.00 | $0.131 (best) |
| Long-context rate | Same rate | Same rate | Same rate |
| Price source | Official OpenAI API | Median of 5 providers | Official Azure API |
| Limits | |||
| Context window | 128,000 tokens | 131,072 tokens (best) | 128,000 tokens |
| Max input | Not published | Not published | Not published |
| Max output | 16,384 tokens | 104,857 tokens (best) | 4,096 tokens |
| Inputs and features | |||
| Text | Yes | Yes | Yes |
| Images | Yes | No | No |
| PDFs | Yes | Yes | No |
| Audio | No | No | No |
| Video | No | No | No |
| Reasoning | No | No | No |
| Tool calling | Yes | Yes | Yes |
| Structured output | Yes | Not published | Not published |
| File attachments | Yes | Yes | No |
| Temperature control | Yes | Yes | Yes |
| Reasoning control | Not published | Not published | Not published |
| Availability | |||
| Weights | Proprietary | Open | Open |
| API model ID | gpt-4o | Not published | phi-4-mini |
| API providers | 27 (best) | 5 | 2 |
| Released | May 13, 2024 | Jul 24, 2024 | Feb 26, 2025 |
| Knowledge cutoff | Sep 2023 | Mar 31, 2024 | Jun 2024 |
| Publisher documentation | Publisher documentation | Model weights | Publisher documentation · Model weights |
| Source metadata updated | Aug 6, 2024 | Jul 24, 2024 | Feb 26, 2025 |
| Data sources | models.dev · Epoch AI | models.dev · Epoch AI | models.dev · Epoch AI |
| Catalog checked | Nov 22, 2026 | Nov 22, 2026 | Nov 22, 2026 |
What would a month cost?
Enter your expected volume in millions of tokens. List prices only; caching and batch discounts would lower these.
GPT-4o$45.00
Mistral Large 2407$32.00
Phi-4-mini$1.35
Which should you choose?
Which is better: GPT-4o, Mistral Large 2407 or Phi-4-mini?
There is not enough shared capability evidence to name an overall winner. The scores (Phi-4-mini 72/100, Mistral Large 2407 28/100, GPT-4o 22/100) compare the available specifications and price. The score weighs price 71%, context window 29%. None of the shared benchmarks cover every model here yet, so capability is left out of this verdict.There is not enough shared capability evidence to name an overall winner. The scores (Mistral Large 2407 32/100, GPT-4o 32/100, Phi-4-mini 32/100) compare the available specifications only. The score weighs context window 100%. None of the shared benchmarks cover every model here yet, so capability is left out of this verdict.
Which is cheaper, GPT-4o, Mistral Large 2407 or Phi-4-mini?
Phi-4-mini is cheaper at $0.075 input / $0.30 output per million tokens (official Azure API price). Mistral Large 2407 costs $2.00 input / $6.00 output per million tokens (median across 5 API providers); GPT-4o costs $2.50 input / $10.00 output per million tokens (official OpenAI API price). At a typical mix of three input tokens to one output token, that is $0.131 per million tokens for Phi-4-mini versus $3.00 for Mistral Large 2407 (23× as much) and $4.38 for GPT-4o (33× as much).
Which scores higher on benchmarks?
There is no independent benchmark that covers all three models yet. GPT-4o has an ECI of 128.1, Mistral Large 2407 has an ECI of 126.4 and Phi-4-mini has not been scored yet.
Which is better for coding?
There are no published SWE-bench Verified results for GPT-4o, Mistral Large 2407 and Phi-4-mini yet, so there is no like-for-like coding score. Test both on a sample of your own tasks. All three support tool calling for agent workflows.
Which has the bigger context window?
Mistral Large 2407 has the largest context window at 131,072 tokens, against 128,000 for GPT-4o and 128,000 for Phi-4-mini. Maximum output per response: GPT-4o up to 16,384, Mistral Large 2407 up to 104,857, Phi-4-mini up to 4,096 tokens.
Which can read images, PDFs, audio or video?
GPT-4o accepts text, images and PDFs; Mistral Large 2407 accepts text and PDFs; Phi-4-mini accepts text. GPT-4o handles the widest range of inputs.
Are any of these open source?
Mistral Large 2407 and Phi-4-mini publishes its weights and can be self-hosted; GPT-4o is proprietary.
Which is newer?
Phi-4-mini is the newest, released Feb 26, 2025. Mistral Large 2407 came out Jul 24, 2024; GPT-4o came out May 13, 2024. Knowledge cutoff: GPT-4o Sep 2023, Mistral Large 2407 Mar 31, 2024, Phi-4-mini Jun 2024.
How do you decide the winner?
This rating uses price (71%, blended price per million tokens (3 input : 1 output), log scale); context window (29%, maximum tokens per request, log scale). Dimensions missing for any model are dropped and the remaining weights rescaled, so every model is judged on the same evidence. Specs and prices come from public model listings and the labs’ own API pages; capability scores come from independent benchmark runs. Data updated Nov 22, 2026.This rating uses context window (100%, maximum tokens per request, log scale). Dimensions missing for any model are dropped and the remaining weights rescaled, so every model is judged on the same evidence. Specs and prices come from public model listings and the labs’ own API pages; capability scores come from independent benchmark runs. Data updated Nov 22, 2026.