Mistral Large 2407 vs Phi-4-mini vs GPT-4o
No independent capability benchmark covers every model here yet. The score uses price and context window.No independent capability benchmark covers every model here yet. The score uses context window.
Mistral AI
Mistral Large 2407
28/100- ECI126.4
- Price$2.00 / $6.00
- Context131K
Microsoft
Phi-4-mini
72/100- ECI—
- Price$0.075 / $0.30
- Context128K
OpenAI
GPT-4o
22/100- ECI128.1
- Price$2.50 / $10.00
- Context128K
Mistral AI
Mistral Large 2407
32/100- ECI126.4
- Price$2.00 / $6.00
- Context131K
Microsoft
Phi-4-mini
32/100- ECI—
- Price$0.075 / $0.30
- Context128K
OpenAI
GPT-4o
32/100- ECI128.1
- Price$2.50 / $10.00
- Context128K
Capability evidence is incomplete
There is not enough shared capability evidence to name an overall winner. The scores (Phi-4-mini 72/100, Mistral Large 2407 28/100, GPT-4o 22/100) compare the available specifications and price. The score weighs price 71%, context window 29%. None of the shared benchmarks cover every model here yet, so capability is left out of this verdict.There is not enough shared capability evidence to name an overall winner. The scores (Mistral Large 2407 32/100, Phi-4-mini 32/100, GPT-4o 32/100) compare the available specifications only. The score weighs context window 100%. None of the shared benchmarks cover every model here yet, so capability is left out of this verdict.
- CapabilityNot enough dataNo independent benchmark covers every model here yet
- Lowest pricePhi-4-miniPhi-4-mini $0.131 · Mistral Large 2407 $3.00 · GPT-4o $4.38 per 1M tokens (3:1 blend)
- Longest contextMistral Large 2407Mistral Large 2407 131,072 · Phi-4-mini 128,000 · GPT-4o 128,000 tokens
- Widest inputsGPT-4oMistral Large 2407: Text, PDFs · Phi-4-mini: Text · GPT-4o: Text, Images, PDFs
- Self-hostingMistral Large 2407 and Phi-4-miniPublishes downloadable weights
| Measure | Weight | Mistral Large 2407 | Phi-4-mini | GPT-4o |
|---|---|---|---|---|
| Price | 71% | 26 | 88 | 19 |
| Context window | 29% | 32 | 32 | 32 |
| Specs & price only | 100% | 28/100 | 72/100 | 22/100 |
Left out because at least one model lacks the data: capability and inputs & features. The remaining weights were rescaled.
| Measure | Weight | Mistral Large 2407 | Phi-4-mini | GPT-4o |
|---|---|---|---|---|
| Context window | 100% | 32 | 32 | 32 |
| Specs only | 100% | 32/100 | 32/100 | 32/100 |
Left out because at least one model lacks the data: capability and inputs & features. The remaining weights were rescaled.
Every spec in one table
Highlighted cells lead their row. Unavailable specifications are marked “Not published”. Publisher results include their evaluation settings and source.
| Specification | |||
|---|---|---|---|
| Capability | |||
| Capabilities Index (ECI) | 126.4 | Not published | 128.1 (best) |
| ECI rank | #144 of 159 | Not published | #140 of 159 (best) |
| ECI confidence interval | 123.1–129.4 | Not published | 125.4–130.7 |
| ECI evaluation date | Jul 24, 2024 | Not published | May 13, 2024 |
| Documented capabilities | Flagship Mistral model for advanced reasoning, coding, and multilingual work | Compact Microsoft instruction model tuned for efficient coding assistance, reasoning, and low-latency agent tasks | Omni-era GPT for multimodal chat, practical coding, and general assistants |
| Model parameters | Not published | Not published | Not published |
| Output modalities | Text | Text | Text |
| GPQA DiamondGraduate-level science questions | 49.0% (best) | Not published | 48.9% |
| OTIS Mock AIME 2024–2025Competition mathematics | 8.5% (best) | Not published | 6.3% |
| Publisher-reported benchmarks | |||
| MMLUPublisher-reported result | Not published | 67.3accuracyReported result | Not published |
| Aider PolyglotPublisher-reported result | Not published | Not published | 23.1percent correctReported resultDec 30, 2024 |
| Price per million tokens | |||
| Input | $2.00 | $0.075 (best) | $2.50 |
| Output | $6.00 | $0.30 (best) | $10.00 |
| Cached input | Not published | Not published | $1.25 |
| Blended (3:1) | $3.00 | $0.131 (best) | $4.38 |
| Long-context rate | Same rate | Same rate | Same rate |
| Price source | Median of 5 providers | Official Azure API | Official OpenAI API |
| Limits | |||
| Context window | 131,072 tokens (best) | 128,000 tokens | 128,000 tokens |
| Max input | Not published | Not published | Not published |
| Max output | 104,857 tokens (best) | 4,096 tokens | 16,384 tokens |
| Inputs and features | |||
| Text | Yes | Yes | Yes |
| Images | No | No | Yes |
| PDFs | Yes | No | Yes |
| Audio | No | No | No |
| Video | No | No | No |
| Reasoning | No | No | No |
| Tool calling | Yes | Yes | Yes |
| Structured output | Not published | Not published | Yes |
| File attachments | Yes | No | Yes |
| Temperature control | Yes | Yes | Yes |
| Reasoning control | Not published | Not published | Not published |
| Availability | |||
| Weights | Open | Open | Proprietary |
| API model ID | Not published | phi-4-mini | gpt-4o |
| API providers | 5 | 2 | 27 (best) |
| Released | Jul 24, 2024 | Feb 26, 2025 | May 13, 2024 |
| Knowledge cutoff | Mar 31, 2024 | Jun 2024 | Sep 2023 |
| Publisher documentation | Model weights | Publisher documentation · Model weights | Publisher documentation |
| Source metadata updated | Jul 24, 2024 | Feb 26, 2025 | Aug 6, 2024 |
| Data sources | models.dev · Epoch AI | models.dev · Epoch AI | models.dev · Epoch AI |
| Catalog checked | Nov 22, 2026 | Nov 22, 2026 | Nov 22, 2026 |
What would a month cost?
Enter your expected volume in millions of tokens. List prices only; caching and batch discounts would lower these.
Mistral Large 2407$32.00
Phi-4-mini$1.35
GPT-4o$45.00
Which should you choose?
Which is better: Mistral Large 2407, Phi-4-mini or GPT-4o?
There is not enough shared capability evidence to name an overall winner. The scores (Phi-4-mini 72/100, Mistral Large 2407 28/100, GPT-4o 22/100) compare the available specifications and price. The score weighs price 71%, context window 29%. None of the shared benchmarks cover every model here yet, so capability is left out of this verdict.There is not enough shared capability evidence to name an overall winner. The scores (Mistral Large 2407 32/100, Phi-4-mini 32/100, GPT-4o 32/100) compare the available specifications only. The score weighs context window 100%. None of the shared benchmarks cover every model here yet, so capability is left out of this verdict.
Which is cheaper, Mistral Large 2407, Phi-4-mini or GPT-4o?
Phi-4-mini is cheaper at $0.075 input / $0.30 output per million tokens (official Azure API price). Mistral Large 2407 costs $2.00 input / $6.00 output per million tokens (median across 5 API providers); GPT-4o costs $2.50 input / $10.00 output per million tokens (official OpenAI API price). At a typical mix of three input tokens to one output token, that is $0.131 per million tokens for Phi-4-mini versus $3.00 for Mistral Large 2407 (23× as much) and $4.38 for GPT-4o (33× as much).
Which scores higher on benchmarks?
There is no independent benchmark that covers all three models yet. Mistral Large 2407 has an ECI of 126.4, Phi-4-mini has not been scored yet and GPT-4o has an ECI of 128.1.
Which is better for coding?
There are no published SWE-bench Verified results for Mistral Large 2407, Phi-4-mini and GPT-4o yet, so there is no like-for-like coding score. Test both on a sample of your own tasks. All three support tool calling for agent workflows.
Which has the bigger context window?
Mistral Large 2407 has the largest context window at 131,072 tokens, against 128,000 for Phi-4-mini and 128,000 for GPT-4o. Maximum output per response: Mistral Large 2407 up to 104,857, Phi-4-mini up to 4,096, GPT-4o up to 16,384 tokens.
Which can read images, PDFs, audio or video?
Mistral Large 2407 accepts text and PDFs; Phi-4-mini accepts text; GPT-4o accepts text, images and PDFs. GPT-4o handles the widest range of inputs.
Are any of these open source?
Mistral Large 2407 and Phi-4-mini publishes its weights and can be self-hosted; GPT-4o is proprietary.
Which is newer?
Phi-4-mini is the newest, released Feb 26, 2025. Mistral Large 2407 came out Jul 24, 2024; GPT-4o came out May 13, 2024. Knowledge cutoff: Mistral Large 2407 Mar 31, 2024, Phi-4-mini Jun 2024, GPT-4o Sep 2023.
How do you decide the winner?
This rating uses price (71%, blended price per million tokens (3 input : 1 output), log scale); context window (29%, maximum tokens per request, log scale). Dimensions missing for any model are dropped and the remaining weights rescaled, so every model is judged on the same evidence. Specs and prices come from public model listings and the labs’ own API pages; capability scores come from independent benchmark runs. Data updated Nov 22, 2026.This rating uses context window (100%, maximum tokens per request, log scale). Dimensions missing for any model are dropped and the remaining weights rescaled, so every model is judged on the same evidence. Specs and prices come from public model listings and the labs’ own API pages; capability scores come from independent benchmark runs. Data updated Nov 22, 2026.