ZMIME
Comparison · 3 models · Updated Nov 18, 2026

GPT-4o vs Hermes 3 70B Instruct vs Mistral Large 2407

No independent capability benchmark covers every model here yet. The score uses inputs & features and context window.

Price in rating: Excluded · Include price

  1. OpenAI

    GPT-4o

    Released May 13, 2024

    55/100
    • ECI128.1
    • Price$2.50 / $10.00
    • Context128K
  2. Nous Research

    Hermes 3 70B Instruct

    Released Aug 18, 2024

    13/100
    • ECI—
    • Price$0.70 / $0.70
    • Context131K
  3. Mistral AI

    Mistral Large 2407

    Released Jul 24, 2024

    34/100
    • ECI126.4
    • Price$2.00 / $6.00
    • Context131K
01 — Verdict

Capability evidence is incomplete

There is not enough shared capability evidence to name an overall winner. The scores (GPT-4o 55/100, Mistral Large 2407 34/100, Hermes 3 70B Instruct 13/100) compare the available specifications only. The score weighs inputs & features 60%, context window 40%. None of the shared benchmarks cover every model here yet, so capability is left out of this verdict.

  • CapabilityNot enough dataNo independent benchmark covers every model here yet
  • Lowest priceHermes 3 70B InstructHermes 3 70B Instruct $0.70 · Mistral Large 2407 $3.00 · GPT-4o $4.38 per 1M tokens (3:1 blend)
  • Longest contextHermes 3 70B Instruct and Mistral Large 2407Hermes 3 70B Instruct 131,072 · Mistral Large 2407 131,072 · GPT-4o 128,000 tokens
  • Widest inputsGPT-4oGPT-4o: Text, Images, PDFs · Hermes 3 70B Instruct: Text · Mistral Large 2407: Text, PDFs
  • Self-hostingHermes 3 70B Instruct and Mistral Large 2407Publishes downloadable weights
How the score is built
MeasureWeightGPT-4oHermes 3 70B InstructMistral Large 2407
Inputs & features60%70035
Context window40%323232
Specs only100%55/10013/10034/100

Left out because at least one model lacks the data: capability. The remaining weights were rescaled.

02 — Side by side

Every spec in one table

Highlighted cells lead their row. Dashes mean the data is not published.

GPT-4o vs Hermes 3 70B Instruct vs Mistral Large 2407 specifications side by side
SpecificationGPT-4oOpenAIHermes 3 70B InstructNous ResearchMistral Large 2407Mistral AI
Capability
Capabilities Index (ECI)128.1 (best)—126.4
ECI rank#139 of 158 (best)—#143 of 158
GPQA DiamondGraduate-level science questions48.9%—49.0% (best)
OTIS Mock AIME 2024–2025Competition mathematics6.3%—8.5% (best)
Price per million tokens
Input$2.50$0.70 (best)$2.00
Output$10.00$0.70 (best)$6.00
Cached input$1.25——
Blended (3:1)$4.38$0.70 (best)$3.00
Long-context rateSame rateSame rateSame rate
Price sourceOfficial OpenAI APIMedian of 1 providersMedian of 5 providers
Limits
Context window128,000 tokens131,072 tokens (best)131,072 tokens (best)
Max output16,384 tokens16,384 tokens104,857 tokens (best)
Inputs and features
TextYesYesYes
ImagesYesNoNo
PDFsYesNoYes
AudioNoNoNo
VideoNoNoNo
ReasoningNoNoNo
Tool callingYesNoYes
Structured outputYesNoNo
Availability
WeightsProprietaryOpenOpen
API model IDgpt-4o——
API providers27 (best)15
ReleasedMay 13, 2024Aug 18, 2024Jul 24, 2024
Knowledge cutoffSep 2023Dec 31, 2023Mar 31, 2024
03 — Cost

What would a month cost?

Enter your expected volume in millions of tokens. List prices only; caching and batch discounts would lower these.

  • GPT-4o$45.00
  • Hermes 3 70B Instruct$8.40
  • Mistral Large 2407$32.00
04 — Questions

Which should you choose?

Which is better: GPT-4o, Hermes 3 70B Instruct or Mistral Large 2407?

There is not enough shared capability evidence to name an overall winner. The scores (GPT-4o 55/100, Mistral Large 2407 34/100, Hermes 3 70B Instruct 13/100) compare the available specifications only. The score weighs inputs & features 60%, context window 40%. None of the shared benchmarks cover every model here yet, so capability is left out of this verdict.

Which is cheaper, GPT-4o, Hermes 3 70B Instruct or Mistral Large 2407?

Hermes 3 70B Instruct is cheaper at $0.70 input / $0.70 output per million tokens (median across 1 API provider). Mistral Large 2407 costs $2.00 input / $6.00 output per million tokens (median across 5 API providers); GPT-4o costs $2.50 input / $10.00 output per million tokens (official OpenAI API price). At a typical mix of three input tokens to one output token, that is $0.70 per million tokens for Hermes 3 70B Instruct versus $3.00 for Mistral Large 2407 (4.3× as much) and $4.38 for GPT-4o (6.3× as much).

Which scores higher on benchmarks?

There is no independent benchmark that covers all three models yet. GPT-4o has an ECI of 128.1, Hermes 3 70B Instruct has not been scored yet and Mistral Large 2407 has an ECI of 126.4.

Which is better for coding?

There are no published SWE-bench Verified results for GPT-4o, Hermes 3 70B Instruct and Mistral Large 2407 yet, so there is no like-for-like coding score. Test both on a sample of your own tasks. Note that Hermes 3 70B Instruct does not support tool calling, which most coding agents need.

Which has the bigger context window?

Hermes 3 70B Instruct and Mistral Large 2407 have the largest context windows (131,072 and 131,072 tokens), against 128,000 for GPT-4o. Maximum output per response: GPT-4o up to 16,384, Hermes 3 70B Instruct up to 16,384, Mistral Large 2407 up to 104,857 tokens.

Which can read images, PDFs, audio or video?

GPT-4o accepts text, images and PDFs; Hermes 3 70B Instruct accepts text; Mistral Large 2407 accepts text and PDFs. GPT-4o handles the widest range of inputs.

Are any of these open source?

Hermes 3 70B Instruct and Mistral Large 2407 publishes its weights and can be self-hosted; GPT-4o is proprietary.

Which is newer?

Hermes 3 70B Instruct is the newest, released Aug 18, 2024. Mistral Large 2407 came out Jul 24, 2024; GPT-4o came out May 13, 2024. Knowledge cutoff: GPT-4o Sep 2023, Hermes 3 70B Instruct Dec 31, 2023, Mistral Large 2407 Mar 31, 2024.

How do you decide the winner?

This rating uses inputs & features (60%, image, PDF, audio and video input, tool calling, structured output and reasoning); context window (40%, maximum tokens per request, log scale). Dimensions missing for any model are dropped and the remaining weights rescaled, so every model is judged on the same evidence. Specs and prices come from public model listings and the labs’ own API pages; capability scores come from independent benchmark runs. Data updated Nov 18, 2026.