ZMIME
Comparison · 3 models · Updated Nov 18, 2026

GPT-4o vs Hermes 2 Pro Llama 3 8B vs Mistral Large 2407

No independent capability benchmark covers every model here yet. The score uses inputs & features and context window.

Price in rating: Excluded · Include price

  1. OpenAI

    GPT-4o

    Released May 13, 2024

    55/100
    • ECI128.1
    • Price$2.50 / $10.00
    • Context128K
  2. Nous Research

    Hermes 2 Pro Llama 3 8B

    Released Apr 30, 2024

    15/100
    • ECI—
    • Price$0.14 / $0.14
    • Context8K
  3. Mistral AI

    Mistral Large 2407

    Released Jul 24, 2024

    34/100
    • ECI126.4
    • Price$2.00 / $6.00
    • Context131K
01 — Verdict

Capability evidence is incomplete

There is not enough shared capability evidence to name an overall winner. The scores (GPT-4o 55/100, Mistral Large 2407 34/100, Hermes 2 Pro Llama 3 8B 15/100) compare the available specifications only. The score weighs inputs & features 60%, context window 40%. None of the shared benchmarks cover every model here yet, so capability is left out of this verdict.

  • CapabilityNot enough dataNo independent benchmark covers every model here yet
  • Lowest priceHermes 2 Pro Llama 3 8BHermes 2 Pro Llama 3 8B $0.14 · Mistral Large 2407 $3.00 · GPT-4o $4.38 per 1M tokens (3:1 blend)
  • Longest contextMistral Large 2407Mistral Large 2407 131,072 · GPT-4o 128,000 · Hermes 2 Pro Llama 3 8B 8,192 tokens
  • Widest inputsGPT-4oGPT-4o: Text, Images, PDFs · Hermes 2 Pro Llama 3 8B: Text · Mistral Large 2407: Text, PDFs
  • Self-hostingHermes 2 Pro Llama 3 8B and Mistral Large 2407Publishes downloadable weights (Llama 3 Community License)
How the score is built
MeasureWeightGPT-4oHermes 2 Pro Llama 3 8BMistral Large 2407
Inputs & features60%702535
Context window40%32032
Specs only100%55/10015/10034/100

Left out because at least one model lacks the data: capability. The remaining weights were rescaled.

02 — Side by side

Every spec in one table

Highlighted cells lead their row. Dashes mean the data is not published.

GPT-4o vs Hermes 2 Pro Llama 3 8B vs Mistral Large 2407 specifications side by side
SpecificationGPT-4oOpenAIHermes 2 Pro Llama 3 8BNous ResearchMistral Large 2407Mistral AI
Capability
Capabilities Index (ECI)128.1 (best)—126.4
ECI rank#139 of 158 (best)—#143 of 158
GPQA DiamondGraduate-level science questions48.9%—49.0% (best)
OTIS Mock AIME 2024–2025Competition mathematics6.3%—8.5% (best)
Price per million tokens
Input$2.50$0.14 (best)$2.00
Output$10.00$0.14 (best)$6.00
Cached input$1.25——
Blended (3:1)$4.38$0.14 (best)$3.00
Long-context rateSame rateSame rateSame rate
Price sourceOfficial OpenAI APIMedian of 2 providersMedian of 5 providers
Limits
Context window128,000 tokens8,192 tokens131,072 tokens (best)
Max output16,384 tokens8,192 tokens104,857 tokens (best)
Inputs and features
TextYesYesYes
ImagesYesNoNo
PDFsYesNoYes
AudioNoNoNo
VideoNoNoNo
ReasoningNoNoNo
Tool callingYesYesYes
Structured outputYesNoNo
Availability
WeightsProprietaryOpenLlama 3 Community LicenseOpen
API model IDgpt-4o——
API providers27 (best)25
ReleasedMay 13, 2024Apr 30, 2024Jul 24, 2024
Knowledge cutoffSep 2023—Mar 31, 2024
03 — Cost

What would a month cost?

Enter your expected volume in millions of tokens. List prices only; caching and batch discounts would lower these.

  • GPT-4o$45.00
  • Hermes 2 Pro Llama 3 8B$1.68
  • Mistral Large 2407$32.00
04 — Questions

Which should you choose?

Which is better: GPT-4o, Hermes 2 Pro Llama 3 8B or Mistral Large 2407?

There is not enough shared capability evidence to name an overall winner. The scores (GPT-4o 55/100, Mistral Large 2407 34/100, Hermes 2 Pro Llama 3 8B 15/100) compare the available specifications only. The score weighs inputs & features 60%, context window 40%. None of the shared benchmarks cover every model here yet, so capability is left out of this verdict.

Which is cheaper, GPT-4o, Hermes 2 Pro Llama 3 8B or Mistral Large 2407?

Hermes 2 Pro Llama 3 8B is cheaper at $0.14 input / $0.14 output per million tokens (median across 2 API providers). Mistral Large 2407 costs $2.00 input / $6.00 output per million tokens (median across 5 API providers); GPT-4o costs $2.50 input / $10.00 output per million tokens (official OpenAI API price). At a typical mix of three input tokens to one output token, that is $0.14 per million tokens for Hermes 2 Pro Llama 3 8B versus $3.00 for Mistral Large 2407 (21× as much) and $4.38 for GPT-4o (31× as much).

Which scores higher on benchmarks?

There is no independent benchmark that covers all three models yet. GPT-4o has an ECI of 128.1, Hermes 2 Pro Llama 3 8B has not been scored yet and Mistral Large 2407 has an ECI of 126.4.

Which is better for coding?

There are no published SWE-bench Verified results for GPT-4o, Hermes 2 Pro Llama 3 8B and Mistral Large 2407 yet, so there is no like-for-like coding score. Test both on a sample of your own tasks. All three support tool calling for agent workflows.

Which has the bigger context window?

Mistral Large 2407 has the largest context window at 131,072 tokens, against 128,000 for GPT-4o and 8,192 for Hermes 2 Pro Llama 3 8B. Maximum output per response: GPT-4o up to 16,384, Hermes 2 Pro Llama 3 8B up to 8,192, Mistral Large 2407 up to 104,857 tokens.

Which can read images, PDFs, audio or video?

GPT-4o accepts text, images and PDFs; Hermes 2 Pro Llama 3 8B accepts text; Mistral Large 2407 accepts text and PDFs. GPT-4o handles the widest range of inputs.

Are any of these open source?

Hermes 2 Pro Llama 3 8B and Mistral Large 2407 publishes its weights (Llama 3 Community License) and can be self-hosted; GPT-4o is proprietary.

Which is newer?

Mistral Large 2407 is the newest, released Jul 24, 2024. GPT-4o came out May 13, 2024; Hermes 2 Pro Llama 3 8B came out Apr 30, 2024. Knowledge cutoff: GPT-4o Sep 2023, Mistral Large 2407 Mar 31, 2024.

How do you decide the winner?

This rating uses inputs & features (60%, image, PDF, audio and video input, tool calling, structured output and reasoning); context window (40%, maximum tokens per request, log scale). Dimensions missing for any model are dropped and the remaining weights rescaled, so every model is judged on the same evidence. Specs and prices come from public model listings and the labs’ own API pages; capability scores come from independent benchmark runs. Data updated Nov 18, 2026.