Hermes 4 405B vs Kimi K2 Instruct vs Qwen3 235B-A22B Thinking 2507
No independent capability benchmark covers every model here yet. The score uses price, inputs & features and context window.
Price in rating: Included · Exclude price
Nous Research
Hermes 4 405B
37/100- ECI—
- Price$1.00 / $3.00
- Context131K
Moonshot AI
Kimi K2 Instruct
38/100- ECI141.3
- Price$0.57 / $2.30
- Context131K
Alibaba (Qwen)
Qwen3 235B-A22B Thinking 2507
43/100- ECI143.3
- Price$0.30 / $2.90
- Context262K
Capability evidence is incomplete
There is not enough shared capability evidence to name an overall winner. The scores (Qwen3 235B-A22B Thinking 2507 43/100, Kimi K2 Instruct 38/100, Hermes 4 405B 37/100) compare the available specifications and price. The score weighs price 50%, inputs & features 30%, context window 20%. None of the shared benchmarks cover every model here yet, so capability is left out of this verdict.
- CapabilityNot enough dataNo independent benchmark covers every model here yet
- Lowest priceQwen3 235B-A22B Thinking 2507Qwen3 235B-A22B Thinking 2507 $0.95 · Kimi K2 Instruct $1.00 · Hermes 4 405B $1.50 per 1M tokens (3:1 blend)
- Longest contextQwen3 235B-A22B Thinking 2507Qwen3 235B-A22B Thinking 2507 262,144 · Hermes 4 405B 131,072 · Kimi K2 Instruct 131,072 tokens
- Widest inputsSame inputsHermes 4 405B: Text · Kimi K2 Instruct: Text · Qwen3 235B-A22B Thinking 2507: Text
- Self-hostingAll open weightsEvery model here can be downloaded and run on your own hardware
| Measure | Weight | Hermes 4 405B | Kimi K2 Instruct | Qwen3 235B-A22B Thinking 2507 |
|---|---|---|---|---|
| Price | 50% | 40 | 48 | 49 |
| Inputs & features | 30% | 35 | 25 | 35 |
| Context window | 20% | 32 | 32 | 43 |
| Specs & price only | 100% | 37/100 | 38/100 | 43/100 |
Left out because at least one model lacks the data: capability. The remaining weights were rescaled.
Every spec in one table
Highlighted cells lead their row. Dashes mean the data is not published.
| Specification | |||
|---|---|---|---|
| Capability | |||
| Capabilities Index (ECI) | — | 141.3 | 143.3 (best) |
| ECI rank | — | #108 of 158 | #100 of 158 (best) |
| GPQA DiamondGraduate-level science questions | — | — | 80.1% |
| OTIS Mock AIME 2024–2025Competition mathematics | — | — | 86.7% |
| SimpleQA VerifiedShort factual questions | — | — | 40.4% |
| Price per million tokens | |||
| Input | $1.00 | $0.57 | $0.30 (best) |
| Output | $3.00 | $2.30 (best) | $2.90 |
| Cached input | — | — | — |
| Blended (3:1) | $1.50 | $1.00 | $0.95 (best) |
| Long-context rate | Same rate | Same rate | Same rate |
| Price source | Median of 4 providers | Median of 11 providers | Median of 11 providers |
| Limits | |||
| Context window | 131,072 tokens | 131,072 tokens | 262,144 tokens (best) |
| Max output | 117,964 tokens (best) | 32,768 tokens | 81,920 tokens |
| Inputs and features | |||
| Text | Yes | Yes | Yes |
| Images | No | No | No |
| PDFs | No | No | No |
| Audio | No | No | No |
| Video | No | No | No |
| Reasoning | Yes | No | Yes |
| Tool calling | Yes | Yes | Yes |
| Structured output | No | No | No |
| Availability | |||
| Weights | Open | OpenModified MIT | OpenApache 2.0 |
| API model ID | — | — | — |
| API providers | 4 | 11 | 12 (best) |
| Released | Aug 26, 2025 | Jul 11, 2025 | Jul 25, 2025 |
| Knowledge cutoff | Aug 31, 2024 | — | — |
What would a month cost?
Enter your expected volume in millions of tokens. List prices only; caching and batch discounts would lower these.
Hermes 4 405B$16.00
Kimi K2 Instruct$10.30
Qwen3 235B-A22B Thinking 2507$8.80
Which should you choose?
Which is better: Hermes 4 405B, Kimi K2 Instruct or Qwen3 235B-A22B Thinking 2507?
There is not enough shared capability evidence to name an overall winner. The scores (Qwen3 235B-A22B Thinking 2507 43/100, Kimi K2 Instruct 38/100, Hermes 4 405B 37/100) compare the available specifications and price. The score weighs price 50%, inputs & features 30%, context window 20%. None of the shared benchmarks cover every model here yet, so capability is left out of this verdict.
Which is cheaper, Hermes 4 405B, Kimi K2 Instruct or Qwen3 235B-A22B Thinking 2507?
Qwen3 235B-A22B Thinking 2507 is cheaper at $0.30 input / $2.90 output per million tokens (median across 11 API providers). Kimi K2 Instruct costs $0.57 input / $2.30 output per million tokens (median across 11 API providers); Hermes 4 405B costs $1.00 input / $3.00 output per million tokens (median across 4 API providers). At a typical mix of three input tokens to one output token, that is $0.95 per million tokens for Qwen3 235B-A22B Thinking 2507 versus $1.00 for Kimi K2 Instruct (1.1× as much) and $1.50 for Hermes 4 405B (1.6× as much).
Which scores higher on benchmarks?
There is no independent benchmark that covers all three models yet. Hermes 4 405B has not been scored yet, Kimi K2 Instruct has an ECI of 141.3 and Qwen3 235B-A22B Thinking 2507 has an ECI of 143.3.
Which is better for coding?
There are no published SWE-bench Verified results for Hermes 4 405B, Kimi K2 Instruct and Qwen3 235B-A22B Thinking 2507 yet, so there is no like-for-like coding score. Test both on a sample of your own tasks. All three support tool calling for agent workflows.
Which has the bigger context window?
Qwen3 235B-A22B Thinking 2507 has the largest context window at 262,144 tokens, against 131,072 for Hermes 4 405B and 131,072 for Kimi K2 Instruct. Maximum output per response: Hermes 4 405B up to 117,964, Kimi K2 Instruct up to 32,768, Qwen3 235B-A22B Thinking 2507 up to 81,920 tokens.
Which can read images, PDFs, audio or video?
Hermes 4 405B accepts text; Kimi K2 Instruct accepts text; Qwen3 235B-A22B Thinking 2507 accepts text. They handle the same number of input types.
Are any of these open source?
Yes, all three publish their weights (Modified MIT and Apache 2.0), so you can self-host them.
Which is newer?
Hermes 4 405B is the newest, released Aug 26, 2025. Qwen3 235B-A22B Thinking 2507 came out Jul 25, 2025; Kimi K2 Instruct came out Jul 11, 2025. Knowledge cutoff: Hermes 4 405B Aug 31, 2024.
How do you decide the winner?
This rating uses price (50%, blended price per million tokens (3 input : 1 output), log scale); inputs & features (30%, image, PDF, audio and video input, tool calling, structured output and reasoning); context window (20%, maximum tokens per request, log scale). Dimensions missing for any model are dropped and the remaining weights rescaled, so every model is judged on the same evidence. Specs and prices come from public model listings and the labs’ own API pages; capability scores come from independent benchmark runs. Data updated Nov 18, 2026.