Llama-3.1-70B-Instruct vs Gemma 2 27B vs WizardLM 2 8x22B

Llama-3.1-70B-Instruct is the better all-round choice, scoring 42/100 against WizardLM 2 8x22B (38) and Gemma 2 27B (32). It leads on inputs & features and context window. WizardLM 2 8x22B wins on price. The score weighs capability 50%, price 25%, inputs & features 15%, context window 10%. Capability uses the average of shared benchmarks (GPQA Diamond), because WizardLM 2 8x22B has no Capabilities Index score yet.

WizardLM 2 8x22B is cheaper at $0.493 input / $0.493 output per million tokens (median across 3 API providers). Gemma 2 27B costs $0.65 input / $0.65 output per million tokens (median across 3 API providers); Llama-3.1-70B-Instruct costs $0.72 input / $0.72 output per million tokens (median across 8 API providers). At a typical mix of three input tokens to one output token, that is $0.493 per million tokens for WizardLM 2 8x22B versus $0.65 for Gemma 2 27B (1.3× as much) and $0.72 for Llama-3.1-70B-Instruct (1.5× as much).

Not every model here has a Capabilities Index score, so we compare the average of shared benchmarks (GPQA Diamond): Llama-3.1-70B-Instruct 44.2%, WizardLM 2 8x22B 43.4% and Gemma 2 27B 36.5%. On individual benchmarks: GPQA Diamond — Llama-3.1-70B-Instruct 44.2%, WizardLM 2 8x22B 43.4%, Gemma 2 27B 36.5%.

There are no published SWE-bench Verified results for Llama-3.1-70B-Instruct, Gemma 2 27B and WizardLM 2 8x22B yet, so there is no like-for-like coding score. On overall capability, Llama-3.1-70B-Instruct leads, which tends to carry over to coding, but test on your own codebase. Note that Gemma 2 27B and WizardLM 2 8x22B does not support tool calling, which most coding agents need.

Llama-3.1-70B-Instruct has the largest context window at 128,000 tokens, against 65,536 for WizardLM 2 8x22B and 8,192 for Gemma 2 27B. Maximum output per response: Llama-3.1-70B-Instruct up to 4,096, Gemma 2 27B up to 2,048, WizardLM 2 8x22B up to 8,000 tokens.

Llama-3.1-70B-Instruct accepts text; Gemma 2 27B accepts text; WizardLM 2 8x22B accepts text. They handle the same number of input types.

Yes, all three publish their weights (Apache-2.0), so you can self-host them.

Llama-3.1-70B-Instruct is the newest, released Jul 23, 2024. Gemma 2 27B came out Jul 13, 2024; WizardLM 2 8x22B came out Apr 15, 2024. Knowledge cutoff: Llama-3.1-70B-Instruct Dec 2023, Gemma 2 27B Jun 30, 2024.

Each model gets a 0–100 score on capability (50%, independent benchmark results); price (25%, blended price per million tokens (3 input : 1 output), log scale); inputs & features (15%, image, PDF, audio and video input, tool calling, structured output and reasoning); context window (10%, maximum tokens per request, log scale). Dimensions missing for any model are dropped and the remaining weights rescaled, so every model is judged on the same evidence. Specs and prices come from public model listings and the labs’ own API pages; capability scores come from independent benchmark runs. Data updated Nov 2, 2026.