ZMIME
Microsoft · Released Apr 15, 2024

WizardLM 2 8x22B

Microsoft WizardLM instruction-tuned Mixtral MoE for multilingual dialogue and complex tasks.

  • Open weights
Capability
—No ECI score yet
Input
$0.493per 1M tokens
Output
$0.493per 1M tokens
Context
66K8K max output
Pricing

What it costs

Input
$0.493per million tokens
Output
$0.493per million tokens
Blended (3:1)
$0.493cheaper than 60% of priced models

Typical monthly bills

Monthly usageEstimated cost
Side project2M input + 0.5M output tokens$1.23
Team assistant25M input + 5M output tokens$14.79
Production app250M input + 50M output tokens$147.90

Median of 3 paid API providers on models.dev.

Capability

Independent benchmarks

Epoch AI has not published a Capabilities Index score for WizardLM 2 8x22B yet.

  • GPQA DiamondGraduate-level science questions43.4%

Scores from Epoch AI, run independently of Microsoft.

Specifications

The details

Lab
Microsoft
Released
Apr 15, 2024
Context window
65,536 tokens
Max output
8,000 tokens
Inputs
Text
Output
Text
Reasoning
No
Tool calling
No
Structured output
No
Availability
3 API providerslisted on models.dev
Same lab

More from Microsoft

Questions

About WizardLM 2 8x22B

How much does WizardLM 2 8x22B cost?

WizardLM 2 8x22B costs $0.493 input / $0.493 output per million tokens (median across 3 API providers). At a 3:1 input-to-output mix that is $0.493 per million tokens, cheaper than 60% of the 445 priced models we track.

What is the context window of WizardLM 2 8x22B?

WizardLM 2 8x22B accepts up to 65,536 tokens per request and can write up to 8,000 tokens in one response.

How good is WizardLM 2 8x22B?

Epoch AI has not published a Capabilities Index score for WizardLM 2 8x22B yet. Epoch AI benchmark results: GPQA Diamond 43.4%.

Is WizardLM 2 8x22B open source?

Yes. Microsoft publishes the weights under the Apache-2.0 licence, so it can be downloaded and self-hosted.

What inputs does WizardLM 2 8x22B support?

WizardLM 2 8x22B accepts text and replies in text. It is not a dedicated reasoning model, does not support tool calling.

When was WizardLM 2 8x22B released?

Microsoft released WizardLM 2 8x22B on Apr 15, 2024.

What are the best alternatives to WizardLM 2 8x22B?

The closest current models from other labs on capability, price and release date are Llama-3.1-70B-Instruct (Meta, ECI 125.9, $0.72 / $0.72), Mistral Large (Mistral AI, ECI 122.0, $0.50 / $1.50), Claude Haiku 3 (Anthropic, ECI 118.8, $0.25 / $1.25) and Gemma 2 27B (Google, ECI 122.1, $0.65 / $0.65).