Mixtral 8x22B

Open source

Mistral

Open license

text

MixtralReleased 2y ago

Avg score

12.8

/ 100

Context

66k

Output limit

Input price

$1.20 /M

Output price

$1.20 /M

Pricing verified 1y ago · source · Median of hosted endpoints

Benchmarks

Elo

Crowdsourced pairwise human preference rankings of LLM responses. Higher Elo means more frequently preferred by users.

MMLU ProHigh risk

Harder version of MMLU testing knowledge across 57 academic subjects; reduces guessing-friendly answers.

Graduate-level Google-proof Q&A in physics, chemistry, and biology. Diamond subset is the hardest tier with PhD-validated answers.

MATH-500Saturated

500 high-school competition math problems requiring multi-step solutions. Scored on final-answer correctness.

American Invitational Mathematics Examination 2024 problems. Three-digit integer answers; very hard for non-reasoning models.

% pass@1

164 hand-written Python programming problems scored by passing unit tests. Saturated for frontier models.

IFEvalSome risk

Verifiable instruction-following benchmark; 25 categories of strict formatting / structural directives.

Long-context retrieval and reasoning suite. We report the 128k token effective-context score.

Provider	Input $/M	Output $/M	Context	Quant
Mistral mistral	$2.00	$6.00	66k	unknown

Sourced from OpenRouter. Sorted by lowest output price.