BE
← Leaderboard

DeepSeek R1

Open source
DeepSeek
Open license
text
DeepSeek R1Released 1y ago
Avg score
87.1
/ 100
Context
128k
Output limit
32k
Input price
$0.55 /M
Output price
$2.19 /M

Pricing verified 1y ago · source

Benchmarks

preference

Crowdsourced pairwise human preference rankings of LLM responses. Higher Elo means more frequently preferred by users.

math

American Invitational Mathematics Examination 2024 problems. Three-digit integer answers; very hard for non-reasoning models.

coding

HumanEval% pass@1

164 hand-written Python programming problems scored by passing unit tests. Saturated for frontier models.

Continuously refreshed coding benchmark drawing from LeetCode, AtCoder, and Codeforces; reduces benchmark contamination.

agentic

Real GitHub issues solved end-to-end. Verified subset is a 500-task human-validated slice of SWE-bench.

long context

Long-context retrieval and reasoning suite. We report the 128k token effective-context score.

performance

Median sustained output speed in tokens per second on the model's first-party API for medium-length prompts. Higher is faster.

Median time from request to first output chunk in milliseconds on the model's first-party API for medium-length prompts. Lower is snappier; reasoning models are penalised here because they think before talking.

Providers

ProviderInput $/MOutput $/MContextQuant
DeepInfra
deepinfra/fp4
$0.50$2.15164kfp4
AtlasCloud
atlas-cloud/fp8
$0.55$2.15131kfp8
SiliconFlow
siliconflow/fp8
$0.50$2.18164kfp8
Novita
novita/fp8
$0.70$2.50164kfp8
Together
together/fp8
$3.00$7.00164kfp8
Sourced from OpenRouter. Sorted by lowest output price.

Compare with...