SciCode benchmark

145 AI models ranked on SciCode. Each row shows the model’s score next to its cheapest API price per 1M tokens where it has one, so you can weigh quality against cost.

Top model today

Claude Opus 5.5 (Anthropic) leads at 67%, from $4.00 per 1M input via Anthropic.

Data via arXiv:2407.13168 →

Models ranked

145

on this benchmark

Top score

67%

current leader

Type

Single eval

benchmark

Updated

Oct 14, 2026

benchmark scores

Cost vs SciCode

111 priced models
Most attractive quadrant (cheap + high)
= reasoning model (extended thinking)

Each labelled name links to that model’s page. Curated to the cost-efficiency frontier, top scorers and cheapest so labels stay readable; the full field is in the leaderboard table below (and via “select all”). Reasoning models (extended “thinking” before answering) carry a ring around the dot.

Models ranked on SciCode

highest score first · 145 models
Maker
#
1Claude Opus 5.5Anthropic67%
$4.00
via Anthropic
$20.00
via Databricks
2Claude Fable 5.1Anthropic63%
$10.00
via Anthropic
$50.00
via Anthropic
3Muse Wonder Full (Max)Meta63%
n/a
n/a
4Gemini 4 ArgonGoogle62%
$2.00
via Google
$10.00
via Google
5Claude Fable 5Anthropic61%
$10.00
via Anthropic
$50.00
via Anthropic
6Claude Sonnet 5.5Anthropic61%
$2.00
via Anthropic
$10.00
via Anthropic
7MiMo-V2.6-ProXiaomi61%
$0.435
via Xiaomi Mimo
$0.87
via Xiaomi Mimo
8Muse WonderOther60%
$4.00
Routed quote
$20.00
Routed quote
9Kimi K3Moonshot59%
$0.70
Routed quote
$12.50
via Sail
10GLM 5.3Zhipu59%
$0.079
Routed quote
$3.08
via Sail
11Step 5 PreviewStepfun59%
n/a
n/a
12Muse Spark 1.3Other59%
$1.25
via Azure
$4.25
via Azure
13Muse Spark 1.1Other59%
$1.25
via Meta
$4.25
via Meta
14Gemini 3.1 Pro PreviewGoogle59%
$2.00
via Google
$12.00
via Google
15GPT-5.6 SolOpenAI58%high
$2.00
Routed quote
$10.00
Routed quote
16GPT-6 SolOpenAI58%
$2.00
via OpenAI
$10.00
via OpenAI
17Grok 4.7xAI57%
$2.00
via xAI
$6.00
via xAI
18Muse Spark 1.2Other57%
$1.25
via Meta
$4.25
via Meta
19Gemini 3.7 FlashGoogle57%
$0.75
via Google
$3.75
via Google
20Gemini 3.8 FlashGoogle57%
$0.75
via Google
$3.75
via Google
21Grok 4.6xAI56%
$2.00
via xAI
$6.00
via xAI
22GPT-6 AstraOpenAI56%
$10.00
via OpenAI
$50.00
via OpenAI
23Claude Opus 5Anthropic56%
$5.00
via Anthropic
$25.00
via Anthropic
24GPT-5.5OpenAI56%high
$5.00
via OpenAI
$30.00
via OpenAI
25Claude Haiku 5.5Anthropic55%
$0.10
via Anthropic
$0.50
via Anthropic
26GPT-5.6 TerraOpenAI55%
$2.00
via OpenAI
$12.00
via OpenAI
27Grok 4.5xAI55%
$2.00
via xAI
$6.00
via xAI
28GPT-6 LunaOpenAI55%
$0.10
via OpenAI
$0.50
via OpenAI
29Claude Opus 4.8Anthropic54%
$5.00
via Anthropic
$25.00
via Anthropic
30Claude Sonnet 5Anthropic54%
$2.00
via Anthropic
$10.00
via Anthropic
31GPT-6.1 SolOpenAI54%
$2.00
via OpenAI
$10.00
via OpenAI
32Mistral Large 4Mistral54%
$0.68
via Mistral
$2.09
via Mistral
33Qwen3.8 2.4T A95BAlibaba54%
$2.00
via Aihubmix
$6.00
via Aihubmix
34Ling 3.1 FlashInclusionAI54%
n/a
n/a
35Gemini 3.5 FlashGoogle54%
$1.50
via Google
$9.00
via Google
36GPT-5.6 LunaOpenAI54%
$0.20
via OpenAI
$1.20
via OpenAI
37Gemini 3.6 FlashGoogle53%
$0.75
via Google
$3.75
via Google
38Qwen3.8 MaxAlibaba53%
$1.65
via DeepInfra
$4.95
via DeepInfra
39GPT-5.5 Instant (June 2026)OpenAI53%
n/a
n/a
40GPT-5.4 MiniOpenAI52%
$0.75
via Databricks
$4.50
via OpenAI
41Qwen3.8 Max (0902)Alibaba52%
$2.00
Routed quote
$6.00
Routed quote
42JT-4.1 Flash 236B A21BChina-mobile52%
n/a
n/a
43JT-4.1 Flash 236B A21BChina-mobile52%
n/a
n/a
44DeepSeek V4.1 FlashDeepSeek52%
$0.01
via Coralbricks
$0.60
via Sail
45GLM 5.3 FlashZhipu52%
$0.11
via Sail
$0.35
via Sail
46Kimi K2.6Moonshot52%
$0.65
via Wandb
$3.40
via Novita
47MiMo-V2.6-FlashXiaomi51%
$0.14
via Xiaomi Mimo
$0.28
via Xiaomi Mimo
48GLM 5.2Zhipu51%
$0.05
Routed quote
$1.98
via Scx AI
49DeepSeek V4 Pro 0813DeepSeek51%
$0.66
Routed quote
$1.98
Routed quote
50DeepSeek V4 Pro 0423DeepSeek51%
$0.435
via Tencent
$0.87
via Tencent
1–50 of 464
Page 1 of 10
On-demand listed rates, OpenRouter routed quotes and Vercel reseller quotes. Enterprise commitments can be materially lower. Cost per task uses best-effort token usage. An OpenRouter routed quote is the price of whichever upstream provider OpenRouter prefers today, so it moves day to day.

Frequently asked questions

What is the SciCode benchmark?

A research coding benchmark curated by scientists across 16 natural-science sub-fields, where models write Python to solve real scientific problems. Its 80 main problems decompose into 338 subproblems, graded against scientist-annotated gold solutions and test cases.

Which AI model scores highest on SciCode?

Claude Opus 5.5 (Anthropic) leads with 67%, from $4.00 per 1M input tokens from Anthropic.

How many models are ranked on SciCode?

145 models carry a SciCode score. Scores come from Artificial Analysis; where a model has a listed API price it is drawn from LiteLLM and OpenRouter, and models with no current price are listed without one.

Other benchmarks

compare the same models on a different eval
Benchmark scores via Artificial Analysis · scores updated Oct 14, 2026 · Listed prices from LiteLLM, OpenRouter and Vercel · catalogue refreshed Oct 14, 2026 · 156 prices older, back to Jul 19, 2026

Every weekday

AI moves fast. Here's your debrief.

News, analysis, tools, and more.

For people who build with AI