SWE-bench Pro benchmark
22 AI models ranked on SWE-bench Pro. Each row shows the model’s score next to its cheapest API price per 1M tokens where it has one, so you can weigh quality against cost.
Top model today
GLM 5.2 (Zhipu) leads at 62%, from $1.40 per 1M input.
Data via Scale AI SWE-bench Pro →Models ranked
22
on this benchmark
Top score
62%
current leader
Type
Single eval
benchmark
Updated
15 July 2026
last source fetch
Cost vs SWE-bench Pro
17 priced modelsEach labelled name links to that model’s page. Curated to the cost-efficiency frontier, top scorers and cheapest so labels stay readable; the full field is in the leaderboard table below (and via “select all”). Reasoning models (extended “thinking” before answering) carry a ring around the dot.
Models ranked on SWE-bench Pro
highest score first · 22 models| # | ||||||
|---|---|---|---|---|---|---|
| 1 | GLM 5.2 |  Zhipu | 62% | $1.40 | $4.40 | |
| 2 | MiniMax M3 |  MiniMax | 59% | $0.30 | $1.20 | |
| 3 | Kimi K2.6 |  Moonshot | 59% | n/a | n/a | |
| 4 | GLM 5p1 | Zhipu | 58% | $1.40 | $4.40 | |
| 5 | Hy3-preview | Tencent | 58% | n/a | n/a | |
| 6 | MiMo-V2.5-Pro |  Xiaomi | 57% | $1.00 | $3.00 | |
| 7 | Step 3.7 Flash | Stepfun | 56% | n/a | n/a | |
| 8 | MiniMax M2.7 | MiniMax | 56% | $0.26 | $0.55 | |
| 9 | MiMo-V2.5 | Xiaomi | 56% | $0.40 | $2.00 | |
| 10 | DeepSeek V4 Pro |  DeepSeek | 55% | $0.43 | $0.87 | |
| 11 | MiniMax M2.5 | MiniMax | 55% | n/a | n/a | |
| 12 | Qwen3.6 27B |  Alibaba | 54% | $0.15 | $0.50 | |
| 13 | Kimi K2.5 | Moonshot | 51% | $0.50 | $2.80 | |
| 14 | Qwen3.6 35B A3B | Alibaba | 50% | $0.14 | $0.45 | |
| 15 | Qwen3 Coder Next | Alibaba | 44% | $0.50 | $1.20 | |
| 16 | North Mini Code |  Cohere | 40% | n/a | n/a | |
| 17 | Qwen3 Coder 480B A35b Instruct | Alibaba | 39% | $0.30 | $1.30 | |
| 18 | MiniMax M2.1 | MiniMax | 37% | $0.27 | $1.20 | |
| 19 | Kimi K2 Instruct | Moonshot | 28% | $0.50 | $2.00 | |
| 20 | Qwen3 235B A22B | Alibaba | 21% | $0.18 | $0.54 | |
| 21 | gpt-oss-120b |  OpenAI | 16% | $0.05 | $0.25 | |
| 22 | GLM 4.6 | Zhipu | 10% | $0.40 | $1.75 |
Frequently asked questions
What is the SWE-bench Pro benchmark?
SWE-bench Pro (Scale AI) is a harder, contamination-resistant successor to SWE-bench, built from larger and more recent real-world software tasks across many repositories. The model must generate a patch that passes the project's tests. Scored as the percentage of tasks resolved, with frontier models still well short of saturation.
Which AI model scores highest on SWE-bench Pro?
GLM 5.2 (Zhipu) leads with 62%, from $1.40 per 1M input tokens.
How many models are ranked on SWE-bench Pro?
22 models carry a SWE-bench Pro score. Scores come from Hugging Face leaderboards; where a model has a live API price it is verified against LiteLLM and OpenRouter, and models with no current price are listed without one.
Other benchmarks
compare the same models on a different evalEvery weekday
AI moves fast. Here's your debrief.
News, analysis, tools, and more.
For people who build with AI