CritPt benchmark

307 AI models ranked on CritPt. Each row shows the model’s score next to its cheapest API price per 1M tokens where it has one, so you can weigh quality against cost.

Top model today

GPT-5.6 Sol (OpenAI) leads at 32%, from $5.00 per 1M input.

Data via arXiv:2509.26574

Models ranked

307

on this benchmark

Top score

32%

current leader

Type

Single eval

benchmark

Updated

15 July 2026

last source fetch

Cost vs CritPt

162 priced models
Most attractive quadrant (cheap + high)
= reasoning model (extended thinking)

Each labelled name links to that model’s page. Curated to the cost-efficiency frontier, top scorers and cheapest so labels stay readable; the full field is in the leaderboard table below (and via “select all”). Reasoning models (extended “thinking” before answering) carry a ring around the dot.

Models ranked on CritPt

highest score first · 307 models
Maker
#
1GPT-5.6 SolOpenAI32%$5.00$30.00
2GPT-5.5 ProOpenAI31%n/an/a
3GPT-5.6 TerraOpenAI30%$2.50$15.00
4GPT-5.4 ProOpenAI30%n/an/a
5Claude Fable 5Anthropic29%$10.00$50.00
6GPT-5.5OpenAI27%$5.00$30.00
7Gemini 3 Deep ThinkGoogle26%n/an/a
8GPT-5.4OpenAI23%$2.50$15.00
9Claude Opus 4.8Anthropic21%$5.00$25.00
10GLM 5.2Zhipu21%$1.40$4.40
11GPT-5.6 LunaOpenAI21%$1.00$6.00
12Gemini 3.1 Pro PreviewGoogle18%$2.00$12.00
13Claude Sonnet 5Anthropic17%$2.00$10.00
14GPT-5.3 CodexOpenAI17%n/an/a
15Grok 4.5xAI15%$2.00$6.00
16Muse Spark 1.1Other15%$1.25$4.25
17Qwen3.7 MaxAlibaba13%n/an/a
18Gemini 3.5 FlashGoogle13%$1.50$9.00
19DeepSeek V4 ProDeepSeek13%$0.43$0.87
20Claude Opus 4.6Anthropic13%reasoning: adaptive$5.00$25.00
21Claude Opus 4.7Anthropic12%$5.00$25.00
22GPT-5.2OpenAI12%$1.75$14.00
23Muse SparkMeta11%n/an/a
24GPT-5.4 MiniOpenAI10%$0.75$4.50
25Kimi K2.7 CodeMoonshot10%$0.95$4.00
26GPT-5.4 NanoOpenAI9%$0.20$1.25
27Gemini 3 ProGoogle9%$2.00$12.00
28Grok Build 0.1 0616Spacexai9%n/an/a
29Qwen3.7 PlusAlibaba9%n/an/a
30GPT-5.2-CodexOpenAI9%$1.75$14.00
31Gemini 3 FlashGoogle9%reasoning: truen/an/a
32Nex-N2-ProNex-agi9%n/an/a
33Grok 4.3xAI8%$1.25$2.50
34Kimi K2.6Moonshot8%n/an/a
35DeepSeek V3 2 SpecialeDeepSeek7%$0.58$1.68
36DeepSeek V4 FlashDeepSeek7%n/an/a
37Grok 4.20 0309 v2Spacexai7%n/an/a
38Grok 4.20 0309Spacexai6%n/an/a
39GPT-5OpenAI6%$1.25$10.00
40GPT-5.1 CodexOpenAI6%n/an/a
41GPT-5 CodexOpenAI5%$1.25$10.00
42GPT-5.1OpenAI5%$1.25$10.00
43Hy3-previewTencent5%n/an/a
44Claude Opus 4.5Anthropic5%reasoning: true$5.00$25.00
45GLM 5.1Zhipu5%$1.05$3.50
46Hy3-previewTencent5%n/an/a
47Mimo V2 FlashXiaomi4%reasoning: true$0.10$0.30
48MiMo-V2.5-ProXiaomi4%$1.00$3.00
49Ring-2.6-1TInclusionai4%n/an/a
50MiniMax M3MiniMax4%$0.30$1.20
150 of 307
Page 1 of 7
Prices are on-demand list rates. Enterprise commitments can be materially lower. Cost per task uses best-effort token usage.

Frequently asked questions

What is the CritPt benchmark?

CritPt (Complex Research using Integrated Thinking, Physics Test) is a frontier physics benchmark of 71 unpublished, research-level challenges across 12 subdisciplines, created by more than 50 active physicists. Scored on accuracy in guess-resistant formats (numeric arrays, symbolic expressions, code), where the best current models solve only single-digit percentages unaided.

Which AI model scores highest on CritPt?

GPT-5.6 Sol (OpenAI) leads with 32%, from $5.00 per 1M input tokens.

How many models are ranked on CritPt?

307 models carry a CritPt score. Scores come from Artificial Analysis; where a model has a live API price it is verified against LiteLLM and OpenRouter, and models with no current price are listed without one.

Other benchmarks

compare the same models on a different eval
Benchmark scores via Artificial Analysis · pricing verified against LiteLLM + OpenRouter · refreshed daily · updated 15 July 2026

Every weekday

AI moves fast. Here's your debrief.

News, analysis, tools, and more.

For people who build with AI