IFBench benchmark

314 AI models ranked on IFBench. Each row shows the model’s score next to its cheapest API price per 1M tokens where it has one, so you can weigh quality against cost.

Top model today

Grok 4.3 (xAI) leads at 83%, from $1.25 per 1M input.

Data via arXiv:2507.02833

Models ranked

314

on this benchmark

Top score

83%

current leader

Type

Single eval

benchmark

Updated

15 July 2026

last source fetch

Cost vs IFBench

168 priced models
Most attractive quadrant (cheap + high)
= reasoning model (extended thinking)

Each labelled name links to that model’s page. Curated to the cost-efficiency frontier, top scorers and cheapest so labels stay readable; the full field is in the leaderboard table below (and via “select all”). Reasoning models (extended “thinking” before answering) carry a ring around the dot.

Models ranked on IFBench

highest score first · 314 models
Maker
#
1Grok 4.3xAI83%medium$1.25$2.50
2Grok 4.20 0309Spacexai83%n/an/a
3MiniMax M3MiniMax83%$0.30$1.20
4Nemotron 3 UltraNVIDIA81%n/an/a
5Grok 4.20 0309 v2Spacexai81%n/an/a
6Qwen3.7 MaxAlibaba81%n/an/a
7Nemotron Cascade 2 30B A3BNVIDIA80%n/an/a
8MiMo-V2.5-ProXiaomi80%$1.00$3.00
9Nova 2.0 Pro PreviewAmazon80%lown/an/a
10DeepSeek V4 FlashDeepSeek79%n/an/a
11Qwen3.5 397B A17BAlibaba79%$0.60$3.60
12Gemini 3 FlashGoogle78%reasoning: truen/an/a
13Qwen3.7 PlusAlibaba78%n/an/a
14GPT-5.2-CodexOpenAI78%$1.75$14.00
15Gemini 3.1 Flash Lite PreviewGoogle77%$0.25$1.50
16Gemini 3.1 Pro PreviewGoogle77%$2.00$12.00
17Qwen3.6 Max PreviewAlibaba77%n/an/a
18DeepSeek V4 ProDeepSeek76%$0.43$0.87
19Gemini 3.5 FlashGoogle76%$1.50$9.00
20GLM 5.1Zhipu76%$1.05$3.50
21Kimi K2.6Moonshot76%n/an/a
22GPT-5.4 NanoOpenAI76%$0.20$1.25
23Muse SparkMeta76%n/an/a
24GPT-5.5OpenAI76%$5.00$30.00
25Qwen3.5-122B-A10BAlibaba76%$0.25$1.75
26MiniMax M2.7MiniMax76%$0.26$0.55
27Gemma 4 31BGoogle76%$0.14$0.40
28Qwen3.5-27BAlibaba76%$0.30$2.40
29GPT-5 MiniOpenAI75%$0.25$2.00
30GPT-5.2OpenAI75%$1.75$14.00
31GPT-5.3 CodexOpenAI75%n/an/a
32Qwen3.6 PlusAlibaba75%$0.33$1.95
33GPT-5 CodexOpenAI74%$1.25$10.00
34GPT-5.4OpenAI74%$2.50$15.00
35Command A+Cohere74%n/an/a
36Gemma 4 12BGoogle74%n/an/a
37GLM 5.2Zhipu73%$1.40$4.40
38GPT-5.4 MiniOpenAI73%$0.75$4.50
39GLM-5-TurboZhipu73%n/an/a
40GPT-5OpenAI73%$1.25$10.00
41GPT-5.1OpenAI73%$1.25$10.00
42GPT-5.6 SolOpenAI73%$5.00$30.00
43Qwen3.5-35B-A3BAlibaba73%$0.25$2.00
44Gemma 4 26B A4bGoogle72%$0.13$0.40
45MiniMax M2MiniMax72%$0.26$1.02
46GLM 5Zhipu72%$0.80$2.56
47MiMo-V2-Flash (Feb 2026)Xiaomi72%n/an/a
48MiniMax M2.5MiniMax72%n/an/a
49Nemotron 3 120B A12bNVIDIA72%$0.50$1.50
50GPT-5.5 Instant (May 2026)OpenAI72%n/an/a
150 of 314
Page 1 of 7
Prices are on-demand list rates. Enterprise commitments can be materially lower. Cost per task uses best-effort token usage.

Frequently asked questions

What is the IFBench benchmark?

IFBench (Ai2) tests how well models follow new, previously unseen verifiable output constraints such as word-count limits, required keywords or formatting rules that were not part of training. Scoring is fully programmatic: verifier functions check whether each response satisfies the constraint.

Which AI model scores highest on IFBench?

Grok 4.3 (xAI) leads with 83%, from $1.25 per 1M input tokens.

How many models are ranked on IFBench?

314 models carry a IFBench score. Scores come from Artificial Analysis; where a model has a live API price it is verified against LiteLLM and OpenRouter, and models with no current price are listed without one.

Other benchmarks

compare the same models on a different eval
Benchmark scores via Artificial Analysis · pricing verified against LiteLLM + OpenRouter · refreshed daily · updated 15 July 2026

Every weekday

AI moves fast. Here's your debrief.

News, analysis, tools, and more.

For people who build with AI