AA-Briefcase benchmark
24 AI models ranked on AA-Briefcase. Each row shows the model’s score next to its cheapest API price per 1M tokens where it has one, so you can weigh quality against cost.
Top model today
Claude Fable 5 (Anthropic) leads at 54%, from $10.00 per 1M input.
Data via Artificial Analysis AA-Briefcase →Models ranked
24
on this benchmark
Top score
54%
current leader
Type
Single eval
benchmark
Updated
15 July 2026
last source fetch
Cost vs AA-Briefcase
22 priced modelsEach labelled name links to that model’s page. Curated to the cost-efficiency frontier, top scorers and cheapest so labels stay readable; the full field is in the leaderboard table below (and via “select all”). Reasoning models (extended “thinking” before answering) carry a ring around the dot.
Models ranked on AA-Briefcase
highest score first · 24 models| # | ||||||
|---|---|---|---|---|---|---|
| 1 | Claude Fable 5 |  Anthropic | 54% | $10.00 | $50.00 | |
| 2 | Claude Sonnet 5 | Anthropic | 45% | $2.00 | $10.00 | |
| 3 | Claude Opus 4.8 | Anthropic | 43% | $5.00 | $25.00 | |
| 4 | Claude Opus 4.7 | Anthropic | 40% | $5.00 | $25.00 | |
| 5 | GLM 5.2 |  Zhipu | 38% | $1.40 | $4.40 | |
| 6 | GPT-5.5 |  OpenAI | 33% | $5.00 | $30.00 | |
| 7 | MiniMax M3 |  MiniMax | 31% | $0.30 | $1.20 | |
| 8 | GLM 5.1 | Zhipu | 24% | $1.05 | $3.50 | |
| 9 | DeepSeek V4 Pro |  DeepSeek | 22% | $0.43 | $0.87 | |
| 10 | MiMo-V2.5-Pro |  Xiaomi | 19% | $1.00 | $3.00 | |
| 11 | Gemini 3.5 Flash |  Google | 18% | $1.50 | $9.00 | |
| 12 | DeepSeek V4 Flash | DeepSeek | 16% | n/a | n/a | |
| 13 | Kimi K2.6 |  Moonshot | 16% | n/a | n/a | |
| 14 | Qwen3.6 27B |  Alibaba | 15% | $0.15 | $0.50 | |
| 15 | Grok 4.3 |  xAI | 13% | $1.25 | $2.50 | |
| 16 | GPT-5.4 Mini | OpenAI | 10% | $0.75 | $4.50 | |
| 17 | Qwen3.5 397B A17B | Alibaba | 2% | $0.60 | $3.60 | |
| 18 | Mistral Medium 3.5 |  Mistral | 0% | $1.50 | $7.50 | |
| 19 | gpt-oss-120b | OpenAI | 0% | $0.05 | $0.25 | |
| 20 | gpt-oss-20b | OpenAI | 0% | $0.01 | $0.07 | |
| 21 | Gemini 3.1 Pro Preview | Google | 0% | $2.00 | $12.00 | |
| 22 | Gemini 3.1 Flash Lite Preview | Google | 0% | $0.25 | $1.50 | |
| 23 | Llama 4 Maverick |  Meta | 0% | $0.20 | $0.60 | |
| 24 | Gemma 4 31B | Google | 0% | $0.14 | $0.40 |
Frequently asked questions
What is the AA-Briefcase benchmark?
AA-Briefcase (Artificial Analysis) tests models on realistic, multi-week knowledge-work projects, each with many linked tasks and thousands of fragmented source files such as Slack threads, emails, meeting transcripts and spreadsheets. It combines rubric grading with pairwise quality comparisons to score task success, analytical quality and presentation. The normalised score shown here is demanding: even the strongest models satisfy only a small fraction of tasks in full.
Which AI model scores highest on AA-Briefcase?
Claude Fable 5 (Anthropic) leads with 54%, from $10.00 per 1M input tokens.
How many models are ranked on AA-Briefcase?
24 models carry a AA-Briefcase score. Scores come from Artificial Analysis; where a model has a live API price it is verified against LiteLLM and OpenRouter, and models with no current price are listed without one.
Other benchmarks
compare the same models on a different evalEvery weekday
AI moves fast. Here's your debrief.
News, analysis, tools, and more.
For people who build with AI