Context
200K
Max output
131K
Serving providers
6
Cheapest input
$0.02 /1M
Prices are on-demand list rates. Enterprise commitments (committed-use discounts, provisioned throughput, negotiated rates) can be materially lower.

Benchmarks

independent evaluations · source: Artificial Analysis
Speed & latency
Output speed
88 t/s
tokens / second
Time to first token
6.90s
latency
Headline indices
Individual benchmarks · click a row for effort variants
BenchmarkBest scoreEffortCost / task
CritPt0%default
EvalComputeProxy1374.4default
GDPval-123.7default
GPQA Diamond26%default
Humanity's Last Exam5%default
IFBench29%default
LiveCodeBench12%default
Long-Context Reasoning16%default
MMLU-Pro48%default
Omniscience-30.3default
SciCode13%default
TerminalBench Hard1%default
TerminalBench v2.12%default
τ-bench Banking2%default
τ²-bench16%default

Pricing by serving provider

standard tier · per 1M tokens · click a provider to expand

Input pricing runs from $0.02 to $0.72 per 1M tokens across 6 providers, so the dearest route costs 3500% more than the cheapest for the same model.

Serving providerInput /1MOutput /1MEndpoints
NovitaCheapest$0.02$0.051
ComponentUnitStandardBatchCached
Text input/1M tok$0.0200
Text output/1M tok$0.0500
Nscale$0.03$0.031
Ovhcloud$0.10$0.101
Databricks$0.15$0.451
Perplexity$0.20$0.201
OCI$0.72$0.721

Price history

input + output $/1M since we started tracking
Input Output
Input down 93% since first tracked
$0.000$0.050$0.100$0.150$0.200Aug 14Sep 12Jan 9Jun 22$0.020$0.015

Cost calculator

estimate your monthly spend on this model
$8
estimated / month

Model IDs

copy the exact identifier for your platform
novita/meta-llama/llama-3.1-8b-instructnscale/meta-llama/Llama-3.1-8B-Instructovhcloud/Llama-3.1-8B-Instructdatabricks/databricks-meta-llama-3-1-8b-instructperplexity/llama-3.1-8b-instructoci/meta.llama-3.1-8b-instruct

Frequently asked questions

Llama 3.1 8B Instruct pricing, context and availability

How much does Llama 3.1 8B Instruct cost?

Llama 3.1 8B Instruct costs $0.02 per 1M input tokens and $0.03 per 1M output tokens at its cheapest provider via Novita. Across 6 serving providers, input prices range from $0.02 to $0.72 per 1M tokens.

What is the context window of Llama 3.1 8B Instruct?

Llama 3.1 8B Instruct accepts up to 200K tokens of context and can return up to 131K output tokens.

Which providers serve Llama 3.1 8B Instruct?

Llama 3.1 8B Instruct is available from 6 serving providers, each with its own pricing and model ID. Novita is currently the cheapest.

What can Llama 3.1 8B Instruct do?

Llama 3.1 8B Instruct supports tool use and structured output.

Other Meta models

compare pricing across the Meta lineup
Pricing verified against LiteLLM + OpenRouter + provider pages · refreshed daily

Every weekday

AI moves fast. Here's your debrief.

News, analysis, tools, and more.

For people who build with AI