Llama 3.1 Nemotron 70B Instruct
Context
131K
Max output
131K
Serving providers
1
Cheapest input
$0.60 /1M
Prices are on-demand list rates. Enterprise commitments (committed-use discounts, provisioned throughput, negotiated rates) can be materially lower.
Benchmarks
independent evaluations · source: Artificial AnalysisSpeed & latency
Output speed
285 t/s
tokens / second
Time to first token
8.40s
latency
Headline indices
Individual benchmarks · click a row for effort variants
| Benchmark | Best score | Effort | Cost / task | |
|---|---|---|---|---|
| CritPt | 0% | default | — | |
| EvalComputeProxy | 133.1 | default | — | |
| GPQA Diamond | 46% | default | — | |
| Humanity's Last Exam | 5% | default | — | |
| IFBench | 31% | default | — | |
| LiveCodeBench | 17% | default | — | |
| Long-Context Reasoning | 7% | default | — | |
| MMLU-Pro | 69% | default | — | |
| Omniscience | -41.0 | default | — | |
| SciCode | 23% | default | — | |
| TerminalBench Hard | 5% | default | — | |
| τ²-bench | 23% | default | — |
Pricing by serving provider
standard tier · per 1M tokens · click a provider to expand| Serving provider | Input /1M | Output /1M | Endpoints | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| DeepInfraCheapest | $0.60 | $0.60 | 1 | ||||||||||||||||
| |||||||||||||||||||
Price history
input + output $/1M since we started tracking Input Output
Cost calculator
estimate your monthly spend on this model$168
estimated / month
Model IDs
copy the exact identifier for your platformdeepinfra/nvidia/Llama-3.1-Nemotron-70B-Instruct
Frequently asked questions
Llama 3.1 Nemotron 70B Instruct pricing, context and availabilityHow much does Llama 3.1 Nemotron 70B Instruct cost?
Llama 3.1 Nemotron 70B Instruct costs $0.60 per 1M input tokens and $0.60 per 1M output tokens at its cheapest provider via DeepInfra.
What is the context window of Llama 3.1 Nemotron 70B Instruct?
Llama 3.1 Nemotron 70B Instruct accepts up to 131K tokens of context and can return up to 131K output tokens.
What can Llama 3.1 Nemotron 70B Instruct do?
Llama 3.1 Nemotron 70B Instruct supports tool use.
Other NVIDIA models
compare pricing across the NVIDIA lineupNvidia Nemotron Nano 9B$0.04/1M · 3 providersNvidia Nemotron Nano 12B$0.20/1M · 2 providersNvidia Nemotron Nano 3 30B$0.06/1M · 1 providerLlama 3.3 Nemotron Super 49B$0.10/1M · 1 providerNemotron Nano V2 12B VL$0.10/1M · 1 providerLlama 3.3 Nemotron Super 49B V1.5$0.10/1M · 1 providerLlama3 1 Nemotron 70B Instruct FP8$0.12/1M · 1 providerNvidia Nemotron Super 3 120B$0.15/1M · 1 provider
Pricing verified against LiteLLM + OpenRouter + provider pages · refreshed daily
Every weekday
AI moves fast. Here's your debrief.
News, analysis, tools, and more.
For people who build with AI