Llama-3.1-8B-Instruct
Compact open Llama model for lightweight chat, drafting, and self-hosting.
- Capability
- 110.8ECI · #157 of 158
- Input
- $0.055per 1M tokens
- Output
- $0.078per 1M tokens
- Context
- 128K4K max output
What it costs
- Input
- $0.055per million tokens
- Output
- $0.078per million tokens
- Blended (3:1)
- $0.061cheaper than 95% of priced models
Typical monthly bills
| Monthly usage | Estimated cost |
|---|---|
| Side project2M input + 0.5M output tokens | $0.149 |
| Team assistant25M input + 5M output tokens | $1.77 |
| Production app250M input + 50M output tokens | $17.66 |
Median of 18 paid API providers on models.dev.
Independent benchmarks
#157 of 158 scored models
The shaded band is Epoch AI’s confidence range (105.3–115.8); the tick marks the median scored model.
Scores from Epoch AI, run independently of Meta.
The details
- Lab
- Meta
- Released
- Jul 23, 2024
- Knowledge cutoff
- Dec 2023
- Context window
- 128,000 tokens
- Max output
- 4,096 tokens
- Inputs
- Text
- Output
- Text
- Reasoning
- No
- Tool calling
- Yes
- Structured output
- No
- Weights
- Open weights
- Availability
- 19 API providerslisted on models.dev
More from Meta
About Llama-3.1-8B-Instruct
How much does Llama-3.1-8B-Instruct cost?
Llama-3.1-8B-Instruct costs $0.055 input / $0.078 output per million tokens (median across 18 API providers). At a 3:1 input-to-output mix that is $0.061 per million tokens, cheaper than 95% of the 469 priced models we track.
What is the context window of Llama-3.1-8B-Instruct?
Llama-3.1-8B-Instruct accepts up to 128,000 tokens per request and can write up to 4,096 tokens in one response.
How good is Llama-3.1-8B-Instruct?
Epoch AI gives Llama-3.1-8B-Instruct a Capabilities Index score of 110.8 (likely range 105.3–115.8), ranking it #157 of 158 models Epoch has scored. Epoch AI benchmark results: GPQA Diamond 27.0%, OTIS Mock AIME 2024–2025 1.7%.
Is Llama-3.1-8B-Instruct open source?
Yes. Meta publishes the weights, so it can be downloaded and self-hosted.
What inputs does Llama-3.1-8B-Instruct support?
Llama-3.1-8B-Instruct accepts text and replies in text. It is not a dedicated reasoning model, supports tool calling.
When was Llama-3.1-8B-Instruct released?
Meta released Llama-3.1-8B-Instruct on Jul 23, 2024. Its training data runs to Dec 2023.
What are the best alternatives to Llama-3.1-8B-Instruct?
The closest current models from other labs on capability, price and release date are Mistral Nemo (Mistral AI, ECI 113.8, $0.09 / $0.109), Gemma 3 4B IT (Google, $0.05 / $0.10), Qwen2.5 7B Instruct (Alibaba (Qwen), $0.075 / $0.15) and Nova Micro (Amazon, $0.035 / $0.14).