Meta · Released Jul 23, 2024Llama-3.1-8B-Instruct
Compact open Llama model for lightweight chat, drafting, and self-hosting.
- Capability
- 116.6ECI · #145 of 148
- Input
- $0.152per 1M tokens
- Output
- $0.167per 1M tokens
- Context
- 128K4K max output
What it costs
- Input
- $0.152per million tokens
- Output
- $0.167per million tokens
- Blended (3:1)
- $0.156cheaper than 83% of priced models
Typical monthly bills
| Monthly usage | Estimated cost |
|---|---|
| Side project2M input + 0.5M output tokens | $0.388 |
| Team assistant25M input + 5M output tokens | $4.63 |
| Production app250M input + 50M output tokens | $46.35 |
Median of 9 paid API providers on models.dev.
Independent benchmarks
#145 of 148 scored models
The shaded band is Epoch AI’s confidence range (106.3–121.6); the tick marks the median scored model.
Scores from Epoch AI, run independently of Meta.
The details
- Lab
- Meta
- Released
- Jul 23, 2024
- Knowledge cutoff
- Dec 2023
- Context window
- 128,000 tokens
- Max output
- 4,096 tokens
- Inputs
- Text
- Output
- Text
- Reasoning
- No
- Tool calling
- Yes
- Structured output
- No
- Weights
- Open weights
- Availability
- 9 API providerslisted on models.dev
More from Meta
About Llama-3.1-8B-Instruct
How much does Llama-3.1-8B-Instruct cost?
Llama-3.1-8B-Instruct costs $0.152 input / $0.167 output per million tokens (median across 9 API providers). At a 3:1 input-to-output mix that is $0.156 per million tokens, cheaper than 83% of the 360 priced models we track.
What is the context window of Llama-3.1-8B-Instruct?
Llama-3.1-8B-Instruct accepts up to 128,000 tokens per request and can write up to 4,096 tokens in one response.
How good is Llama-3.1-8B-Instruct?
Epoch AI gives Llama-3.1-8B-Instruct a Capabilities Index score of 116.6 (likely range 106.3–121.6), ranking it #145 of 148 models Epoch has scored. Epoch AI benchmark results: GPQA Diamond 27.0%, OTIS Mock AIME 2024–2025 1.7%.
Is Llama-3.1-8B-Instruct open source?
Yes. Meta publishes the weights, so it can be downloaded and self-hosted.
What inputs does Llama-3.1-8B-Instruct support?
Llama-3.1-8B-Instruct accepts text and replies in text. It is not a dedicated reasoning model, supports tool calling.
When was Llama-3.1-8B-Instruct released?
Meta released Llama-3.1-8B-Instruct on Jul 23, 2024. Its training data runs to Dec 2023.
What are the best alternatives to Llama-3.1-8B-Instruct?
The closest current models from other labs on capability, price and release date are Ministral 8B Instruct (Mistral AI, $0.15 / $0.15), Qwen2.5 7B Instruct (Alibaba (Qwen), ECI 118.5, $0.175 / $0.70), Gemma 3 4B IT (Google, ECI 116.1, $0.05 / $0.10) and Claude Haiku 3 (Anthropic, ECI 118.4, $0.25 / $1.25).