ZMIME
Meta · Released Jul 23, 2024

Llama-3.1-8B-Instruct

Compact open Llama model for lightweight chat, drafting, and self-hosting.

  • Open weights
  • Tool calling
Capability
110.8ECI · #157 of 158
Input
$0.055per 1M tokens
Output
$0.078per 1M tokens
Context
128K4K max output
Pricing

What it costs

Input
$0.055per million tokens
Output
$0.078per million tokens
Blended (3:1)
$0.061cheaper than 95% of priced models

Typical monthly bills

Monthly usageEstimated cost
Side project2M input + 0.5M output tokens$0.149
Team assistant25M input + 5M output tokens$1.77
Production app250M input + 50M output tokens$17.66

Median of 18 paid API providers on models.dev.

Capability

Independent benchmarks

110.8Epoch Capabilities Index
#157 of 158 scored models
68Median 147174

The shaded band is Epoch AI’s confidence range (105.3–115.8); the tick marks the median scored model.

  • GPQA DiamondGraduate-level science questions27.0%
  • OTIS Mock AIME 2024–2025Competition mathematics1.7%

Scores from Epoch AI, run independently of Meta.

Specifications

The details

Lab
Meta
Released
Jul 23, 2024
Knowledge cutoff
Dec 2023
Context window
128,000 tokens
Max output
4,096 tokens
Inputs
Text
Output
Text
Reasoning
No
Tool calling
Yes
Structured output
No
Availability
19 API providerslisted on models.dev
Same lab

More from Meta

Questions

About Llama-3.1-8B-Instruct

How much does Llama-3.1-8B-Instruct cost?

Llama-3.1-8B-Instruct costs $0.055 input / $0.078 output per million tokens (median across 18 API providers). At a 3:1 input-to-output mix that is $0.061 per million tokens, cheaper than 95% of the 469 priced models we track.

What is the context window of Llama-3.1-8B-Instruct?

Llama-3.1-8B-Instruct accepts up to 128,000 tokens per request and can write up to 4,096 tokens in one response.

How good is Llama-3.1-8B-Instruct?

Epoch AI gives Llama-3.1-8B-Instruct a Capabilities Index score of 110.8 (likely range 105.3–115.8), ranking it #157 of 158 models Epoch has scored. Epoch AI benchmark results: GPQA Diamond 27.0%, OTIS Mock AIME 2024–2025 1.7%.

Is Llama-3.1-8B-Instruct open source?

Yes. Meta publishes the weights, so it can be downloaded and self-hosted.

What inputs does Llama-3.1-8B-Instruct support?

Llama-3.1-8B-Instruct accepts text and replies in text. It is not a dedicated reasoning model, supports tool calling.

When was Llama-3.1-8B-Instruct released?

Meta released Llama-3.1-8B-Instruct on Jul 23, 2024. Its training data runs to Dec 2023.

What are the best alternatives to Llama-3.1-8B-Instruct?

The closest current models from other labs on capability, price and release date are Mistral Nemo (Mistral AI, ECI 113.8, $0.09 / $0.109), Gemma 3 4B IT (Google, $0.05 / $0.10), Qwen2.5 7B Instruct (Alibaba (Qwen), $0.075 / $0.15) and Nova Micro (Amazon, $0.035 / $0.14).