Llama 3.1 8B Instruct fp8
Summary
Llama 3.1 8B Instruct fp8 is an open-weight language model from Meta, released on 23 Jul 2024. It accepts text and generates text, with a 32K-token context window and up to 32K output tokens per response. As of 4 Oct 2026, the lowest listed API price is $0.02 per million input tokens and $0.05 per million output tokens (Novita AI), across 5 providers we track.
Open Llama instruction model for multilingual chat, reasoning, and coding
Last verified 4 Oct 2026. Every figure on this page links to its source.
Specifications
| Developer | Meta |
|---|---|
| Release date | 23 Jul 2024 [models.dev] |
| Status | Generally available [models.dev] |
| Weights | Open weights [Hugging Face] |
| License | llama3.1 [Hugging Face] |
| Parameters | 8B [Hugging Face] |
| Context window | 32K (32,000 tokens) [models.dev] |
| Max output | 32K tokens [models.dev] |
| Knowledge cutoff | Dec 2023 [models.dev] |
| Input | Text [models.dev] |
| Output | Text [models.dev] |
| Reasoning mode | No [models.dev] |
| Tool calling | No [models.dev] |
| Structured output | No [models.dev] |
| Hugging Face | meta-llama/Meta-Llama-3.1-8B-Instruct [Hugging Face] |
Llama 3.1 8B Instruct fp8 API pricing by provider
USD per million tokens. Sorted by input price.
| Provider | Input | Output | Cached input | Context | Source |
|---|---|---|---|---|---|
| Novita AI meta-llama/llama-3.1-8b-instruct | $0.02 | $0.05 | – | 16K | models.dev, 4 Oct 2026 |
| OpenRouter meta-llama/llama-3.1-8b-instruct | $0.05 | $0.08 | $0.03 | 131K | OpenRouter, 4 Oct 2026 |
| Hugging Face Inference Providers meta-llama/Llama-3.1-8B-Instruct | $0.06 | $0.06 | – | 131K | models.dev, 4 Oct 2026 |
| Cloudflare Workers AI @cf/meta/llama-3.1-8b-instruct-fp8 | $0.15 | $0.29 | – | 32K | models.dev, 4 Oct 2026 |
| Amazon Bedrock us.meta.llama3-1-8b-instruct-v1:0 | $0.22 | $0.22 | – | 128K | models.dev, 4 Oct 2026 |
| Amazon Bedrock meta.llama3-1-8b-instruct-v1:0 | $0.22 | $0.22 | – | 128K | models.dev, 4 Oct 2026 |
Frequently asked questions
What is the context window of Llama 3.1 8B Instruct fp8?
Llama 3.1 8B Instruct fp8 has a context window of 32,000 tokens (32K) and can generate up to 32,000 tokens in a single response, according to models.dev.
How much does the Llama 3.1 8B Instruct fp8 API cost?
Llama 3.1 8B Instruct fp8 is listed from $0.02 per million input tokens and $0.05 per million output tokens (Novita AI). Prices last verified 4 Oct 2026.
Is Llama 3.1 8B Instruct fp8 open source?
Llama 3.1 8B Instruct fp8 is an open-weight model: its weights are published on Hugging Face as meta-llama/Meta-Llama-3.1-8B-Instruct under the llama3.1 license. Check the license terms before commercial use.
When was Llama 3.1 8B Instruct fp8 released?
Meta released Llama 3.1 8B Instruct fp8 on 23 Jul 2024, according to models.dev.
Which providers offer Llama 3.1 8B Instruct fp8?
We track Llama 3.1 8B Instruct fp8 on 5 providers: Novita AI, OpenRouter, Hugging Face Inference Providers, Cloudflare Workers AI, Amazon Bedrock.
Change history
No changes detected since we started tracking this model. We re-check every source daily.
Sources
- https://openrouter.ai/meta-llama/llama-3.1-8b-instruct
- https://github.com/sst/models.dev/blob/dev/providers/cloudflare-workers-ai/models/@cf/meta/llama-3.1-8b-instruct-fp8.toml
- https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct
- https://github.com/sst/models.dev/blob/dev/providers/novita-ai/models/meta-llama/llama-3.1-8b-instruct.toml
- https://github.com/sst/models.dev/blob/dev/providers/huggingface/models/meta-llama/Llama-3.1-8B-Instruct.toml
- https://github.com/sst/models.dev/blob/dev/providers/amazon-bedrock/models/us.meta.llama3-1-8b-instruct-v1:0.toml
- https://github.com/sst/models.dev/blob/dev/providers/amazon-bedrock/models/meta.llama3-1-8b-instruct-v1:0.toml