Qwen2.5 7B Instruct
Summary
Qwen2.5 7B Instruct is an open-weight language model from Alibaba (Qwen), released on Sept 2024. It accepts text and generates text, with a 131K-token context window and up to 8K output tokens per response. Alibaba (Qwen) has deprecated this model.
Qwen instruction model for multilingual chat, reasoning, and tool use
Last verified 18 Nov 2026. Every figure on this page links to its source.
Specifications
| Developer | Alibaba (Qwen) |
|---|---|
| Release date | Sept 2024 [models.dev] |
| Status | Deprecated [models.dev] |
| Weights | Open weights [Hugging Face] |
| License | apache-2.0 [Hugging Face] |
| Parameters | 7.6B [Hugging Face] |
| Context window | 131K (131,072 tokens) [models.dev] |
| Max output | 8K tokens [models.dev] |
| Knowledge cutoff | Apr 2024 [models.dev] |
| Input | Text [models.dev] |
| Output | Text [models.dev] |
| Reasoning mode | No [models.dev] |
| Tool calling | Yes [models.dev] |
| Hugging Face | Qwen/Qwen2.5-7B-Instruct [Hugging Face] |
Qwen2.5 7B Instruct API pricing by provider
USD per million tokens. Sorted by input price.
We do not currently track a paid API listing for this model.
Running Qwen2.5 7B Instruct locally
Estimated memory, from the parameter count and the architecture in config.json on Hugging Face. Includes about 0.8 GB of runtime overhead.
| Quantization | Weights | Total, 8K context | Total, 32K context |
|---|---|---|---|
| Q4_K_M (4-bit) | 4.6 GB | 5.9 GB | 7.3 GB |
| Q8_0 (8-bit) | 8.1 GB | 9.4 GB | 11 GB |
| FP16 / BF16 (16-bit) | 15 GB | 17 GB | 18 GB |
At 4-bit with an 8K conversation, Qwen2.5 7B Instruct needs about 5.9 GB, so it fits on a graphics card with 8 GB or more, such as the NVIDIA GeForce RTX 4060 8 GB. Check your own hardware, or see Running local LLMs on an 8 GB GPU on our sister site AIPCs.
Frequently asked questions
What is the context window of Qwen2.5 7B Instruct?
Qwen2.5 7B Instruct has a context window of 131,072 tokens (131K) and can generate up to 8,192 tokens in a single response, according to models.dev.
Is Qwen2.5 7B Instruct open source?
Qwen2.5 7B Instruct is an open-weight model: its weights are published on Hugging Face as Qwen/Qwen2.5-7B-Instruct under the apache-2.0 license. Check the license terms before commercial use.
When was Qwen2.5 7B Instruct released?
Alibaba (Qwen) released Qwen2.5 7B Instruct on Sept 2024, according to models.dev.
How much VRAM does Qwen2.5 7B Instruct need?
About 5.9 GB at 4-bit (Q4_K_M) with an 8K-token conversation, and about 9.4 GB at 8-bit. The 4-bit model fits on a graphics card with 8 GB or more, such as the NVIDIA GeForce RTX 4060 8 GB. These are estimates from the model's published parameter count and architecture.
Similar models from other labs
Comparable on output type, weights, release date, price and context window. Prices are the lowest listed, USD per million tokens.
| Model | Lab | Released | Context | Input $/1M | Output $/1M | Weights |
|---|---|---|---|---|---|---|
| Llama 3.1 Euryale 70B v2.2 | Sao10k | 28 Aug 2024 | 131K | $0.85 | $0.85 | Open |
| Llama 3.1 Euryale 70B v2.2 | Sao10k | 28 Aug 2024 | 131K | – | – | Open |
| Command R | Cohere | 30 Aug 2024 | 128K | $0.15 | $0.60 | Open |
| Command R+ | Cohere | 30 Aug 2024 | 128K | $2.50 | $10 | Open |
| Hermes 3 70B Instruct | Nousresearch | 18 Aug 2024 | 131K | – | – | Open |
| Hermes 3 70B Instruct (Deep Infra) | Nousresearch | 18 Aug 2024 | 131K | – | – | Open |
Change history
- No longer listed on openrouter
- Status changed from active to deprecated
- No longer listed on alibaba