Alibaba (Qwen)

Qwen2.5 7B Instruct

DeprecatedOpen weights131K context

Summary

Qwen2.5 7B Instruct is an open-weight language model from Alibaba (Qwen), released on Sept 2024. It accepts text and generates text, with a 131K-token context window and up to 8K output tokens per response. Alibaba (Qwen) has deprecated this model.

Qwen instruction model for multilingual chat, reasoning, and tool use

Last verified 18 Nov 2026. Every figure on this page links to its source.

Specifications

DeveloperAlibaba (Qwen)
Release dateSept 2024 [models.dev]
StatusDeprecated [models.dev]
WeightsOpen weights [Hugging Face]
Licenseapache-2.0 [Hugging Face]
Parameters7.6B [Hugging Face]
Context window131K (131,072 tokens) [models.dev]
Max output8K tokens [models.dev]
Knowledge cutoffApr 2024 [models.dev]
InputText [models.dev]
OutputText [models.dev]
Reasoning modeNo [models.dev]
Tool callingYes [models.dev]
Hugging FaceQwen/Qwen2.5-7B-Instruct [Hugging Face]

Qwen2.5 7B Instruct API pricing by provider

USD per million tokens. Sorted by input price.

We do not currently track a paid API listing for this model.

Running Qwen2.5 7B Instruct locally

Estimated memory, from the parameter count and the architecture in config.json on Hugging Face. Includes about 0.8 GB of runtime overhead.

QuantizationWeightsTotal, 8K contextTotal, 32K context
Q4_K_M (4-bit)4.6 GB5.9 GB7.3 GB
Q8_0 (8-bit)8.1 GB9.4 GB11 GB
FP16 / BF16 (16-bit)15 GB17 GB18 GB

At 4-bit with an 8K conversation, Qwen2.5 7B Instruct needs about 5.9 GB, so it fits on a graphics card with 8 GB or more, such as the NVIDIA GeForce RTX 4060 8 GB. Check your own hardware, or see Running local LLMs on an 8 GB GPU on our sister site AIPCs.

Frequently asked questions

What is the context window of Qwen2.5 7B Instruct?

Qwen2.5 7B Instruct has a context window of 131,072 tokens (131K) and can generate up to 8,192 tokens in a single response, according to models.dev.

Is Qwen2.5 7B Instruct open source?

Qwen2.5 7B Instruct is an open-weight model: its weights are published on Hugging Face as Qwen/Qwen2.5-7B-Instruct under the apache-2.0 license. Check the license terms before commercial use.

When was Qwen2.5 7B Instruct released?

Alibaba (Qwen) released Qwen2.5 7B Instruct on Sept 2024, according to models.dev.

How much VRAM does Qwen2.5 7B Instruct need?

About 5.9 GB at 4-bit (Q4_K_M) with an 8K-token conversation, and about 9.4 GB at 8-bit. The 4-bit model fits on a graphics card with 8 GB or more, such as the NVIDIA GeForce RTX 4060 8 GB. These are estimates from the model's published parameter count and architecture.

Similar models from other labs

Comparable on output type, weights, release date, price and context window. Prices are the lowest listed, USD per million tokens.

ModelLabReleasedContextInput $/1MOutput $/1MWeights
Llama 3.1 Euryale 70B v2.2Sao10k28 Aug 2024131K$0.85$0.85Open
Llama 3.1 Euryale 70B v2.2Sao10k28 Aug 2024131K––Open
Command RCohere30 Aug 2024128K$0.15$0.60Open
Command R+Cohere30 Aug 2024128K$2.50$10Open
Hermes 3 70B InstructNousresearch18 Aug 2024131K––Open
Hermes 3 70B Instruct (Deep Infra)Nousresearch18 Aug 2024131K––Open

Change history

  • No longer listed on openrouter
  • Status changed from active to deprecated
  • No longer listed on alibaba

Sources