Gemma 3 12B IT
Summary
Gemma 3 12B IT is an open-weight language model from Google DeepMind, released on 12 Mar 2025. It accepts text and images and generates text, with a 131K-token context window and up to 131K output tokens per response. As of 18 Nov 2026, the lowest listed API price is $0.05 per million input tokens and $0.10 per million output tokens (Novita AI), across 4 providers we track.
Open Gemma instruction model for efficient chat and self-hosted deployments
Last verified 18 Nov 2026. Every figure on this page links to its source.
Specifications
| Developer | Google DeepMind |
|---|---|
| Release date | 12 Mar 2025 [models.dev] |
| Status | Generally available [models.dev] |
| Weights | Open weights [Hugging Face] |
| License | gemma [Hugging Face] |
| Parameters | 12.2B [Hugging Face] |
| Context window | 131K (131,072 tokens) [models.dev] |
| Max output | 131K tokens [models.dev] |
| Knowledge cutoff | Aug 2024 [models.dev] |
| Input | Text and images [models.dev] |
| Output | Text [models.dev] |
| Reasoning mode | No [models.dev] |
| Tool calling | Yes [models.dev] |
| Structured output | Yes [models.dev] |
| Hugging Face | google/gemma-3-12b-it [Hugging Face] |
Gemma 3 12B IT API pricing by provider
USD per million tokens. Sorted by input price.
| Provider | Input | Output | Cached input | Context | Source |
|---|---|---|---|---|---|
| DeepInfra google/gemma-3-12b-it | $0.05 | $0.15 | – | 131K | models.dev, 18 Nov 2026 |
| Hugging Face Inference Providers google/gemma-3-12b-it | $0.05 | $0.15 | – | 131K | models.dev, 18 Nov 2026 |
| Novita AI google/gemma-3-12b-it | $0.05 | $0.10 | – | 131K | models.dev, 18 Nov 2026 |
| OpenRouter google/gemma-3-12b-it | $0.05 | $0.15 | – | 131K | OpenRouter, 18 Nov 2026 |
Running Gemma 3 12B IT locally
Estimated memory, from the parameter count on Hugging Face. Includes about 0.8 GB of runtime overhead.
| Quantization | Weights | Total, 8K context | Total, 32K context |
|---|---|---|---|
| Q4_K_M (4-bit) | 7.4 GB | 8.2 GB | – |
| Q8_0 (8-bit) | 13 GB | 14 GB | – |
| FP16 / BF16 (16-bit) | 24 GB | 25 GB | – |
At 4-bit with an 8K conversation, Gemma 3 12B IT needs about 8.2 GB, so it fits on a graphics card with 10 GB or more, such as the NVIDIA GeForce RTX 3080 10 GB. The model's architecture is not public, so the conversation cache is not included. Check your own hardware, or see Best GPU for local LLMs on our sister site AIPCs.
Frequently asked questions
What is the context window of Gemma 3 12B IT?
Gemma 3 12B IT has a context window of 131,072 tokens (131K) and can generate up to 131,072 tokens in a single response, according to models.dev.
How much does the Gemma 3 12B IT API cost?
Gemma 3 12B IT is listed from $0.05 per million input tokens and $0.10 per million output tokens (Novita AI). Prices last verified 18 Nov 2026.
Is Gemma 3 12B IT open source?
Gemma 3 12B IT is an open-weight model: its weights are published on Hugging Face as google/gemma-3-12b-it under the gemma license. Check the license terms before commercial use.
When was Gemma 3 12B IT released?
Google DeepMind released Gemma 3 12B IT on 12 Mar 2025, according to models.dev.
Which providers offer Gemma 3 12B IT?
We track Gemma 3 12B IT on 4 providers: DeepInfra, Hugging Face Inference Providers, Novita AI, OpenRouter.
How much VRAM does Gemma 3 12B IT need?
About 8.2 GB at 4-bit (Q4_K_M) with an 8K-token conversation, and about 14 GB at 8-bit. The 4-bit model fits on a graphics card with 10 GB or more, such as the NVIDIA GeForce RTX 3080 10 GB. These are estimates from the model's published parameter count.
Similar models from other labs
Comparable on output type, weights, release date, price and context window. Prices are the lowest listed, USD per million tokens.
| Model | Lab | Released | Context | Input $/1M | Output $/1M | Weights |
|---|---|---|---|---|---|---|
| Command R7B Arabic | Cohere | 27 Feb 2025 | 128K | $0.04 | $0.15 | Open |
| DeepSeek R1 0528 Qwen3 8B | DeepSeek | 29 May 2025 | 128K | $0.06 | $0.09 | Open |
| Command R7B | Cohere | 13 Dec 2024 | 128K | $0.04 | $0.15 | Open |
| Mistral Small 3.1 24B | Mistral AI | 17 Mar 2025 | 128K | $0.10 | $0.30 | Open |
| Baichuan M2 32B | Baichuan | 13 Aug 2025 | 131K | $0.07 | $0.07 | Open |
| Llama-4-Scout-17B-16E-Instruct-FP8 | Meta | 5 Apr 2025 | 128K | $0.10 | $0.30 | Open |
Change history
- Tool calling changed from no to yes
- Max output changed from 8K to 131K
- Tool calling changed from yes to no
- Max output changed from 131K to 8K
- Max output changed from 16K to 131K
- Max output changed from 8K to 16K
- Tool calling changed from no to yes
- Max output changed from 131K to 8K
- Tool calling changed from yes to no
- Max output changed from 16K to 131K
- Max output changed from 131K to 16K
- Max output changed from 16K to 131K
- Tool calling changed from no to yes
- Max output changed from 8K to 16K
- Tool calling changed from yes to no
- Max output changed from 131K to 8K
- Max output changed from 16K to 131K
- Tool calling changed from no to yes
- Max output changed from 8K to 16K
- Tool calling changed from yes to no
- Max output changed from 131K to 8K
- Max output changed from 8K to 131K
- Tool calling changed from no to yes
- Max output changed from 131K to 8K
- No longer listed on nvidia
Sources
- https://openrouter.ai/google/gemma-3-12b-it
- https://github.com/sst/models.dev/blob/dev/providers/huggingface/models/google/gemma-3-12b-it.toml
- https://huggingface.co/google/gemma-3-12b-it
- https://github.com/sst/models.dev/blob/dev/providers/deepinfra/models/google/gemma-3-12b-it.toml
- https://github.com/sst/models.dev/blob/dev/providers/novita-ai/models/google/gemma-3-12b-it.toml