Nemotron 3.5 Lightning 30B
Summary
Nemotron 3.5 Lightning 30B is an open-weight language model from NVIDIA, released on 11 Aug 2026. It accepts text and generates text, with a 262K-token context window and up to 131K output tokens per response. As of 18 Nov 2026, the lowest listed API price is $0.06 per million input tokens and $0.16 per million output tokens (Vercel AI Gateway), across 4 providers we track.
Nemotron model for efficient reasoning, coding, and specialized AI agents
Last verified 18 Nov 2026. Every figure on this page links to its source.
Specifications
| Developer | NVIDIA |
|---|---|
| Release date | 11 Aug 2026 [models.dev] |
| Status | Generally available [models.dev] |
| Weights | Open weights [Hugging Face] |
| License | openmdw-1.1 [Hugging Face] |
| Parameters | 31.6B [Hugging Face] |
| Context window | 262K (262,144 tokens) [models.dev] |
| Max output | 131K tokens [models.dev] |
| Knowledge cutoff | Sept 2025 [models.dev] |
| Input | Text [models.dev] |
| Output | Text [models.dev] |
| Reasoning mode | Yes [models.dev] |
| Tool calling | Yes [models.dev] |
| Structured output | Yes [models.dev] |
| Hugging Face | nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 [Hugging Face] |
Nemotron 3.5 Lightning 30B API pricing by provider
USD per million tokens. Sorted by input price.
| Provider | Input | Output | Cached input | Context | Source |
|---|---|---|---|---|---|
| NVIDIA NIM nvidia/nemotron-3.5-lightning-30b-a3b | Free | Free | – | 262K | models.dev, 18 Nov 2026 |
| Vercel AI Gateway nvidia/nemotron-3.5-lightning-free | Free | Free | – | 1M | models.dev, 18 Nov 2026 |
| Nebius AI Studio nvidia/Nemotron-3_5-Lightning | $0.06 | $0.24 | $0.06 | 1M | models.dev, 18 Nov 2026 |
| Vercel AI Gateway nvidia/nemotron-3.5-lightning | $0.06 | $0.16 | $0.03 | 262K | models.dev, 18 Nov 2026 |
| OpenRouter nvidia/nemotron-3.5-lightning | $0.07 | $0.20 | $0.04 | 262K | OpenRouter, 18 Nov 2026 |
Running Nemotron 3.5 Lightning 30B locally
Estimated memory, from the parameter count and the architecture in config.json on Hugging Face. Includes about 0.8 GB of runtime overhead.
| Quantization | Weights | Total, 8K context | Total, 32K context |
|---|---|---|---|
| Q4_K_M (4-bit) | 19 GB | 20 GB | 22 GB |
| Q8_0 (8-bit) | 34 GB | 35 GB | 36 GB |
| FP16 / BF16 (16-bit) | 63 GB | 64 GB | 66 GB |
At 4-bit with an 8K conversation, Nemotron 3.5 Lightning 30B needs about 20 GB, so it fits on a graphics card with 24 GB or more, such as the NVIDIA GeForce RTX 3090 24 GB. Check your own hardware, or see Best GPU for local LLMs on our sister site AIPCs.
Frequently asked questions
What is the context window of Nemotron 3.5 Lightning 30B?
Nemotron 3.5 Lightning 30B has a context window of 262,144 tokens (262K) and can generate up to 131,072 tokens in a single response, according to models.dev.
How much does the Nemotron 3.5 Lightning 30B API cost?
Nemotron 3.5 Lightning 30B is listed from $0.06 per million input tokens and $0.16 per million output tokens (Vercel AI Gateway). Prices last verified 18 Nov 2026.
Is Nemotron 3.5 Lightning 30B open source?
Nemotron 3.5 Lightning 30B is an open-weight model: its weights are published on Hugging Face as nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 under the openmdw-1.1 license. Check the license terms before commercial use.
When was Nemotron 3.5 Lightning 30B released?
NVIDIA released Nemotron 3.5 Lightning 30B on 11 Aug 2026, according to models.dev.
Which providers offer Nemotron 3.5 Lightning 30B?
We track Nemotron 3.5 Lightning 30B on 4 providers: NVIDIA NIM, Vercel AI Gateway, Nebius AI Studio, OpenRouter.
How much VRAM does Nemotron 3.5 Lightning 30B need?
About 20 GB at 4-bit (Q4_K_M) with an 8K-token conversation, and about 35 GB at 8-bit. The 4-bit model fits on a graphics card with 24 GB or more, such as the NVIDIA GeForce RTX 3090 24 GB. These are estimates from the model's published parameter count and architecture.
Similar models from other labs
Comparable on output type, weights, release date, price and context window. Prices are the lowest listed, USD per million tokens.
| Model | Lab | Released | Context | Input $/1M | Output $/1M | Weights |
|---|---|---|---|---|---|---|
| Ling 3.0 Flash VL | Inclusionai | 10 Sept 2026 | 256K | $0.06 | $0.18 | Open |
| Ling 3.0 Flash Fin | Inclusionai | 27 Aug 2026 | 256K | $0.07 | $0.22 | Open |
| Ternary Bonsai 2 9B | Prism ML | 16 Oct 2026 | 262K | $0.08 | $0.13 | Open |
| Nex-N2.5-Pro | NEX AGI | 8 Sept 2026 | 262K | $0.07 | $0.25 | Open |
| Nex-N2.5-Mini | NEX AGI | 8 Sept 2026 | 262K | $0.03 | $0.10 | Open |
| LFM3-1.7B | Liquid | 6 Nov 2026 | 262K | $0.08 | $0.20 | Open |
Change history
- Max output changed from 262K to 131K
- Name changed from Nemotron 3.5 Lightning 30B A3B to Nemotron 3.5 Lightning 30B
- Max output changed from 236K to 262K
- Max output changed from 262K to 236K
- Max output changed from 1M to 262K
- Context window changed from 1M to 262K
- Max output changed from 262K to 1M
- Context window changed from 262K to 1M
- Max output changed from 131K to 262K
- Name changed from Nemotron 3.5 Lightning 30B to Nemotron 3.5 Lightning 30B A3B
- Max output changed from 1M to 131K
- Context window changed from 1M to 262K
- Name changed from Nemotron 3.5 Lightning 30B A3B to Nemotron 3.5 Lightning 30B
- Name changed from Nemotron 3.5 Lightning 30B to Nemotron 3.5 Lightning 30B A3B
- Context window changed from 262K to 1M
- Max output changed from 131K to 1M
- Max output changed from 1M to 131K
- Name changed from Nemotron 3.5 Lightning 30B A3B to Nemotron 3.5 Lightning 30B
- Context window changed from 1M to 262K
- Context window changed from 262K to 1M
- Max output changed from 262K to 1M
- Max output changed from 236K to 262K
- Vercel AI Gateway price changed: input $0.05 → $0.06, output $0.20 → $0.16 per 1M tokens
- Max output changed from 1M to 236K
- Context window changed from 1M to 262K
Sources
- https://openrouter.ai/nvidia/nemotron-3.5-lightning
- https://github.com/sst/models.dev/blob/dev/providers/vercel/models/nvidia/nemotron-3.5-lightning.toml
- https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16
- https://github.com/sst/models.dev/blob/dev/providers/nvidia/models/nvidia/nemotron-3.5-lightning-30b-a3b.toml
- https://github.com/sst/models.dev/blob/dev/providers/vercel/models/nvidia/nemotron-3.5-lightning-free.toml
- https://github.com/sst/models.dev/blob/dev/providers/nebius/models/nvidia/Nemotron-3_5-Lightning.toml