Nousresearch

Hermes 3 405B Instruct

Generally availableOpen weights131K context

Summary

Hermes 3 405B Instruct is an open-weight language model from Nousresearch, released on 16 Aug 2024. It accepts text and generates text, with a 131K-token context window and up to 16K output tokens per response.

Hermes 3 is a generalist language model with many improvements over Hermes 2, including advanced agentic capabilities, much better roleplaying, reasoning, multi-turn conversation, long context coherence, and improvements across the...

Last verified 19 Nov 2026. Every figure on this page links to its source.

Specifications

DeveloperNousresearch
Release date16 Aug 2024 [OpenRouter]
StatusGenerally available
WeightsOpen weights [Hugging Face]
Licensellama3 [Hugging Face]
Parameters406B [Hugging Face]
Context window131K (131,072 tokens) [OpenRouter]
Max output16K tokens [OpenRouter]
Knowledge cutoff31 Dec 2023 [OpenRouter]
InputText [OpenRouter]
OutputText [OpenRouter]
Reasoning modeNo [OpenRouter]
Tool callingNo [OpenRouter]
Structured outputYes [OpenRouter]
Hugging FaceNousResearch/Hermes-3-Llama-3.1-405B [Hugging Face]

Hermes 3 405B Instruct API pricing by provider

USD per million tokens. Sorted by input price.

We do not currently track a paid API listing for this model.

Running Hermes 3 405B Instruct locally

Estimated memory, from the parameter count and the architecture in config.json on Hugging Face. Includes about 0.8 GB of runtime overhead.

QuantizationWeightsTotal, 8K contextTotal, 32K context
Q4_K_M (4-bit)246 GB251 GB264 GB
Q8_0 (8-bit)431 GB436 GB449 GB
FP16 / BF16 (16-bit)812 GB817 GB829 GB

At 4-bit with an 8K conversation, Hermes 3 405B Instruct needs about 251 GB, more than any single consumer graphics card; it needs a unified-memory machine, a multi-GPU setup or a split between graphics card and system RAM. Check your own hardware, or see Best computer for local AI on our sister site AIPCs.

Frequently asked questions

What is the context window of Hermes 3 405B Instruct?

Hermes 3 405B Instruct has a context window of 131,072 tokens (131K) and can generate up to 16,384 tokens in a single response, according to OpenRouter.

Is Hermes 3 405B Instruct open source?

Hermes 3 405B Instruct is an open-weight model: its weights are published on Hugging Face as NousResearch/Hermes-3-Llama-3.1-405B under the llama3 license. Check the license terms before commercial use.

When was Hermes 3 405B Instruct released?

Nousresearch released Hermes 3 405B Instruct on 16 Aug 2024, according to OpenRouter.

How much VRAM does Hermes 3 405B Instruct need?

About 251 GB at 4-bit (Q4_K_M) with an 8K-token conversation, and about 436 GB at 8-bit. That is more than any single consumer graphics card holds. These are estimates from the model's published parameter count and architecture.

Similar models from other labs

Comparable on output type, weights, release date, price and context window. Prices are the lowest listed, USD per million tokens.

ModelLabReleasedContextInput $/1MOutput $/1MWeights
Llama 3.1 Euryale 70B v2.2Sao10k28 Aug 2024131K$0.85$0.85Open
Llama 3.1 Euryale 70B v2.2Sao10k28 Aug 2024131K––Open
Command RCohere30 Aug 2024128K$0.15$0.60Open
Command R+Cohere30 Aug 2024128K$2.50$10Open
Llama Guard 3 8BMeta23 Jul 2024131K$0.48$0.03Open
Llama-3.1-70B-InstructMeta23 Jul 2024131K$0.72$0.72Open

Change history

  • No longer listed on openrouter

Sources