Llama 3.1 405B Instruct
The highly anticipated 400B class of Llama3 is here! Clocking in at 128k context with impressive eval scores, the Meta AI team continues to push the frontier of open-source LLMs. Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 405B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong performance compared to leading closed-source models including GPT-4o and Claude 3.5 Sonnet in evaluations. To read more about the model release, [click here](https://ai.meta.com/blog/meta-llama-3-1/). Usage of this model is subject to [Meta's Acceptable Use Policy](https://llama.meta.com/llama3/use-policy/).
Specifications
Modalities
Supported Parameters
Data policy
- Prompt retention
- Unknown — we could not confirm
- Training
- Unknown — not declared
"Unknown" does not mean "safe". It means we could not confirm it.
Whether a provider trains on prompts is a declared value from our terms with them. Retention is determined from the upstream listing for every host this model can reach. Neither is guessed.
Frequently asked questions
- Is Llama 3.1 405B Instruct available on FastMetal?
- Not at the moment. Llama 3.1 8B Instruct, from the same lab, is available on the FastMetal API today.
- What is the context window of Llama 3.1 405B Instruct?
- 131,000 tokens, shared between the prompt and the response.