Is Llama 3.1 Nemotron 70B Instruct available on FastMetal?

Not at the moment. Nemotron 3 Super, from the same lab, is available on the FastMetal API today.

What is the context window of Llama 3.1 Nemotron 70B Instruct?

131,072 tokens, shared between the prompt and the response.

Back to Models

NVIDIA

nvidia/llama-3-1-nemotron-70b-instruct

Not Available

Llama 3.1 Nemotron 70B Instruct

NVIDIA's Llama 3.1 Nemotron 70B is a language model designed for generating precise and useful responses. Leveraging [Llama 3.1 70B](/models/meta-llama/llama-3.1-70b-instruct) architecture and Reinforcement Learning from Human Feedback (RLHF), it excels in automatic alignment benchmarks. This model is tailored for applications requiring high accuracy in helpfulness and response generation, suitable for diverse user queries across multiple domains. Usage of this model is subject to [Meta's Acceptable Use Policy](https://www.llama.com/llama3/use-policy/).

10/15/2024

131,072 tokens

Specifications

Modalities

Input

text

Output

text

Supported Parameters

frequency_penalty

max_tokens

min_p

presence_penalty

repetition_penalty

response_format

seed

stop

temperature

tool_choice

tools

top_k

top_p

Max Output Tokens

16,384

Data policy

Prompt retention: Unknown — we could not confirm
Training: Unknown — not declared

"Unknown" does not mean "safe". It means we could not confirm it.

Whether a provider trains on prompts is a declared value from our terms with them. Retention is determined from the upstream listing for every host this model can reach. Neither is guessed.

Frequently asked questions

Is Llama 3.1 Nemotron 70B Instruct available on FastMetal?: Not at the moment. Nemotron 3 Super, from the same lab, is available on the FastMetal API today.
What is the context window of Llama 3.1 Nemotron 70B Instruct?: 131,072 tokens, shared between the prompt and the response.

Models you can use on FastMetal

Nemotron 3 Super

262,144 tokens

Nemotron 3.5 Super VL