Back to Models
nvidia/llama-3-1-nemotron-70b-instruct
Not Available
Llama 3.1 Nemotron 70B Instruct
NVIDIA's Llama 3.1 Nemotron 70B is a language model designed for generating precise and useful responses. Leveraging [Llama 3.1 70B](/models/meta-llama/llama-3.1-70b-instruct) architecture and Reinforcement Learning from Human Feedback (RLHF), it excels in automatic alignment benchmarks. This model is tailored for applications requiring high accuracy in helpfulness and response generation, suitable for diverse user queries across multiple domains. Usage of this model is subject to [Meta's Acceptable Use Policy](https://www.llama.com/llama3/use-policy/).
10/15/2024
131,072 tokens
Specifications
Modalities
Input
text
Output
text
Supported Parameters
frequency_penalty
max_tokens
min_p
presence_penalty
repetition_penalty
response_format
seed
stop
temperature
tool_choice
tools
top_k
top_p
Max Output Tokens
16,384Frequently asked questions
- Is Llama 3.1 Nemotron 70B Instruct available on FastMetal?
- Not at the moment. GLM 5.3 Flash, from the same lab, is available on the FastMetal API today.
- What is the context window of Llama 3.1 Nemotron 70B Instruct?
- 131,072 tokens, shared between the prompt and the response.