Back to Models
Llama 3.1 70B Instruct
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong performance compared to leading closed-source models in human evaluations. To read more about the model release, [click here](https://ai.meta.com/blog/meta-llama-3-1/). Usage of this model is subject to [Meta's Acceptable Use Policy](https://llama.meta.com/llama3/use-policy/).
7/23/2024
131,072 tokens
Specifications
Modalities
Input
text
Output
text
Supported Parameters
frequency_penalty
logit_bias
max_tokens
min_p
presence_penalty
repetition_penalty
response_format
seed
stop
temperature
tool_choice
tools
top_k
top_p
Data policy
- Prompt retention
- Unknown — we could not confirm
- Training
- Unknown — not declared
"Unknown" does not mean "safe". It means we could not confirm it.
Whether a provider trains on prompts is a declared value from our terms with them. Retention is determined from the upstream listing for every host this model can reach. Neither is guessed.
Frequently asked questions
- Is Llama 3.1 70B Instruct available on FastMetal?
- Not at the moment. Llama 3.1 8B Instruct, from the same lab, is available on the FastMetal API today.
- What is the context window of Llama 3.1 70B Instruct?
- 131,072 tokens, shared between the prompt and the response.