Is Llama 3 70B Instruct available on FastMetal?

Not at the moment. GLM 5.3 Flash, from the same lab, is available on the FastMetal API today.

What is the context window of Llama 3 70B Instruct?

8,192 tokens, shared between the prompt and the response.

How does Llama 3 70B Instruct rank?

#240 on the public arena's Japanese board (ELO 1,083). Ranks move as the leaderboard is updated.

Back to Models

meta-llama/llama-3-70b-instruct

Not Available

Llama 3 70B Instruct

Meta's latest class of model (Llama 3) launched with a variety of sizes & flavors. This 70B instruct-tuned version was optimized for high quality dialogue usecases. It has demonstrated strong performance compared to leading closed-source models in human evaluations. To read more about the model release, [click here](https://ai.meta.com/blog/meta-llama-3/). Usage of this model is subject to [Meta's Acceptable Use Policy](https://llama.meta.com/llama3/use-policy/).

4/18/2024

8,192 tokens

#225 Text (french)

Specifications

Modalities

Input

text

Output

text

Supported Parameters

frequency_penalty

max_tokens

presence_penalty

repetition_penalty

response_format

seed

stop

structured_outputs

temperature

top_k

top_p

Max Output Tokens

8,000

Frequently asked questions

Is Llama 3 70B Instruct available on FastMetal?: Not at the moment. GLM 5.3 Flash, from the same lab, is available on the FastMetal API today.
What is the context window of Llama 3 70B Instruct?: 8,192 tokens, shared between the prompt and the response.
How does Llama 3 70B Instruct rank?: #240 on the public arena's Japanese board (ELO 1,083). Ranks move as the leaderboard is updated.