Is Llama 3 8B Instruct available on FastMetal?

Not at the moment. GLM 5.3 Flash, from the same lab, is available on the FastMetal API today.

What is the context window of Llama 3 8B Instruct?

8,192 tokens, shared between the prompt and the response.

How does Llama 3 8B Instruct rank?

#251 on the public arena's Japanese board (ELO 1,036). Ranks move as the leaderboard is updated.

Back to Models

meta-llama/llama-3-8b-instruct

Not Available

Llama 3 8B Instruct

Meta's latest class of model (Llama 3) launched with a variety of sizes & flavors. This 8B instruct-tuned version was optimized for high quality dialogue usecases. It has demonstrated strong performance compared to leading closed-source models in human evaluations. To read more about the model release, [click here](https://ai.meta.com/blog/meta-llama-3/). Usage of this model is subject to [Meta's Acceptable Use Policy](https://llama.meta.com/llama3/use-policy/).

4/18/2024

8,192 tokens

#250 Text (Korean)

Specifications

Modalities

Input

text

Output

text

Supported Parameters

frequency_penalty

logit_bias

max_tokens

min_p

presence_penalty

repetition_penalty

response_format

seed

stop

temperature

tool_choice

tools

top_k

top_p

Max Output Tokens

16,384

Frequently asked questions

Is Llama 3 8B Instruct available on FastMetal?: Not at the moment. GLM 5.3 Flash, from the same lab, is available on the FastMetal API today.
What is the context window of Llama 3 8B Instruct?: 8,192 tokens, shared between the prompt and the response.
How does Llama 3 8B Instruct rank?: #251 on the public arena's Japanese board (ELO 1,036). Ranks move as the leaderboard is updated.