Is Llama 3.1 8B Instruct available on FastMetal?

Not at the moment. GLM 5.3 Flash, from the same lab, is available on the FastMetal API today.

What is the context window of Llama 3.1 8B Instruct?

16,384 tokens, shared between the prompt and the response.

meta-llama/llama-3-1-8b-instruct

Not Available

Llama 3.1 8B Instruct

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. It has demonstrated strong performance compared to leading closed-source models in human evaluations. To read more about the model release, [click here](https://ai.meta.com/blog/meta-llama-3-1/). Usage of this model is subject to [Meta's Acceptable Use Policy](https://llama.meta.com/llama3/use-policy/).

7/23/2024

16,384 tokens

Specifications

Modalities

Input

text

Output

text

Supported Parameters

frequency_penalty

logit_bias

logprobs

max_tokens

min_p

presence_penalty

repetition_penalty

response_format

seed

stop

structured_outputs

temperature

tool_choice

tools

top_k

top_logprobs

top_p

Max Output Tokens

16,384

Frequently asked questions

Is Llama 3.1 8B Instruct available on FastMetal?: Not at the moment. GLM 5.3 Flash, from the same lab, is available on the FastMetal API today.
What is the context window of Llama 3.1 8B Instruct?: 16,384 tokens, shared between the prompt and the response.

Models you can use on FastMetal