Is Llama 3.3 70B Instruct (free) available on FastMetal?

Not at the moment. Llama 3.1 8B Instruct, from the same lab, is available on the FastMetal API today.

What is the context window of Llama 3.3 70B Instruct (free)?

128,000 tokens, shared between the prompt and the response.

Llama 3.3 70B Instruct (free)

The Meta Llama 3.3 multilingual large language model (LLM) is a pretrained and instruction tuned generative model in 70B (text in/text out). The Llama 3.3 instruction tuned text only model is optimized for multilingual dialogue use cases and outperforms many of the available open source and closed chat models on common industry benchmarks. Supported languages: English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai. [Model Card](https://github.com/meta-llama/llama-models/blob/main/models/llama3_3/MODEL_CARD.md)

12/6/2024

128,000 tokens

Specifications

Modalities

Input

text

Output

text

Supported Parameters

frequency_penalty

max_tokens

presence_penalty

seed

stop

temperature

tool_choice

tools

top_k

top_p

Max Output Tokens

128,000

Data policy

Prompt retention: Unknown — we could not confirm
Training: Unknown — not declared

"Unknown" does not mean "safe". It means we could not confirm it.

Whether a provider trains on prompts is a declared value from our terms with them. Retention is determined from the upstream listing for every host this model can reach. Neither is guessed.

Frequently asked questions

Is Llama 3.3 70B Instruct (free) available on FastMetal?: Not at the moment. Llama 3.1 8B Instruct, from the same lab, is available on the FastMetal API today.
What is the context window of Llama 3.3 70B Instruct (free)?: 128,000 tokens, shared between the prompt and the response.

Models you can use on FastMetal

Llama 3.1 8B Instruct

131,072 tokens

Llama 3.3 70B Instruct

131,072 tokens

Llama 4 Maverick

1,048,576 tokens

Llama 3.2 3B Instruct