Is Mixtral 8x22B Instruct available on FastMetal?

Not at the moment. Voxtral Mini 3B, from the same lab, is available on the FastMetal API today.

What is the context window of Mixtral 8x22B Instruct?

65,536 tokens, shared between the prompt and the response.

How does Mixtral 8x22B Instruct rank?

#236 on the public arena's Japanese board (ELO 1,109). Ranks move as the leaderboard is updated.

Back to Models

mistralai/mixtral-8x22b-instruct

Not Available

Mixtral 8x22B Instruct

Mistral's official instruct fine-tuned version of [Mixtral 8x22B](/models/mistralai/mixtral-8x22b). It uses 39B active parameters out of 141B, offering unparalleled cost efficiency for its size. Its strengths include: - strong math, coding, and reasoning - large context length (64k) - fluency in English, French, Italian, German, and Spanish See benchmarks on the launch announcement [here](https://mistral.ai/news/mixtral-8x22b/). #moe

4/17/2024

65,536 tokens

#236 Text (Japanese)

Specifications

Modalities

Input

text

Output

text

Supported Parameters

frequency_penalty

max_tokens

presence_penalty

response_format

seed

stop

structured_outputs

temperature

tool_choice

tools

top_p

Frequently asked questions

Is Mixtral 8x22B Instruct available on FastMetal?: Not at the moment. Voxtral Mini 3B, from the same lab, is available on the FastMetal API today.
What is the context window of Mixtral 8x22B Instruct?: 65,536 tokens, shared between the prompt and the response.
How does Mixtral 8x22B Instruct rank?: #236 on the public arena's Japanese board (ELO 1,109). Ranks move as the leaderboard is updated.