Is Mixtral 8x7B Instruct available on FastMetal?

Not at the moment. Voxtral Mini 3B, from the same lab, is available on the FastMetal API today.

What is the context window of Mixtral 8x7B Instruct?

32,768 tokens, shared between the prompt and the response.

How does Mixtral 8x7B Instruct rank?

#255 on the public arena's Japanese board (ELO 1,003). Ranks move as the leaderboard is updated.

Back to Models

mistralai/mixtral-8x7b-instruct

Not Available

Mixtral 8x7B Instruct

Mixtral 8x7B Instruct is a pretrained generative Sparse Mixture of Experts, by Mistral AI, for chat and instruction use. Incorporates 8 experts (feed-forward networks) for a total of 47 billion parameters. Instruct model fine-tuned by Mistral. #moe

12/10/2023

32,768 tokens

#245 Text (french)

Specifications

Modalities

Input

text

Output

text

Supported Parameters

frequency_penalty

logit_bias

max_tokens

min_p

presence_penalty

repetition_penalty

response_format

seed

stop

temperature

tool_choice

tools

top_k

top_p

Max Output Tokens

16,384

Frequently asked questions

Is Mixtral 8x7B Instruct available on FastMetal?: Not at the moment. Voxtral Mini 3B, from the same lab, is available on the FastMetal API today.
What is the context window of Mixtral 8x7B Instruct?: 32,768 tokens, shared between the prompt and the response.
How does Mixtral 8x7B Instruct rank?: #255 on the public arena's Japanese board (ELO 1,003). Ranks move as the leaderboard is updated.