Back to Models
Mixtral 8x22B Instruct
Mistral's official instruct fine-tuned version of [Mixtral 8x22B](/models/mistralai/mixtral-8x22b). It uses 39B active parameters out of 141B, offering unparalleled cost efficiency for its size. Its strengths include: - strong math, coding, and reasoning - large context length (64k) - fluency in English, French, Italian, German, and Spanish See benchmarks on the launch announcement [here](https://mistral.ai/news/mixtral-8x22b/). #moe
4/17/2024
65,536 tokens
Specifications
Modalities
Input
text
Output
text
Supported Parameters
frequency_penalty
max_tokens
presence_penalty
response_format
seed
stop
structured_outputs
temperature
tool_choice
tools
top_p
Data policy
- Prompt retention
- Unknown — we could not confirm
- Training
- Unknown — not declared
"Unknown" does not mean "safe". It means we could not confirm it.
Whether a provider trains on prompts is a declared value from our terms with them. Retention is determined from the upstream listing for every host this model can reach. Neither is guessed.
Frequently asked questions
- Is Mixtral 8x22B Instruct available on FastMetal?
- Not at the moment. Voxtral Mini 3B, from the same lab, is available on the FastMetal API today.
- What is the context window of Mixtral 8x22B Instruct?
- 65,536 tokens, shared between the prompt and the response.