Is Mistral 7B Instruct available on FastMetal?

Not at the moment. Voxtral Mini 3B, from the same lab, is available on the FastMetal API today.

What is the context window of Mistral 7B Instruct?

32,768 tokens, shared between the prompt and the response.

How does Mistral 7B Instruct rank?

#383 on the public arena's Overall board (ELO 1,110). Ranks move as the leaderboard is updated.

Back to Models

mistralai/mistral-7b-instruct

Not Available

Mistral 7B Instruct

A high-performing, industry-standard 7.3B parameter model, with optimizations for speed and context length. *Mistral 7B Instruct has multiple version variants, and this is intended to be the latest version.*

5/27/2024

32,768 tokens

#277 Text (french)

Specifications

Modalities

Input

text

Output

text

Supported Parameters

frequency_penalty

logit_bias

max_tokens

min_p

presence_penalty

repetition_penalty

stop

temperature

top_k

top_p

Max Output Tokens

4,096

Frequently asked questions

Is Mistral 7B Instruct available on FastMetal?: Not at the moment. Voxtral Mini 3B, from the same lab, is available on the FastMetal API today.
What is the context window of Mistral 7B Instruct?: 32,768 tokens, shared between the prompt and the response.
How does Mistral 7B Instruct rank?: #383 on the public arena's Overall board (ELO 1,110). Ranks move as the leaderboard is updated.