Is Mistral 7B Instruct v0.3 available on FastMetal?

Not at the moment. Voxtral Mini 3B, from the same lab, is available on the FastMetal API today.

What is the context window of Mistral 7B Instruct v0.3?

32,768 tokens, shared between the prompt and the response.

mistralai/mistral-7b-instruct-v0-3

Not Available

Mistral 7B Instruct v0.3

A high-performing, industry-standard 7.3B parameter model, with optimizations for speed and context length. An improved version of [Mistral 7B Instruct v0.2](/models/mistralai/mistral-7b-instruct-v0.2), with the following changes: - Extended vocabulary to 32768 - Supports v3 Tokenizer - Supports function calling NOTE: Support for function calling depends on the provider.

5/27/2024

32,768 tokens

Specifications

Modalities

Input

text

Output

text

Supported Parameters

frequency_penalty

logit_bias

max_tokens

min_p

presence_penalty

repetition_penalty

stop

temperature

top_k

top_p

Max Output Tokens

4,096

Frequently asked questions

Is Mistral 7B Instruct v0.3 available on FastMetal?: Not at the moment. Voxtral Mini 3B, from the same lab, is available on the FastMetal API today.
What is the context window of Mistral 7B Instruct v0.3?: 32,768 tokens, shared between the prompt and the response.

Models you can use on FastMetal