R1 Distill Llama 70B
DeepSeek R1 Distill Llama 70B is a distilled large language model based on [Llama-3.3-70B-Instruct](/meta-llama/llama-3.3-70b-instruct), using outputs from [DeepSeek R1](/deepseek/deepseek-r1). The model combines advanced distillation techniques to achieve high performance across multiple benchmarks, including: - AIME 2024 pass@1: 70.0 - MATH-500 pass@1: 94.5 - CodeForces Rating: 1633 The model leverages fine-tuning from DeepSeek R1's outputs, enabling competitive performance comparable to larger frontier models.
Specifications
Modalities
Supported Parameters
Max Output Tokens
16,384Data policy
- Prompt retention
- Unknown — we could not confirm
- Training
- Unknown — not declared
"Unknown" does not mean "safe". It means we could not confirm it.
Whether a provider trains on prompts is a declared value from our terms with them. Retention is determined from the upstream listing for every host this model can reach. Neither is guessed.
Frequently asked questions
- Is R1 Distill Llama 70B available on FastMetal?
- Not at the moment. DeepSeek V4.1 Flash, from the same lab, is available on the FastMetal API today.
- What is the context window of R1 Distill Llama 70B?
- 131,072 tokens, shared between the prompt and the response.