DeepSeek
R1 Distill Llama 70B
DeepSeek R1 Distill Llama 70B is a distilled large language model based on [Llama-3.3-70B-Instruct](/meta-llama/llama-3.3-70b-instruct), using outputs from [DeepSeek R1](/deepseek/deepseek-r1). The model combines advanced distillation techniques to achieve high performance across multiple benchmarks, including: - AIME 2024 pass@1: 70.0 - MATH-500 pass@1: 94.5 - CodeForces Rating: 1633 The model leverages fine-tuning from DeepSeek R1's outputs, enabling competitive performance comparable to larger frontier models.
- Input / 1M tokens
- $0.700
- Output / 1M tokens
- $0.800
- Context window
- 131K tokens
- Provider
- DeepSeek
- Knowledge cutoff
- 2024-07-31
Performance
Median streaming throughput and first-token latency measured by Artificial Analysis.
- Output tokens / sec
- 42 t/s
- Time to first token
- 0.48s
Benchmarks
Intelligence, coding, and math indexes plus the underlying evaluation scores.
- Intelligence Index
- 16
- Coding Index
- 11
- Math Index
- 54
- MMLU-Pro
- 79.5%
- GPQA
- 40.2%
- HLE
- 6.1%
- LiveCodeBench
- 26.6%
- SciCode
- 31.2%
- MATH-500
- 93.5%
- AIME
- 67.0%
Benchmarks via Artificial Analysis