DeepSeek open-sourced DeepSeek-R1, an LLM fine-tuned with support knowing (RL) to enhance thinking ability. DeepSeek-R1 attains outcomes on par with OpenAI’s o1 model on a number of benchmarks, including MATH-500 and SWE-bench.

DeepSeek-R1 is based on DeepSeek-V3, a mixture of professionals (MoE) model recently open-sourced by DeepSeek. This base model is fine-tuned utilizing Group Relative Policy Optimization (GRPO), a reasoning-oriented variant of RL. The research team also carried out knowledge distillation from DeepSeek-R1 to open-source Qwen and Llama models and released several versions of each