AI NEWS.ccMiMo-7B-RL
Unlocking the Reasoning Potential of Language Model From Pretraining to Posttraining MATH500 (Pass@1) 95.8 97.2 AIME 2024 (Pass@1) 68.2 80.1 AIME 2025 (Pass@1) 55.4 70.2 Code LiveCodeBench v5 (Pass@1) 57.8 60.9 LiveCodeBench v6 (Pass@1) 49.3 52.2 STEM GPQA-Diamond (Pass@1) 54.4 60.6 General Alignbench1.1 (Evaluated by GPT4.1) 6.9 7.4 Currently, most successful RL works, including open-source research, rely on relatively large base models, e.g., 32B models, particularly for enhancing code reasoning capabilities. Moreover, it was widely considered that achieving uniform and simultaneous improvements in both mathematical and code capabilities within a small model is challenging. Nonetheless, we believe that the effectiveness of the RL trained reasoning model relies on the inherent reasoning potential of the base model. To fully unlock the reasoning potential of language models, efforts must focus not only on post-training but also on pre-training strategies tailored to reasoning.
译文尚未就绪，显示来源原文
Unlocking the Reasoning Potential of Language Model From Pretraining to Posttraining MATH500 (Pass@1) 95.8 97.2 AIME 2024 (Pass@1) 68.2 80.1 AIME 2025 (Pass@1) 55.4 70.2 Code LiveCodeBench v5 (Pass@1) 57.8 60.9 LiveCodeBench v6 (Pass@1) 49.3 52.2 STEM GPQA-Diamond (Pass@1) 54.4 60.6 General Alignbench1.1 (Evaluated by GPT4.1) 6.9 7.4 Currently, most successful RL works, including open-source research, rely on relatively large base models, e.g., 32B models, particularly for enhancing code reasoning capabilities. Moreover, it was widely considered that achieving uniform and simultaneous improvements in both mathematical and code capabilities within a small model is challenging. Nonetheless, we believe that the effectiveness of the RL trained reasoning model relies on the inherent reasoning potential of the base model. To fully unlock the reasoning potential of language models, efforts must focus not only on post-training but also on pre-training strategies tailored to reasoning.