Mathematical Reasoning on MATH (test) (Acc, AUROC, ECE, Brier)
0.5578AccuracySTaR + Slow Thinking (ICL)
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| STaR + Slow Thinking (ICL)Model=Qwen-3-4B, Inference-time scaling=Slow Thinking (ICL)2026.01 | 0.5578 | 0.796 | 0.15 | 0.131 | 0.232 | |
| EPICAR + Slow Thinking (ICL)Model=Qwen-3-8B, Inference-time scaling=Slow Thinking (ICL)2026.01 | 0.5556 | 0.78 | 0.107 | 0.148 | 0.22 | |
| Base Model + Slow Thinking (ICL)Model=Qwen-3-8B, Inference-time scaling=Slow Thinking (ICL)2026.01 | 0.5516 | 0.673 | 0.134 | 0.065 | 0.251 | |
| STaR + Slow Thinking (ICL)Model=Qwen-3-8B, Inference-time scaling=Slow Thinking (ICL)2026.01 | 0.5452 | 0.659 | 0.19 | 0.032 | 0.271 | |
| EPICARModel=Qwen-3-8B2026.01 | 0.4976 | 0.797 | 0.131 | 0.088 | 0.206 | |
| EPICAR + Model MergingModel=Qwen-3-8B, Weight-space intervention=Model Merging2026.01 | 0.4972 | 0.769 | 0.123 | 0.103 | 0.217 | |
| STaRModel=Qwen-3-8B2026.01 | 0.4952 | 0.71 | 0.179 | 0.117 | 0.258 | |
| STaR + Model MergingModel=Qwen-3-8B, Weight-space intervention=Model Merging2026.01 | 0.4808 | 0.712 | 0.19 | 0.122 | 0.261 | |
| Base ModelModel=Qwen-3-8B2026.01 | 0.4586 | 0.727 | 0.196 | 0.121 | 0.259 | |
| EPICAR + Model MergingModel=Qwen-3-4B, Weight-space intervention=Model Merging2026.01 | 0.4354 | 0.826 | 0.176 | 0.164 | 0.211 | |
| EPICARModel=Qwen-3-4B2026.01 | 0.435 | 0.835 | 0.137 | 0.139 | 0.193 | |
| STaRModel=Qwen-3-4B2026.01 | 0.432 | 0.765 | 0.273 | 0.154 | 0.283 | |
| EPICAR + Model MergingModel=Qwen-3-1.7B, Weight-space intervention=Model Merging2026.01 | 0.4308 | 0.543 | 0.161 | 0.018 | 0.27 | |
| STaR + Slow Thinking (ICL)Model=Qwen-3-1.7B, Inference-time scaling=Slow Thinking (ICL)2026.01 | 0.4298 | 0.617 | 0.042 | 0.049 | 0.239 | |
| STaR + Model MergingModel=Qwen-3-4B, Weight-space intervention=Model Merging2026.01 | 0.4258 | 0.784 | 0.24 | 0.168 | 0.263 | |
| EPICARModel=Qwen-3-1.7B2026.01 | 0.4234 | 0.637 | 0.297 | 0.079 | 0.323 | |
| STaR + Model MergingModel=Qwen-3-1.7B, Weight-space intervention=Model Merging2026.01 | 0.4202 | 0.413 | 0.111 | 0.072 | 0.257 | |
| Base ModelModel=Qwen-3-1.7B2026.01 | 0.4144 | 0.408 | 0.101 | 0.074 | 0.255 | |
| Base Model + Slow Thinking (ICL)Model=Qwen-3-1.7B, Inference-time scaling=Slow Thinking (ICL)2026.01 | 0.4134 | 0.601 | 0.091 | 0.101 | 0.245 | |
| EPICAR + Slow Thinking (ICL)Model=Qwen-3-4B, Inference-time scaling=Slow Thinking (ICL)2026.01 | 0.4106 | 0.82 | 0.126 | 0.08 | 0.186 | |
| Base ModelModel=Qwen-3-4B2026.01 | 0.4066 | 0.676 | 0.093 | 0.093 | 0.232 | |
| STaRModel=Qwen-3-1.7B2026.01 | 0.3816 | 0.43 | 0.124 | 0.102 | 0.257 | |
| EPICAR + Slow Thinking (ICL)Model=Qwen-3-1.7B, Inference-time scaling=Slow Thinking (ICL)2026.01 | 0.3206 | 0.631 | 0.204 | 0.054 | 0.253 | |
| Base Model + Slow Thinking (ICL)Model=Qwen-3-4B, Inference-time scaling=Slow Thinking (ICL)2026.01 | 0.2798 | 0.755 | 0.275 | 0.269 | 0.24 |