Competition Mathematics Reasoning on AIME24, AMC23, and Olympiadbench (test)
34.6AccuracyHD+IDFT
Evaluation Results
| Method | Links | |
|---|---|---|
| HD+IDFTBase Model=Qwen2.5-7B-instruct, Budget (FLOPs)=44.70 x 10^182026.02 | 34.6 | |
| HD+SFTBase Model=Qwen2.5-7B-instruct, Budget (FLOPs)=44.70 x 10^182026.02 | 34.1 | |
| SimPOBase Model=Qwen2.5-7B-instruct, Budget (FLOPs)=77.88 x 10^182026.02 | 33.9 | |
| OriginBase Model=Qwen2.5-7B-instruct, Budget (FLOPs)=02026.02 | 33.6 | |
| DPOBase Model=Qwen2.5-7B-instruct, Budget (FLOPs)=77.88 x 10^182026.02 | 33.6 | |
| CPOBase Model=Qwen2.5-7B-instruct, Budget (FLOPs)=77.88 x 10^182026.02 | 33.5 | |
| Rej@2Base Model=Qwen2.5-7B-instruct, Budget (FLOPs)=46.03 x 10^182026.02 | 32.9 | |
| Rej@4Base Model=Qwen2.5-7B-instruct, Budget (FLOPs)=60.19 x 10^182026.02 | 32.7 | |
| RPOBase Model=Qwen2.5-7B-instruct, Budget (FLOPs)=77.88 x 10^182026.02 | 32.4 | |
| SimPOBase Model=Phi4-mini-instruct (3.8B), Budget (FLOPs)=40.39 x 10^182026.02 | 24.6 | |
| Rej@4Base Model=Phi4-mini-instruct (3.8B), Budget (FLOPs)=35.81 x 10^182026.02 | 22 | |
| HD+IDFTBase Model=Phi4-mini-instruct (3.8B), Budget (FLOPs)=19.86 x 10^182026.02 | 19.8 | |
| Rej@2Base Model=Phi4-mini-instruct (3.8B), Budget (FLOPs)=25.40 x 10^182026.02 | 18.1 | |
| HD+SFTBase Model=Phi4-mini-instruct (3.8B), Budget (FLOPs)=19.86 x 10^182026.02 | 17.8 | |
| DPOBase Model=Phi4-mini-instruct (3.8B), Budget (FLOPs)=40.39 x 10^182026.02 | 17.4 | |
| EAFTBase Model=Qwen2.5-7B-instruct, Budget (FLOPs)=31.87 x 10^182026.02 | 16.9 | |
| RPOBase Model=Phi4-mini-instruct (3.8B), Budget (FLOPs)=40.39 x 10^182026.02 | 16.8 | |
| OriginBase Model=Phi4-mini-instruct (3.8B), Budget (FLOPs)=02026.02 | 16.5 | |
| CPOBase Model=Phi4-mini-instruct (3.8B), Budget (FLOPs)=40.39 x 10^182026.02 | 16.2 | |
| SFTBase Model=Qwen2.5-7B-instruct, Budget (FLOPs)=31.87 x 10^182026.02 | 15.1 | |
| SFTBase Model=Phi4-mini-instruct (3.8B), Budget (FLOPs)=14.99 x 10^182026.02 | 14.4 | |
| DFTBase Model=Phi4-mini-instruct (3.8B), Budget (FLOPs)=14.99 x 10^182026.02 | 11.9 | |
| EAFTBase Model=Phi4-mini-instruct (3.8B), Budget (FLOPs)=14.99 x 10^182026.02 | 11.8 | |
| DFTBase Model=Qwen2.5-7B-instruct, Budget (FLOPs)=31.87 x 10^182026.02 | 10.7 |