General Mathematics Reasoning on College-math, Math-OAI, Minerva-math (test)
54.1AccuracyRej@4
Evaluation Results
| Method | Links | |
|---|---|---|
| Rej@4Base Model=Qwen2.5-7B-instruct, Budget (FLOPs)=60.19 x 10^182026.02 | 54.1 | |
| SimPOBase Model=Qwen2.5-7B-instruct, Budget (FLOPs)=77.88 x 10^182026.02 | 54.1 | |
| HD+SFTBase Model=Qwen2.5-7B-instruct, Budget (FLOPs)=44.70 x 10^182026.02 | 53.9 | |
| CPOBase Model=Qwen2.5-7B-instruct, Budget (FLOPs)=77.88 x 10^182026.02 | 53.7 | |
| OriginBase Model=Qwen2.5-7B-instruct, Budget (FLOPs)=02026.02 | 53.5 | |
| DPOBase Model=Qwen2.5-7B-instruct, Budget (FLOPs)=77.88 x 10^182026.02 | 53.5 | |
| Rej@2Base Model=Qwen2.5-7B-instruct, Budget (FLOPs)=46.03 x 10^182026.02 | 53.4 | |
| HD+IDFTBase Model=Qwen2.5-7B-instruct, Budget (FLOPs)=44.70 x 10^182026.02 | 53.2 | |
| RPOBase Model=Qwen2.5-7B-instruct, Budget (FLOPs)=77.88 x 10^182026.02 | 52.1 | |
| HD+IDFTBase Model=Phi4-mini-instruct (3.8B), Budget (FLOPs)=19.86 x 10^182026.02 | 41.9 | |
| Rej@4Base Model=Phi4-mini-instruct (3.8B), Budget (FLOPs)=35.81 x 10^182026.02 | 41.6 | |
| SimPOBase Model=Phi4-mini-instruct (3.8B), Budget (FLOPs)=40.39 x 10^182026.02 | 41.6 | |
| Rej@2Base Model=Phi4-mini-instruct (3.8B), Budget (FLOPs)=25.40 x 10^182026.02 | 38.9 | |
| OriginBase Model=Phi4-mini-instruct (3.8B), Budget (FLOPs)=02026.02 | 38.1 | |
| HD+SFTBase Model=Phi4-mini-instruct (3.8B), Budget (FLOPs)=19.86 x 10^182026.02 | 37.5 | |
| RPOBase Model=Phi4-mini-instruct (3.8B), Budget (FLOPs)=40.39 x 10^182026.02 | 36.1 | |
| DPOBase Model=Phi4-mini-instruct (3.8B), Budget (FLOPs)=40.39 x 10^182026.02 | 35.7 | |
| CPOBase Model=Phi4-mini-instruct (3.8B), Budget (FLOPs)=40.39 x 10^182026.02 | 31.7 | |
| EAFTBase Model=Qwen2.5-7B-instruct, Budget (FLOPs)=31.87 x 10^182026.02 | 27 | |
| SFTBase Model=Qwen2.5-7B-instruct, Budget (FLOPs)=31.87 x 10^182026.02 | 25.3 | |
| DFTBase Model=Phi4-mini-instruct (3.8B), Budget (FLOPs)=14.99 x 10^182026.02 | 24.8 | |
| DFTBase Model=Qwen2.5-7B-instruct, Budget (FLOPs)=31.87 x 10^182026.02 | 22.8 | |
| EAFTBase Model=Phi4-mini-instruct (3.8B), Budget (FLOPs)=14.99 x 10^182026.02 | 21.4 | |
| SFTBase Model=Phi4-mini-instruct (3.8B), Budget (FLOPs)=14.99 x 10^182026.02 | 2.8 |