General Reasoning on MMLU-stem and ARC-challenge (test)
61.8AccuracyOrigin
Evaluation results
| Method | Links | |
|---|---|---|
| OriginBase Model=Qwen2.5-7B-instruct, Budget (FLOPs)=02026.02 | 61.8 | |
| RPOBase Model=Qwen2.5-7B-instruct, Budget (FLOPs)=77.88 x 10^182026.02 | 61.8 | |
| SimPOBase Model=Qwen2.5-7B-instruct, Budget (FLOPs)=77.88 x 10^182026.02 | 61.8 | |
| DPOBase Model=Qwen2.5-7B-instruct, Budget (FLOPs)=77.88 x 10^182026.02 | 61.6 | |
| HD+IDFTBase Model=Qwen2.5-7B-instruct, Budget (FLOPs)=44.70 x 10^182026.02 | 61.5 | |
| Rej@4Base Model=Qwen2.5-7B-instruct, Budget (FLOPs)=60.19 x 10^182026.02 | 61.4 | |
| CPOBase Model=Qwen2.5-7B-instruct, Budget (FLOPs)=77.88 x 10^182026.02 | 61.4 | |
| Rej@2Base Model=Qwen2.5-7B-instruct, Budget (FLOPs)=46.03 x 10^182026.02 | 61.2 | |
| HD+SFTBase Model=Qwen2.5-7B-instruct, Budget (FLOPs)=44.70 x 10^182026.02 | 61.2 | |
| RPOBase Model=Phi4-mini-instruct (3.8B), Budget (FLOPs)=40.39 x 10^182026.02 | 59.6 | |
| CPOBase Model=Phi4-mini-instruct (3.8B), Budget (FLOPs)=40.39 x 10^182026.02 | 59.6 | |
| HD+IDFTBase Model=Phi4-mini-instruct (3.8B), Budget (FLOPs)=19.86 x 10^182026.02 | 59.4 | |
| DPOBase Model=Phi4-mini-instruct (3.8B), Budget (FLOPs)=40.39 x 10^182026.02 | 59.3 | |
| SimPOBase Model=Phi4-mini-instruct (3.8B), Budget (FLOPs)=40.39 x 10^182026.02 | 59.3 | |
| OriginBase Model=Phi4-mini-instruct (3.8B), Budget (FLOPs)=02026.02 | 59.2 | |
| Rej@4Base Model=Phi4-mini-instruct (3.8B), Budget (FLOPs)=35.81 x 10^182026.02 | 59.2 | |
| Rej@2Base Model=Phi4-mini-instruct (3.8B), Budget (FLOPs)=25.40 x 10^182026.02 | 58.7 | |
| HD+SFTBase Model=Phi4-mini-instruct (3.8B), Budget (FLOPs)=19.86 x 10^182026.02 | 58.7 | |
| SFTBase Model=Qwen2.5-7B-instruct, Budget (FLOPs)=31.87 x 10^182026.02 | 56.9 | |
| EAFTBase Model=Qwen2.5-7B-instruct, Budget (FLOPs)=31.87 x 10^182026.02 | 55.9 | |
| EAFTBase Model=Phi4-mini-instruct (3.8B), Budget (FLOPs)=14.99 x 10^182026.02 | 51.6 | |
| DFTBase Model=Qwen2.5-7B-instruct, Budget (FLOPs)=31.87 x 10^182026.02 | 50.5 | |
| SFTBase Model=Phi4-mini-instruct (3.8B), Budget (FLOPs)=14.99 x 10^182026.02 | 50.1 | |
| DFTBase Model=Phi4-mini-instruct (3.8B), Budget (FLOPs)=14.99 x 10^182026.02 | 48.3 |