Language Understanding on MMLU (5-shot Accuracy)
78.33MMLU 5-shot AccuracyLP-SFT
Evaluation Results
| Method | Links | |
|---|---|---|
| LP-SFTBackbone=Qwen3-14B2026.07 | 78.33 | |
| ASFTBackbone=Qwen3-14B2026.07 | 77.94 | |
| EAFTBackbone=Qwen3-14B2026.07 | 77.76 | |
| DFTBackbone=Qwen3-14B2026.07 | 77.4 | |
| CEBackbone=Qwen3-14B2026.07 | 77.39 | |
| GEMBackbone=Qwen3-14B2026.07 | 77.13 | |
| LP-SFTBackbone=Qwen3-4B2026.07 | 69.95 | |
| CEBackbone=Qwen3-4B2026.07 | 69.69 | |
| ASFTBackbone=Qwen3-4B2026.07 | 69.41 | |
| GEMBackbone=Qwen3-4B2026.07 | 69.15 | |
| DFTBackbone=Qwen3-4B2026.07 | 69.09 | |
| EAFTBackbone=Qwen3-4B2026.07 | 68.99 | |
| LP-SFTBackbone=Llama3.1-8B2026.07 | 61.94 | |
| CEBackbone=Llama3.1-8B2026.07 | 61.6 | |
| GEMBackbone=Llama3.1-8B2026.07 | 60.55 | |
| ASFTBackbone=Llama3.1-8B2026.07 | 60.22 | |
| EAFTBackbone=Llama3.1-8B2026.07 | 60 | |
| DFTBackbone=Llama3.1-8B2026.07 | 55.14 |