General Language Capability on MMLU, GSM8K, HEval, IFEval, MTBench
76.4MMLU AccuracyBaseline
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| BaselineBackbone=QWEN-2.5-7B2026.07 | 76.4 | 80.8 | 64 | 53.6 | 82.4 | 71.4 | |
| DPOBackbone=QWEN-2.5-7B2026.07 | 76.4 | 82.4 | 64 | 49.8 | 79.1 | 70.3 | |
| HARC + DPOBackbone=QWEN-2.5-7B2026.07 | 76.4 | 83.2 | 64 | 51.8 | 80.2 | 71.1 | |
| RepBendBackbone=QWEN-2.5-7B2026.07 | 76.3 | 79.6 | 64.6 | 0.4 | 10 | 46.2 | |
| HARCBackbone=QWEN-2.5-7B2026.07 | 76.3 | 80.4 | 68.3 | 51 | 82.6 | 71.7 | |
| Circuit BreakerBackbone=QWEN-2.5-7B2026.07 | 76.2 | 80.4 | 63.4 | 51.2 | 79.1 | 70.1 | |
| SFTBackbone=QWEN-2.5-7B2026.07 | 76 | 80 | 59.1 | 33.1 | 66.6 | 63 | |
| CASTBackbone=QWEN-2.5-7B2026.07 | 74.5 | 76.4 | 64 | 51.8 | 82.5 | 69.8 | |
| DPOBackbone=LLAMA-3.1-8B2026.07 | 70 | 75.6 | 59.1 | 46.8 | 70.9 | 64.5 | |
| BaselineBackbone=LLAMA-3.1-8B2026.07 | 69.9 | 74.4 | 62.2 | 52.1 | 75.5 | 66.8 | |
| SFTBackbone=LLAMA-3.1-8B2026.07 | 69.9 | 76.8 | 60.4 | 45.7 | 70.6 | 64.7 | |
| HARC + DPOBackbone=LLAMA-3.1-8B2026.07 | 69.9 | 73.6 | 59.8 | 50 | 76.6 | 66 | |
| Circuit BreakerBackbone=LLAMA-3.1-8B2026.07 | 69.8 | 74.8 | 61.6 | 49.2 | 77.4 | 66.6 | |
| HARCBackbone=LLAMA-3.1-8B2026.07 | 69.8 | 75.6 | 61 | 51.2 | 77.2 | 67 | |
| RepBendBackbone=LLAMA-3.1-8B2026.07 | 69.7 | 66 | 61.6 | 26.8 | 51.6 | 55.1 | |
| CASTBackbone=LLAMA-3.1-8B2026.07 | 68.5 | 58 | 50 | 41.9 | 61 | 55.9 |