General Knowledge Evaluation on MMMLU (Accuracy)
82.25MMMLU General Knowledge AccuracyDOS-CPT
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| DOS-CPTBackbone=Qwen3-14B-Base, CPT Strategy=Distance-to-Optimum Selection2025.12 | 82.25 | — | |
| RS-CPTBackbone=Qwen3-14B-Base, CPT Strategy=Random Data Sampling2025.12 | 82.23 | — | |
| HPS-CPTBackbone=Qwen3-14B-Base, CPT Strategy=High-PPL Sampling2025.12 | 82.11 | — | |
| Qwen3-14B-BaseBackbone=Qwen3-14B-Base, CPT Strategy=None2025.12 | 82.03 | — | |
| LPS-CPTBackbone=Qwen3-14B-Base, CPT Strategy=Low-PPL Sampling2025.12 | 82.03 | — | |
| Base modelBackbone=Llama3.2-3B Instruct2026.02 | 60.45 | — | |
| GA + KLRetention data (w/ Dr)=true, Backbone=Llama3.2-3B Instruct2026.02 | 60.18 | — | |
| NPO + KLRetention data (w/ Dr)=true, Backbone=Llama3.2-3B Instruct2026.02 | 59.47 | — | |
| NPOBackbone=Llama3.2-3B Instruct2026.02 | 54.79 | — | |
| CATNIPBackbone=Llama3.2-3B Instruct2026.02 | 52.17 | — | |
| SimNPOBackbone=Llama3.2-3B Instruct2026.02 | 51.84 | — | |
| FLATContrastive data (w/ Dct)=true, Backbone=Llama3.2-3B Instruct2026.02 | 50.12 | — | |
| ML-SFTModel Backbone=Qwen2.5-7B2025.06 | 50.05 | — | |
| CC-TUNINGModel Backbone=Qwen2.5-7B2025.06 | 49.65 | — | |
| CC-TUNING+MTModel Backbone=Qwen2.5-7B2025.06 | 49.39 | — | |
| ML-SFT+ENModel Backbone=Qwen2.5-7B2025.06 | 48.8 | — | |
| CC-TUNING+SDRRLModel Backbone=Qwen2.5-7B2025.06 | 47.87 | — | |
| ML-SFT+MTModel Backbone=Qwen2.5-7B2025.06 | 47.49 | — | |
| CC-TUNING+ENModel Backbone=Qwen2.5-7B2025.06 | 47.35 | — | |
| ML-SFT+SDRRLModel Backbone=Qwen2.5-7B2025.06 | 47.28 | — | |
| CC-TUNINGModel Backbone=LLaMA-3.1-8B2025.06 | 40.74 | — | |
| ML-SFT+MTModel Backbone=LLaMA-3.1-8B2025.06 | 40.68 | — | |
| ML-SFTModel Backbone=LLaMA-3.1-8B2025.06 | 40.2 | — | |
| ML-SFT+ENModel Backbone=LLaMA-3.1-8B2025.06 | 39.62 | — | |
| CC-TUNING+MTModel Backbone=LLaMA-3.1-8B2025.06 | 38.87 | — | |
| CC-TUNING+ENModel Backbone=LLaMA-3.1-8B2025.06 | 38.73 | — | |
| CC-TUNING+SDRRLModel Backbone=LLaMA-3.1-8B2025.06 | 37.77 | — | |
| ML-SFT+SDRRLModel Backbone=LLaMA-3.1-8B2025.06 | 28.06 | — | |
| GABackbone=Llama3.2-3B Instruct2026.02 | 24.87 | — |