Language Understanding on Global MMLU (T5)
59.1AccuracyFull Retraining
Evaluation results
| Method | Links | |
|---|---|---|
| Full RetrainingModel=Qwen2.5-7B-Instruct2026.04 | 59.1 | |
| COMPASS-ECDAModel=Qwen2.5-7B-Instruct2026.04 | 59.1 | |
| EWCModel=Qwen2.5-7B-Instruct2026.04 | 57.6 | |
| Random RehearsalModel=Qwen2.5-7B-Instruct2026.04 | 57 | |
| Naive Fine-tuningModel=Qwen2.5-7B-Instruct2026.04 | 49.1 |