General Language Understanding on MMLU and AGIEval
0.5592MMLU ScoreTSV-M + OrthoMerge-G
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| TSV-M + OrthoMerge-GMerging Strategy=TSV-M, OrthoMerge Variant=G2026.02 | 0.5592 | 0.3356 | 0.4474 | |
| TA + OrthoMerge-CMerging Strategy=Task Arithmetic, OrthoMerge Variant=C2026.02 | 0.5576 | 0.3269 | 0.4423 | |
| TA + OrthoMerge-GMerging Strategy=Task Arithmetic, OrthoMerge Variant=G2026.02 | 0.5557 | 0.3285 | 0.4421 | |
| TSV-M + OrthoMerge-CMerging Strategy=TSV-M, OrthoMerge Variant=C2026.02 | 0.5557 | 0.3379 | 0.4468 | |
| TSV-MMerging Strategy=TSV-M2026.02 | 0.5549 | 0.3356 | 0.4453 | |
| TIES + OrthoMerge-CMerging Strategy=TIES, OrthoMerge Variant=C2026.02 | 0.5536 | 0.3401 | 0.4469 | |
| TAMerging Strategy=Task Arithmetic2026.02 | 0.5535 | 0.3267 | 0.4401 | |
| Llama-3.2-3BModel Type=Pre-trained Base Model2026.02 | 0.55 | 0.3105 | 0.4303 | |
| TIES + OrthoMerge-GMerging Strategy=TIES, OrthoMerge Variant=G2026.02 | 0.5489 | 0.3345 | 0.4417 | |
| TIESMerging Strategy=TIES2026.02 | 0.5452 | 0.3388 | 0.442 |