Multilingual Question Answering on M-ARC
44.75AccuracyOrthoMerge
Evaluation Results
| Method | Links | |
|---|---|---|
| OrthoMergeBase Model=Llama-3.1-8B, Fine-tuning Technique=OFT, Merging Strategy=OrthoMerge2026.02 | 44.75 | |
| TIESBase Model=Llama-3.1-8B, Fine-tuning Technique=LoRA, Merging Strategy=TIES2026.02 | 44.57 | |
| TSV-MBase Model=Llama-3.1-8B, Fine-tuning Technique=OFT, Merging Strategy=TSV-M2026.02 | 44 | |
| TABase Model=Llama-3.1-8B, Fine-tuning Technique=LoRA, Merging Strategy=TA2026.02 | 43.8 | |
| DAREBase Model=Llama-3.1-8B, Fine-tuning Technique=LoRA, Merging Strategy=DARE2026.02 | 43.8 | |
| TSV-MBase Model=Llama-3.1-8B, Fine-tuning Technique=LoRA, Merging Strategy=TSV-M2026.02 | 43.44 | |
| DAREBase Model=Llama-3.1-8B, Fine-tuning Technique=OFT, Merging Strategy=DARE2026.02 | 43.08 | |
| TABase Model=Llama-3.1-8B, Fine-tuning Technique=OFT, Merging Strategy=TA2026.02 | 43.03 | |
| TIESBase Model=Llama-3.1-8B, Fine-tuning Technique=OFT, Merging Strategy=TIES2026.02 | 43.01 | |
| Llama-3.1-8BBase Model=Llama-3.1-8B, Fine-tuning Technique=None, Merging Strategy=None2026.02 | 40.85 |