Question Answering on MMLU CS
38AccuracyTaDA
Evaluation results
| Method | Links | |
|---|---|---|
| TaDABackbone=Llama-2-7b, Number of samples=5002026.06 | 38 | |
| Base modelBackbone=Llama-2-7b, Number of samples=5002026.06 | 35 | |
| Task onlyBackbone=Llama-2-7b, Number of samples=5002026.06 | 33 | |
| DARE-TIESBackbone=Llama-2-7b, Number of samples=500, Evaluation protocol=mean over 3 random seeds2026.06 | 31 | |
| Domain onlyBackbone=Llama-2-7b, Number of samples=5002026.06 | 30 | |
| LinearBackbone=Llama-2-7b, Number of samples=5002026.06 | 29 | |
| TIESBackbone=Llama-2-7b, Number of samples=5002026.06 | 29 | |
| Mag. PruningBackbone=Llama-2-7b, Number of samples=5002026.06 | 29 | |
| Task Arith.Backbone=Llama-2-7b, Number of samples=5002026.06 | 27 | |
| DARE-LinBackbone=Llama-2-7b, Number of samples=500, Evaluation protocol=mean over 3 random seeds2026.06 | 26 | |
| SVD MergeBackbone=Llama-2-7b, Number of samples=5002026.06 | 25 |