Knowledge on Knowledge Suite
84.07ARC-CTask Arithmetic
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Task ArithmeticMerging Method=Task Arithmetic2026.01 | 84.07 | 90.3 | 63.68 | 44.7 | |
| ReasonAnyMerging Method=ReasonAny (ours)2026.01 | 82.37 | 90.19 | 69.93 | 46.97 | |
| LEDMerging Method=LED Merging2026.01 | 80.34 | 89.77 | 63.45 | 9.85 | |
| ReasoningMerging Method=Expert Model (DeepSeek-R1-Distill-Llama-8B)2026.01 | 70.85 | 83.95 | 53.25 | 47.51 | |
| DAREMerging Method=DARE Merging2026.01 | 64.41 | 77.78 | 53.7 | 22.73 | |
| TIESMerging Method=TIES Merging2026.01 | 60 | 70.37 | 52.41 | 28.03 | |
| FuseLLMMerging Method=FuseLLM2026.01 | 55.25 | 74.78 | 48.38 | 0.76 | |
| BiomedicineMerging Method=Expert Model (MMed-Llama-8B)2026.01 | 35.59 | 37.21 | 60.08 | 9.62 | |
| LinearMerging Method=Linear Merging2026.01 | 30.85 | 31.39 | 61.33 | 43.18 |