Downstream Task Evaluation on DS-Avg 9 Downstream Tasks Suite
63.6ARC-c AccuracyUncompressed
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| UncompressedModel=Qwen 3.5 122B-A10B, Rate=Uncompressed2026.05 | 63.6 | 80.5 | 86.3 | 85.9 | 88.1 | 83.4 | 51.8 | 74.6 | 88.3 | 78 | |
| REAPModel=Qwen 3.5 122B-A10B, Rate=33%2026.05 | 63.3 | 81.6 | 71.8 | 84.8 | 84.7 | 83.3 | 53.2 | 77.1 | 81.7 | 75.7 | |
| STUN+WandaModel=Qwen 3.5 122B-A10B, Rate=33%2026.05 | 62.5 | 84.6 | 88.8 | 78.8 | 83.1 | 79.8 | 52.6 | 74.6 | 74.8 | 75.5 | |
| HodgeCover+WandaModel=Qwen 3.5 122B-A10B, Rate=33%2026.05 | 62.2 | 79.9 | 84.2 | 85.6 | 85.5 | 83.4 | 51.2 | 77.5 | 90.3 | 77.8 | |
| UncompressedModel=Qwen 3.5 35B-A3B, Rate=Uncompressed2026.05 | 62.1 | 79.5 | 87.9 | 82.5 | 84.9 | 83 | 53.5 | 74.7 | 86.9 | 77.2 | |
| REAMModel=Qwen 3.5 122B-A10B, Rate=33%2026.05 | 61.9 | 81.7 | 74.6 | 83.5 | 83.5 | 83.1 | 52.9 | 75.6 | 82.6 | 75.5 | |
| HodgeCoverModel=Qwen 3.5 122B-A10B, Rate=33%2026.05 | 61.7 | 80.1 | 74.4 | 84.9 | 83.9 | 83.1 | 51.6 | 77.3 | 84.5 | 75.7 | |
| HodgeCover+WandaModel=Qwen 3.5 122B-A10B, Rate=66%2026.05 | 61.2 | 82.3 | 79.3 | 80.1 | 83.2 | 81.9 | 51.1 | 76.4 | 87.9 | 75.9 | |
| STUN+WandaModel=Qwen 3.5 122B-A10B, Rate=66%2026.05 | 59.6 | 84.8 | 82.1 | 71 | 78.3 | 76.9 | 49.6 | 73 | 62.3 | 70.8 | |
| REAPModel=Qwen 3.5 35B-A3B, Rate=33%2026.05 | 57.1 | 76 | 90 | 81.5 | 79.8 | 82 | 53.2 | 75.1 | 87.6 | 75.8 | |
| HodgeCover+WandaModel=Qwen 3.5 35B-A3B, Rate=66%2026.05 | 56.5 | 78.5 | 90.8 | 76.8 | 78 | 80.8 | 50.3 | 74.1 | 85.5 | 74.6 | |
| HodgeCoverModel=Qwen 3.5 35B-A3B, Rate=33%2026.05 | 56.3 | 73.9 | 91.3 | 82.5 | 80.7 | 82.9 | 54.7 | 76.3 | 85.1 | 75.9 | |
| HodgeCover+WandaModel=Qwen 3.5 35B-A3B, Rate=33%2026.05 | 55.9 | 76 | 89 | 81.8 | 82.6 | 82.3 | 53.7 | 74.2 | 89.6 | 76.1 | |
| REAMModel=Qwen 3.5 35B-A3B, Rate=33%2026.05 | 54.4 | 73.1 | 90.5 | 80.6 | 78.8 | 81.2 | 53.8 | 74 | 86.8 | 74.8 | |
| HodgeCoverModel=Qwen 3.5 122B-A10B, Rate=66%2026.05 | 52.2 | 71.1 | 75.3 | 77 | 69 | 80.1 | 51.5 | 76.4 | 78.1 | 70.1 | |
| STUN+WandaModel=Qwen 3.5 35B-A3B, Rate=33%2026.05 | 50.9 | 74.4 | 89.2 | 72.1 | 76.7 | 76.1 | 51 | 70.6 | 33.2 | 66 | |
| REAPModel=Qwen 3.5 122B-A10B, Rate=66%2026.05 | 50.2 | 71.3 | 77.9 | 75.1 | 70 | 79.8 | 50.5 | 75 | 80.2 | 70 | |
| STUN+WandaModel=Qwen 3.5 35B-A3B, Rate=66%2026.05 | 49.6 | 76.6 | 89.5 | 63.8 | 69.2 | 72.9 | 47.1 | 67.5 | 22.1 | 62 | |
| MC-SMoEModel=Qwen 3.5 122B-A10B, Rate=33%2026.05 | 49.2 | 72.4 | 80.5 | 81.8 | 71.6 | 82.1 | 54 | 75.6 | 82.4 | 72.2 | |
| UncompressedModel=OLMoE 1B-7B, Rate=Uncompressed2026.05 | 48.9 | 76.2 | 75 | 77 | 52.8 | 80.7 | 35.6 | 68.7 | 9.8 | 58.3 | |
| REAMModel=Qwen 3.5 122B-A10B, Rate=66%2026.05 | 46.8 | 67.6 | 83.7 | 70.5 | 65.4 | 75.5 | 48.8 | 73.6 | 30.4 | 62.5 | |
| HodgeCoverModel=Qwen 3.5 35B-A3B, Rate=66%2026.05 | 46.4 | 67.5 | 88.1 | 72.5 | 54.5 | 78.1 | 51.7 | 73.7 | 67.5 | 66.7 | |
| REAPModel=Qwen 3.5 35B-A3B, Rate=66%2026.05 | 46 | 69.8 | 88.2 | 71.4 | 58.7 | 77.3 | 48.2 | 72.5 | 65.3 | 66.4 | |
| MC-SMoEModel=Qwen 3.5 35B-A3B, Rate=33%2026.05 | 45.1 | 64.6 | 89.2 | 78.3 | 62.5 | 81 | 51.3 | 76.1 | 83.9 | 70.2 | |
| REAMModel=Qwen 3.5 35B-A3B, Rate=66%2026.05 | 42.7 | 64.4 | 87.2 | 67.9 | 51.7 | 74.1 | 46.9 | 70.9 | 39 | 60.5 | |
| STUN+WandaModel=OLMoE 1B-7B, Rate=33%2026.05 | 41.5 | 67.2 | 66.4 | 69.2 | 34.6 | 77.3 | 33.3 | 64.8 | 2.6 | 50.8 | |
| HodgeCover+WandaModel=OLMoE 1B-7B, Rate=33%2026.05 | 40.9 | 67.3 | 73 | 73.6 | 38.7 | 78.1 | 35.1 | 67.8 | 2.4 | 53 | |
| HodgeCover+WandaModel=OLMoE 1B-7B, Rate=66%2026.05 | 33.7 | 56.6 | 72.6 | 64.4 | 35 | 72.6 | 35.2 | 64.5 | 2.5 | 48.6 | |
| MC-SMoEModel=Qwen 3.5 122B-A10B, Rate=66%2026.05 | 33.6 | 50.5 | 86 | 62.9 | 34.6 | 72.4 | 44 | 72.5 | 34 | 54.5 | |
| STUN+WandaModel=OLMoE 1B-7B, Rate=66%2026.05 | 32.9 | 58 | 62.5 | 55.3 | 26.9 | 71.7 | 36 | 61.1 | 1.8 | 45.1 | |
| HodgeCoverModel=OLMoE 1B-7B, Rate=33%2026.05 | 32.8 | 50.3 | 62.8 | 67 | 25.6 | 73 | 41.7 | 64.9 | 2.2 | 46.7 | |
| MC-SMoEModel=Qwen 3.5 35B-A3B, Rate=66%2026.05 | 29 | 47.5 | 85.1 | 54.9 | 32.7 | 69.4 | 47.2 | 67.6 | 34.6 | 52 | |
| REAPModel=OLMoE 1B-7B, Rate=33%2026.05 | 28.7 | 42.5 | 65.3 | 63.8 | 27.4 | 66.8 | 35.5 | 64.8 | 1.7 | 44.1 | |
| REAMModel=OLMoE 1B-7B, Rate=33%2026.05 | 27.1 | 39.3 | 63.3 | 53 | 27.5 | 63.4 | 41.5 | 60.9 | 1.3 | 41.9 | |
| MC-SMoEModel=OLMoE 1B-7B, Rate=33%2026.05 | 26.3 | 41.8 | 62.3 | 43.3 | 27.2 | 65.1 | 39.2 | 50.3 | 1.2 | 39.6 | |
| REAPModel=OLMoE 1B-7B, Rate=66%2026.05 | 24.5 | 30.9 | 48 | 32.3 | 25.1 | 54.2 | 50.7 | 53.2 | 0 | 35.4 | |
| REAMModel=OLMoE 1B-7B, Rate=66%2026.05 | 24.3 | 30.4 | 42.8 | 28.8 | 25.3 | 53.2 | 50.2 | 50.9 | 0 | 34 | |
| HodgeCoverModel=OLMoE 1B-7B, Rate=66%2026.05 | 24.2 | 29.5 | 38.6 | 30 | 25.4 | 52.7 | 47.7 | 51.2 | 0.1 | 33.3 | |
| MC-SMoEModel=OLMoE 1B-7B, Rate=66%2026.05 | 23.6 | 30.8 | 43.3 | 27.9 | 23.5 | 54.1 | 50 | 50.8 | 0 | 33.8 |