Multi-hop Reasoning on MuSR
43.12AccuracyQwen3 8B
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen3 8BCompression Ratio=dense2026.02 | 43.12 | |
| CoSpaDiCompression Ratio=0.22026.02 | 42.06 | |
| SVD-LLMCompression Ratio=0.32026.02 | 41.4 | |
| ROCKETCompression Ratio=0.42026.02 | 41 | |
| ROCKETCompression Ratio=0.32026.02 | 39.94 | |
| SVD-LLMCompression Ratio=0.22026.02 | 39.81 | |
| ROCKETCompression Ratio=0.22026.02 | 39.68 | |
| CoSpaDiCompression Ratio=0.32026.02 | 38.36 | |
| CoSpaDiCompression Ratio=0.42026.02 | 38.1 | |
| SVD-LLMCompression Ratio=0.42026.02 | 37.7 |