Expert Knowledge Evaluation on MMLU-Pro
47.72AccuracyQwen3 8B
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen3 8BCompression Ratio=dense2026.02 | 47.72 | |
| ROCKETCompression Ratio=0.22026.02 | 36.65 | |
| ROCKETCompression Ratio=0.32026.02 | 32.27 | |
| CoSpaDiCompression Ratio=0.22026.02 | 31.46 | |
| SVD-LLMCompression Ratio=0.22026.02 | 26.3 | |
| ROCKETCompression Ratio=0.42026.02 | 25.53 | |
| CoSpaDiCompression Ratio=0.32026.02 | 22.81 | |
| SVD-LLMCompression Ratio=0.32026.02 | 18.82 | |
| CoSpaDiCompression Ratio=0.42026.02 | 16.74 | |
| SVD-LLMCompression Ratio=0.42026.02 | 11.55 |