Question Answering on BoolQ (Accuracy and Supernodes Pruned)
80AccuracyUnpruned
Evaluation results
| Method | Links | ||
|---|---|---|---|
| UnprunedBackbone=Llama-3.1-8B2026.04 | 80 | 0 | |
| Act. L2Backbone=Llama-3.1-8B, Sparsity=50%, Sparsity Target=FFN channel2026.04 | 71 | 19.6 | |
| SCAR-LPBackbone=Llama-3.1-8B, Sparsity=50%, Sparsity Target=FFN channel2026.04 | 66 | 0 | |
| SCAR-ProtBackbone=Llama-3.1-8B, Sparsity=50%, Sparsity Target=FFN channel2026.04 | 66 | 0 | |
| SCAR-ConnBackbone=Llama-3.1-8B, Sparsity=50%, Sparsity Target=FFN channel2026.04 | 64 | 0 | |
| SparseGPT (channel)Backbone=Llama-3.1-8B, Sparsity=50%, Sparsity Target=FFN channel2026.04 | 32 | 34.6 | |
| Magnitude (channel)Backbone=Llama-3.1-8B, Sparsity=50%, Sparsity Target=FFN channel2026.04 | 31 | 41.7 | |
| Wanda (channel)Backbone=Llama-3.1-8B, Sparsity=50%, Sparsity Target=FFN channel2026.04 | 30 | 24.3 |