Language Modeling on WikiText (test) (Avg ∆PPL)
0.678Avg Delta PPLEMP-Wanda
Evaluation Results
| Method | Links | |
|---|---|---|
| EMP-WandaAvg Sparsity(%)=40.472025.09 | 0.678 | |
| EMP-MagnitudeAvg Sparsity(%)=36.632025.09 | 0.752 | |
| WandaAvg Sparsity(%)=50.002025.09 | 0.799 | |
| MagnitudeAvg Sparsity(%)=50.002025.09 | 2.982 |