Language Modeling on Wikitext-2 (Specific PPL Variants)
7.43Perplexity (Original)ROME
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| ROMEModel=Qwen-2.5, Pruned (%)=15.3%2026.04 | 7.43 | 8.07 | 7.76 | |
| MEMITModel=Qwen-2.5, Pruned (%)=7.9%2026.04 | 7.43 | 7.66 | 7.74 | |
| ROMEModel=LLaMA-3.2, Pruned (%)=10.0%2026.04 | 9.46 | 9.59 | 10.14 | |
| MEMITModel=LLaMA-3.2, Pruned (%)=8.8%2026.04 | 9.46 | 10.78 | 12.53 | |
| ROMEModel=GPT-2 XL, Pruned (%)=10.0%2026.04 | 17.8 | 44.51 | 25.68 | |
| MEMITModel=GPT-2 XL, Pruned (%)=4.5%2026.04 | 17.8 | 17.9 | 19 |