Commonsense Reasoning on WinoG (test val)
73.88AccuracyLLaDA (Base)
Evaluation results
| Method | Links | |
|---|---|---|
| LLaDA (Base)Pruning Ratio=0.02026.02 | 73.88 | |
| Sink-Aware (Ours)Pruning Ratio=0.32026.02 | 67.4 | |
| LLaDA-structurePruning Ratio=0.32026.02 | 66.3 | |
| Sink-Aware (Ours)Pruning Ratio=0.52026.02 | 57.24 | |
| LLaDA-structurePruning Ratio=0.52026.02 | 55.72 |