Outlier Suppression on Language Model Activations
2.949Average KurtosisOASIS
Evaluation results
| Method | Links | ||
|---|---|---|---|
| OASISModel=Qwen3-0.6B2026.05 | 2.949 | 12.997 | |
| OASISModel=Llama-3.2-1B2026.05 | 3.024 | 12.25 | |
| AoSModel=Llama-3.2-1B2026.05 | 3.031 | 12.538 | |
| AoSModel=Qwen3-0.6B2026.05 | 3.031 | 13.898 | |
| OutEffHopModel=Qwen3-0.6B2026.05 | 3.035 | 14.164 | |
| OutEffHopModel=Llama-3.2-1B2026.05 | 3.076 | 13.776 | |
| VanillaModel=Llama-3.2-1B2026.05 | 91.706 | 84.433 | |
| VanillaModel=Qwen3-0.6B2026.05 | 93.039 | 74.778 |