Language Model Calibration on WikiText-2
5.82Perplexity (PPL)RIA+SQ+EBFT
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| RIA+SQ+EBFTBase Model=Mistral, Outliers=16:256, Sparsity=8:162025.07 | 5.82 | — | — | — | — | — | — | |
| RIA+SQ+EBFTBase Model=Mistral, Outliers=8:256, Sparsity=8:162025.07 | 5.96 | — | — | — | — | — | — | |
| RIA+SQBase Model=Mistral, Outliers=16:256, Sparsity=8:162025.07 | 6.06 | — | — | — | — | — | — | |
| RIA+SQ+EBFTBase Model=Mistral, Outliers=4:256, Sparsity=8:162025.07 | 6.06 | — | — | — | — | — | — | |
| RIA+SQ+EBFTBase Model=Mistral, Outliers=None, Sparsity=8:162025.07 | 6.14 | — | — | — | — | — | — | |
| RIA+SQ+EBFTBase Model=Mistral, Outliers=16:256, Sparsity=2:42025.07 | 6.27 | — | — | — | — | — | — | |
| RIA+SQBase Model=Mistral, Outliers=8:256, Sparsity=8:162025.07 | 6.34 | — | — | — | — | — | — | |
| RIA+SQBase Model=Mistral, Outliers=4:256, Sparsity=8:162025.07 | 6.52 | — | — | — | — | — | — | |
| RIA+SQ+EBFTBase Model=Mistral, Outliers=8:256, Sparsity=2:42025.07 | 6.59 | — | — | — | — | — | — | |
| RIA+SQBase Model=Mistral, Outliers=None, Sparsity=8:162025.07 | 6.74 | — | — | — | — | — | — | |
| RIA+SQ+EBFTBase Model=Mistral, Outliers=4:256, Sparsity=2:42025.07 | 6.86 | — | — | — | — | — | — | |
| RIA+SQBase Model=Mistral, Outliers=16:256, Sparsity=2:42025.07 | 6.97 | — | — | — | — | — | — | |
| RIA+SQ+EBFTBase Model=Mistral, Outliers=None, Sparsity=2:42025.07 | 7.1 | — | — | — | — | — | — | |
| RIA+SQ+VC+EBFTBase Model=LLaMA3-8B, Outliers=16:256, Sparsity=8:162025.07 | 7.4 | — | — | — | — | — | — | |
| RIA+SQ+VC+EBFTBase Model=LLaMA3-8B, Outliers=8:256, Sparsity=8:162025.07 | 7.69 | — | — | — | — | — | — | |
| RIA+SQBase Model=Mistral, Outliers=8:256, Sparsity=2:42025.07 | 7.8 | — | — | — | — | — | — | |
| RIA+SQ+VC+EBFTBase Model=LLaMA3-8B, Outliers=4:256, Sparsity=8:162025.07 | 7.88 | — | — | — | — | — | — | |
| RIA+SQ+VC+EBFTBase Model=LLaMA3-8B, Outliers=None, Sparsity=8:162025.07 | 8.08 | — | — | — | — | — | — | |
| RIA+SQ+VC+EBFTBase Model=LLaMA3-8B, Outliers=16:256, Sparsity=2:42025.07 | 8.24 | — | — | — | — | — | — | |
| RIA+SQ+VCBase Model=LLaMA3-8B, Outliers=16:256, Sparsity=8:162025.07 | 8.42 | — | — | — | — | — | — | |
| RIA+SQBase Model=Mistral, Outliers=4:256, Sparsity=2:42025.07 | 8.48 | — | — | — | — | — | — | |
| RIA+SQBase Model=LLaMA3-8B, Outliers=16:256, Sparsity=8:162025.07 | 8.52 | — | — | — | — | — | — | |
| RIA+SQ+VCBase Model=LLaMA3-8B, Outliers=8:256, Sparsity=8:162025.07 | 9.11 | — | — | — | — | — | — | |
| RIA+SQ+VC+EBFTBase Model=LLaMA3-8B, Outliers=4:256, Sparsity=2:42025.07 | 9.18 | — | — | — | — | — | — | |
| RIA+SQBase Model=LLaMA3-8B, Outliers=8:256, Sparsity=8:162025.07 | 9.32 | — | — | — | — | — | — | |
| RIA+SQBase Model=Mistral, Outliers=None, Sparsity=2:42025.07 | 9.34 | — | — | — | — | — | — | |
| RIA+SQ+VCBase Model=LLaMA3-8B, Outliers=4:256, Sparsity=8:162025.07 | 9.52 | — | — | — | — | — | — | |
| RIA+SQ+VC+EBFTBase Model=LLaMA3-8B, Outliers=8:256, Sparsity=2:42025.07 | 9.53 | — | — | — | — | — | — | |
| RIA+SQBase Model=LLaMA3-8B, Outliers=4:256, Sparsity=8:162025.07 | 9.85 | — | — | — | — | — | — | |
| RIA+SQ+VCBase Model=LLaMA3-8B, Outliers=None, Sparsity=8:162025.07 | 10.09 | — | — | — | — | — | — | |
| RIA+SQ+VC+EBFTBase Model=LLaMA3-8B, Outliers=None, Sparsity=2:42025.07 | 10.49 | — | — | — | — | — | — | |
| RIA+SQBase Model=LLaMA3-8B, Outliers=None, Sparsity=8:162025.07 | 10.55 | — | — | — | — | — | — | |
| RIA+SQ+VCBase Model=LLaMA3-8B, Outliers=16:256, Sparsity=2:42025.07 | 10.68 | — | — | — | — | — | — | |
| RIA+SQBase Model=LLaMA3-8B, Outliers=16:256, Sparsity=2:42025.07 | 11.48 | — | — | — | — | — | — | |
| RIA+SQ+VCBase Model=LLaMA3-8B, Outliers=8:256, Sparsity=2:42025.07 | 12.73 | — | — | — | — | — | — | |
| RIA+SQBase Model=LLaMA3-8B, Outliers=8:256, Sparsity=2:42025.07 | 14.28 | — | — | — | — | — | — | |
| RIA+SQ+VCBase Model=LLaMA3-8B, Outliers=4:256, Sparsity=2:42025.07 | 14.47 | — | — | — | — | — | — | |
| RIA+SQ+VCBase Model=LLaMA3-8B, Outliers=None, Sparsity=2:42025.07 | 16.19 | — | — | — | — | — | — | |
| RIA+SQBase Model=LLaMA3-8B, Outliers=4:256, Sparsity=2:42025.07 | 16.5 | — | — | — | — | — | — | |
| RIA+SQBase Model=LLaMA3-8B, Outliers=None, Sparsity=2:42025.07 | 19.13 | — | — | — | — | — | — | |
| GPT-2Model=GPT-2+CALM2026.04 | — | 6.2 | 1.18 | 6.7 | 2.8 | 10.8 | 3.87 |