Scaling Law Modeling on Pythia AWQ 4-bit
0.9935R2 ScoreShannon Scaling Law
Evaluation results
| Method | Links | |
|---|---|---|
| Shannon Scaling LawQuantization=AWQ, Precision=4-bit2026.05 | 0.9935 | |
| Asymmetric LawQuantization=AWQ, Precision=4-bit2026.05 | 0.9913 | |
| Symmetric LawQuantization=AWQ, Precision=4-bit2026.05 | 0.9866 | |
| QiD LawQuantization=AWQ, Precision=4-bit2026.05 | 0.9855 | |
| Law of PrecisionQuantization=AWQ, Precision=4-bit2026.05 | 0.9855 | |
| Shannon Scaling Law (Simplified)Quantization=AWQ, Precision=4-bit2026.05 | 0.9837 | |
| OpenAIQuantization=AWQ, Precision=4-bit2026.05 | 0.9764 | |
| ChinchillaQuantization=AWQ, Precision=4-bit2026.05 | 0.9574 |