Scaling Law Modeling on Pythia bnb 4-bit
99.36R2 ScoreAsymmetric Law
Evaluation results
| Method | Links | |
|---|---|---|
| Asymmetric LawQuantization=bitsandbytes (bnb), Precision=4-bit2026.05 | 99.36 | |
| Shannon Scaling LawQuantization=bitsandbytes (bnb), Precision=4-bit2026.05 | 98.81 | |
| Symmetric LawQuantization=bitsandbytes (bnb), Precision=4-bit2026.05 | 98.67 | |
| QiD LawQuantization=bitsandbytes (bnb), Precision=4-bit2026.05 | 98.6 | |
| Law of PrecisionQuantization=bitsandbytes (bnb), Precision=4-bit2026.05 | 98.6 | |
| Shannon Scaling Law (Simplified)Quantization=bitsandbytes (bnb), Precision=4-bit2026.05 | 97.68 | |
| OpenAIQuantization=bitsandbytes (bnb), Precision=4-bit2026.05 | 96.79 | |
| ChinchillaQuantization=bitsandbytes (bnb), Precision=4-bit2026.05 | 95.42 |