Sentence Completion on HellaSwag (0-shot)
79.3AccuracyFP16
Evaluation results
| Method | Links | |
|---|---|---|
| FP16Backbone=LLaMA-3.1-8B, Quantization=None, Protocol=0-shot2026.02 | 79.3 | |
| AstroBackbone=LLaMA-3.1-8B, Quantization=W3A16g128, Protocol=0-shot2026.02 | 74 | |
| OmniQuantBackbone=LLaMA-3.1-8B, Quantization=W3A16g128, Protocol=0-shot2026.02 | 72.3 | |
| MagRBackbone=LLaMA-3.1-8B, Quantization=W3A16g128, Protocol=0-shot2026.02 | 72 |