Commonsense Reasoning on HSwag (accuracy)
82.52HSwag AccuracyOPTIMER
Evaluation results
| Method | Links | |
|---|---|---|
| OPTIMERBase Model=Gemma 3 27B2026.03 | 82.52 | |
| OPTIMERBase Model=SEA-LION v42026.03 | 82.49 | |
| SEA-LION v4 27B IT2026.03 | 69.13 | |
| OriginalModel=LLaMA-3.2-1B-Instruct, Compression Ratio=100%, Precision=fp162025.07 | 60.7 | |
| Gemma 3 27B IT2026.03 | 55.91 | |
| COALAμModel=LLaMA-3.2-1B-Instruct, Compression Ratio=90%, Precision=fp162025.07 | 36.6 | |
| SVD-LLMModel=LLaMA-3.2-1B-Instruct, Compression Ratio=90%, Precision=fp162025.07 | 34.6 | |
| COALAμ=0Model=LLaMA-3.2-1B-Instruct, Compression Ratio=90%, Precision=fp162025.07 | 34.6 | |
| ASVDModel=LLaMA-3.2-1B-Instruct, Compression Ratio=90%, Precision=fp162025.07 | 27.8 |