Logical Reasoning on ZebraLogic 140 puzzles
130Puzzle Accuracybf16
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| bf16precision=bf162026.04 | 130 | 2,671 | 2,671 | |
| arhq r128 allrank=128, layers=all2026.04 | 130 | 2,660 | 2,660 | |
| svdquant r128rank=1282026.04 | 127 | 2,643 | 2,643 | |
| awq4bitquantization=4-bit2026.04 | 125 | 2,589 | 2,589 | |
| nvfp4precision=nvfp42026.04 | 105 | 2,279 | 2,279 |