Model Training on Llama3.1-8B (train)
20.19Memory (GB)MXFP4
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| MXFP42026.04 | 20.19 | 14,323.01 | — | |
| MXFP4+HadamardHadamard Transform=true2026.04 | 20.6 | 14,312.19 | — | |
| Tseng et al.2026.04 | 20.6 | 12,997.9 | — | |
| HALO2026.04 | 20.6 | 10,482.19 | — | |
| AdaHOP-Lv1Optimization Level=Lv12026.04 | 20.94 | 13,246.88 | — | |
| AdaHOP-Lv2Optimization Level=Lv22026.04 | 28.04 | 13,134.02 | — | |
| BF162026.04 | 76 | 12,945.51 | — |