Image Classification on Fashion-MNIST 4x2000 (test)
87.12AccuracyEntmax-1.5 energy (GELU)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Entmax-1.5 energy (GELU)Label pathway=FFCL, Goodness function=Entmax-1.5 energy (GELU)2026.03 | 87.12 | 30.7 | |
| Entmax-1.25 energy (GELU)Label pathway=FFCL, Goodness function=Entmax-1.25 energy (GELU)2026.03 | 86.77 | 30.4 | |
| Entmax-1.5 energy (GELU)Label pathway=Std, Goodness function=Entmax-1.5 energy (GELU)2026.03 | 85.08 | 28.7 | |
| Contrast top-k (GELU)Label pathway=FFCL, Goodness function=Contrast top-k (GELU)2026.03 | 83.59 | 27.2 | |
| LayerNorm-top-k (GELU)Label pathway=Std, Goodness function=LayerNorm-top-k (GELU)2026.03 | 83.28 | 26.9 | |
| SoS (GELU)Label pathway=FFCL, Goodness function=SoS (GELU)2026.03 | 82.38 | 26 | |
| Top-k (Swish)Label pathway=Std, Goodness function=Top-k (Swish)2026.03 | 79.03 | 22.6 | |
| Contrast top-k (GELU)Label pathway=Std, Goodness function=Contrast top-k (GELU)2026.03 | 70.49 | 14.1 | |
| Softmax-energy-marginLabel pathway=Std, Goodness function=Softmax-energy-margin2026.03 | 68.72 | 12.3 | |
| SoS (GELU)Label pathway=Std, Goodness function=SoS (GELU)2026.03 | 61.43 | 5 | |
| SoS (ReLU)Label pathway=Std, Goodness function=SoS (ReLU)2026.03 | 56.41 | — |