ResearchBenchmarksImage Classification on CIFAR-10 (test) (Accuracy vs GELU Delta)Follow92.51AccuracySE-GEM91.282891.601491.9292.2386Apr 23, 2026Evaluation ResultsMethodMethodLinksAccuracyAccuracy Delta (vs GELU)SE-GEMBackbone=ResNet-56, Ep...Backbone=ResNet-56, Epsilon (ε)=10⁻⁴2026.0492.510.07GELUBackbone=ResNet-56Backbone=ResNet-562026.0492.44—ReLUBackbone=ResNet-56Backbone=ResNet-562026.0491.33—