Classification on HIGGS (test)
79.1AUCReLU
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| ReLUArchitecture=Heavy, Params=26,6012026.01 | 79.1 | 71.8 | 0.179 | |
| ReLUArchitecture=Light, Params=4,1612026.01 | 78.4 | 71 | 0.217 | |
| GELUArchitecture=Light, Params=4,1612026.01 | 78.1 | 70.9 | 0.216 | |
| Hybrid (Specialist)Architecture=Light, Params=4,1612026.01 | 77.7 | 70.7 | 0.215 | |
| SiLUArchitecture=Light, Params=4,1612026.01 | 77 | 70.1 | 0.213 | |
| Gaussian RFFM=8192, D=8192, optimizer=Streaming Adam, batch size=8192, learning rate=0.022026.06 | 76 | — | — | |
| Gaussian RFFM=4096, D=4096, optimizer=Streaming Adam, batch size=8192, learning rate=0.022026.06 | 75.5 | — | — | |
| Gaussian RFFM=2048, D=2048, optimizer=Streaming Adam, batch size=8192, learning rate=0.022026.06 | 74.9 | — | — | |
| RAY (sketch)M=8192, D=52, optimizer=Streaming Adam, batch size=8192, learning rate=0.022026.06 | 74.9 | — | — | |
| RAY (sketch)M=4096, D=26, optimizer=Streaming Adam, batch size=8192, learning rate=0.022026.06 | 74.3 | — | — | |
| exact modulationM=4096, D=9, optimizer=Streaming Adam, batch size=8192, learning rate=0.022026.06 | 74.1 | — | — | |
| Gaussian RFFM=1024, D=1024, optimizer=Streaming Adam, batch size=8192, learning rate=0.022026.06 | 73.7 | — | — | |
| exact modulationM=8192, D=18, optimizer=Streaming Adam, batch size=8192, learning rate=0.022026.06 | 73.6 | — | — | |
| RAY (sketch)M=2048, D=13, optimizer=Streaming Adam, batch size=8192, learning rate=0.022026.06 | 73.4 | — | — | |
| exact modulationM=2048, D=4, optimizer=Streaming Adam, batch size=8192, learning rate=0.022026.06 | 73.2 | — | — | |
| Gaussian RFFM=512, D=512, optimizer=Streaming Adam, batch size=8192, learning rate=0.022026.06 | 71.9 | — | — | |
| RAY (sketch)M=1024, D=6, optimizer=Streaming Adam, batch size=8192, learning rate=0.022026.06 | 71.9 | — | — | |
| RAY (sketch)M=512, D=3, optimizer=Streaming Adam, batch size=8192, learning rate=0.022026.06 | 69.9 | — | — | |
| exact modulationM=1024, D=2, optimizer=Streaming Adam, batch size=8192, learning rate=0.022026.06 | 69.8 | — | — | |
| Linear baseline2026.06 | 68.2 | — | — | |
| exact modulationM=512, D=1, optimizer=Streaming Adam, batch size=8192, learning rate=0.022026.06 | 65.9 | — | — |