Image Classification on CIFAR-10 (Standard Test Set)
95.1AccuracyLinGeoPE
Evaluation results
| Method | Links | ||
|---|---|---|---|
| LinGeoPEBackbone=Swin-S, Resolution=32x32, Training=from scratch, Window size=42025.12 | 95.1 | 0.04 | |
| GeoPEBackbone=Swin-S, Resolution=32x32, Training=from scratch, Window size=42025.12 | 94.8 | 0.05 | |
| LieREBackbone=Swin-S, Resolution=32x32, Training=from scratch, Window size=42025.12 | 94.5 | 0.05 | |
| STRINGBackbone=Swin-S, Resolution=32x32, Training=from scratch, Window size=42025.12 | 94.1 | 0.06 | |
| RoPE-MixedBackbone=Swin-S, Resolution=32x32, Training=from scratch, Window size=42025.12 | 93.8 | 0.07 | |
| CPEBackbone=Swin-S, Resolution=32x32, Training=from scratch, Window size=42025.12 | 93.2 | 0.09 | |
| RPBBackbone=Swin-S, Resolution=32x32, Training=from scratch, Window size=42025.12 | 92.8 | 0.1 | |
| LinGeoPEBackbone=ViT-Base, Resolution=32x32, Training=from scratch, Patch size=4, Epochs=4002025.12 | 92.5 | 0.06 | |
| GeoPEBackbone=ViT-Base, Resolution=32x32, Training=from scratch, Patch size=4, Epochs=4002025.12 | 92.1 | 0.07 | |
| LieREBackbone=ViT-Base, Resolution=32x32, Training=from scratch, Patch size=4, Epochs=4002025.12 | 91.7 | 0.08 | |
| STRINGBackbone=ViT-Base, Resolution=32x32, Training=from scratch, Patch size=4, Epochs=4002025.12 | 91.3 | 0.09 | |
| LinGeoPEBackbone=ViT-Small, Resolution=32x32, Training=from scratch, Patch size=4, Epochs=4002025.12 | 91.2 | 0.05 | |
| RoPE-MixedBackbone=ViT-Base, Resolution=32x32, Training=from scratch, Patch size=4, Epochs=4002025.12 | 90.9 | 0.1 | |
| GeoPEBackbone=ViT-Small, Resolution=32x32, Training=from scratch, Patch size=4, Epochs=4002025.12 | 90.8 | 0.07 | |
| LieREBackbone=ViT-Small, Resolution=32x32, Training=from scratch, Patch size=4, Epochs=4002025.12 | 90.4 | 0.06 | |
| CPEBackbone=ViT-Base, Resolution=32x32, Training=from scratch, Patch size=4, Epochs=4002025.12 | 90.3 | 0.11 | |
| STRINGBackbone=ViT-Small, Resolution=32x32, Training=from scratch, Patch size=4, Epochs=4002025.12 | 90 | 0.08 | |
| RoPE-MixedBackbone=ViT-Small, Resolution=32x32, Training=from scratch, Patch size=4, Epochs=4002025.12 | 89.6 | 0.08 | |
| APEBackbone=ViT-Base, Resolution=32x32, Training=from scratch, Patch size=4, Epochs=4002025.12 | 89.5 | 0.15 | |
| CPEBackbone=ViT-Small, Resolution=32x32, Training=from scratch, Patch size=4, Epochs=4002025.12 | 89.1 | 0.09 | |
| APEBackbone=ViT-Small, Resolution=32x32, Training=from scratch, Patch size=4, Epochs=4002025.12 | 88.2 | 0.12 |