Image Recognition on ImageNet-1K 2009 (val)
80.6Top-1 AccuracyFlowformer
Evaluation results
| Method | Links | ||
|---|---|---|---|
| FlowformerComplexity=O(nd²), Params (MB)=41, FLOPs (G)=6.32022.02 | 80.6 | 94.9 | |
| DeiT+FlowformerComplexity=O(nd²), Params (MB)=22, FLOPs (G)=4.22022.02 | 80 | 94.8 | |
| DeiT-SComplexity=O(n²d), Params (MB)=22, FLOPs (G)=4.62022.02 | 79.8 | 95 | |
| ReformerComplexity=O((n log n)d), Params (MB)=37, FLOPs (G)=62022.02 | 79.6 | 94.7 | |
| SOFTComplexity=O(nd²), Params (MB)=37, FLOPs (G)=5.82022.02 | 79.2 | 94.5 | |
| Linear Trans.Complexity=O(nd²), Params (MB)=41, FLOPs (G)=6.32022.02 | 79 | 94.1 | |
| YOSO-EComplexity=O(nd²), Params (MB)=41, FLOPs (G)=5.82022.02 | 79 | 94.3 | |
| Full Attn.Complexity=O(n²d), Params (MB)=41, FLOPs (G)=6.72022.02 | 78.7 | 94.3 | |
| PerformerComplexity=O(nd²), Params (MB)=41, FLOPs (G)=6.32022.02 | 78.1 | 93.2 | |
| ViT-BaseComplexity=O(n²d), Params (MB)=86, FLOPs (G)=55.42022.02 | 77.9 | — | |
| LongformerComplexity=O(nd²), Params (MB)=38, FLOPs (G)=6.32022.02 | 77.6 | 93.1 | |
| NyströmformerComplexity=O(nd²), Params (MB)=41, FLOPs (G)=6.32022.02 | 77.2 | 93 | |
| ViT-LargeComplexity=O(n²d), Params (MB)=307, FLOPs (G)=190.72022.02 | 76.5 | — | |
| cosFormerComplexity=O(nd²), Params (MB)=41, FLOPs (G)=6.32022.02 | 68.3 | 88 |