Image Classification on JFT 300M (test)
60.62Top-1 AccuracyV-MoE-H/14, Every-2
Evaluation Results
| Method | Links | |
|---|---|---|
| V-MoE-H/14, Every-2Params=7.2B, ExaFLOPs=5.79k, TPUv3-days=3.47k2021.06 | 60.62 | |
| V-MoE-H/14, Last-5Params=2.7B, ExaFLOPs=4.75k, TPUv3-days=2.73k2021.06 | 60.12 | |
| V-MoE-L/16, Every-2Params=3.4B, ExaFLOPs=2.17k, TPUv3-days=1.20k2021.06 | 57.65 | |
| ViT-H/14Params=656M, ExaFLOPs=4.27k, TPUv3-days=2.38k2021.06 | 56.68 |