Semantic Probing on ImageNet-100 (test)
85.8Top-1 AccCOMiT-L
Evaluation results
| Method | Links | |
|---|---|---|
| COMiT-L#params=610M, msg length=256, voc. size=64k2026.02 | 85.8 | |
| COMiT-XL#params=900M, msg length=256, voc. size=64k2026.02 | 84.69 | |
| COMiT-B#params=174M, msg length=256, voc. size=64k2026.02 | 82.91 | |
| FlexTok(d18-d18)#params=860M, msg length=256, voc. size=64k2026.02 | 81.54 | |
| FlexTok(d18-d28)#params=2.5B, msg length=256, voc. size=64k2026.02 | 80.93 | |
| FlexTok(d12-d12)#params=254M, msg length=256, voc. size=64k2026.02 | 80.25 | |
| SelfTok#params=2.17B, msg length=512, voc. size=2^15, trained on larger data mixtures=true2026.02 | 40.64 | |
| SelfTok#params=2.17B, msg length=1024, voc. size=2^16, trained on larger data mixtures=true2026.02 | 35.9 | |
| ALIT#params=229M, msg length=256, voc. size=2^102026.02 | 29.43 | |
| TiTok-S#params=44M, msg length=128, voc. size=2^122026.02 | 19.47 | |
| TiTok-B#params=172M, msg length=64, voc. size=2^122026.02 | 19.43 | |
| TiTok-L#params=614M, msg length=32, voc. size=2^122026.02 | 17.26 |