Multimodal Understanding on SEED (Score, Performance retention rate (%))
59.35ScoreEOS
Evaluation results
| Method | Links | ||
|---|---|---|---|
| EOSRetain (visual tokens)=322026.06 | 59.35 | — | |
| Upper BoundTokens=5762025.12 | 57.9 | 100 | |
| SparseVLM-v2Retain (visual tokens)=322026.06 | 57.71 | — | |
| SparseVLM-v1Retain (visual tokens)=322026.06 | 56.4 | — | |
| EOSRetain (visual tokens)=162026.06 | 55.1 | — | |
| ToMeRetain (visual tokens)=322026.06 | 53.62 | — | |
| SparseVLM-v2Retain (visual tokens)=162026.06 | 53.09 | — | |
| SparseVLM-v1Retain (visual tokens)=162026.06 | 51.94 | — | |
| Avg. PoolTokens=12025.12 | 50.3 | 25.8 | |
| ToMeRetain (visual tokens)=162026.06 | 50.07 | — | |
| HTC-VLMTokens=1 (hybrid)2025.12 | 49.8 | 61.4 | |
| VoCo-LLaMATokens=12025.12 | 48.8 | 56.7 | |
| Q-FormerTokens=12025.12 | 47.2 | 34.5 | |
| Lower BoundTokens=12025.12 | 36.9 | 0 | |
| PoolRetain (visual tokens)=322026.06 | 31.71 | — | |
| Fed-CMPSetting=MCross2026.03 | 31.6 | — | |
| FedAvg-TIEsSetting=MCross2026.03 | 29.4 | — | |
| MOONSetting=MCross2026.03 | 28.2 | — | |
| FedAvgSetting=MCross2026.03 | 27.8 | — | |
| PoolRetain (visual tokens)=162026.06 | 27.45 | — | |
| FedAdamSetting=MCross2026.03 | 26.5 | — | |
| Local TrainingSetting=MCross2026.03 | 25.1 | — | |
| FedAvg-TASetting=MCross2026.03 | 23.5 | — | |
| FedAvg-DARESetting=MCross2026.03 | 22.1 | — | |
| FedProxSetting=MCross2026.03 | 20.7 | — |