Vision Understanding on Common Visual Understanding Benchmarks (GQA, MMB, MME, POPE, SEED, SQA, VQAv2)
61.1GQA ScoreUpper Bound
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Upper BoundToken=5762024.06 | 61.1 | 64 | 1,487.2 | 85 | 57.9 | 66.5 | 77.7 | 100 | 100 | |
| VoCo-LLaMAToken=12024.06 | 57 | 58.8 | 1,323.3 | 81.4 | 53.7 | 65.4 | 72.3 | 83.7 | 83.7 | |
| Avg. Pool + LinearToken=12024.06 | 52.9 | 55.5 | 1,210.3 | 79.1 | 50.3 | 62.2 | 65 | 64.1 | 64.1 | |
| Q-FormerToken=12024.06 | 51.1 | 51.7 | 1,079.7 | 77.3 | 47.2 | 62.7 | 63.4 | 57.2 | 57.2 | |
| Lower BoundToken=12024.06 | 37.7 | 22.3 | 617.3 | 53.9 | 36.9 | 60.7 | 41.2 | 0 | 0 |