Multimodal Understanding on MM-Vet (Efficiency)
3.82Average Accepted Length (tau)HSR-VATA
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| HSR-VATATemperature=0, VATA mechanism=disabled2026.02 | 3.82 | 73.42 | 1.95 | |
| HSR-VATATemperature=0, VATA mechanism=enabled2026.02 | 3.8 | 74.16 | 1.97 | |
| ViSpecTemperature=02026.02 | 3.72 | 72.83 | 1.94 | |
| MSDTemperature=02026.02 | 3.6 | 70.14 | 1.87 | |
| ViSpec(orig.)Temperature=02026.02 | 3.2 | 64.81 | 1.72 | |
| HSR-VATATemperature=1, VATA mechanism=enabled2026.02 | 3 | 64.02 | 1.7 | |
| MSDTemperature=12026.02 | 2.94 | 62.7 | 1.66 | |
| ViSpecTemperature=12026.02 | 2.91 | 63.52 | 1.69 | |
| HSR-VATATemperature=1, VATA mechanism=disabled2026.02 | 2.8 | 58.86 | 1.56 | |
| ViSpec(orig.)Temperature=12026.02 | 2.7 | 58.25 | 1.55 |