Decoding Speed and Efficiency on ScienceQA (SQA)
3.86Avg Accepted LengthHSR-VATA
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| HSR-VATATemperature=0, VATA mechanism=disabled2026.02 | 3.86 | 77.5 | 1.97 | |
| HSR-VATATemperature=0, VATA mechanism=enabled2026.02 | 3.84 | 78.19 | 1.99 | |
| ViSpecTemperature=02026.02 | 3.78 | 78.01 | 1.98 | |
| MSDTemperature=02026.02 | 3.75 | 76.66 | 1.95 | |
| ViSpec(orig.)Temperature=02026.02 | 3.26 | 68.73 | 1.75 | |
| MSDTemperature=12026.02 | 3.24 | 67.3 | 1.71 | |
| HSR-VATATemperature=1, VATA mechanism=disabled2026.02 | 3.23 | 67.72 | 1.72 | |
| HSR-VATATemperature=1, VATA mechanism=enabled2026.02 | 3.23 | 68.58 | 1.74 | |
| ViSpecTemperature=12026.02 | 3.21 | 68 | 1.72 | |
| ViSpec(orig.)Temperature=12026.02 | 2.85 | 61.61 | 1.56 |