Visual Question Answering on VQA Standard v2 (test)
45.41APHyLoVQA
Evaluation results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| HyLoVQA#Mem=50002026.05 | 45.41 | — | — | — | — | — | — | — | — | — | — | 2.82 | — | |
| MacVQA2026.01 | 43.38 | 26.19 | 28.96 | 66.64 | 66.22 | 32.3 | 58.13 | 56.95 | 35.9 | 50.78 | 15.95 | 2.32 | — | |
| CLT-VQA#Mem=50002026.05 | 40.69 | — | — | — | — | — | — | — | — | — | — | 2.11 | — | |
| ProtoGroup2026.01 | 39.81 | 20.66 | 28.77 | 62.55 | 69.21 | 29.44 | 50.79 | 44.66 | 26.44 | 44.86 | 12.7 | 2.87 | — | |
| ProtoGroup#Mem=50002026.05 | 39.81 | — | — | — | — | — | — | — | — | — | — | 2.87 | — | |
| QUAD2026.01 | 39.25 | 20.51 | 28.04 | 62.62 | 68.65 | 29.39 | 50.67 | 44.48 | 26.38 | 44.72 | 12.64 | 3.91 | — | |
| QUAD#Mem=50002026.05 | 39.25 | — | — | — | — | — | — | — | — | — | — | 4.91 | — | |
| VQACL2026.01 | 38.77 | 20.47 | 28.02 | 62.55 | 68.61 | 29.35 | 50.66 | 44.45 | 26.36 | 44.65 | 12.6 | 2.9 | — | |
| VQACL#Mem=50002026.05 | 38.77 | — | — | — | — | — | — | — | — | — | — | 3.96 | — | |
| ER2026.01 | 36.99 | 18.64 | 21.36 | 61.27 | 64.17 | 30.29 | 52.84 | 43.39 | 23.31 | 42.75 | 11.85 | 4.8 | — | |
| ER#Mem=50002026.05 | 36.99 | — | — | — | — | — | — | — | — | — | — | 5.99 | — | |
| DER2026.01 | 35.35 | 14.55 | 13.83 | 62.88 | 65.16 | 30.96 | 51.19 | 40.51 | 19.04 | 42.87 | 12.55 | 6.58 | — | |
| DER#Mem=50002026.05 | 35.35 | — | — | — | — | — | — | — | — | — | — | 8.62 | — | |
| VS#Mem=50002026.05 | 34.03 | — | — | — | — | — | — | — | — | — | — | 8.79 | — | |
| MAS2026.01 | 20.56 | 30.81 | 8.07 | 25.5 | 4 | 31.9 | 32.39 | 26.24 | 24.75 | 19.85 | 2.75 | 21.97 | — | |
| MAS#Mem=50002026.05 | 20.56 | — | — | — | — | — | — | — | — | — | — | 11.16 | — | |
| EWC2026.01 | 15.77 | 6.73 | 8.43 | 27.22 | 47.1 | 0.14 | 12.4 | 1.76 | 10.98 | 31.05 | 11.85 | 28.38 | — | |
| EWC#Mem=50002026.05 | 15.77 | — | — | — | — | — | — | — | — | — | — | 30.62 | — | |
| Vanilla2026.01 | 14.49 | 7.39 | 4.94 | 22.29 | 32.3 | 0.71 | 12.14 | 12.1 | 10.69 | 27.29 | 15.1 | 30.15 | — | |
| Vanilla#Mem=50002026.05 | 14.49 | — | — | — | — | — | — | — | — | — | — | 30.8 | — | |
| Fully-FTArchitecture=CLIP-ViL2023.08 | — | — | — | — | — | — | — | — | — | — | — | — | 76.86 | |
| LSTArchitecture=CLIP-ViL2023.08 | — | — | — | — | — | — | — | — | — | — | — | — | 75.44 | |
| Partially⇑Architecture=CLIP-ViL2023.08 | — | — | — | — | — | — | — | — | — | — | — | — | 76.84 | |
| UniPTArchitecture=CLIP-ViL2023.08 | — | — | — | — | — | — | — | — | — | — | — | — | 75.53 |