Visual Question Answering on VQA v2 (Novel Compositional Test)
44.96APHyLoVQA
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| HyLoVQA#Mem=50002026.05 | 44.96 | — | — | — | — | — | — | — | — | — | — | 2.62 | |
| MacVQA2026.01 | 42.53 | 24.35 | 28.09 | 67.05 | 69.65 | 30.06 | 48.41 | 54.05 | 29.43 | 47.21 | 17 | 3.6 | |
| QUAD2026.01 | 40 | 20.59 | 28.08 | 63.01 | 68.73 | 29.47 | 50.75 | 44.56 | 26.46 | 44.8 | 12.72 | 3.81 | |
| QUAD#Mem=50002026.05 | 40 | — | — | — | — | — | — | — | — | — | — | 3.81 | |
| CLT-VQA#Mem=50002026.05 | 38.46 | — | — | — | — | — | — | — | — | — | — | 3.51 | |
| ProtoGroup#Mem=50002026.05 | 36.9 | — | — | — | — | — | — | — | — | — | — | 4.06 | |
| ProtoGroup2026.01 | 36.81 | 20.33 | 27.89 | 62.22 | 68.64 | 29.23 | 50.45 | 44.27 | 26.14 | 44.42 | 12.34 | 4.09 | |
| VQACL2026.01 | 35.4 | 20.13 | 27.68 | 62.38 | 68.1 | 29.01 | 50.32 | 44.11 | 26.02 | 44.31 | 12.26 | 4.9 | |
| VQACL#Mem=50002026.05 | 35.4 | — | — | — | — | — | — | — | — | — | — | 4.9 | |
| ER2026.01 | 33.78 | 18.32 | 21.04 | 60.79 | 64.01 | 29.97 | 52.52 | 43.07 | 22.99 | 42.43 | 11.53 | 5.76 | |
| ER#Mem=50002026.05 | 33.78 | — | — | — | — | — | — | — | — | — | — | 5.76 | |
| VS#Mem=50002026.05 | 32.96 | — | — | — | — | — | — | — | — | — | — | 5.78 | |
| DER2026.01 | 31.52 | 14.17 | 13.45 | 62.5 | 64.78 | 30.58 | 50.81 | 39.94 | 18.85 | 42.49 | 12.17 | 8.59 | |
| DER#Mem=50002026.05 | 31.52 | — | — | — | — | — | — | — | — | — | — | 8.59 | |
| MAS2026.01 | 23.9 | 31.06 | 8.32 | 25.75 | 4.25 | 32.15 | 32.64 | 26.49 | 25 | 20.1 | 3 | 6.24 | |
| MAS#Mem=50002026.05 | 23.9 | — | — | — | — | — | — | — | — | — | — | 6.24 | |
| EWC2026.01 | 12.83 | 6.44 | 8.14 | 26.93 | 46.81 | 0.05 | 12.02 | 1.67 | 10.6 | 30.76 | 11.56 | 28.16 | |
| EWC#Mem=50002026.05 | 12.83 | — | — | — | — | — | — | — | — | — | — | 28.16 | |
| Vanilla2026.01 | 11.79 | 7.23 | 4.55 | 21.56 | 31.98 | 0.66 | 12.08 | 11.88 | 8.99 | 27.12 | 14.7 | 27.16 | |
| Vanilla#Mem=50002026.05 | 11.79 | — | — | — | — | — | — | — | — | — | — | 27.16 |