Visual Question Answering on VQA-CP v1 (test)
76.78Accuracy (Overall)TPCL_Fix↑
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| TPCL_Fix↑backbone=LXMERT2024.11 | 76.78 | 90.74 | 72.22 | 64.72 | |
| TPCL_Dyn↑backbone=LXMERT2024.11 | 76.15 | 93.93 | 62.62 | 63.91 | |
| PDGH2024.11 | 64.56 | 89.56 | 47.35 | 46.01 | |
| GenBBase=UpDn2022.08 | 62.74 | 86.18 | 43.85 | 47.03 | |
| GENBbackbone=UpDn2024.11 | 62.74 | 86.18 | 43.85 | 47.03 | |
| LBCLbackbone=UpDn2024.11 | 61.57 | 84.48 | 42.84 | 46.32 | |
| LMH-CSSBackbone=UpDn2020.03 | 60.95 | 85.6 | 40.57 | 44.62 | |
| CSSBase=UpDn2022.08 | 60.95 | 85.6 | 40.57 | 47.03 | |
| CF-VQA(SUM)Base=S-MRL2022.08 | 57.39 | 88.46 | 14.8 | 43.61 | |
| CF-VQA(SUM)Base=UpDn2022.08 | 57.03 | 89.02 | 17.08 | 41.27 | |
| LMHBackbone=UpDn, Ensemble-based=true, Reimplementation=true2020.03 | 55.27 | 76.47 | 26.66 | 45.68 | |
| LMHBase=UpDn2022.08 | 55.27 | 76.47 | 26.66 | 45.68 | |
| LXMERT2024.11 | 52.82 | 54.08 | 25.05 | 62.72 | |
| RUBiBackbone=UpDn, Ensemble-based=true, Reimplementation=true2020.03 | 50.9 | 80.83 | 13.84 | 36.02 | |
| RUBiBase=UpDn2022.08 | 50.9 | 80.83 | 13.84 | 36.02 | |
| RUBiBackbone=Baseline2019.06 | 46.93 | 66.78 | 20.98 | 43.64 | |
| RUBiBackbone=SAN2019.06 | 46.08 | 75 | 13.3 | 30.49 | |
| GRLBackbone=UpDn, Ensemble-based=true2020.03 | 45.69 | 77.64 | 13.21 | 26.97 | |
| RUBiBackbone=UpDn2019.06 | 44.81 | 69.65 | 14.91 | 32.13 | |
| AdvRegBackbone=SAN2019.06 | 43.43 | 74.16 | 12.44 | 25.32 | |
| ARegBase=UpDn2022.08 | 43.43 | 74.16 | 12.44 | 25.32 | |
| ARegBackbone=UpDn, Ensemble-based=true2020.03 | 41.17 | 65.49 | 15.48 | 35.48 | |
| UpDnBackbone=UpDn2020.03 | 39.74 | 42.27 | 11.93 | 46.05 | |
| GVQABackbone=SAN2020.03 | 39.23 | 64.72 | 11.87 | 24.86 | |
| GVQA2019.06 | 39.23 | 64.72 | 11.87 | 24.86 | |
| GVQA2022.08 | 39.23 | 64.72 | 11.87 | 24.86 | |
| UpDn2024.11 | 37.96 | 42.79 | 12.41 | 42.53 | |
| UpDn2019.06 | 37.15 | 41.13 | 12.73 | 43 | |
| Baseline2019.06 | 37.13 | 41.96 | 12.54 | 41.35 | |
| S-MRL2022.08 | 36.38 | 42.72 | 12.59 | 40.35 | |
| UpDn2022.08 | 36.38 | 42.72 | 42.14 | 40.35 | |
| SAN2022.08 | 32.5 | 36.86 | 12.47 | 36.22 | |
| SAN2019.06 | 26.88 | 35.34 | 11.34 | 24.7 |