VQA Natural Language Explanation on VQA-X filtered (test)
64.7BLEU-1S³C
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| S³Cevaluation_mode=filtered, unlabelled_samples=true2023.09 | 64.7 | 50.5 | 38.8 | 30.7 | 23.9 | 52.1 | 23 | 116.7 | 85.6 | 79.2 | |
| S³C*evaluation_mode=filtered, unlabelled_samples=false2023.09 | 64.4 | 49.9 | 38 | 29.1 | 23.4 | 51.9 | 22.7 | 112.1 | 83.7 | 75.9 | |
| NLX-GPTevaluation_mode=filtered2023.09 | 64.2 | 49.5 | 37.6 | 28.5 | 23.1 | 51.5 | 22.1 | 110.6 | 83.2 | 73.7 | |
| FMEevaluation_mode=filtered2023.09 | 59.1 | 43.4 | 31.7 | 23.1 | 20.4 | 47.1 | 18.4 | 87 | 75.5 | — | |
| PJ-Xevaluation_mode=filtered2023.09 | 57.4 | 42.2 | 30.9 | 22.7 | 19.7 | 46 | 17.1 | 82.7 | 76.4 | 69.3 | |
| e-UGevaluation_mode=filtered2023.09 | 57.3 | 42.7 | 31.4 | 23.2 | 22.1 | 45.7 | 20.1 | 74.1 | 80.5 | 71.4 | |
| RVTevaluation_mode=filtered2023.09 | 51.9 | 37 | 25.6 | 17.4 | 19.2 | 42.1 | 15.8 | 52.5 | 68.6 | 60.5 | |
| QA-onlyevaluation_mode=filtered2023.09 | 51 | 36.4 | 25.3 | 17.3 | 18.6 | 41.9 | 14.9 | 49.9 | — | — |