Visual Situated Reasoning on STAR-QA (test)
46.23Accuracy @ICoVGT
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| CoVGTPre-training=true2023.02 | 46.23 | 50.34 | 45.11 | 43.13 | 46.2 | |
| CoVGTPre-training=false2023.02 | 44.83 | 48.72 | 41.34 | 41.04 | 43.98 | |
| VGTPre-training=true2023.02 | 44.63 | 49.54 | 43.44 | 39.65 | 44.32 | |
| VGTPre-training=false2023.02 | 42.38 | 47.01 | 41.18 | 39.13 | 42.43 | |
| ClipBERTPre-training=false2023.02 | 39.81 | 43.59 | 32.34 | 31.42 | 36.79 | |
| HCRNPre-training=false2023.02 | 39.1 | 38.17 | 28.75 | 27.27 | 33.32 | |
| LGCNPre-training=false2023.02 | 39.01 | 37.97 | 28.81 | 26.98 | 33.19 | |
| VisualBERTPre-training=false2023.02 | 33.59 | 37.16 | 30.95 | 30.84 | 33.14 | |
| CLEVRERPre-training=false2023.02 | 33.25 | 32.67 | 30.69 | 30.43 | 31.76 | |
| NS-SRPre-training=false2023.02 | 30.88 | 31.76 | 30.23 | 29.73 | 30.65 |