Compositional Visual Reasoning on CVR (Sample Size Sweep)
47.4Accuracy (Joint)PR-A2CL
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| PR-A2CLPara. (M)=27.8, GFLOPs=13.32026.03 | 47.4 | 47.2 | 68.9 | 67.5 | |
| DBCRPara. (M)=73.1, GFLOPs=11.32026.03 | 46.5 | 45.3 | 67.3 | 65.6 | |
| R³PCLPara. (M)=29.6, GFLOPs=12.72026.03 | 44.8 | 40.9 | 63.8 | 60.3 | |
| SSL-ResNet-50Para. (M)=28.0, GFLOPs=10.82026.03 | 44.3 | 40.5 | 59.6 | 54.5 | |
| SSL-ViT-SmallPara. (M)=22.6, GFLOPs=11.22026.03 | 39.3 | 46.7 | 46.3 | 56.4 | |
| IN-ResNet-50Para. (M)=28.0, GFLOPs=10.82026.03 | 32 | 33.9 | 46.2 | 46.6 | |
| CLIP-ViT-BasePara. (M)=22.6, GFLOPs=11.22026.03 | 31.1 | 33.9 | 52.7 | 48.9 | |
| CLIP-ResNet-50Para. (M)=28.0, GFLOPs=10.82026.03 | 28.7 | 34 | 47.1 | 48.5 | |
| IN-ViT-SmallPara. (M)=22.6, GFLOPs=11.22026.03 | 27.9 | 31.7 | 32.9 | 37 | |
| ResNet-50Para. (M)=28.0, GFLOPs=10.82026.03 | 27.5 | 28 | 38.4 | 34.9 | |
| ViT-SmallPara. (M)=22.6, GFLOPs=11.22026.03 | 27.3 | 28.6 | 28.7 | 31.7 | |
| PredRNetPara. (M)=8.4, GFLOPs=5.82026.03 | 26.9 | 28.9 | 37.5 | 38.5 | |
| WReNPara. (M)=1.5, GFLOPs=0.32026.03 | 26.8 | 30 | 32 | 34.1 | |
| SCL-ResNet-18Para. (M)=11.5, GFLOPs=4.82026.03 | 26.4 | 31.4 | 40.4 | 39.5 | |
| SCARPara. (M)=0.5, GFLOPs=0.72026.03 | 26.2 | 27.1 | 27.4 | 28.4 | |
| SCLPara. (M)=0.2, GFLOPs=0.12026.03 | 25.8 | 26.9 | 33.9 | 30.3 |