Scene Graph Classification on VG150 (test)
28.01mR@50BGNN
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| BGNNMethod=C-bias, Constraint Setting=no constraint2022.03 | 28.01 | — | — | — | 20.1 | 33.65 | |
| PCPLConstraint Setting=no constraint2022.03 | 26.8 | — | — | — | — | 32.8 | |
| BGNNMethod=baseline, Constraint Setting=no constraint2022.03 | 25.29 | — | — | — | 17.96 | 30.98 | |
| SHA + GCL2022.03 | 23 | — | — | — | 19.6 | 24.3 | |
| VCTree + GCL2022.03 | 22.5 | — | — | — | 19.5 | 23.5 | |
| Motifs + GCL2022.03 | 20.8 | — | — | — | 18 | 21.8 | |
| G-RCNNMethod=C-bias, Constraint Setting=no constraint2022.03 | 20.77 | — | — | — | 13.83 | 26.23 | |
| MotifsMethod=C-bias, Constraint Setting=no constraint2022.03 | 20.73 | — | — | — | 13.59 | 26.08 | |
| BGNNMethod=C-bias, Constraint Setting=constraint2022.03 | 20.38 | — | — | — | 15.8 | 21.87 | |
| G-RCNNMethod=baseline, Constraint Setting=no constraint2022.03 | 20.11 | — | — | — | 13.66 | 24.71 | |
| MotifsMethod=baseline, Constraint Setting=no constraint2022.03 | 19.76 | — | — | — | 12.9 | 25.54 | |
| VCTree-DLFEGraph Constraint=true2021.07 | 18.9 | 29.7 | 33.5 | 34.6 | 15.8 | 20 | |
| VCTree + DLFEBias Handling Strategy=Model-agnostic2022.03 | 18.9 | — | — | — | 15.8 | — | |
| VCTree + CogTreeBias Handling Strategy=Model-agnostic2022.03 | 18.8 | — | — | — | 15.4 | 19.9 | |
| PCPLConstraint Setting=constraint2022.03 | 18.6 | — | — | — | — | 19.6 | |
| PCPL+Object Detector=Faster R-CNN, Backbone=VGG-162022.03 | 18.6 | — | — | — | — | 19.6 | |
| SG-CogTree2022.03 | 15.7 | — | — | — | 13 | 16.7 | |
| BGNNMethod=baseline, Constraint Setting=constraint2022.03 | 15.58 | — | — | — | 13.24 | 16.58 | |
| MOTIFS-DLFEGraph Constraint=true2021.07 | 15.2 | 29 | 32.3 | 33.1 | 12.8 | 15.9 | |
| VCTree-TDEvariant=dagger, Graph Constraint=true2021.07 | 15.2 | 21.7 | 28.8 | 32 | 11.2 | 17.5 | |
| VCTree-PCPLvariant=dagger, Graph Constraint=true2021.07 | 15.2 | 36.5 | 40.6 | 41.7 | 12.7 | 16.1 | |
| Motifs + DLFEBias Handling Strategy=Model-agnostic2022.03 | 15.2 | — | — | — | 12.8 | 15.9 | |
| Motifs + CogTreeBias Handling Strategy=Model-agnostic2022.03 | 14.9 | — | — | — | 12.1 | 16.1 | |
| VCTree-STLvariant=diamond, Graph Constraint=true2021.07 | 14.6 | 40.6 | 45.7 | 46.9 | 10.5 | 16.6 | |
| BGNN2022.03 | 14.3 | — | — | — | — | 16.5 | |
| MOTIFS-TDEvariant=dagger, Graph Constraint=true2021.07 | 13.1 | 21.4 | 27.1 | 29.5 | 9.9 | 14.9 | |
| Motifs + TDEBias Handling Strategy=Model-agnostic2022.03 | 13.1 | — | — | — | 9.8 | 14.9 | |
| MOTIFS-STLvariant=diamond, Graph Constraint=true2021.07 | 12.8 | 35.4 | 39.9 | 40.9 | 8.5 | 14.1 | |
| GB-Net-BBackbone=VGG, Graph Constraint=true2021.07 | 12.7 | — | 37.3 | 38 | — | 13.4 | |
| VCTree-Reweightvariant=dagger, Graph Constraint=true2021.07 | 12.5 | 38 | 42.3 | 43.5 | 10.6 | 13.1 | |
| VCTree + ReweightBias Handling Strategy=Model-agnostic2022.03 | 12.5 | — | — | — | 10.6 | 13.1 | |
| VCTree + EBMBias Handling Strategy=Model-agnostic2022.03 | 12.5 | — | — | — | 10.4 | 13.5 | |
| VCTree-L2+uKDvariant=dagger, Graph Constraint=true2021.07 | 12.4 | 40.9 | 44.7 | 45.6 | 9.9 | 13.4 | |
| VCTree-L2+cKDvariant=dagger, Graph Constraint=true2021.07 | 12.4 | 41.4 | 45.2 | 46.1 | 9.7 | 13.1 | |
| VCTree + TDEBias Handling Strategy=Model-agnostic2022.03 | 12.2 | — | — | — | 8.9 | 14 | |
| MOTIFS-PCPLvariant=dagger, Graph Constraint=true2021.07 | 12 | 31.9 | 35.3 | 36.1 | 9.9 | 12.7 | |
| GPS-NetBackbone=VGG, Graph Constraint=true2021.07 | 11.8 | 36.1 | 39.2 | 40.1 | 10 | 12.6 | |
| GPS-Net2022.03 | 11.8 | — | — | — | 10 | 12.6 | |
| VCTree2022.03 | 11.8 | — | — | — | 9.6 | 12.5 | |
| VCTreevariant=dagger, Graph Constraint=true2021.07 | 11.3 | 42.1 | 45.8 | 46.8 | 9.1 | 12 | |
| MOTIFS-ReweightGraph Constraint=true2021.07 | 11.2 | 24.2 | 29.5 | 31.5 | 9.5 | 11.7 | |
| Motifs + ReweightBias Handling Strategy=Model-agnostic2022.03 | 11.2 | — | — | — | 9.5 | 11.7 | |
| MOTIFS-Resamplevariant=double-dagger, Graph Constraint=true2021.07 | 11 | 34.5 | 37.9 | 38.8 | 9.1 | 11.8 | |
| Part-AwareBackbone=VGG, Graph Constraint=true2021.07 | 10.9 | 36.5 | 39.4 | 40.2 | 8.7 | 11.6 | |
| MOTIFS-L2+uKDvariant=dagger, Graph Constraint=true2021.07 | 10.9 | 35.1 | 38.5 | 39.3 | 8.6 | 11.8 | |
| SHA2022.03 | 10.9 | — | — | — | 8.7 | 11.6 | |
| MOTIFS-L2+cKDvariant=double-dagger, Graph Constraint=true2021.07 | 10.7 | 35.6 | 38.9 | 39.8 | 8.7 | 11.4 | |
| Motifs + EBMBias Handling Strategy=Model-agnostic2022.03 | 10.2 | — | — | — | 8.2 | 11 | |
| G-RCNNMethod=C-bias, Constraint Setting=constraint2022.03 | 10.11 | — | — | — | 8.62 | 10.8 | |
| VCTreeBackbone=VGG, Graph Constraint=true2021.07 | 10.1 | 35.2 | 38.1 | 38.8 | 8.2 | 10.8 | |
| MotifsMethod=C-bias, Constraint Setting=constraint2022.03 | 9.89 | — | — | — | 8.5 | 10.41 | |
| G-RCNNMethod=baseline, Constraint Setting=constraint2022.03 | 9.67 | — | — | — | 8.35 | 10.17 | |
| KERNBackbone=VGG, Graph Constraint=true2021.07 | 9.4 | — | 36.7 | 37.4 | — | 10 | |
| KERN2022.03 | 9.4 | — | — | — | — | 10 | |
| MotifsMethod=baseline, Constraint Setting=constraint2022.03 | 9.39 | — | — | — | 7.9 | 9.97 | |
| IMPConstraint Setting=constraint2022.03 | 9.3 | — | — | — | — | 9.6 | |
| MOTIFSvariant=dagger, Graph Constraint=true2021.07 | 8.9 | 36.4 | 39.5 | 40.3 | 7.2 | 9.4 | |
| Motifs2022.03 | 8.3 | — | — | — | 6.7 | 8.8 | |
| VTransE+Object Detector=Faster R-CNN, Backbone=VGG-162022.03 | 8.2 | — | — | — | 6.6 | 8.7 | |
| MOTIFSBackbone=VGG, Graph Constraint=true2021.07 | 7.7 | 32.9 | 35.8 | 36.5 | 6.3 | 8.2 | |
| MOTIFS-Focalvariant=dagger, Graph Constraint=true2021.07 | 7.7 | 36 | 39.3 | 40.1 | 6.3 | 8.3 | |
| VCTreeConstraint Setting=constraint2022.03 | 7.4 | — | — | — | — | 7.9 | |
| FREQBackbone=VGG, Graph Constraint=true2021.07 | 7.2 | 29.3 | 32.3 | 32.9 | 5.1 | 8.5 | |
| IMP+Backbone=VGG, Graph Constraint=true2021.07 | 5.8 | 31.7 | 34.6 | 35.4 | — | 6 | |
| IMPConstraint Setting=no constraint2022.03 | 5.8 | — | — | — | — | 6 | |
| IMP+Object Detector=Faster R-CNN, Backbone=VGG-162022.03 | 5.8 | — | — | — | — | 6 | |
| DG-PGNNBackbone=VGG, Graph Constraint=true2021.07 | — | — | 39.3 | 40.1 | — | — | |
| HCNetBackbone=VGG, Graph Constraint=true2021.07 | — | 34.2 | 36.6 | 37.3 | — | — | |
| HOSE-NetBackbone=VGG, Graph Constraint=true2021.07 | — | — | 36.3 | 37.4 | — | — | |
| NODISBackbone=VGG, Graph Constraint=true2021.07 | — | 36 | 39.8 | 40.7 | — | — | |
| UVTransEBackbone=VGG, Graph Constraint=true2021.07 | — | — | 30.9 | 32.2 | — | — |