Predicate Classification on Visual Genome
81.1Recall@50MOTIFNET
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| MOTIFNETGraph constraints=false2017.11 | 81.1 | 88.3 | — | — | — | — | — | — | — | |
| MOTIFNET-NOCONTEXTGraph constraints=false2017.11 | 78.8 | 85.9 | — | — | — | — | — | — | — | |
| FREQ-OVERLAPGraph constraints=false2017.11 | 75.7 | 82.9 | — | — | — | — | — | — | — | |
| MESSAGE PASSING+Graph constraints=false2017.11 | 75.2 | 83.6 | — | — | — | — | — | — | — | |
| FREQGraph constraints=false2017.11 | 71.3 | 81.2 | — | — | — | — | — | — | — | |
| JMSGGgraph constraints=true, bi-level sampling=false2023.04 | 70.8 | 71.7 | 24.9 | 28 | — | — | — | 36.8 | 40.3 | |
| PE-Net(P)Backbone=ResNeXt-101-FPN, Training Protocol=PL only2023.03 | 68.2 | 70.1 | 23.1 | 25.4 | 45.7 | 47.8 | — | — | — | |
| ASSOC. EMBEDGraph constraints=false2017.11 | 68 | 75.2 | — | — | — | — | — | — | — | |
| RU-Netgraph constraints=true, bi-level sampling=false2023.04 | 67.7 | 69.6 | — | 24.2 | — | — | — | — | 35.9 | |
| MSDNGraph constraints=true2017.11 | 67 | 71 | — | — | — | — | — | — | — | |
| R-CAGCNBackbone=ResNeXt-101-FPN2023.03 | 66.6 | 68.3 | 18.3 | 19.9 | 42.5 | 44.1 | — | — | — | |
| Seq2Seqgraph constraints=true, bi-level sampling=false2023.04 | 66.4 | 68.5 | 26.1 | 30.5 | — | — | — | 37.5 | 42.2 | |
| Motifs+graph constraints=true, bi-level sampling=false2023.04 | 66 | 67.9 | 14.6 | 15.8 | — | — | — | 23.9 | 25.6 | |
| KERNBackbone=ResNeXt-101-FPN, Reproduction=codebase [13], [27]2023.03 | 65.8 | 67.6 | 17.7 | 19.2 | 41.8 | 43.4 | — | — | — | |
| VTransEBackbone=ResNeXt-101-FPN2023.03 | 65.7 | 67.6 | 14.7 | 15.8 | 40.2 | 41.7 | — | — | — | |
| FlowSGMethod Stages=Two-stage, Evaluation Protocol=closed-set2026.04 | 65.7 | 68.8 | 49.2 | 53.3 | — | — | — | — | — | |
| VCTreeBackbone=ResNeXt-101-FPN2023.03 | 65.5 | 67.4 | 16.7 | 17.9 | 41.1 | 42.7 | — | — | — | |
| VCTreegraph constraints=true, bi-level sampling=false2023.04 | 65.5 | 67.4 | 15.4 | 16.6 | — | — | — | 24.9 | 26.6 | |
| VCTreeMethod Stages=Two-stage, Evaluation Protocol=closed-set2026.04 | 65.5 | 67.4 | 16.7 | 17.9 | — | — | — | — | — | |
| GR-CNNBackbone=ResNeXt-101-FPN, Reproduction=codebase [13], [27]2023.03 | 65.4 | 67.2 | 16.4 | 17.2 | 40.9 | 42.2 | — | — | — | |
| MotifsBackbone=ResNeXt-101-FPN2023.03 | 65.3 | 67.2 | 14.9 | 16.3 | 40.1 | 41.8 | — | — | — | |
| MOTIFMethod Stages=Two-stage, Evaluation Protocol=closed-set2026.04 | 65.3 | 67.2 | 14.9 | 16.3 | — | — | — | — | — | |
| GPS-NetBackbone=ResNeXt-101-FPN, Reproduction=codebase [13], [27]2023.03 | 65.2 | 67.1 | 15.2 | 16.6 | 40.2 | 41.9 | — | — | — | |
| GPS-Netgraph constraints=true, bi-level sampling=false2023.04 | 65.2 | 67.1 | 15.2 | 16.6 | — | — | — | 24.7 | 26.6 | |
| MOTIFNETGraph constraints=true2017.11 | 65.2 | 67.1 | — | — | — | — | — | — | — | |
| PE-NetBackbone=ResNeXt-101-FPN, Training Protocol=PL and PR2023.03 | 64.9 | 67.2 | 31.5 | 33.8 | 48.2 | 50.5 | — | — | — | |
| RelDNgraph constraints=true, bi-level sampling=false2023.04 | 64.8 | 66.7 | 15.8 | 17.2 | — | — | — | 25.4 | 27.3 | |
| Motifs++graph constraints=true, bi-level sampling=false2023.04 | 64.6 | 66.7 | 18.5 | 20 | — | — | — | 28.8 | 30.8 | |
| MSDNgraph constraints=true, bi-level sampling=false2023.04 | 64.6 | 66.6 | 15.9 | 17.5 | — | — | — | 25.5 | 27.7 | |
| GPS-Net++graph constraints=true, bi-level sampling=false2023.04 | 64.4 | 66.7 | 19.2 | 21.4 | — | — | — | 29.6 | 32.4 | |
| MOTIFNET-NOCONTEXTGraph constraints=true2017.11 | 63.7 | 65.6 | — | — | — | — | — | — | — | |
| CAPSGGMethod Stages=Two-stage, Evaluation Protocol=closed-set2026.04 | 63.4 | 67.7 | — | — | — | — | — | — | — | |
| OpenPSGMethod Stages=Two-stage, Evaluation Protocol=closed-set, reproduced=true2026.04 | 62.2 | 67.4 | 45.8 | 50.3 | — | — | — | — | — | |
| IMP++graph constraints=true, bi-level sampling=false2023.04 | 61.1 | 63.1 | 11 | 11.8 | — | — | — | 18.6 | 19.9 | |
| HL-Netgraph constraints=true, bi-level sampling=false2023.04 | 60.7 | 67 | — | 22.8 | — | — | — | — | 34 | |
| FREQ-OVERLAPGraph constraints=true2017.11 | 60.6 | 62.2 | — | — | — | — | — | — | — | |
| FREQGraph constraints=true2017.11 | 59.9 | 64.1 | — | — | — | — | — | — | — | |
| MESSAGE PASSING+Graph constraints=true2017.11 | 59.3 | 61.3 | — | — | — | — | — | — | — | |
| BGNNBackbone=ResNeXt-101-FPN, Reproduction=codebase [13], [27]2023.03 | 59.2 | 61.3 | 30.4 | 32.9 | 44.8 | 47.1 | — | — | — | |
| BGNNgraph constraints=true, bi-level sampling=true2023.04 | 59.2 | 61.3 | 30.4 | 32.9 | — | — | — | 40.2 | 42.8 | |
| PE-Net-ReweightBackbone=ResNeXt-101-FPN, Training Protocol=PL and PR, Re-weighting Strategy=[2]2023.03 | 59 | 61.4 | 38.8 | 40.7 | 48.9 | 51.1 | — | — | — | |
| PE-NetMethod Stages=Two-stage, Evaluation Protocol=closed-set2026.04 | 59 | 61.4 | 38.8 | 40.7 | — | — | — | — | — | |
| MSDN-FREQGraph constraints=true2017.11 | 56 | 61 | — | — | — | — | — | — | — | |
| SQUATgraph constraints=true, bi-level sampling=true2023.04 | 55.7 | 57.9 | 30.9 | 33.4 | — | — | — | 39.7 | 42.4 | |
| Motifs-NICEBackbone=ResNeXt-101-FPN2023.03 | 55.1 | 57.2 | 29.9 | 32.3 | 42.5 | 44.8 | — | — | — | |
| ASSOC. EMBEDGraph constraints=true2017.11 | 54.2 | 55.5 | — | — | — | — | — | — | — | |
| DSGGMethod Stages=Two-stage, Evaluation Protocol=closed-set2026.04 | 53.9 | 65.1 | 39.4 | 49.9 | — | — | — | — | — | |
| Motifs-ReweightBackbone=ResNeXt-101-FPN, Re-weighting Strategy=[2]2023.03 | 53.2 | 55.5 | 33.7 | 36.1 | 43.5 | 45.8 | — | — | — | |
| Motifs-BPL-SABackbone=ResNeXt-101-FPN2023.03 | 50.7 | 52.5 | 29.7 | 31.7 | 40.2 | 42.1 | — | — | — | |
| Motifs-PPDLBackbone=ResNeXt-101-FPN2023.03 | 47.2 | 47.6 | 32.2 | 33.3 | 39.7 | 40.5 | — | — | — | |
| VCTree-TDEgraph constraints=true, bi-level sampling=false2023.04 | 47.2 | 51.6 | 25.4 | 28.7 | — | — | — | 33 | 36.9 | |
| Motifs-TDEBackbone=ResNeXt-101-FPN, Strategy=Total Direct Effect (TDE)2023.03 | 46.2 | 51.4 | 25.5 | 29.1 | 35.9 | 40.3 | — | — | — | |
| MESSAGE PASSINGGraph constraints=true2017.11 | 44.8 | 53 | — | — | — | — | — | — | — | |
| Iterative Message PassingPooling strategy=learnt weighted sum2017.01 | 44.75 | 53.08 | — | — | — | — | — | — | — | |
| Motifs-GCLBackbone=ResNeXt-101-FPN2023.03 | 42.7 | 44.4 | 36.1 | 38.2 | 39.4 | 41.3 | — | — | — | |
| MSDN (current best reproducible)Graph constraints=true2017.11 | 42.3 | 48.2 | — | — | — | — | — | — | — | |
| Motifs-CogTreeBackbone=ResNeXt-101-FPN2023.03 | 35.6 | 36.8 | 26.4 | 29 | 31 | 32.9 | — | — | — | |
| Iterative Message PassingPooling strategy=max-pooling2017.01 | 34.33 | 41.99 | — | — | — | — | — | — | — | |
| Iterative Message PassingPooling strategy=average pooling2017.01 | 32.39 | 39.63 | — | — | — | — | — | — | — | |
| VRDGraph constraints=true2017.11 | 27.9 | 35 | — | — | — | — | — | — | — | |
| Lu et al.2017.01 | 27.88 | 35.04 | — | — | — | — | — | — | — | |
| BGNNgraph constraints=true, bi-level sampling=true2023.04 | — | — | 30.4 | 32.9 | — | — | — | — | — | |
| GPS-Netgraph constraints=true2023.04 | — | — | 15.2 | 16.6 | — | — | — | — | — | |
| GPS-Net+graph constraints=true2023.04 | — | — | 27.1 | 29.1 | — | — | 21.5 | — | — | |
| HL-Netgraph constraints=true2023.04 | — | — | — | 22.8 | — | — | — | — | — | |
| IMP++graph constraints=true2023.04 | — | — | 11 | 11.8 | — | — | 8.9 | — | — | |
| JMSGGgraph constraints=true2023.04 | — | — | 24.9 | 28 | — | — | — | — | — | |
| Motifs+graph constraints=true2023.04 | — | — | 14.6 | 15.8 | — | — | 11.5 | — | — | |
| MSDNgraph constraints=true2023.04 | — | — | 15.9 | 17.5 | — | — | — | — | — | |
| RelDNgraph constraints=true2023.04 | — | — | 15.8 | 17.2 | — | — | — | — | — | |
| RU-NetBackbone=ResNeXt-101-FPN2023.03 | — | — | — | 24.2 | — | 46.9 | — | — | — | |
| RU-Netgraph constraints=true2023.04 | — | — | — | 24.2 | — | — | — | — | — | |
| Seq2Seqgraph constraints=true2023.04 | — | — | 26.1 | 30.5 | — | — | 21.3 | — | — | |
| SQUATgraph constraints=true, bi-level sampling=true2023.04 | — | — | 30.9 | 33.4 | — | — | 25.6 | — | — | |
| VCTree-TDEgraph constraints=true, source=reported from [40]2023.04 | — | — | 25.4 | 28.7 | — | — | 18.4 | — | — | |
| VCTree+graph constraints=true2023.04 | — | — | 15.4 | 16.6 | — | — | 12.4 | — | — |