Explanation Graph Generation on ExplaGraphs (test)
91SAUpper Bound
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Upper Bound2022.04 | 91 | 91 | 83.5 | 71.1 | 0.38 | 46.8 | |
| EG3P2023.06 | 87.75 | 50.75 | 31.25 | 43.86 | 0.62 | 27.75 | |
| T5-BaseModel Scale=Base2022.04 | 87.2 | 38.7 | 19 | 33.6 | 0.71 | 20.8 | |
| T5-LargeModel Scale=Large2022.04 | 87.2 | 51 | 34.7 | 43.9 | 0.61 | 29.5 | |
| Generate & RefineModel Scale=Large, Modelling Technique=Generate & Refine2022.04 | 87.2 | 52.5 | 37.7 | 45.3 | 0.6 | 30 | |
| Pos Data AugModel Scale=Large, Data Augmentation Strategy=Positive Graph Perturbations2022.04 | 87.2 | 54.5 | 41.5 | 46.9 | 0.58 | 30.2 | |
| Max-MarginModel Scale=Large, Loss Function Type=Max-Margin2022.04 | 87.2 | 56.7 | 43.5 | 48.6 | 0.57 | 30.5 | |
| ContrastiveModel Scale=Large, Loss Function Type=Contrastive2022.04 | 87.2 | 60.5 | 42.5 | 52.1 | 0.52 | 33.1 | |
| BART-LargeBackbone=BART-Large2023.06 | 87.2 | 34.2 | 22.2 | 28.9 | 0.75 | 20 | |
| Contrastive Learning2023.06 | 87.2 | 40.7 | 26.3 | 31.3 | 0.71 | 22.3 | |
| COCOGEN2023.06 | 87.2 | 45.2 | 23.74 | 34.68 | 0.69 | 23.58 |