List your company

Argument validity and novelty prediction on VALNOV (test)

45.16Joint F1ST-1st (GPT-3)
-23.2824-5.513712.25530.0237May 15, 2023

Evaluation results

MethodLinks
ST-1st (GPT-3)Category=Shared Task (ST)2023.0545.1674.6461.32
CCKGFull System=true2023.0543.9170.6963.3
ST-2nd (w/ KG)Category=Shared Task (ST)2023.0543.2769.862.43
contrastiveCategory=EG w/ Ours (ExplaGraphs)2023.0537.8264.7759.96
T5Category=EG w/ Ours (ExplaGraphs)2023.0537.7167.0763.53
max-marginCategory=EG w/ Ours (ExplaGraphs)2023.0536.2267.6163.27
ST System AvgCategory=Shared Task (ST)2023.0535.9462.7452.97
ST BaselineCategory=Shared Task (ST)2023.0523.959.9636.12
CCKGAblation=w/o PC-distance feats., Type=Relative to CCKG2023.05-2.27-0.27-3.73
CCKGAblation=w/o EWA, Type=Relative to CCKG2023.05-3.25-4.451.76
CCKGAblation=w/o connectivity feats., Type=Relative to CCKG2023.05-5.6-4.01-0.6
CCKGAblation=w/o EWO, Type=Relative to CCKG2023.05-6.51-3.8-1.69
CCKGAblation=string matching, Type=Relative to CCKG2023.05-6.71-3.230.55
CCKGAblation=w/o Graph feats., Type=Relative to CCKG2023.05-11.65-3.4-5.12
CCKGAblation=w/o Text feats., Type=Relative to CCKG2023.05-20.65-20.74-17.69