ATOMIC
Benchmarks
TaskDatasetSOTA resultTrendResults
ATOMIC 20 (test)
0.507BLEU-1
24
δ-ATOMIC
87.6Accuracy
18
ATOMIC20 2021 (test)
50.71BLEU-1
16
ATOMIC selected tasks 20
42.81ROUGE F1
12
ATOMIC (test)
15.4Overall Score
7
ATOMIC20 few-shot n = 30
16.65ROUGE Score
6
ATOMIC 20 (selected tasks)
19.92ROUGE
6
Annotated ATOMIC Subgraph (test)
80Precision (Total)
6
ATOMIC subset (test)
46.41MRR
6
ATOMIC
0.462BLEU-2
5
ATOMIC (2,000 events)
70,014Total Bits
3
ATOMIC 2019 (test)
11.11PPL
2
ATOMIC
299,068Total Events Count
1