DocRED
Benchmarks
TaskDatasetSOTA resultTrendResults
DocRED (dev)
63.18F1 Score
235
DocRED (test)
64.03F1 Score
183
DocRED (test)
65.92F1 Score
121
DocRED (dev)
65.69F1 Score
98
DocRED v1 (test)
67.28F1
66
DocRED v1 (dev)
67.12F1 Score
65
Re-DocRED (test)
83.11Ignored F1
56
DocRED 1.0 (test)
63.89F1
51
DocRED official (test)
67.53RE
45
DocRED 1.0 (dev)
62.24F1
42
Re-DocRED (test)
80.39Ignored F1 Score
38
DocRED official (dev)
67.41F1 Score
38
DocRED human-annotated (test)
59.5Micro F1
36
DocRED Long-Tail Triples (dev)
0.439Precision
16
DocRED (dev)
57.55F1 Score
14
DocRED (test)
57.34F1 Score
13
Env-Re-DocRED revised entity name variation (test)
68.87Ignored F1
12
DocRED
80.2F1 Score
11
DocRED official (test)
84.96COREF
7
DocRED (val)
59.58Ignored F1
6
DocRED official (test)
93.38ME Score
6
DocRED v1 (test)
55.67F1 Score
6
DocRED v1 (dev)
55.84F1 Score
6
DocRED (dev)
45.12Macro F1-Score
5
DocRED (E2E split)
90.93Coref
5