TACRED
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Re-TACRED K=32 (low-resource)
65.2Micro F1
10
TACRED low-resource K=16 re-evaluated
63.3Micro F1
10
Re-TACRED K=8 low-resource re-evaluated
57.1Micro F1
10
TACRED (OOD)
67.5Micro-F1
10
TACRED ID
71.1Micro-F1
10
Re-TACRED
91.3Micro F1
9
TACRED n known relations
95.53Accuracy
8
TACRED (test)
0.77Accuracy
8
TACRED (incremental)
0.983Performance T1
8
FS-TACRED 1-shot (test)
29F1 Score
7
TACRED
78.8B3 Precision
7
TACRED (test)
87.1B3 Precision
7
TACRED (unlabeled)
86.24Precision
7
TACRED 5-way 5-shot
88.42Score T1
7
TACRED 5-way 10-shot (test)
0.888Performance Score T1
7
TACRED (test)
53.28MRR
6
TACRED 10% (train)
0.658Precision
6
TACRED 1% (train)
73.8Precision
6
TACRED FS
27.6F1 Score
6
TACRED single-model (test)
72.1Precision
6
TACRED full (test)
71.1Micro F1 (Positive Class)
5
TACRED 1% (dev)
66.3Precision
5
TACRED (No dev)
46.6Precision
5
FS-TACRED (test)
12.39F1 Score
1
TACRED Session 1 to 10 (incremental)
—Primary metric
0