FewRel
Benchmarks
TaskDatasetSOTA resultTrendResults
FewRel Biomedical domain 2.0 (test)
87.9Accuracy
36
FewRel 1.0 (test)
0.971Accuracy
36
FewRel
87.34Micro-F1
23
FewRel (test)
0.902Precision
22
FewRel 2.0
0.674Accuracy (5-way 1-shot)
18
FewRel (test)
55.02Micro-F1
16
FewRel (test)
30.71Accuracy
15
FewRel 1.0
90.3Accuracy (5-way 1-shot)
13
FewRel (test)
27.3Accuracy
12
FewRel 10-way 5-shot 1.0
91.9Accuracy
8
FewRel 10-way 1-shot 1.0
88.2Accuracy
8
FewRel 5-way 5-shot 1.0
96Accuracy
8
FewRel 5-way 1-shot 1.0
92.6Accuracy
8
FewRel
93.5Accuracy
8
FewRel (test)
74Accuracy
8
FewRel (incremental)
98.8T1
8
FewRel Domain Adaptation 2.0
73.98Acc (5-way 1-shot)
8
FewRel
87.7B3 Precision
7
FewRel
43.8Accuracy (ACC)
7
FewRel (test)
75.2B3 Precision
7
FewRel 1.0
98.45-way 1-shot Acc
7
FewRel (unlabeled)
86.06Precision
7
FewRel m=15 (test)
74.33Precision
7
FewRel m=10 (test)
83.21Precision
7
FewRel m=5 (test)
92.82Precision
7