FRAMES
Benchmarks
TaskDatasetSOTA resultTrendResults
FRAMES
86Accuracy
46
FRAMES (test)
97Precision
36
FRAMES
95F1 Score
36
FRAMES (test)
23.91Accuracy
35
FRAMES (test)
41.1Unreliability Rate
28
FRAMES
84.7Score
27
Frames
41.38ACCE
24
FRAMES
73.54Avg@4 Score
22
Frames
46.42Accuracy
16
Frames
36.6String-F1
14
FRAMES
56Accuracy
14
FRAMES
82.5Accuracy
14
FRAMES (test)
73.3Recall
13
FRAMES
10.5EM
13
FRAMES
90.6Average @3
13
Frames
90.6Accuracy
13
FRAMES
81.5Recall
11
FRAMES out-domain (test)
31.31LasJ
11
FRAMES Wiki18 index (test)
37.5Pass@4
10
FRAMES C=12k
34.95Accuracy
10
FRAMES
82.3Accuracy
10
Frames
50.57Success Rate (SR)
9
FRAMES
90.6Accuracy
9
FRAMES n=50 (full)
77.31Accuracy
8
FRAMES
90.6Pass@1
7