MultiRC
Benchmarks
TaskDatasetSOTA resultTrendResults
MultiRC
82.6Accuracy
35
MultiRC
72.9MultiRC Accuracy
32
MultiRC
88.2F1 Score
17
MultiRC
82.72F1
16
MultiRC (test)
13.19Sufficiency
16
MultiRC
87.82F1 Score
14
MultiRC (dev)
77.5F1 Score
10
MultiRC
13,150Total Communication Time
9
MultiRC
10.3Accuracy (0-shot)
6
MultiRC Dir alpha=0.1
72.53Generalized Accuracy
5
MultiRC Dir alpha=0.1 Standard
75.21Personalized Accuracy (Acc_p)
5
MultiRC SuperGLUE (test)
27.2EM
5
MultiRC ERASER (test)
67Weighted Avg F1 (MultiRC)
5
MultiRC SuperGLUE (dev)
68.67Accuracy
4