CSQA
Benchmarks
TaskDatasetSOTA resultTrendResults
CSQA
96Accuracy
366
CSQA
91.2CSQA Accuracy
195
CSQA (test)
0.953Accuracy
127
CSQA (test)
89.4Accuracy
123
CSQA
85.1AUROC
107
CSQA
88.9Accuracy
71
CSQA (test)
87.2Accuracy
68
CSQA
82.72Accuracy
61
CSQA
18.33ASR@3
52
CSQA
88Accuracy
42
CSQA
62ASR
36
CSQA OOD (test)
82.1Accuracy
32
CSQA
82.5Task Success Rate (TSR)
30
CSQA
0.49ASR@3
28
CSQA
98.9Accuracy
26
CSQA
85.42Accuracy
25
CSQA
86.7Accuracy (CSQA)
24
CSQA
1.67ASR@3
24
CSQA
1.04ECE
22
CSQA (in-domain)
86.8Accuracy
22
CSQA
88.1Accuracy
20
CSQA
84.1Accuracy
18
CSQA
66.4Accuracy (CSQA)
18
CSQA
84.06PIQA
18
CSQA
1.57ECE
16