FSC
Benchmarks
TaskDatasetSOTA resultTrendResults
FSC-147 1.0 (val)
9.52MAE
50
FSC-89
41.88Average Accuracy (AA)
25
FSC (test)
99.7Accuracy
25
FSC-147 (Average)
6.93MAE
19
FSC
99.2Accuracy
17
FSC (test)
100Intent Accuracy
16
FSC (val)
97.8Accuracy
14
FSC-133 (test)
13.85MAE
11
FSC-89 5-way 5-shot
80.83Accuracy
9
FSC-89 5-way 1-shot
63.62Accuracy
9
FSC Phase-4 (Eval)
25.7WER
9
FSC Phase-4 (dev)
23.7WER
9
FSC 3 tasks
99.28Avg Accuracy
9
FSC-147
11.3Pass@1
7
FSC-147
17.9MAE
7
FSC
98.58Accuracy
6
FSC (test)
100EM (Oracle)
4
100-FSC-147 (val)
81.39Accuracy
4