Spider
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Spider
77.5Pass@1
4
Spider Local Task r=0
58.7F1 Score
4
Spider (test dev)
0.717Execution Accuracy
4
SPIDER-SSP 1.0 (test)
70.1Template Match Rate
4
SPIDER
90.56Dice Score
3
Spider (dev)
41.7Strict Accuracy
3
SPIDER-CRC (test)
89.5Accuracy
3
SPIDER-Breast (test)
87.8Accuracy
3
SPIDER
35.9SP-SR
2
Spider (val)
91.08Accuracy (Easy)
2
Spider (test)
25.19Table EM
2