SpreadSheetBench
Benchmarks
TaskDatasetSOTA resultTrendResults
SpreadsheetBench held-out (test)
85Score
59
SpreadsheetBench (in-distribution)
48.33Vrf Score
30
SpreadsheetBench (test)
58.5Accuracy
24
SpreadsheetBench Full
47.42Soft Score
24
SpreadsheetBench Verified (Held-out)
70.5Verification Score
24
SpreadsheetBench Soft Restriction
75.56Cell-Level Accuracy
24
SpreadsheetBench Hard Restriction
66.67Cell-Level Accuracy
21
SpreadsheetBench Verified
71.11Accuracy
18
SpreadsheetBench (test)
84Pass Rate
18
SpreadsheetBench
57.7Pass@1
16
SpreadsheetBench Verified
82.3Score
8
SpreadsheetBench
28.8Soft Accuracy
8
SpreadsheetBench (SSB)
96Coverage
7
SpreadsheetBench
50.5Pass@1
7
SpreadSheetBench
55.36Success Rate
5
SpreadsheetBench
69.83Vrf Score
4
SpreadsheetBench common tasks (test)
52Pass Rate
3
SpreadsheetBench (250 held-out tasks)
57.4Mean Score
3
SpreadsheetBench (test)
4.278Correctness
2