Executable SQL generation on Spider Snow (style-shift) 2.0
86Execution AccuracyREFORCE
Evaluation results
| Method | Links | |
|---|---|---|
| REFORCEInput Table=Text, Tokens=3,5002026.01 | 86 | |
| OPTISQL (FROZENENC)Input Table=Image, Tokens=2562026.01 | 72 | |
| OPTISQL (FULLFT)Input Table=Image, Tokens=2562026.01 | 65 | |
| DEEPSEEK-OCRInput Table=OCR text, Tokens=3,5002026.01 | 58 | |
| PIX2STRUCTInput Table=Image, Tokens=8002026.01 | 50 | |
| DONUTInput Table=Image, Tokens=9002026.01 | 48 |