Executable SQL generation on Spider Snow 2.0
0.78EXAccREFORCE
Evaluation results
| Method | Links | ||
|---|---|---|---|
| REFORCEInput Table=Text, Tokens=3,5002026.01 | 0.78 | 0.86 | |
| OPTISQL (FULLFT)Input Table=Image, Tokens=2562026.01 | 0.68 | 0.77 | |
| OPTISQL (FROZENENC)Input Table=Image, Tokens=2562026.01 | 0.66 | 0.76 | |
| DEEPSEEK-OCRInput Table=OCR text, Tokens=3,5002026.01 | 0.62 | 0.7 | |
| DONUTInput Table=Image, Tokens=9002026.01 | 0.57 | 0.65 | |
| PIX2STRUCTInput Table=Image, Tokens=8002026.01 | 0.55 | 0.63 |