Semantic Parsing on GeoQuery Length split
95.7Execution AccuracyGrammar Prompting (w. oracle grammar)
Evaluation Results
| Method | Links | |
|---|---|---|
| Grammar Prompting (w. oracle grammar)# ICL examples=32, # retrieval set=4402023.05 | 95.7 | |
| Grammar Prompting# ICL examples=32, # retrieval set=4402023.05 | 88.6 | |
| Standard Prompting# ICL examples=32, # retrieval set=4402023.05 | 86.4 | |
| Transformer2024.12 | 26 | |
| RU-Transformer2024.12 | 25 | |
| sDTM2024.12 | 20 |