Text-to-SQL on GEOQUERY template (test)
0.83AccuracyLIRd+RIR
Evaluation results
| Method | Links | |
|---|---|---|
| LIRd+RIRbackbone=T5-base2021.04 | 0.83 | |
| Baselinebackbone=T5-large2021.04 | 0.819 | |
| Baselinebackbone=T5-base2021.04 | 0.797 | |
| Baselinebackbone=T5-3B2021.04 | 0.797 | |
| LIRd+RIRbackbone=T5-large2021.04 | 0.797 | |
| LIRd+RIRbackbone=T5-3B2021.04 | 0.758 | |
| Seq2Seq+STcitation_symbol=♣2021.04 | 0.636 | |
| Transformer+STcitation_symbol=♣2021.04 | 0.619 | |
| Transformercitation_symbol=♣2021.04 | 0.539 | |
| GECAcitation_symbol=◊2021.04 | 0.521 | |
| Seq2Seqcitation_symbol=♣2021.04 | 0.485 | |
| Seq2Seqcitation_symbol=♠2021.04 | 0.2 |