Numerical Reasoning on SVAMP (test)
57.4Exact Match (EM)POET-SQL_T5
Evaluation Results
| Method | Links | |
|---|---|---|
| POET-SQL_T5Model size=11B, Base model=T52022.01 | 57.4 | |
| T5-11BModel size=11B2022.01 | 52.9 | |
| POET-SQLBackbone=BART-Large2022.01 | 33.5 | |
| BART-LargeBackbone=BART-Large2022.01 | 12.4 |