Math Word Problem solving on PARAMAWPS
79.1Value AccuracyDeBERTa (VM)
Evaluation results
| Method | Links | |
|---|---|---|
| DeBERTa (VM)5-fold cross validation=true, Voting Mechanism=true2023.06 | 79.1 | |
| DeBERTa5-fold cross validation=true2023.06 | 74.1 | |
| RNNEncDec5-fold cross validation=true2023.06 | 73.6 | |
| gpt-3.5-turboNumber of parameters=175B, Evaluation setup=zero-shot2023.06 | 73 | |
| RNNVAE5-fold cross validation=true2023.06 | 72.8 | |
| RoBERTa5-fold cross validation=true2023.06 | 72.5 | |
| BERT5-fold cross validation=true2023.06 | 72.1 | |
| Math-EN5-fold cross validation=true2023.06 | 71.6 | |
| DNS5-fold cross validation=true2023.06 | 71.2 | |
| GROUP-ATT5-fold cross validation=true2023.06 | 70.8 | |
| Transformer5-fold cross validation=true2023.06 | 64.6 | |
| GPT-JNumber of parameters=6B, Evaluation setup=zero-shot2023.06 | 5.9 | |
| text-curie-001Number of parameters=13B, Evaluation setup=zero-shot2023.06 | 4.2 | |
| text-babbage-001Number of parameters=6.7B, Evaluation setup=zero-shot2023.06 | 3.21 |