Reasoning on AQUA, GSM8K, SVAMP, ASDiv, StrategyQA, CSQA, ARC, LastLetter (test)
72.84AQUA AccuracySGE
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| SGEBackbone=GPT-3.5, Use Code Interpreter=true2024.05 | 72.84 | 86.18 | 86.44 | 90.17 | 77.44 | 79.09 | 87.83 | 78.78 | 82.27 | |
| Decomp PromptingBackbone=GPT-3.5, Use Code Interpreter=true2024.05 | 71.64 | 82.11 | 84.34 | 89.83 | 76.16 | 78.84 | 87.48 | 77.89 | 81.11 | |
| Refine PromptingBackbone=GPT-3.5, Use Code Interpreter=true2024.05 | 58.81 | 76.1 | 80.44 | 87.35 | 73.38 | 74.13 | 85.71 | 74.78 | 76.34 | |
| CoT PromptingBackbone=GPT-3.5, Use Code Interpreter=true2024.05 | 58.35 | 75.84 | 80.3 | 87.39 | 72.97 | 74.36 | 85.48 | 74.63 | 76.17 | |
| IO PromptingBackbone=GPT-3.5, Use Code Interpreter=true2024.05 | 44.16 | 57.05 | 60.02 | 65.43 | 54.7 | 55.68 | 64.35 | 56.21 | 57.2 |