Mathematical Reasoning on GSM8K (Accuracy & Average interaction number)
95.5AccuracyGPT-4 + PHP
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GPT-4 + PHPPHP=true, Prompting Strategy=Complex CoT, Decoding Strategy=greedy2023.04 | 95.5 | 2.0507 | |
| GPT-4PHP=false, Prompting Strategy=Complex CoT, Decoding Strategy=greedy2023.04 | 94.9 | — | |
| Previous SOTAPHP=false, Prompting Strategy=Complex CoT, Decoding Strategy=greedy2023.04 | 92 | — | |
| GPT-3.5 Turbo + PHPPHP=true, Prompting Strategy=Complex CoT, Decoding Strategy=greedy2023.04 | 85.1 | 2.3426 | |
| GPT-3.5 TurboPHP=false, Prompting Strategy=Complex CoT, Decoding Strategy=greedy2023.04 | 82.8 | — |