Accuracy on SVAMP Mathematical Reasoning
86.6Accuracy (SVAMP)Few-shot-CoT + self consistency
Evaluation Results
| Method | Links | |
|---|---|---|
| Few-shot-CoT + self consistencyModel=PaLM (540B), Prompting Strategy=Few-shot, Chain-of-thought=true, Self-consistency=40 paths2022.05 | 86.6 | |
| Zero-shot-CoT + self consistencyModel=PaLM (540B), Prompting Strategy=Zero-shot, Chain-of-thought=true, Self-consistency=40 paths2022.05 | 80.5 | |
| Few-shot-CoTModel=PaLM (540B), Prompting Strategy=Few-shot, Chain-of-thought=true2022.05 | 79 | |
| Zero-shotModel=PaLM (540B), Prompting Strategy=Zero-shot, Chain-of-thought=false2022.05 | 63.1 | |
| Zero-shot-CoTModel=PaLM (540B), Prompting Strategy=Zero-shot, Chain-of-thought=true2022.05 | 63.1 |