Math Reasoning on SingleOp (test)
97.86AccuracyCoT + Skill-Based
Evaluation results
| Method | Links | |
|---|---|---|
| CoT + Skill-BasedPrompting=Chain-of-Thought with Skill-Based exemplar selection, Model=GPT-4-0613, Shots=4-shot, Decoding Strategy=Greedy decoding2024.05 | 97.86 | |
| CoT + PALPrompting=Hybrid CoT + PAL, Model=GPT-4-0613, Shots=4-shot, Decoding Strategy=Greedy decoding2024.05 | 97.3 | |
| CoTPrompting=Chain-of-Thought, Model=GPT-4-0613, Shots=4-shot, Decoding Strategy=Greedy decoding2024.05 | 97.2 | |
| PALPrompting=Program-Aided Language Models, Model=GPT-4-0613, Shots=4-shot, Decoding Strategy=Greedy decoding2024.05 | 95.2 | |
| CoReBackbone=GPT-J 12B, Evaluation Protocol=Zero-shot2022.10 | 85.2 | |
| LogicFormEvaluation Protocol=Fine-tune2022.10 | 80.1 | |
| Self-ConsistencyBackbone=GPT-J 6B, Evaluation Protocol=Zero-shot2022.10 | 59.6 | |
| Generator onlyBackbone=GPT-J 6B, Evaluation Protocol=Zero-shot2022.10 | 53.2 |