Symbolic Reasoning on Last Letter Concatenation (test)
81.9AccuracyGPT-3.5-turbo
Evaluation Results
| Method | Links | |
|---|---|---|
| GPT-3.5-turboPrompting Strategy=Self-Consistency, Scenario=Scenario 32023.11 | 81.9 | |
| Self-AgreementModel=GPT-3.5-turbo, Scenario=Scenario 32023.11 | 81 | |
| GPT-3.5-turboPrompting Strategy=Few-Shot CoT, Scenario=Scenario 32023.11 | 80.6 | |
| GPT-3.5-turboPrompting Strategy=USC, Scenario=Scenario 32023.11 | 79.4 | |
| PaLMPrompting Strategy=Self-Consistency, Scenario=Scenario 32023.11 | 70.8 | |
| PaLMPrompting Strategy=Few-Shot CoT, Scenario=Scenario 32023.11 | 65.8 | |
| LaMDAPrompting Strategy=Few-Shot CoT, Scenario=Scenario 32023.11 | 8.2 | |
| LaMDAPrompting Strategy=Self-Consistency, Scenario=Scenario 32023.11 | 8.2 |