Reasoning on CP
56AccuracyStrategyLLM-SC
Evaluation Results
| Method | Links | |
|---|---|---|
| StrategyLLM-SCModel=GPT-42023.11 | 56 | |
| CoT-SCModel=GPT-42023.11 | 54.5 | |
| StrategyLLMModel=GPT-42023.11 | 52.5 | |
| SolutionLLMModel=GPT-42023.11 | 52 | |
| CoTModel=GPT-42023.11 | 49.5 | |
| StrategyLLMModel=Claude-3-Sonnet2023.11 | 28 | |
| StrategyLLM-SCModel=Claude-3-Sonnet2023.11 | 28 | |
| CoTModel=Claude-3-Sonnet2023.11 | 26 | |
| CoT-SCModel=Claude-3-Sonnet2023.11 | 26 | |
| SolutionLLMModel=Claude-3-Sonnet2023.11 | 21 |