Mathematical Reasoning on MATH Full (test)
0.539Overall AccuracyComplex CoT
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Complex CoTw/ PHP=true, Number of shots=8-shot, Backbone=GPT-4, Code Environment=None2023.08 | 0.539 | 0.298 | 0.419 | 0.557 | 0.563 | 0.738 | 0.743 | 2.8494 | |
| Complex CoTw/ PHP=false, Number of shots=8-shot, Backbone=GPT-4, Code Environment=None2023.08 | 0.5036 | 0.267 | 0.365 | 0.496 | 0.531 | 0.716 | 0.708 | — | |
| CoTw/ PHP=false, Backbone=GPT-4, Code Environment=None2023.08 | 0.425 | — | — | — | — | — | — | — |