Mathematical Reasoning on Math Base-11
33Accuracy (P_clean, Avg)SCO
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| SCOAdditional Information=Ground Truth2024.10 | 33 | 29.2 | 24 | 20 | 24.4 | 29.2 | 20 | 17.2 | 22.1 | |
| CD-CoTAdditional Information=Clean Demo2024.10 | 31 | 33.7 | 32.7 | 34.7 | 33.7 | 29 | 30.7 | 25.3 | 28.3 | |
| BTAdditional Information=Noise Position2024.10 | 24.3 | 17.9 | 17.2 | 13.7 | 16.3 | 12.8 | 9.2 | 6.8 | 9.6 | |
| Base2024.10 | 23.9 | 19.1 | 13.6 | 10.7 | 14.5 | 14 | 6.7 | 3.6 | 8.1 | |
| CCAdditional Information=Clean Demo2024.10 | 22.3 | 19.1 | 18.4 | 18.2 | 18.6 | 19 | 15.3 | 14.6 | 16.3 |