Mathematical Reasoning on GSM8K (Inference Time)
1.67Average Inference Time (s)CoT
Evaluation Results
| Method | Links | |
|---|---|---|
| CoTModel=GPT-3.52025.09 | 1.67 | |
| CoTModel=Llama3-70b2025.09 | 2.24 | |
| CoTModel=Mixtral 8x22b2025.09 | 2.5 | |
| Self-reflectionModel=GPT-3.52025.09 | 2.63 | |
| Self-reflectionModel=Mixtral 8x22b2025.09 | 3.46 | |
| CoTModel=GPT-4o-mini2025.09 | 3.48 | |
| Self-reflectionModel=Llama3-70b2025.09 | 4.31 | |
| CoTModel=Mixtral 8x7b2025.09 | 4.32 | |
| Self-reflectionModel=GPT-4o-mini2025.09 | 5.42 | |
| Self-consistencyModel=GPT-3.52025.09 | 5.97 | |
| MARSModel=GPT-3.52025.09 | 7.17 | |
| MADModel=GPT-3.52025.09 | 11.58 | |
| DMADModel=GPT-3.52025.09 | 14.47 | |
| Self-consistencyModel=Mixtral 8x22b2025.09 | 14.63 | |
| MARSModel=Mixtral 8x22b2025.09 | 16.23 | |
| Self-consistencyModel=GPT-4o-mini2025.09 | 18.53 | |
| DMADModel=Mixtral 8x22b2025.09 | 20.31 | |
| MARSModel=GPT-4o-mini2025.09 | 23.16 | |
| MADModel=Mixtral 8x22b2025.09 | 23.55 | |
| Self-consistencyModel=Llama3-70b2025.09 | 26.35 | |
| Self-reflectionModel=Mixtral 8x7b2025.09 | 26.84 | |
| MARSModel=Llama3-70b2025.09 | 27.53 | |
| MADModel=Llama3-70b2025.09 | 28.67 | |
| MADModel=GPT-4o-mini2025.09 | 39.69 | |
| DMADModel=GPT-4o-mini2025.09 | 46.86 | |
| Self-consistencyModel=Mixtral 8x7b2025.09 | 47.78 | |
| DMADModel=Mixtral 8x7b2025.09 | 54.61 | |
| MARSModel=Mixtral 8x7b2025.09 | 63.15 | |
| DMADModel=Llama3-70b2025.09 | 70.35 | |
| MADModel=Mixtral 8x7b2025.09 | 79.21 |