List your company
ResearchFormerly WizWand

Mathematical Reasoning on GSM8K (Inference Time)

1.67Average Inference Time (s)CoT
-1.431619.504240.4461.3758Sep 24, 2025
Updated 7mo ago

Evaluation results

MethodLinks
CoTModel=GPT-3.52025.091.67
CoTModel=Llama3-70b2025.092.24
CoTModel=Mixtral 8x22b2025.092.5
Self-reflectionModel=GPT-3.52025.092.63
Self-reflectionModel=Mixtral 8x22b2025.093.46
CoTModel=GPT-4o-mini2025.093.48
Self-reflectionModel=Llama3-70b2025.094.31
CoTModel=Mixtral 8x7b2025.094.32
Self-reflectionModel=GPT-4o-mini2025.095.42
Self-consistencyModel=GPT-3.52025.095.97
MARSModel=GPT-3.52025.097.17
MADModel=GPT-3.52025.0911.58
DMADModel=GPT-3.52025.0914.47
Self-consistencyModel=Mixtral 8x22b2025.0914.63
MARSModel=Mixtral 8x22b2025.0916.23
Self-consistencyModel=GPT-4o-mini2025.0918.53
DMADModel=Mixtral 8x22b2025.0920.31
MARSModel=GPT-4o-mini2025.0923.16
MADModel=Mixtral 8x22b2025.0923.55
Self-consistencyModel=Llama3-70b2025.0926.35
Self-reflectionModel=Mixtral 8x7b2025.0926.84
MARSModel=Llama3-70b2025.0927.53
MADModel=Llama3-70b2025.0928.67
MADModel=GPT-4o-mini2025.0939.69
DMADModel=GPT-4o-mini2025.0946.86
Self-consistencyModel=Mixtral 8x7b2025.0947.78
DMADModel=Mixtral 8x7b2025.0954.61
MARSModel=Mixtral 8x7b2025.0963.15
DMADModel=Llama3-70b2025.0970.35
MADModel=Mixtral 8x7b2025.0979.21