List your company
ResearchFormerly WizWand

Question Answering on MMLU (Accuracy and Token Count)

85.67AccuracyMARS
53.076461.53827078.4618Sep 24, 2025
Updated 7mo ago

Evaluation results

MethodLinks
MARSBackbone=GPT-4o-mini2025.0985.674,210
MADBackbone=GPT-4o-mini2025.0985.338,338
DMADBackbone=GPT-4o-mini2025.0985.338,706
Self-consistencyBackbone=GPT-4o-mini2025.09851,515
DMADBackbone=Llama3-70b2025.0984.679,641
MARSBackbone=Llama3-70b2025.0984.674,210
CoTBackbone=Llama3-70b2025.0984446
MADBackbone=Llama3-70b2025.09849,370
Self-reflectionBackbone=Llama3-70b2025.0983.671,087
DMADBackbone=Mixtral 8x22b2025.09837,570
Self-consistencyBackbone=Llama3-70b2025.0982.331,919
CoTBackbone=GPT-4o-mini2025.0981.67357
Self-reflectionBackbone=GPT-4o-mini2025.0980.67847
MARSBackbone=Mixtral 8x22b2025.0977.673,829
Self-reflectionBackbone=Mixtral 8x22b2025.0977.33988
MADBackbone=Mixtral 8x22b2025.0976.677,200
Self-consistencyBackbone=Mixtral 8x22b2025.0976.331,757
CoTBackbone=Mixtral 8x22b2025.0973.33434
MADBackbone=GPT-3.52025.0971.334,647
DMADBackbone=GPT-3.52025.09714,023
MARSBackbone=GPT-3.52025.09712,692
Self-reflectionBackbone=GPT-3.52025.0970.33609
Self-consistencyBackbone=GPT-3.52025.0969.331,141
CoTBackbone=GPT-3.52025.0968283
MARSBackbone=Mixtral 8x7b2025.09633,887
CoTBackbone=Mixtral 8x7b2025.0962438
Self-consistencyBackbone=Mixtral 8x7b2025.0961.671,742
MADBackbone=Mixtral 8x7b2025.09617,118
Self-reflectionBackbone=Mixtral 8x7b2025.09601,042
DMADBackbone=Mixtral 8x7b2025.0954.338,658