List your company
ResearchFormerly WizWand

Mathematical Reasoning on OlympiadBench (Avg@4 accuracy)

51.45Avg@4 AccuracyReQueR
0.562813.773926.98540.1961Apr 28, 2026
Updated 6mo ago

Evaluation results

MethodLinks
ReQueRModel=Qwen3-8B, Temperature=0.62026.0451.45
CoTModel=Qwen3-8B, Temperature=0.62026.0450
ReQueRModel=Qwen2.5-72B-Instruct, Temperature=0.62026.0446.44
CoTModel=Qwen2.5-72B-Instruct, Temperature=0.62026.0443.62
ReQueRModel=Qwen3-1.7B, Temperature=0.62026.0439.02
CoTModel=Qwen3-1.7B, Temperature=0.62026.0437.83
ReQueRModel=Llama-3.1-70B-Instruct, Temperature=0.62026.0436.05
CoTModel=Llama-3.1-70B-Instruct, Temperature=0.62026.0431.31
ReQueRModel=Llama-3.1-8B-Instruct, Temperature=0.62026.0421.81
ReQueRModel=Qwen3-0.6B, Temperature=0.62026.0421.66
ReQueRModel=Llama-3.2-3B-Instruct, Temperature=0.62026.0419.88
CoTModel=Qwen3-0.6B, Temperature=0.62026.0419.14
CoTModel=Llama-3.1-8B-Instruct, Temperature=0.62026.0416.02
CoTModel=Llama-3.2-3B-Instruct, Temperature=0.62026.0412.76
ReQueRModel=Mixtral-8x7B-Instruct, Temperature=0.62026.0410.68
CoTModel=Mixtral-8x7B-Instruct, Temperature=0.62026.047.12
ReQueRModel=DS-MoE-16B-Chat, Temperature=0.62026.043.56
CoTModel=DS-MoE-16B-Chat, Temperature=0.62026.042.52