List your company
ResearchFormerly WizWand

Mathematical Reasoning on GSM8K (test) (Gains, RSE %)

156.22GainCEM
-5.250436.669878.59120.5102May 11, 2026
Updated 5mo ago

Evaluation results

MethodLinks
CEMModel=Gemini 2.5 Flash Lite, Template ID=6, K=16, λ=0.12026.05156.220.32
CEMModel=Gemini 2.5 Flash Lite, Template ID=6, K=16, λ=0.32026.0585.210.36
CEMModel=Gemini 2.5 Flash Lite, Template ID=6, K=16, λ=0.52026.0582.590.37
CEMModel=Qwen2.5-Math-7B-Instruct, Template ID=6, K=16, λ=0.12026.0517.120.43
CEMModel=Qwen2.5-Math-7B-Instruct, Template ID=0, K=16, λ=0.12026.0516.411.02
CEMModel=Qwen2.5-Math-7B-Instruct, Template ID=6, K=8, λ=0.12026.0515.840.44
CEMModel=Qwen2.5-Math-7B-Instruct, Template ID=0, K=16, λ=0.32026.0515.841.05
CEMModel=Qwen2.5-Math-7B-Instruct, Template ID=0, K=16, λ=0.52026.0513.651.13
CEMModel=Qwen2.5-Math-7B-Instruct, Template ID=7, K=16, λ=0.12026.0511.450.79
CEMModel=Qwen2.5-Math-7B-Instruct, Template ID=0, K=8, λ=0.32026.058.031.21
CEMModel=Qwen2.5-Math-7B-Instruct, Template ID=7, K=8, λ=0.12026.058.020.95
CEMModel=Qwen2.5-Math-7B-Instruct, Template ID=5, K=16, λ=0.12026.056.935.05
CEMModel=Qwen2.5-Math-7B-Instruct, Template ID=0, K=8, λ=0.52026.056.591.26
CEMModel=Qwen2.5-Math-7B-Instruct, Template ID=0, K=8, λ=0.12026.056.51.22
CEMModel=Qwen2.5-Math-7B-Instruct, Template ID=6, K=4, λ=0.12026.055.360.44
CEMModel=Qwen2.5-Math-7B-Instruct, Template ID=1, K=16, λ=0.12026.055.332.95
CEMModel=Gemini 2.5 Flash Lite, Template ID=0, K=16, λ=0.12026.055.292.35
CEMModel=gpt-oss-20b-low, Template ID=8, K=24, λ=0.12026.054.571.36
CEMModel=Qwen2.5-Math-7B-Instruct, Template ID=0, K=4, λ=0.32026.054.511.27
CEMModel=gpt-oss-20b-low, Template ID=8, K=16, λ=0.12026.054.411.18
CEMModel=gpt-oss-20b-low, Template ID=8, K=8, λ=0.12026.054.360.84
CEMModel=Gemini 2.5 Flash Lite, Template ID=0, K=8, λ=0.12026.054.051.9
CEMModel=Qwen2.5-Math-7B-Instruct, Template ID=0, K=4, λ=0.52026.053.821.27
CEMModel=gpt-oss-20b-low, Template ID=0, K=16, λ=0.12026.053.812.95
CEMModel=Qwen2.5-Math-7B-Instruct, Template ID=0, K=4, λ=0.12026.053.681.24
CEMModel=Qwen2.5-Math-7B-Instruct, Template ID=5, K=8, λ=0.12026.053.671.77
CEMModel=gpt-oss-20b-low, Template ID=0, K=24, λ=0.12026.053.633.92
CEMModel=gpt-oss-20b-low, Template ID=0, K=8, λ=0.12026.053.342.56
CEMModel=Qwen2.5-Math-7B-Instruct, Template ID=7, K=4, λ=0.12026.053.221.08
CEMModel=Gemini 2.5 Flash Lite, Template ID=6, K=8, λ=0.12026.052.751.8
CEMModel=Qwen2.5-Math-7B-Instruct, Template ID=8, K=4, λ=0.32026.052.734.09
CEMModel=Qwen2.5-Math-7B-Instruct, Template ID=8, K=4, λ=0.52026.052.454.57
CEMModel=Qwen2.5-Math-7B-Instruct, Template ID=1, K=8, λ=0.12026.052.292.99
CEMModel=Qwen2.5-Math-7B-Instruct, Template ID=5, K=4, λ=0.12026.052.151.2
CEMModel=Qwen2.5-Math-7B-Instruct, Template ID=8, K=4, λ=0.12026.051.914.97
CEMModel=Qwen2.5-Math-7B-Instruct, Template ID=2, K=16, λ=0.12026.051.870.27
CEMModel=Qwen2.5-Math-7B-Instruct, Template ID=3, K=16, λ=0.12026.051.750.8
CEMModel=Qwen2.5-Math-7B-Instruct, Template ID=2, K=4, λ=0.12026.051.630.22
CEMModel=Qwen2.5-Math-7B-Instruct, Template ID=2, K=8, λ=0.12026.051.480.24
CEMModel=Qwen2.5-Math-7B-Instruct, Template ID=3, K=8, λ=0.12026.051.460.63
CEMModel=Qwen2.5-Math-7B-Instruct, Template ID=4, K=8, λ=0.12026.051.380.36
CEMModel=Qwen2.5-Math-7B-Instruct, Template ID=4, K=4, λ=0.12026.051.340.31
CEMModel=Qwen2.5-Math-7B-Instruct, Template ID=1, K=4, λ=0.12026.051.311.97
CEMModel=Qwen2.5-Math-7B-Instruct, Template ID=4, K=16, λ=0.12026.051.220.4
CEMModel=Qwen2.5-Math-7B-Instruct, Template ID=3, K=4, λ=0.12026.051.070.43
CEMModel=Gemini 2.5 Flash Lite, Template ID=6, K=4, λ=0.12026.051.060.99
CEMModel=Gemini 2.5 Flash Lite, Template ID=0, K=4, λ=0.12026.050.961.95