List your company
ResearchFormerly WizWand

Competition Math on AIME 2025 (accuracy)

40.8AccuracyVanilla
20.93626.09331.2536.407Nov 3, 2025
Updated 7mo ago

Evaluation results

MethodLinks
VanillaModel=Qwen 2.5 R1 7B, Compression Ratio (CR)=1, Sampling temperature=0.6, top-p=95%, Number of runs=82025.1140.8
kvtcModel=Qwen 2.5 R1 7B, Compression Ratio (CR)=9-11, Variant=8x, Sampling temperature=0.6, top-p=95%, Number of runs=82025.1140.8
kvtcModel=Qwen 2.5 R1 7B, Compression Ratio (CR)=18-21, Variant=16x, Sampling temperature=0.6, top-p=95%, Number of runs=82025.1138.3
kvtcModel=Qwen 2.5 R1 1.5B, Compression Ratio (CR)=9, Variant=8x, Sampling temperature=0.6, top-p=95%, Number of runs=82025.1124.2
kvtcModel=Qwen 2.5 R1 1.5B, Compression Ratio (CR)=18, Variant=16x, Sampling temperature=0.6, top-p=95%, Number of runs=82025.1122.5
VanillaModel=Qwen 2.5 R1 1.5B, Compression Ratio (CR)=1, Sampling temperature=0.6, top-p=95%, Number of runs=82025.1121.7