List your company
ResearchFormerly WizWand

Math Reasoning on AIME 2025 (mean@16 %)

35.6Mean Score (AIME 2025)IRDS
-1.2168.34217.927.458May 27, 2026
Updated 5mo ago

Evaluation results

MethodLinks
IRDSModel=QWEN3-4B, Data Budget=20%2026.0535.6
DEPOModel=QWEN3-4B, Data Budget=20%2026.0529
IFDModel=QWEN3-4B, Data Budget=20%2026.0528.1
PPL-TOPModel=QWEN3-4B, Data Budget=20%2026.0527.9
LIMRModel=QWEN3-4B, Data Budget=20%2026.0527.7
PPL-MIDDLEModel=QWEN3-4B, Data Budget=20%2026.0525.6
IRDSModel=QWEN3-1.7B, Data Budget=20%2026.0522.5
RANDOMModel=QWEN3-4B, Data Budget=20%2026.0521.9
TOKEN-LENGTHModel=QWEN3-4B, Data Budget=20%2026.0520.2
DEPOModel=QWEN3-1.7B, Data Budget=20%2026.0515.4
RANDOMModel=QWEN3-1.7B, Data Budget=20%2026.0514.6
LIMRModel=QWEN3-1.7B, Data Budget=20%2026.0513.5
PPL-MIDDLEModel=QWEN3-1.7B, Data Budget=20%2026.0512.7
TOKEN-LENGTHModel=QWEN3-1.7B, Data Budget=20%2026.0512.3
IFDModel=QWEN3-1.7B, Data Budget=20%2026.0510.8
PPL-TOPModel=QWEN3-1.7B, Data Budget=20%2026.059.2
RANDOMModel=LLAMA-3.1-8B-INSTRUCT, Data Budget=20%2026.051.7
IFDModel=LLAMA-3.1-8B-INSTRUCT, Data Budget=20%2026.051.7
DEPOModel=LLAMA-3.1-8B-INSTRUCT, Data Budget=20%2026.051
LIMRModel=LLAMA-3.1-8B-INSTRUCT, Data Budget=20%2026.050.8
IRDSModel=LLAMA-3.1-8B-INSTRUCT, Data Budget=20%2026.050.8
TOKEN-LENGTHModel=LLAMA-3.1-8B-INSTRUCT, Data Budget=20%2026.050.6
PPL-MIDDLEModel=LLAMA-3.1-8B-INSTRUCT, Data Budget=20%2026.050.6
PPL-TOPModel=LLAMA-3.1-8B-INSTRUCT, Data Budget=20%2026.050.2