List your company
ResearchFormerly WizWand

Mathematical Reasoning on CN Middle School 24

83.3AccuracyLALP
14.03632.0185067.982Sep 18, 2024Nov 20, 2024Jan 23, 2025Mar 28, 2025May 30, 2025Aug 2, 2025Oct 5, 2025
Updated 6mo ago

Evaluation results

MethodLinks
LALPStudent=Qwen2.5-32B-Instruct, Model Configuration=LALP2025.1083.3
Qwen2.5-Math-7B-InstructEvaluation Protocol=CHAIN-OF-THOUGHT, Decoding Strategy=rm@82024.0981.2
Qwen2.5-Math-1.5B-InstructEvaluation Protocol=CHAIN-OF-THOUGHT, Decoding Strategy=rm@82024.0980.2
Qwen2.5-Math-72B-InstructEvaluation Protocol=CHAIN-OF-THOUGHT, Decoding Strategy=rm@82024.0980.2
Qwen2.5-Math-7B-InstructEvaluation Protocol=TOOL-INTEGRATED REASONING, Decoding Strategy=rm@82024.0980.2
Qwen2.5-Math-72B-InstructEvaluation Protocol=TOOL-INTEGRATED REASONING, Decoding Strategy=rm@82024.0980.2
Qwen2-Math-72B-InstructEvaluation Protocol=CHAIN-OF-THOUGHT, Decoding Strategy=maj@82024.0979.2
Qwen2.5-Math-72B-InstructEvaluation Protocol=CHAIN-OF-THOUGHT, Decoding Strategy=Greedy2024.0979.2
Qwen2.5-Math-72B-InstructEvaluation Protocol=CHAIN-OF-THOUGHT, Decoding Strategy=maj@82024.0979.2
Qwen2-Math-7B-InstructEvaluation Protocol=CHAIN-OF-THOUGHT, Decoding Strategy=rm@82024.0978.2
Qwen2-Math-72B-InstructEvaluation Protocol=CHAIN-OF-THOUGHT, Decoding Strategy=rm@82024.0978.2
Qwen2.5-Math-7B-InstructEvaluation Protocol=CHAIN-OF-THOUGHT, Decoding Strategy=maj@82024.0978.2
Qwen2.5-Math-1.5B-InstructEvaluation Protocol=TOOL-INTEGRATED REASONING, Decoding Strategy=maj@82024.0978.2
Qwen2.5-Math-1.5B-InstructEvaluation Protocol=TOOL-INTEGRATED REASONING, Decoding Strategy=rm@82024.0978.2
Qwen2.5-Math-7B-InstructEvaluation Protocol=TOOL-INTEGRATED REASONING, Decoding Strategy=maj@82024.0978.2
Qwen2.5-Math-72B-InstructEvaluation Protocol=TOOL-INTEGRATED REASONING, Decoding Strategy=Greedy2024.0978.2
Qwen2.5-Math-72B-InstructEvaluation Protocol=TOOL-INTEGRATED REASONING, Decoding Strategy=maj@82024.0978.2
Qwen2-Math-72B-InstructEvaluation Protocol=CHAIN-OF-THOUGHT, Decoding Strategy=Greedy2024.0977.2
Qwen2.5-Math-1.5B-InstructEvaluation Protocol=CHAIN-OF-THOUGHT, Decoding Strategy=maj@82024.0977.2
Qwen2.5-Math-1.5B-InstructEvaluation Protocol=CHAIN-OF-THOUGHT, Decoding Strategy=Greedy2024.0976.2
NuminaMath-72B-CoTEvaluation Protocol=CHAIN-OF-THOUGHT, Decoding Strategy=Greedy2024.0975.2
Qwen2-Math-1.5B-InstructEvaluation Protocol=CHAIN-OF-THOUGHT, Decoding Strategy=rm@82024.0975.2
Qwen2.5-Math-7B-InstructEvaluation Protocol=TOOL-INTEGRATED REASONING, Decoding Strategy=Greedy2024.0975.2
Qwen2-72B-InstructEvaluation Protocol=CHAIN-OF-THOUGHT, Decoding Strategy=Greedy2024.0974.3
Qwen2.5-Math-7B-InstructEvaluation Protocol=CHAIN-OF-THOUGHT, Decoding Strategy=Greedy2024.0973.3
RandomStudent=Qwen2.5-32B-Instruct, Model Configuration=Random2025.1073.3
GALPStudent=Qwen2.5-32B-Instruct, Model Configuration=GALP2025.1073.3
Qwen2-Math-7B-InstructEvaluation Protocol=CHAIN-OF-THOUGHT, Decoding Strategy=maj@82024.0972.3
Qwen2.5-Math-1.5B-InstructEvaluation Protocol=TOOL-INTEGRATED REASONING, Decoding Strategy=Greedy2024.0971.3
Qwen2-Math-1.5B-InstructEvaluation Protocol=CHAIN-OF-THOUGHT, Decoding Strategy=maj@82024.0970.3
Local LowestStudent=Qwen2.5-32B-Instruct, Model Configuration=Local Lowest2025.1070
Qwen2-Math-7B-InstructEvaluation Protocol=CHAIN-OF-THOUGHT, Decoding Strategy=Greedy2024.0969.3
DeepSeekMath-7B-RLEvaluation Protocol=CHAIN-OF-THOUGHT, Decoding Strategy=Greedy2024.0967.3
DeepSeek-Coder-V2-Lite-InstructEvaluation Protocol=CHAIN-OF-THOUGHT, Decoding Strategy=Greedy2024.0966.3
Qwen2-Math-1.5B-InstructEvaluation Protocol=CHAIN-OF-THOUGHT, Decoding Strategy=Greedy2024.0966.3
GPT-4o-2024-08-06Evaluation Protocol=CHAIN-OF-THOUGHT, Decoding Strategy=Greedy2024.0960.4
NuminaMath-7B-CoTEvaluation Protocol=CHAIN-OF-THOUGHT, Decoding Strategy=Greedy2024.0960.4
Llama-3.1-70B-InstructEvaluation Protocol=CHAIN-OF-THOUGHT, Decoding Strategy=Greedy2024.0959.4
Qwen2-7B-InstructEvaluation Protocol=CHAIN-OF-THOUGHT, Decoding Strategy=Greedy2024.0954.5
Llama-3.1-8B-InstructEvaluation Protocol=CHAIN-OF-THOUGHT, Decoding Strategy=Greedy2024.0943.6
Mathstral-7B-v0.1Evaluation Protocol=CHAIN-OF-THOUGHT, Decoding Strategy=Greedy2024.0942.6
Internlm2-math-plus-mixtral8x7BEvaluation Protocol=CHAIN-OF-THOUGHT, Decoding Strategy=Greedy2024.0939.6
Internlm2-math-plus-20BEvaluation Protocol=CHAIN-OF-THOUGHT, Decoding Strategy=Greedy2024.0933.7
LALPStudent=Qwen2.5-7B-Instruct, Model Configuration=LALP2025.1033.3
Internlm2-math-plus-7BEvaluation Protocol=CHAIN-OF-THOUGHT, Decoding Strategy=Greedy2024.0932.7
Qwen2-1.5B-InstructEvaluation Protocol=CHAIN-OF-THOUGHT, Decoding Strategy=Greedy2024.0931.7
RandomStudent=Qwen2.5-7B-Instruct, Model Configuration=Random2025.1023.3
GALPStudent=Qwen2.5-7B-Instruct, Model Configuration=GALP2025.1023.3
Local LowestStudent=Qwen2.5-7B-Instruct, Model Configuration=Local Lowest2025.1023.3
Original ModelStudent=Qwen2.5-32B-Instruct, Model Configuration=Original Model2025.1023.3
Original ModelStudent=Qwen2.5-7B-Instruct, Model Configuration=Original Model2025.1016.7