List your company
ResearchFormerly WizWand

Mathematical Reasoning on MATH500 (Avg@16 and Average)

88.05Avg@16 ScoreGRPO
1.948424.301746.65569.0083Dec 22, 2025
Updated 8mo ago

Evaluation results

MethodLinks
GRPOBackbone=Qwen3-8B2025.1288.0564.23
BuPOBackbone=Qwen3-8B2025.1287.7666.36
RLOOBackbone=Qwen3-8B2025.1287.3263.36
PPOBackbone=Qwen3-8B2025.1286.258.41
Reinforce++Backbone=Qwen3-8B2025.1286.0560.41
BuPOBackbone=Qwen3-4B2025.1284.958.51
PPOBackbone=Qwen3-4B2025.1283.6455.22
RLOOBackbone=Qwen3-4B2025.1282.7354
GRPOBackbone=Qwen3-4B2025.1282.4155.08
Reinforce++Backbone=Qwen3-4B2025.1280.6345.03
VanillaBackbone=Qwen3-8B2025.1280.4648.49
VanillaBackbone=Qwen3-4B2025.1280.2947.44
BuPOBackbone=Llama-OctoThinker-8B-Base2025.1262.0527.79
Reinforce++Backbone=Llama-OctoThinker-8B-Base2025.1259.5526.43
PPOBackbone=Llama-OctoThinker-8B-Base2025.1256.9722.82
GRPOBackbone=Llama-OctoThinker-8B-Base2025.1256.8924.11
RLOOBackbone=Llama-OctoThinker-8B-Base2025.1255.9722.18
BuPOBackbone=Llama-OctoThinker-3B-Base2025.1249.7919.59
GRPOBackbone=Llama-OctoThinker-3B-Base2025.1246.0718.58
PPOBackbone=Llama-OctoThinker-3B-Base2025.1243.2316.69
RLOOBackbone=Llama-OctoThinker-3B-Base2025.1241.9317.84
Reinforce++Backbone=Llama-OctoThinker-3B-Base2025.1211.595.27
VanillaBackbone=Llama-OctoThinker-8B-Base2025.129.843.75
VanillaBackbone=Llama-OctoThinker-3B-Base2025.125.261.68