List your company
ResearchFormerly WizWand

General Reasoning on GPQA diamond

75.18Avg@8 AccuracyROSA (+LM + M)
0.674420.017239.3658.7028Sep 27, 2025Oct 18, 2025Nov 8, 2025Nov 30, 2025Dec 21, 2025Jan 11, 2026Feb 2, 2026
Updated 8mo ago

Evaluation results

MethodLinks
ROSA (+LM + M)Model=Qwen3-8B2025.0975.18
ROSA (+HS + R)Model=Qwen3-8B2025.0970.27
ROSA (+LM + R)Model=Qwen3-8B2025.0969.11
ROSA (+LM + M)Model=Qwen2.5-7B-Instruct2025.0945.83
ROSA (+HS + R)Model=Qwen2.5-7B-Instruct2025.0943.16
ROSA (+LM + R)Model=Qwen2.5-7B-Instruct2025.0942.24
BaselineModel=Qwen3-8B2025.0941.16
GPSBackbone=DeepSeek-R1-Distill-1.5B, Strategy=GPS, Runtime=16h2026.0230.4
PCLBackbone=DeepSeek-R1-Distill-1.5B, Strategy=PCL, Runtime=17h2026.0228.5
Uniform SamplingBackbone=DeepSeek-R1-Distill-1.5B, Strategy=Uniform, Runtime=16h2026.0227.5
MoPPSBackbone=DeepSeek-R1-Distill-1.5B, Strategy=MoPPS, Runtime=17h2026.0227.5
Dynamic Sampling (Oracle)Backbone=DeepSeek-R1-Distill-1.5B, Strategy=DS, Runtime=30h2026.0226.8
GRESOBackbone=DeepSeek-R1-Distill-1.5B, Strategy=GRESO, Runtime=27h2026.0226.4
BaselineModel=Qwen2.5-7B-Instruct2025.0926.14
ROSA (+LM + M)Model=DeepSeek-R1-Distill-Llama-8B2025.0925.36
GRESOBackbone=DeepSeek-R1-Distill-7B, Strategy=GRESO, Runtime=53h2026.0225
MoPPSBackbone=DeepSeek-R1-Distill-7B, Strategy=MoPPS, Runtime=42h2026.0223.4
DeepSeek-R1-Distill-1.5BBackbone=DeepSeek-R1-Distill-1.5B, Strategy=Base2026.0222.8
PCLBackbone=DeepSeek-R1-Distill-7B, Strategy=PCL, Runtime=50h2026.0222.4
ROSA (+HS + R)Model=DeepSeek-R1-Distill-Llama-8B2025.0922.23
GPSBackbone=DeepSeek-R1-Distill-7B, Strategy=GPS, Runtime=49h2026.0222.2
ROSA (+LM + R)Model=DeepSeek-R1-Distill-Llama-8B2025.0921.14
Dynamic Sampling (Oracle)Backbone=DeepSeek-R1-Distill-7B, Strategy=DS, Runtime=77h2026.0219.6
DeepSeek-R1-Distill-7BBackbone=DeepSeek-R1-Distill-7B, Strategy=Base2026.0219.2
BaselineModel=DeepSeek-R1-Distill-Llama-8B2025.0919.03
Uniform SamplingBackbone=DeepSeek-R1-Distill-7B, Strategy=Uniform, Runtime=40h2026.0217.3
ROSA (+LM + M)Model=Qwen3-0.6B2025.0913.16
BaselineModel=Qwen3-0.6B2025.0912.2
ROSA (+HS + R)Model=Qwen3-0.6B2025.0910.54
ROSA (+LM + M)Model=Qwen2.5-0.5B-Instruct2025.0910.27
ROSA (+LM + R)Model=Qwen3-0.6B2025.099.09
ROSA (+HS + R)Model=Qwen2.5-0.5B-Instruct2025.098.53
ROSA (+LM + R)Model=Qwen2.5-0.5B-Instruct2025.097.07
BaselineModel=Qwen2.5-0.5B-Instruct2025.093.54