List your company
ResearchFormerly WizWand

General Reasoning on GPQA

86.4AccuracyGemini 2.5 Pro
3.92825.33946.7568.161Nov 6, 2025Dec 9, 2025Jan 12, 2026Feb 15, 2026Mar 20, 2026Apr 23, 2026May 27, 2026
Updated 5mo ago

Evaluation results

MethodLinks
Gemini 2.5 ProInput Modality=Text, LLM-as-a-Judge=GPT-4o2025.1186.4
GPT-5 highInput Modality=Text, LLM-as-a-Judge=GPT-4o2025.1185.7
BaseModel=Qwen3-4B2026.0585
COSEModel=Qwen3-4B2026.0584.85
Claude Sonnet 4.5Input Modality=Text, LLM-as-a-Judge=GPT-4o2025.1183.4
AZRModel=Qwen3-4B2026.0583.2
COSEModel=Llama-3.2-3B-Instruct2026.0583.02
COSEModel=Qwen3-0.6B2026.0582.67
MAEModel=Qwen3-4B2026.0582.6
R-ZeroModel=Qwen3-4B2026.0582.4
MAEModel=Llama-3.2-3B-Instruct2026.0581
Sora-2 AudioInput Modality=Audio, LLM-as-a-Judge=GPT-4o2025.1157.6
Sora-2 Last FrameInput Modality=Last Frame, LLM-as-a-Judge=GPT-4o2025.1151.5
GSPOBackbone=Qwen3-4B-Base2026.0248.5
GSPO + LIEBackbone=Qwen3-4B-Base, Strategy=Length-Incentivized Exploration2026.0247.5
GRPO + LIEBackbone=Qwen3-4B-Base, Strategy=Length-Incentivized Exploration2026.0246.5
GRPO w/Clip-higherBackbone=Qwen3-4B-Base, Variant=Clip-higher2026.0246
GRPOBackbone=Qwen3-4B-Base2026.0244.4
GRPO w/Clip-higher + LIEBackbone=Qwen3-4B-Base, Variant=Clip-higher, Strategy=Length-Incentivized Exploration2026.0243.9
R-ZeroModel=Llama-3.2-3B-Instruct2026.0542.6
AZRModel=Llama-3.2-3B-Instruct2026.0539.73
AZRModel=Qwen2.5-3B-Instruct2026.0538.93
DiSCTTModel=Qwen-3-4B-Base2026.0338.4
STRATAGEMModel=STRATAGEM (Ours)2026.0438.23
BaseModel=Llama-3.2-3B-Instruct2026.0538
SPIRALModel=SPIRAL2026.0436.41
R-ZeroModel=Qwen2.5-3B-Instruct2026.0535.6
MAEModel=Qwen2.5-3B-Instruct2026.0535.42
MAEModel=Qwen3-0.6B2026.0535.1
DiSCTTModel=Qwen-2.5-7B-Instruct2026.0334.9
R-ZeroModel=Qwen3-0.6B2026.0534.8
BaseModel=Qwen2.5-3B-Instruct2026.0534.67
COSEModel=Qwen2.5-3B-Instruct2026.0534.67
AZRModel=Qwen3-0.6B2026.0532.23
Qwen3-4B-BaseModel=Qwen3-4B-Base2026.0430.6
EVOL-RLModel=Qwen-3-4B-Base2026.0330.3
BaseModel=Qwen3-0.6B2026.0530
DiSCTTModel=Qwen-3-1.7B-Base2026.0329.3
EVOL-RLModel=Qwen-2.5-7B-Instruct2026.0329.3
EVOL-RLModel=Qwen-3-1.7B-Base2026.0328.8
TTRLModel=Qwen-3-4B-Base2026.0328.8
TTRLModel=Qwen-2.5-7B-Instruct2026.0328.8
BaseModel=Qwen-3-4B-Base2026.0327.3
BaseModel=Qwen-2.5-7B-Instruct2026.0327.3
Qwen3-4B-Base2026.0226.3
TTRLModel=Qwen-3-1.7B-Base2026.0325.8
DiSCTTModel=LLaMA-3.2-3B-Instruct2026.0324.3
DiSCTTModel=Qwen-2.5-0.5B-Instruct2026.0324.2
DiSCTTModel=LLaMA-3.2-1B-Instruct2026.0323.8
BaseModel=Qwen-3-1.7B-Base2026.0323.2
EVOL-RLModel=LLaMA-3.2-3B-Instruct2026.0320.7
EVOL-RLModel=Qwen-2.5-0.5B-Instruct2026.0318.2
TTRLModel=Qwen-2.5-0.5B-Instruct2026.0316.2
TTRLModel=LLaMA-3.2-3B-Instruct2026.0316.2
BaseModel=Qwen-2.5-0.5B-Instruct2026.0314.1
EVOL-RLModel=LLaMA-3.2-1B-Instruct2026.0314.1
BaseModel=LLaMA-3.2-3B-Instruct2026.0313.6
TTRLModel=LLaMA-3.2-1B-Instruct2026.0310.6
BaseModel=LLaMA-3.2-1B-Instruct2026.037.1