List your company
ResearchFormerly WizWand

Logic Puzzle Solving on ZebraLogic

60.8AccuracyGreedy (BL)
1.20816.67932.1547.621Apr 22, 2026Apr 29, 2026May 6, 2026May 13, 2026May 20, 2026May 27, 2026Jun 4, 2026
Updated 4mo ago

Evaluation results

MethodLinks
Greedy (BL)Model=Phi-4-reasoning-plus (13B)2026.0460.8
BranchingModel=Phi-4-reasoning-plus (13B)2026.0460.4
SteeringModel=Phi-4-reasoning-plus (13B)2026.0460.2
TTPOModel=Phi-4-reasoning-plus (13B)2026.0458.4
Beam Search (BL)Model=Phi-4-reasoning-plus (13B)2026.0457.8
TTPOModel=Gemma-3-12b-it2026.0455.6
Greedy (BL)Model=Gemma-3-12b-it2026.0453.2
SteeringModel=Gemma-3-12b-it2026.0453.2
BranchingModel=Gemma-3-12b-it2026.0452.4
Beam Search (BL)Model=Gemma-3-12b-it2026.0451.8
BranchingModel=Gemma-3-4b-it2026.0442
TTPOModel=Gemma-3-4b-it2026.0440.4
SteeringModel=Phi-4-mini-instruct (4B)2026.0439.6
BranchingModel=Phi-4-mini-instruct (4B)2026.0439.6
SteeringModel=Gemma-3-4b-it2026.0439
Greedy (BL)Model=Gemma-3-4b-it2026.0438.8
Greedy (BL)Model=Phi-4-mini-instruct (4B)2026.0438.8
TTPOModel=Phi-4-mini-instruct (4B)2026.0438.6
Beam Search (BL)Model=Gemma-3-4b-it2026.0433.4
Beam Search (BL)Model=Phi-4-mini-instruct (4B)2026.0431.8
OPDLM-8BScale=8B, Tokens=0.066B, FLOPs=4.2, Decoding Strategy=greedy static decoding, Block Size=42026.0612.9
OPDLM-4BScale=4B, Tokens=0.076B, FLOPs=2.4, Decoding Strategy=greedy static decoding, Block Size=42026.0610.5
SDAR-8BScale=8B, Tokens=55B, FLOPs=2640, Decoding Strategy=greedy static decoding, Block Size=42026.067.8
SDAR-4BScale=4B, Tokens=55B, FLOPs=1320, Decoding Strategy=greedy static decoding, Block Size=42026.066.3
Fast-dLLM-v2-7BScale=8B, Tokens=1B, FLOPs=42, Decoding Strategy=greedy static decoding, Block Size=42026.063.5