List your company
ResearchFormerly WizWand

Budget Allocation on Mostly-Hard

27.8AccuracyOracle
0.767.7814.821.82Jun 2, 2026
Updated 4mo ago

Evaluation results

MethodLinks
OracleBudget=4096, Model=Qwen3-30B-A3B-Instruct2026.0627.8
OracleBudget=1024, Model=Qwen3-30B-A3B-Instruct2026.0617.4
PredictorBudget=4096, Model=Qwen3-30B-A3B-Instruct2026.0615.2
CLEAR (Heur.)Budget=4096, Model=Qwen3-30B-A3B-Instruct2026.0615.2
CLEAR (Ours)Budget=4096, Model=Qwen3-30B-A3B-Instruct2026.0614.8
UniformBudget=4096, Model=Qwen3-30B-A3B-Instruct2026.0614.2
CLEAR (Auction)Budget=4096, Model=Qwen3-30B-A3B-Instruct2026.0613
CLEAR (Heur.)Budget=1024, Model=Qwen3-30B-A3B-Instruct2026.069.8
CLEAR (Ours)Budget=1024, Model=Qwen3-30B-A3B-Instruct2026.068.6
CLEAR (Auction)Budget=1024, Model=Qwen3-30B-A3B-Instruct2026.067
UniformBudget=1024, Model=Qwen3-30B-A3B-Instruct2026.066.4
PredictorBudget=1024, Model=Qwen3-30B-A3B-Instruct2026.061.8