Budget Allocation on Mostly Easy
57.8AccuracyOracle
Evaluation results
| Method | Links | |
|---|---|---|
| OracleBudget=4096, Model=Qwen3-30B-A3B-Instruct2026.06 | 57.8 | |
| PredictorBudget=4096, Model=Qwen3-30B-A3B-Instruct2026.06 | 55.6 | |
| CLEAR (Heur.)Budget=4096, Model=Qwen3-30B-A3B-Instruct2026.06 | 55.6 | |
| OracleBudget=1024, Model=Qwen3-30B-A3B-Instruct2026.06 | 55.4 | |
| CLEAR (Ours)Budget=4096, Model=Qwen3-30B-A3B-Instruct2026.06 | 54.6 | |
| UniformBudget=4096, Model=Qwen3-30B-A3B-Instruct2026.06 | 54.4 | |
| CLEAR (Auction)Budget=4096, Model=Qwen3-30B-A3B-Instruct2026.06 | 54.2 | |
| CLEAR (Ours)Budget=1024, Model=Qwen3-30B-A3B-Instruct2026.06 | 47.4 | |
| UniformBudget=1024, Model=Qwen3-30B-A3B-Instruct2026.06 | 46.6 | |
| CLEAR (Auction)Budget=1024, Model=Qwen3-30B-A3B-Instruct2026.06 | 41 | |
| CLEAR (Heur.)Budget=1024, Model=Qwen3-30B-A3B-Instruct2026.06 | 37.2 | |
| PredictorBudget=1024, Model=Qwen3-30B-A3B-Instruct2026.06 | 32.4 |