Question Answering on 2WikiMultihopQA (EM/F1)
64EMVOI
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| VOIBudget=high, Base Model=Qwen3-32B, Tool-call cap=3, Output-token cap=5002026.05 | 64 | 71 | |
| BATSBudget=high, Base Model=Qwen3-32B, Tool-call cap=3, Output-token cap=5002026.05 | 62 | 73 | |
| AFlowBudget=high, Base Model=Qwen3-32B, Tool-call cap=3, Output-token cap=5002026.05 | 58 | 70 | |
| BAVTBudget=high, Base Model=Qwen3-32B, Tool-call cap=3, Output-token cap=5002026.05 | 56 | 63 | |
| VOIBudget=upper-mid, Base Model=Qwen3-32B, Tool-call cap=2, Output-token cap=3002026.05 | 54 | 62 | |
| BATSBudget=upper-mid, Base Model=Qwen3-32B, Tool-call cap=2, Output-token cap=3002026.05 | 53 | 64 | |
| AFlowBudget=lower-mid, Base Model=Qwen3-32B, Tool-call cap=2, Output-token cap=2002026.05 | 47 | 55 | |
| AFlowBudget=upper-mid, Base Model=Qwen3-32B, Tool-call cap=2, Output-token cap=3002026.05 | 47 | 55 | |
| VOIBudget=lower-mid, Base Model=Qwen3-32B, Tool-call cap=2, Output-token cap=2002026.05 | 44 | 49 | |
| BAVTBudget=upper-mid, Base Model=Qwen3-32B, Tool-call cap=2, Output-token cap=3002026.05 | 40 | 45 | |
| BAVTBudget=lower-mid, Base Model=Qwen3-32B, Tool-call cap=2, Output-token cap=2002026.05 | 28 | 33 | |
| Search-o1Budget=high, Base Model=Qwen3-32B, Tool-call cap=3, Output-token cap=5002026.05 | 27 | 36 | |
| Search-o1Budget=upper-mid, Base Model=Qwen3-32B, Tool-call cap=2, Output-token cap=3002026.05 | 15 | 20 | |
| VOIBudget=low, Base Model=Qwen3-32B, Tool-call cap=1, Output-token cap=1002026.05 | 9 | 11 | |
| BAVTBudget=low, Base Model=Qwen3-32B, Tool-call cap=1, Output-token cap=1002026.05 | 8 | 10 | |
| AFlowBudget=low, Base Model=Qwen3-32B, Tool-call cap=1, Output-token cap=1002026.05 | 7 | 7 | |
| BATSBudget=lower-mid, Base Model=Qwen3-32B, Tool-call cap=2, Output-token cap=2002026.05 | 5 | 5 | |
| Search-o1Budget=lower-mid, Base Model=Qwen3-32B, Tool-call cap=2, Output-token cap=2002026.05 | 3 | 4 | |
| BATSBudget=low, Base Model=Qwen3-32B, Tool-call cap=1, Output-token cap=1002026.05 | 2 | 2 | |
| Search-o1Budget=low, Base Model=Qwen3-32B, Tool-call cap=1, Output-token cap=1002026.05 | 0 | 4 |