Stepwise tool-use on API-Bank (test)
74Success RateBoN+rubric (Ctrl)
Evaluation Results
| Method | Links | |
|---|---|---|
| BoN+rubric (Ctrl)Model=o3-mini2026.05 | 74 | |
| BoN+rubric (Ctrl)Model=GPT-4.12026.05 | 74 | |
| Self-RefineModel=o3-mini2026.05 | 73 | |
| Best-of-NModel=GPT-4.1-mini2026.05 | 73 | |
| Best-of-NModel=GPT-4o2026.05 | 73 | |
| Best-of-NModel=o3-mini2026.05 | 73 | |
| Best-of-NModel=GPT-4.12026.05 | 73 | |
| BoN+fixed rubric (Ctrl)Model=o3-mini2026.05 | 73 | |
| BoN+rubric (Ctrl)Model=GPT-4.1-mini2026.05 | 73 | |
| BoN+rubric (Ctrl)Model=GPT-4o2026.05 | 73 | |
| CodeAct (Baseline)Model=GPT-4.1-mini2026.05 | 72 | |
| CodeAct (Baseline)Model=GPT-4o2026.05 | 72 | |
| CodeAct (Baseline)Model=o3-mini2026.05 | 72 | |
| CodeAct (Baseline)Model=GPT-4.12026.05 | 72 | |
| BoN+fixed rubric (Ctrl)Model=GPT-4.1-mini2026.05 | 72 | |
| BoN+fixed rubric (Ctrl)Model=GPT-4o2026.05 | 72 | |
| BoN+fixed rubric (Ctrl)Model=GPT-4.12026.05 | 72 | |
| Fixed RubricRefine (Ctrl)Model=GPT-4.1-mini2026.05 | 72 | |
| Fixed RubricRefine (Ctrl)Model=GPT-4o2026.05 | 72 | |
| Fixed RubricRefine (Ctrl)Model=o3-mini2026.05 | 72 | |
| Self-RefineModel=GPT-4o2026.05 | 71 | |
| Self-RefineModel=GPT-4.12026.05 | 71 | |
| Fixed RubricRefine (Ctrl)Model=GPT-4.12026.05 | 71 | |
| RubricRefine (Ours)Model=GPT-4o2026.05 | 70 | |
| RubricRefine (Ours)Model=GPT-4.1-mini2026.05 | 69 | |
| RubricRefine (Ours)Model=GPT-4.12026.05 | 69 | |
| Self-RefineModel=GPT-4.1-mini2026.05 | 68 | |
| RubricRefine (Ours)Model=o3-mini2026.05 | 68 |