Tool Use on ToolBench (test)
83.7Pass@1AgentHER-MJ
Evaluation results
| Method | Links | |
|---|---|---|
| AgentHER-MJBackbone=Qwen-72B2026.03 | 83.7 | |
| AgentHER-SJBackbone=Qwen-72B2026.03 | 83 | |
| AgentHER-MJBackbone=GPT-4o2026.03 | 75.6 | |
| SFT-SuccessBackbone=Qwen-72B2026.03 | 75.4 | |
| AgentHER-SJBackbone=GPT-4o2026.03 | 74.3 | |
| Rejection-SamplingBackbone=Qwen-72B2026.03 | 73.7 | |
| AgentHER-MJBackbone=Qwen-7B2026.03 | 72.9 | |
| ReflexionBackbone=Qwen-72B, Mode=Inference-time/online2026.03 | 72.1 | |
| AgentHER-SJBackbone=Qwen-7B2026.03 | 71.4 | |
| AgentHER-MJBackbone=LLaMA-8B2026.03 | 69.4 | |
| SFT-RandomBackbone=Qwen-72B, Data control=Equal-volume (3,000 failed trajectories)2026.03 | 68.9 | |
| AgentHER-SJBackbone=LLaMA-8B2026.03 | 67.9 | |
| SFT-SuccessBackbone=GPT-4o2026.03 | 67.8 | |
| Rejection-SamplingBackbone=GPT-4o2026.03 | 66.2 | |
| ReflexionBackbone=GPT-4o, Mode=Inference-time/online2026.03 | 64.3 | |
| SFT-RandomBackbone=GPT-4o, Data control=Equal-volume (3,000 failed trajectories)2026.03 | 61.4 | |
| SFT-SuccessBackbone=Qwen-7B2026.03 | 61.2 | |
| BaseBackbone=Qwen-72B2026.03 | 60.1 | |
| Rejection-SamplingBackbone=Qwen-7B2026.03 | 59.8 | |
| SFT-SuccessBackbone=LLaMA-8B2026.03 | 58.3 | |
| Rejection-SamplingBackbone=LLaMA-8B2026.03 | 57.4 | |
| ReflexionBackbone=Qwen-7B, Mode=Inference-time/online2026.03 | 57.1 | |
| ReflexionBackbone=LLaMA-8B, Mode=Inference-time/online2026.03 | 55.6 | |
| SFT-RandomBackbone=Qwen-7B, Data control=Equal-volume (3,000 failed trajectories)2026.03 | 54.8 | |
| BaseBackbone=GPT-4o2026.03 | 53.2 | |
| SFT-RandomBackbone=LLaMA-8B, Data control=Equal-volume (3,000 failed trajectories)2026.03 | 52.9 | |
| BaseBackbone=Qwen-7B2026.03 | 44.6 | |
| BaseBackbone=LLaMA-8B2026.03 | 42.1 |