Tool Use on ToolHop
54.87Answer CorrectnessHarnessForge
Evaluation results
| Method | Links | ||
|---|---|---|---|
| HarnessForgeBackbone=Qwen3-8B2026.06 | 54.87 | 74.05 | |
| HarnessForgeBackbone=Qwen3-4B2026.06 | 52.82 | 68.1 | |
| GRPOBackbone=Qwen3-8B2026.06 | 51.28 | 75.62 | |
| RLOOBackbone=Qwen3-8B2026.06 | 50.77 | 72.75 | |
| GRPOBackbone=Qwen3-4B2026.06 | 49.74 | 66.41 | |
| SFTBackbone=Qwen3-8B2026.06 | 48.72 | 72.2 | |
| MermaidFlowBackbone=Qwen3-8B2026.06 | 47.39 | 59.31 | |
| RLOOBackbone=Qwen3-4B2026.06 | 46.15 | 64.87 | |
| SFTBackbone=Qwen3-4B2026.06 | 45.13 | 63.9 | |
| MermaidFlowBackbone=Qwen3-4B2026.06 | 44.62 | 58.74 | |
| MaASBackbone=Qwen3-8B2026.06 | 44.62 | 51.8 | |
| MaASBackbone=Qwen3-4B2026.06 | 42.05 | 51.8 | |
| ADASBackbone=Qwen3-8B2026.06 | 42.05 | 61.32 | |
| ADASBackbone=Qwen3-4B2026.06 | 40 | 44.99 | |
| AFlowBackbone=Qwen3-8B2026.06 | 32.82 | 54.12 | |
| AFlowBackbone=Qwen3-4B2026.06 | 31.28 | 43.81 | |
| AgentSquareBackbone=Qwen3-8B2026.06 | 30.77 | 41.22 | |
| AgentSquareBackbone=Qwen3-4B2026.06 | 29.23 | 39.46 |