Search-based Question Answering on SearchQA
42Hotpot ScoreHarnessForge
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| HarnessForgeBackbone=Qwen3-4B2026.06 | 42 | 42 | 42 | |
| GRPOBackbone=Qwen3-8B2026.06 | 41.33 | 42 | 41.67 | |
| HarnessForgeBackbone=Qwen3-8B2026.06 | 41.33 | 44.33 | 42.83 | |
| SFTBackbone=Qwen3-8B2026.06 | 40.67 | 41.33 | 41 | |
| RLOOBackbone=Qwen3-8B2026.06 | 40 | 39.33 | 39.67 | |
| SFTBackbone=Qwen3-4B2026.06 | 36.67 | 38.67 | 37.67 | |
| GRPOBackbone=Qwen3-4B2026.06 | 36 | 43.33 | 39.67 | |
| RLOOBackbone=Qwen3-4B2026.06 | 35.33 | 40 | 37.67 | |
| MermaidFlowBackbone=Qwen3-8B2026.06 | 32.67 | 30.67 | 31.67 | |
| MaASBackbone=Qwen3-8B2026.06 | 32 | 32 | 32 | |
| MermaidFlowBackbone=Qwen3-4B2026.06 | 31.33 | 28 | 29.67 | |
| ADASBackbone=Qwen3-8B2026.06 | 31.33 | 32 | 31.67 | |
| AFlowBackbone=Qwen3-8B2026.06 | 31.33 | 32.67 | 32 | |
| AFlowBackbone=Qwen3-4B2026.06 | 30.67 | 29.33 | 30 | |
| MaASBackbone=Qwen3-4B2026.06 | 30.67 | 30 | 30.33 | |
| AgentSquareBackbone=Qwen3-4B2026.06 | 29.33 | 30 | 29.67 | |
| AgentSquareBackbone=Qwen3-8B2026.06 | 29.33 | 30 | 29.5 | |
| ADASBackbone=Qwen3-4B2026.06 | 28.67 | 28 | 28.33 |