Multi-hop Question Answering on HotpotQA (test) (avg@16/pass@16)
44Avg@16Dr. MAS
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Dr. MASBackbone=Qwen2.5-7B, Agent Configuration=Multi-Agent & LLM Non-Sharing2026.02 | 44 | 57.5 | |
| GRPOBackbone=Qwen2.5-7B, Agent Configuration=Single-Agent2026.02 | 43 | 55.1 | |
| Dr. MASBackbone=Qwen2.5-7B, Agent Configuration=Multi-Agent & LLM Sharing2026.02 | 42.5 | 56 | |
| GRPOBackbone=Qwen2.5-7B, Agent Configuration=Multi-Agent & LLM Sharing2026.02 | 40.3 | 55 | |
| Dr. MASBackbone=Qwen2.5-3B, Agent Configuration=Multi-Agent & LLM Non-Sharing2026.02 | 35.3 | 51.1 | |
| Dr. MASBackbone=Qwen2.5-3B, Agent Configuration=Multi-Agent & LLM Sharing2026.02 | 33.3 | 51.2 | |
| GRPOBackbone=Qwen2.5-3B, Agent Configuration=Multi-Agent & LLM Sharing2026.02 | 32.5 | 48 | |
| GRPOBackbone=Qwen2.5-3B, Agent Configuration=Multi-Agent & LLM Non-Sharing2026.02 | 32.5 | 45.2 | |
| GRPOBackbone=Qwen2.5-3B, Agent Configuration=Single-Agent2026.02 | 31.8 | 40.9 | |
| GRPOBackbone=Qwen2.5-7B, Agent Configuration=Multi-Agent & LLM Non-Sharing2026.02 | 24.4 | 36.2 |