Question Answering on PopQA single-hop (test)
47.2Avg@16GRPO
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GRPOBackbone=Qwen2.5-7B, Agent Configuration=Single-Agent2026.02 | 47.2 | 53.6 | |
| Dr. MASBackbone=Qwen2.5-7B, Agent Configuration=Multi-Agent & LLM Non-Sharing2026.02 | 46.7 | 57.8 | |
| Dr. MASBackbone=Qwen2.5-3B, Agent Configuration=Multi-Agent & LLM Non-Sharing2026.02 | 46.5 | 57.4 | |
| Dr. MASBackbone=Qwen2.5-7B, Agent Configuration=Multi-Agent & LLM Sharing2026.02 | 45.9 | 57.3 | |
| GRPOBackbone=Qwen2.5-3B, Agent Configuration=Multi-Agent & LLM Non-Sharing2026.02 | 45.6 | 54.5 | |
| Dr. MASBackbone=Qwen2.5-3B, Agent Configuration=Multi-Agent & LLM Sharing2026.02 | 45 | 57.6 | |
| GRPOBackbone=Qwen2.5-3B, Agent Configuration=Single-Agent2026.02 | 44.2 | 49.6 | |
| GRPOBackbone=Qwen2.5-7B, Agent Configuration=Multi-Agent & LLM Sharing2026.02 | 43.9 | 55 | |
| GRPOBackbone=Qwen2.5-3B, Agent Configuration=Multi-Agent & LLM Sharing2026.02 | 43.2 | 58 | |
| GRPOBackbone=Qwen2.5-7B, Agent Configuration=Multi-Agent & LLM Non-Sharing2026.02 | 20.7 | 27.9 |