Multi-hop Question Answering on MuSiQue 300-question hop-stratified (held-out)
75.7Best@3Max-at-K
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Max-at-KBase Model=Qwen3-1.7B, Prompt Strategy=single-answer prompt2026.05 | 75.7 | 76.8 | 78.3 | 80.2 | 57.3 | 17.5 | |
| MaxRLBase Model=Qwen3-1.7B, Prompt Strategy=single-answer prompt2026.05 | 75.1 | 75.7 | 76.5 | 77.6 | 55.2 | 6.8 | |
| VPOBase Model=Qwen3-1.7B, Prompt Strategy=multi-answer prompt2026.05 | 74.2 | 78 | 80.9 | 83.2 | 67.8 | 58.7 | |
| Random-wBase Model=Qwen3-1.7B, Prompt Strategy=single-answer prompt2026.05 | 71.2 | 71.6 | 72.1 | 72.8 | 44.5 | 6.1 | |
| GRPOBase Model=Qwen3-1.7B, Prompt Strategy=single-answer prompt2026.05 | 71.1 | 71.6 | 72.1 | 72.8 | 44.7 | 5.4 | |
| Multi-RLVRBase Model=Qwen3-1.7B, Prompt Strategy=multi-answer prompt2026.05 | 59.9 | 61.6 | 62.7 | 63.3 | 49.8 | 81.4 | |
| Qwen3-1.7BPrompt Strategy=multi-answer prompt2026.05 | 40.2 | 43.9 | 47.5 | 50.6 | 37.9 | 85.5 | |
| Qwen3-1.7BPrompt Strategy=single-answer prompt2026.05 | 31 | 33.9 | 37.3 | 42.3 | 16.1 | 63.4 |