Single-Hop Question Answering on Single-Hop Suite (NQ, TriviaQA, PopQA) (test)
49.64NQ AccuracyAKBE (Ours)
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| AKBE (Ours)Backbone Model=Qwen2.5-7B2026.05 | 49.64 | 64.63 | 47.91 | 54.59 | 1 | 54.59 | |
| OTC-POBackbone Model=Qwen2.5-7B2026.05 | 48.72 | 63.46 | 47.64 | 53.89 | 1 | 53.89 | |
| β-GRPOBackbone Model=Qwen2.5-7B2026.05 | 47.89 | 64.21 | 48.18 | 54.35 | 1.03 | 52.76 | |
| AKBE (Ours)Backbone Model=Qwen3-4B2026.05 | 47.33 | 65.18 | 50.8 | 55.9 | 1.16 | 48.19 | |
| Offline AKBEBackbone Model=Qwen2.5-7B2026.05 | 47.15 | 63.92 | 48.05 | 54.08 | 1.01 | 53.54 | |
| β-GRPOBackbone Model=Qwen3-4B2026.05 | 47 | 64.73 | 49.95 | 55.3 | 1.53 | 36.15 | |
| R1-SearcherBackbone Model=Qwen3-4B2026.05 | 46.85 | 64.52 | 49.43 | 54.95 | 1.48 | 37.13 | |
| Offline AKBEBackbone Model=Qwen3-4B2026.05 | 46.52 | 64.55 | 49.72 | 55.06 | 1.22 | 45.13 | |
| Search-R1Backbone Model=Qwen3-4B2026.05 | 45.98 | 65.17 | 49.18 | 54.97 | 1.41 | 38.99 | |
| OTC-POBackbone Model=Qwen3-4B2026.05 | 45.31 | 64.35 | 49.86 | 54.9 | 1.02 | 53.83 | |
| R1-SearcherBackbone Model=Qwen2.5-7B2026.05 | 45.12 | 63.28 | 49.05 | 54.07 | 1.08 | 50.06 | |
| Search-R1Backbone Model=Qwen2.5-7B2026.05 | 44.35 | 63.65 | 48.7 | 53.96 | 1.05 | 51.39 | |
| Search-o1Backbone Model=Qwen3-4B2026.05 | 33.85 | 57.42 | 40.27 | 46.11 | 1.72 | 26.81 | |
| ReActBackbone Model=Qwen3-4B2026.05 | 26.75 | 53.53 | 35.34 | 41.31 | 2.27 | 18.19 | |
| Search-o1Backbone Model=Qwen2.5-7B2026.05 | 15.87 | 32.45 | 22.18 | 25.37 | 1.28 | 19.82 | |
| ReActBackbone Model=Qwen2.5-7B2026.05 | 4.34 | 10.67 | 9.32 | 9.23 | 1.36 | 6.79 |