Next Query Prediction on NQP Wild Bench
50.72Judge ScoreOnePred
Evaluation results
| Method | Links | ||
|---|---|---|---|
| OnePredModel Regime=Gemini-3.1-Pro, History Context Strategy=Ours2026.05 | 50.72 | 51.14 | |
| Gemini-3.1-ProModel Regime=Gemini-3.1-Pro, History Context Strategy=Full-history2026.05 | 48.81 | 49.86 | |
| OnePredModel Regime=RL-trained Qwen, History Context Strategy=Ours2026.05 | 46 | 47.27 | |
| Gemini-3.1-ProModel Regime=Gemini-3.1-Pro, History Context Strategy=Current-turn2026.05 | 45.53 | 45.31 | |
| RL-trained QwenModel Regime=RL-trained Qwen, History Context Strategy=Full-history2026.05 | 44.35 | 44.97 | |
| RL-trained QwenModel Regime=RL-trained Qwen, History Context Strategy=Current-turn2026.05 | 44.02 | 44.2 | |
| OnePredModel Regime=Base Qwen, History Context Strategy=Ours2026.05 | 39.57 | 40.42 | |
| Base QwenModel Regime=Base Qwen, History Context Strategy=Full-history2026.05 | 38.2 | 39.16 | |
| Base QwenModel Regime=Base Qwen, History Context Strategy=Current-turn2026.05 | 36.09 | 36.42 |