Question Answering on Natural Questions (NQ) (Exact Match Metrics)
58SubEMDSPO
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DSPOModel Scale=7B, Dynamic Filter=true, Sequence-level Optimization=true2025.10 | 58 | — | |
| Search-R1 (GRPO, 14B)Model Scale=14B, RL Algorithm=GRPO2025.10 | 53.5 | 48.2 | |
| DSPO w/o seq-lvl opt.Model Scale=7B, Dynamic Filter=true, Sequence-level Optimization=false2025.10 | 47 | — | |
| Search-R1 (GRPO, 7B)Model Scale=7B, RL Algorithm=GRPO2025.10 | 42.3 | 42.9 | |
| DSPO w/o dyn. filterModel Scale=7B, Dynamic Filter=false, Sequence-level Optimization=true2025.10 | 36.3 | — | |
| Search-R1 (PPO, 14B)Model Scale=14B, RL Algorithm=PPO2025.10 | — | 42.4 | |
| Search-R1 (PPO, 7B)Model Scale=7B, RL Algorithm=PPO2025.10 | — | 39.3 |