Deep Research Evaluation on Deep Research Bench first training epoch (step 600)
52.09ReadabilityTournament-GRPO
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Tournament-GRPOG=2, Kwin=1, Kfinal=1, M=32026.05 | 52.09 | 52.71 | 52.32 | 52.04 | 52.28 | |
| Tournament-GRPOG=2, Kwin=1, Kfinal=1, M=22026.05 | 51.39 | 51.51 | 50.69 | 50.82 | 51.01 | |
| Tournament-GRPOG=4, Kwin=2, Kfinal=2, M=42026.05 | 50.31 | 50.34 | 49.88 | 49.49 | 49.9 | |
| Tournament-GRPOG=4, Kwin=2, Kfinal=2, M=22026.05 | 50.08 | 50.32 | 49.9 | 49.82 | 49.99 | |
| Tournament-GRPOG=4, Kwin=2, Kfinal=2, M=12026.05 | 49.7 | 49.53 | 48.69 | 48.02 | 48.79 | |
| Tournament-GRPOG=2, Kwin=1, Kfinal=1, M=82026.05 | 47.9 | 47.91 | 47.11 | 45.84 | 46.98 | |
| PairwiseGroup=Baseline2026.05 | 47.01 | 47.25 | 46.36 | 45.22 | 46.25 | |
| Tournament-GRPOG=2, Kwin=1, Kfinal=1, M=42026.05 | 46.92 | 47.59 | 46.5 | 45.02 | 46.33 | |
| Tournament-GRPOG=2, Kwin=1, Kfinal=1, M=12026.05 | 43.81 | 43.58 | 42.4 | 40.98 | 42.4 | |
| GDPOGroup=Baseline2026.05 | 43.22 | 42.07 | 39.81 | 39.05 | 40.61 | |
| Tournament-GRPOG=4, Kwin=2, Kfinal=2, M=32026.05 | 43 | 43.32 | 42.78 | 41.84 | 42.6 | |
| GRPO explicitGroup=Baseline2026.05 | 41.75 | 43.43 | 43.04 | 42.61 | 42.79 | |
| Tournament-GRPOG=4, Kwin=2, Kfinal=2, M=82026.05 | 41.48 | 42.03 | 41.28 | 40.39 | 41.17 | |
| GRPO implicitGroup=Baseline2026.05 | 41.41 | 40.23 | 37.85 | 36.88 | 38.6 | |
| Dr. GRPO explicitGroup=Baseline2026.05 | 40.03 | 38.47 | 35.8 | 35.54 | 36.97 | |
| Dr. GRPO implicitGroup=Baseline2026.05 | 38.93 | 37.78 | 34.51 | 34.55 | 35.95 | |
| Zero-shotGroup=Baseline2026.05 | 35.4 | 34.21 | 31.42 | 29.76 | 32.13 |