Search Routing on PopQA & KUQ Oracle-eligible (test)
83.65Macro F1Qwen3.5-4B
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Qwen3.5-4BPolicy=Preference Opt.2026.07 | 83.65 | 84.27 | 23.12 | 10.34 | 92.96 | 91.84 | |
| Gemma E2BPolicy=Preference Opt.2026.07 | 82.35 | 83.29 | 20.59 | 14.34 | 81.03 | 94.34 | |
| Gemma E2BPolicy=SFT2026.07 | 82.07 | 82.92 | 19.28 | 15.74 | 77.59 | 88.68 | |
| Qwen3.5-4BPolicy=SFT2026.07 | 82.07 | 82.63 | 22.84 | 13.39 | 92.96 | 87.76 | |
| Gemma E2BPolicy=Ppre2026.07 | 70.82 | 75.74 | 54.25 | 5.98 | 68.97 | 71.7 | |
| Qwen3.5-4BPolicy=Ppre2026.07 | 70.53 | 71.48 | 36.49 | 22.72 | 87.32 | 65.31 |