Query Performance Prediction on TREC DL 20
0.713Spearman CorrelationVerb-Num
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Verb-NumRanker=Qwen2.5-7B-Instruct, Supervision=Supervised on Augmented MS MARCO2026.06 | 0.713 | 32.3 | |
| Verb-ListRanker=Qwen2.5-7B-Instruct, Supervision=Supervised on Augmented MS MARCO2026.06 | 0.699 | 17.5 | |
| qppBERT-PLRanker=Qwen2.5-7B-Instruct, Supervision=Supervised on Augmented MS MARCO2026.06 | 0.65 | 33.9 | |
| Verb-NumRankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Supervised on Augmented MS MARCO2026.06 | 0.626 | 39.1 | |
| QPP-Gen (3-32B)Ranker=Qwen2.5-7B-Instruct, Supervision=Unsupervised2026.06 | 0.608 | 15.6 | |
| Verb-ListRankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Supervised on Augmented MS MARCO2026.06 | 0.605 | 21.6 | |
| QPP-Gen-SFTRanker=Qwen2.5-7B-Instruct, Supervision=Supervised on MS MARCO2026.06 | 0.567 | 26 | |
| QPP-Gen (3-32B)Rankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Unsupervised2026.06 | 0.534 | 23.9 | |
| qppBERT-PLRankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Supervised on Augmented MS MARCO2026.06 | 0.514 | 42.3 | |
| QPP-GenRankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Unsupervised2026.06 | 0.479 | 15.2 | |
| QPP-Gen-SFTRankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Supervised on MS MARCO2026.06 | 0.477 | 29.7 | |
| QPP-Gen-SFTRankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Supervised on Augmented MS MARCO2026.06 | 0.434 | 40.1 | |
| QPP-GenRanker=Qwen2.5-7B-Instruct, Supervision=Unsupervised2026.06 | 0.412 | 15.1 | |
| QPP-Gen-SFTRanker=Qwen2.5-7B-Instruct, Supervision=Supervised on Augmented MS MARCO2026.06 | 0.41 | 39 | |
| BERTQPPRanker=Qwen2.5-7B-Instruct, Supervision=Supervised on Augmented MS MARCO2026.06 | 0.272 | 31.2 | |
| qppBERT-PLRanker=Qwen2.5-7B-Instruct, Supervision=Supervised on MS MARCO2026.06 | 0.254 | 38.4 | |
| BERTQPPRanker=Qwen2.5-7B-Instruct, Supervision=Supervised on MS MARCO2026.06 | 0.252 | 34.5 | |
| qppBERT-PLRankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Supervised on MS MARCO2026.06 | 0.233 | 46 | |
| BERTQPPRankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Supervised on Augmented MS MARCO2026.06 | 0.132 | 41.4 | |
| BERTQPPRankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Supervised on MS MARCO2026.06 | -0.022 | 44.4 |