Query Performance Prediction on TREC DL 19 (Spearman, ECE)
0.636Spearman CorrelationVerb-Num
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Verb-NumRanker=Qwen2.5-7B-Instruct, Supervision=Supervised on Augmented MS MARCO2026.06 | 0.636 | 0.385 | |
| QPP-Gen (3-32B)Ranker=Qwen2.5-7B-Instruct, Supervision=Unsupervised2026.06 | 0.611 | 0.161 | |
| qppBERT-PLRanker=Qwen2.5-7B-Instruct, Supervision=Supervised on Augmented MS MARCO2026.06 | 0.521 | 0.406 | |
| qppBERT-PLRankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Supervised on Augmented MS MARCO2026.06 | 0.499 | 0.516 | |
| QPP-Gen-SFTRanker=Qwen2.5-7B-Instruct, Supervision=Supervised on MS MARCO2026.06 | 0.496 | 0.236 | |
| Verb-ListRanker=Qwen2.5-7B-Instruct, Supervision=Supervised on Augmented MS MARCO2026.06 | 0.484 | 0.141 | |
| QPP-Gen-SFTRanker=Qwen2.5-7B-Instruct, Supervision=Supervised on Augmented MS MARCO2026.06 | 0.478 | 0.338 | |
| Verb-ListRankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Supervised on Augmented MS MARCO2026.06 | 0.423 | 0.166 | |
| BERTQPPRanker=Qwen2.5-7B-Instruct, Supervision=Supervised on Augmented MS MARCO2026.06 | 0.414 | 0.384 | |
| QPP-Gen (3-32B)Rankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Unsupervised2026.06 | 0.407 | 0.212 | |
| Verb-NumRankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Supervised on Augmented MS MARCO2026.06 | 0.385 | 0.51 | |
| QPP-GenRanker=Qwen2.5-7B-Instruct, Supervision=Unsupervised2026.06 | 0.333 | 0.241 | |
| BERTQPPRankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Supervised on Augmented MS MARCO2026.06 | 0.318 | 0.534 | |
| QPP-Gen-SFTRankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Supervised on Augmented MS MARCO2026.06 | 0.258 | 0.296 | |
| QPP-Gen-SFTRankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Supervised on MS MARCO2026.06 | 0.253 | 0.23 | |
| QPP-GenRankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Unsupervised2026.06 | 0.178 | 0.288 | |
| qppBERT-PLRankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Supervised on MS MARCO2026.06 | 0.164 | 0.587 | |
| BERTQPPRanker=Qwen2.5-7B-Instruct, Supervision=Supervised on MS MARCO2026.06 | 0.135 | 0.419 | |
| BERTQPPRankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Supervised on MS MARCO2026.06 | 0.03 | 0.564 | |
| qppBERT-PLRanker=Qwen2.5-7B-Instruct, Supervision=Supervised on MS MARCO2026.06 | -0.085 | 0.452 |