Query Performance Prediction on TREC DL21 (Spearman, ECE)
0.486Spearman CorrelationVerb-List
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Verb-ListRankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Supervised on Augmented MS MARCO2026.06 | 0.486 | 0.215 | |
| Verb-NumRankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Supervised on Augmented MS MARCO2026.06 | 0.475 | 0.455 | |
| QPP-Gen-SFTRankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Supervised on MS MARCO2026.06 | 0.45 | 0.293 | |
| Verb-NumRanker=Qwen2.5-7B-Instruct, Supervision=Supervised on Augmented MS MARCO2026.06 | 0.414 | 0.328 | |
| BERTQPPRankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Supervised on Augmented MS MARCO2026.06 | 0.402 | 0.494 | |
| QPP-Gen (3-32B)Ranker=Qwen2.5-7B-Instruct, Supervision=Unsupervised2026.06 | 0.365 | 0.225 | |
| QPP-Gen-SFTRanker=Qwen2.5-7B-Instruct, Supervision=Supervised on Augmented MS MARCO2026.06 | 0.361 | 0.437 | |
| QPP-Gen-SFTRanker=Qwen2.5-7B-Instruct, Supervision=Supervised on MS MARCO2026.06 | 0.354 | 0.334 | |
| QPP-GenRankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Unsupervised2026.06 | 0.347 | 0.234 | |
| Verb-ListRanker=Qwen2.5-7B-Instruct, Supervision=Supervised on Augmented MS MARCO2026.06 | 0.335 | 0.202 | |
| BERTQPPRanker=Qwen2.5-7B-Instruct, Supervision=Supervised on Augmented MS MARCO2026.06 | 0.31 | 0.336 | |
| QPP-GenRanker=Qwen2.5-7B-Instruct, Supervision=Unsupervised2026.06 | 0.291 | 0.234 | |
| QPP-Gen (3-32B)Rankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Unsupervised2026.06 | 0.273 | 0.233 | |
| BERTQPPRanker=Qwen2.5-7B-Instruct, Supervision=Supervised on MS MARCO2026.06 | 0.27 | 0.369 | |
| qppBERT-PLRankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Supervised on Augmented MS MARCO2026.06 | 0.253 | 0.599 | |
| QPP-Gen-SFTRankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Supervised on Augmented MS MARCO2026.06 | 0.223 | 0.342 | |
| qppBERT-PLRankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Supervised on MS MARCO2026.06 | 0.189 | 0.588 | |
| BERTQPPRankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Supervised on MS MARCO2026.06 | 0.103 | 0.524 | |
| qppBERT-PLRanker=Qwen2.5-7B-Instruct, Supervision=Supervised on Augmented MS MARCO2026.06 | -0.024 | 0.419 | |
| qppBERT-PLRanker=Qwen2.5-7B-Instruct, Supervision=Supervised on MS MARCO2026.06 | -0.077 | 0.305 |