Query Performance Prediction on TREC DL22 (Spearman, ECE)
0.679Spearman CorrelationVerb-Num
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Verb-NumRankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Supervised on Augmented MS MARCO2026.06 | 0.679 | 0.287 | |
| Verb-ListRanker=Qwen2.5-7B-Instruct, Supervision=Supervised on Augmented MS MARCO2026.06 | 0.677 | 0.187 | |
| QPP-Gen (3-32B)Rankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Unsupervised2026.06 | 0.669 | 0.193 | |
| Verb-NumRanker=Qwen2.5-7B-Instruct, Supervision=Supervised on Augmented MS MARCO2026.06 | 0.617 | 0.151 | |
| Verb-ListRankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Supervised on Augmented MS MARCO2026.06 | 0.612 | 0.163 | |
| QPP-Gen (3-32B)Ranker=Qwen2.5-7B-Instruct, Supervision=Unsupervised2026.06 | 0.605 | 0.187 | |
| QPP-Gen-SFTRanker=Qwen2.5-7B-Instruct, Supervision=Supervised on MS MARCO2026.06 | 0.509 | 0.37 | |
| QPP-GenRankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Unsupervised2026.06 | 0.497 | 0.176 | |
| QPP-Gen-SFTRankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Supervised on MS MARCO2026.06 | 0.462 | 0.362 | |
| BERTQPPRanker=Qwen2.5-7B-Instruct, Supervision=Supervised on Augmented MS MARCO2026.06 | 0.432 | 0.105 | |
| QPP-GenRanker=Qwen2.5-7B-Instruct, Supervision=Unsupervised2026.06 | 0.43 | 0.164 | |
| QPP-Gen-SFTRankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Supervised on Augmented MS MARCO2026.06 | 0.399 | 0.508 | |
| BERTQPPRankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Supervised on Augmented MS MARCO2026.06 | 0.322 | 0.274 | |
| QPP-Gen-SFTRanker=Qwen2.5-7B-Instruct, Supervision=Supervised on Augmented MS MARCO2026.06 | 0.288 | 0.577 | |
| qppBERT-PLRanker=Qwen2.5-7B-Instruct, Supervision=Supervised on MS MARCO2026.06 | 0.229 | 0.077 | |
| qppBERT-PLRankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Supervised on Augmented MS MARCO2026.06 | 0.216 | 0.377 | |
| qppBERT-PLRanker=Qwen2.5-7B-Instruct, Supervision=Supervised on Augmented MS MARCO2026.06 | 0.196 | 0.177 | |
| qppBERT-PLRankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Supervised on MS MARCO2026.06 | 0.105 | 0.341 | |
| BERTQPPRankers=Qwen2.5-7B-Instruc100, Supervision Protocol=Supervised on MS MARCO2026.06 | 0.004 | 0.3 | |
| BERTQPPRanker=Qwen2.5-7B-Instruct, Supervision=Supervised on MS MARCO2026.06 | -0.06 | 0.133 |