Relevance Classification on Pailitao-VL (test)
74.28Instance PrecisionPailitao-VL-Reranker-List
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Pailitao-VL-Reranker-Listtype=listwise reranker, mode=hybrid ranking2026.02 | 74.28 | 88.73 | 73.93 | 94.09 | 74.1 | 91.33 | |
| Pailitao-VL-Reranker-Pointtype=pointwise reranker2026.02 | 63.85 | 82.5 | 83.46 | 95.46 | 72.35 | 88.51 | |
| CLIP-IDClass-Embeddingtype=embedding-based, scoring=cosine similarity, threshold_tuning=max-F1 on validation set2026.02 | 60.34 | 78.29 | 75.38 | 93.72 | 67.03 | 85.31 | |
| Qwen3-VL-Rerankertype=pointwise reranker, scoring=sigmoid(logit(yes) - logit(no))2026.02 | 59.75 | 80.36 | 61.65 | 94.09 | 60.68 | 86.66 | |
| Qwen3-VL-Embeddingtype=embedding-based, scoring=cosine similarity, threshold_tuning=max-F1 on validation set2026.02 | 37.86 | 87.72 | 73.05 | 54.6 | 49.87 | 67.3 |