Reranking Calibration on LangCache SentencePairs v3 (test)
82.4PR-AUCLangCache-Reranker-v1-MNRL
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| LangCache-Reranker-v1-MNRLReranker Architecture Category=LangCache Rerankers (MNRL), Training Objective=MNRL2026.06 | 82.4 | 35.3 | 47.1 | 28 | 42.8 | |
| LangCache-Reranker-v1-BCEReranker Architecture Category=LangCache Rerankers (BCE), Training Objective=BCE2026.06 | 81.6 | 19.9 | 61.8 | 42.7 | 24.4 | |
| LangCache-Reranker-v2-MNRLReranker Architecture Category=LangCache Rerankers (MNRL), Training Objective=MNRL2026.06 | 80.4 | 33 | 47.4 | 28.3 | 41 | |
| LangCache-Reranker-v2-BCEReranker Architecture Category=LangCache Rerankers (BCE), Training Objective=BCE2026.06 | 74.8 | 17.3 | 57.5 | 38.5 | 23.1 | |
| GTE-Reranker-ModernBERT-baseReranker Architecture Category=General cross-encoders2026.06 | 71.2 | 37.5 | 33.8 | 14.7 | 52.7 | |
| ms-marco-MiniLM-L12-v2Reranker Architecture Category=General cross-encoders2026.06 | 56.5 | 24.1 | 32.4 | 13.4 | 42.7 | |
| Reason-ModernColBERTReranker Architecture Category=ColBERT-family2026.06 | 52 | 37.6 | 14.4 | 0 | 72.3 | |
| ColBERT-ZeroReranker Architecture Category=ColBERT-family2026.06 | 51.8 | 37.5 | 14.3 | 0 | 72.4 | |
| GTE-ModernColBERT-v1Reranker Architecture Category=ColBERT-family2026.06 | 51.7 | 34.7 | 17 | 0 | 67.1 | |
| ColBERTv2.0Reranker Architecture Category=ColBERT-family2026.06 | 51.5 | 40.2 | 11.3 | 0 | 78.1 |