Reranking on Hard-case evaluation set Opus-4.6
91.2MAPGemini-3-Flash
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Gemini-3-FlashModel Variant=Flash2026.05 | 91.2 | 97.8 | 95.2 | 93.8 | 97.4 | 54.8 | 82.2 | 68.5 | 82.2 | |
| GPT-4o-miniModel Size=mini2026.05 | 91 | 97.8 | 95.1 | 93.3 | 97.3 | 54.2 | 82.8 | 67.7 | 82.8 | |
| MemReranker-4BParameters=4B2026.05 | 89.3 | 98.5 | 95.5 | 92.1 | 96.8 | 54 | 78.8 | 67.5 | 78.8 | |
| MemReranker-0.6BParameters=0.6B2026.05 | 86.2 | 97 | 93.6 | 89.6 | 96 | 50.4 | 76.6 | 63 | 76.6 | |
| Qwen3-Reranker-8BParameters=8B2026.05 | 84 | 95.5 | 92.7 | 87.2 | 95.2 | 48.4 | 74.6 | 60.5 | 74.6 | |
| BGE-v2-m3Version=v2, Size=m32026.05 | 79.7 | 91.5 | 85 | 82.4 | 92.9 | 45.6 | 70 | 57 | 70 | |
| Qwen3-Reranker-0.6BParameters=0.6B2026.05 | 79.4 | 92.6 | 86.9 | 83 | 93.4 | 45.2 | 69 | 56.5 | 69 |