Rich-media Re-ranking on Rich-Media Search Broad-needs Query 1.0 (test)
97.4N@4Rich-Media Re-ranker
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Rich-Media Re-rankerModel Size=4B2026.02 | 97.4 | 96.7 | 86.5 | 88 | 87.7 | |
| ReaRankModel Size=7B, Re-ranking Principles=true, Cover Image Assessment=true2026.02 | 85.1 | 80.3 | 65 | 63.3 | 62.4 | |
| Rank-R1Model Size=7B, Re-ranking Principles=true, Cover Image Assessment=true2026.02 | 83.9 | 78.5 | 62.1 | 61.2 | 63.2 | |
| ReaRankModel Size=7B, Re-ranking Principles=true, Cover Image Assessment=false2026.02 | 83 | 77.9 | 60.8 | 61 | 58.8 | |
| Rank-R1Model Size=7B, Re-ranking Principles=true, Cover Image Assessment=false2026.02 | 81.1 | 76.2 | 57.5 | 59.3 | 59.3 | |
| ReaRankModel Size=7B, Re-ranking Principles=false, Cover Image Assessment=false2026.02 | 79.8 | 75.3 | 56.7 | 57.6 | 56.8 | |
| Rank-R1Model Size=7B, Re-ranking Principles=false, Cover Image Assessment=false2026.02 | 77.9 | 72.9 | 54.3 | 55.2 | 56.4 | |
| ReasonRankModel Size=7B, Re-ranking Principles=true, Cover Image Assessment=true2026.02 | 71.2 | 70.6 | 54.6 | 57.5 | 58.5 | |
| ReasonRankModel Size=7B, Re-ranking Principles=true, Cover Image Assessment=false2026.02 | 68.8 | 68.4 | 51.1 | 55.3 | 56.1 | |
| ReasonRankModel Size=7B, Re-ranking Principles=false, Cover Image Assessment=false2026.02 | 65.1 | 64.5 | 46.7 | 51.3 | 51.1 |