Rich-media Re-ranking on Rich-Media Search Complex Query 1.0 (test)
97.4N@4Rich-Media Re-ranker
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Rich-Media Re-rankerModel Size=4B2026.02 | 97.4 | 96.7 | 86.9 | 89.3 | 88.8 | |
| ReaRankModel Size=7B, Re-ranking Principles=true, Cover Image Assessment=true2026.02 | 89.1 | 81.5 | 71 | 63.3 | 65.1 | |
| ReaRankModel Size=7B, Re-ranking Principles=true, Cover Image Assessment=false2026.02 | 88.3 | 80 | 69.6 | 62.1 | 63.1 | |
| Rank-R1Model Size=7B, Re-ranking Principles=true, Cover Image Assessment=true2026.02 | 87.9 | 80.6 | 68.2 | 62.1 | 66.5 | |
| Rank-R1Model Size=7B, Re-ranking Principles=true, Cover Image Assessment=false2026.02 | 87.1 | 78.5 | 65.8 | 61 | 63.2 | |
| ReaRankModel Size=7B, Re-ranking Principles=false, Cover Image Assessment=false2026.02 | 83.6 | 76.8 | 62.3 | 59 | 57.9 | |
| Rank-R1Model Size=7B, Re-ranking Principles=false, Cover Image Assessment=false2026.02 | 81.1 | 74.1 | 59.9 | 56.3 | 58.4 | |
| ReasonRankModel Size=7B, Re-ranking Principles=true, Cover Image Assessment=true2026.02 | 78.6 | 76.1 | 63.4 | 61.3 | 65.2 | |
| ReasonRankModel Size=7B, Re-ranking Principles=true, Cover Image Assessment=false2026.02 | 77.1 | 75.1 | 60.4 | 61.2 | 63.1 | |
| ReasonRankModel Size=7B, Re-ranking Principles=false, Cover Image Assessment=false2026.02 | 70.6 | 68.8 | 53.1 | 54.5 | 56.6 |