Rich-media Re-ranking on Rich-Media Search Simple Query 1.0 (test)
98.5N@4Rich-Media Re-ranker
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Rich-Media Re-rankerModel Size=4B2026.02 | 98.5 | 96.9 | 95 | 87.2 | 89.8 | |
| ReaRankModel Size=7B, Re-ranking Principles=true, Cover Image Assessment=true2026.02 | 93.1 | 76.6 | 85.6 | 55.3 | 62.6 | |
| ReaRankModel Size=7B, Re-ranking Principles=true, Cover Image Assessment=false2026.02 | 92.8 | 74.8 | 85.1 | 53.3 | 60.7 | |
| Rank-R1Model Size=7B, Re-ranking Principles=true, Cover Image Assessment=true2026.02 | 91.6 | 77.9 | 79.8 | 56.7 | 64.8 | |
| Rank-R1Model Size=7B, Re-ranking Principles=true, Cover Image Assessment=false2026.02 | 91.1 | 77 | 79.7 | 55.7 | 63.3 | |
| Rank-R1Model Size=7B, Re-ranking Principles=false, Cover Image Assessment=false2026.02 | 90.8 | 76.1 | 79.3 | 54.9 | 62.8 | |
| ReaRankModel Size=7B, Re-ranking Principles=false, Cover Image Assessment=false2026.02 | 90.5 | 73.4 | 82.2 | 52.1 | 57 | |
| ReasonRankModel Size=7B, Re-ranking Principles=true, Cover Image Assessment=true2026.02 | 90.2 | 83.7 | 83.7 | 65.6 | 72.9 | |
| ReasonRankModel Size=7B, Re-ranking Principles=true, Cover Image Assessment=false2026.02 | 87.8 | 80.9 | 80.9 | 62.2 | 70 | |
| ReasonRankModel Size=7B, Re-ranking Principles=false, Cover Image Assessment=false2026.02 | 76.1 | 69.3 | 69.9 | 52.6 | 58.9 |