Information Retrieval on ROBUST04 (test)
27.47AP@1000RM3 ORACLE
Evaluation results
| Method | Links | ||
|---|---|---|---|
| RM3 ORACLEmode=oracle2026.01 | 27.47 | 45.35 | |
| MonoT5F + RM3filtering=MonoT5F, feedback=RM32026.01 | 23.17 | 38.88 | |
| MonoT5F + RM3 w/probfiltering=MonoT5F, feedback=RM3, use_next_token_probability=true2026.01 | 22.14 | 37.17 | |
| LLMF + RM3filtering=LLMF, feedback=RM32026.01 | 21.37 | 36.44 | |
| LLMF + RM3 w/probfiltering=LLMF, feedback=RM3, use_next_token_probability=true2026.01 | 20.91 | 35.87 | |
| RM3feedback_method=RM32026.01 | 20.04 | 34.46 | |
| MonoT5 rerankmode=re-ranking2026.01 | 19.07 | 33.56 | |
| QLD2026.01 | 18.29 | 33.14 |