Information Retrieval on DL-20 (test)
43.5AP@1000RM3 ORACLE
Evaluation results
| Method | Links | ||
|---|---|---|---|
| RM3 ORACLEmode=oracle2026.01 | 43.5 | 56.96 | |
| MonoT5 rerankmode=re-ranking2026.01 | 42.56 | 56.22 | |
| MonoT5F + RM3 w/probfiltering=MonoT5F, feedback=RM3, use_next_token_probability=true2026.01 | 41.54 | 53.55 | |
| MonoT5F + RM3filtering=MonoT5F, feedback=RM32026.01 | 39.41 | 53.17 | |
| LLMF + RM3filtering=LLMF, feedback=RM32026.01 | 37.22 | 49.13 | |
| LLMF + RM3 w/probfiltering=LLMF, feedback=RM3, use_next_token_probability=true2026.01 | 36.83 | 49.31 | |
| RM3feedback_method=RM32026.01 | 33.69 | 46.42 | |
| QLD2026.01 | 32.87 | 47.81 |