Information Retrieval on WT10G (test)
28.31AP@1000RM3 ORACLE
Evaluation results
| Method | Links | ||
|---|---|---|---|
| RM3 ORACLEmode=oracle2026.01 | 28.31 | 46.34 | |
| MonoT5F + RM3 w/probfiltering=MonoT5F, feedback=RM3, use_next_token_probability=true2026.01 | 20.67 | 36.8 | |
| MonoT5F + RM3filtering=MonoT5F, feedback=RM32026.01 | 20.42 | 36.51 | |
| LLMF + RM3 w/probfiltering=LLMF, feedback=RM3, use_next_token_probability=true2026.01 | 17.47 | 32.78 | |
| LLMF + RM3filtering=LLMF, feedback=RM32026.01 | 17.2 | 32.54 | |
| MonoT5 rerankmode=re-ranking2026.01 | 16.17 | 31.74 | |
| RM3feedback_method=RM32026.01 | 15.87 | 31.66 | |
| QLD2026.01 | 15.19 | 30.41 |