Information Retrieval on AP88-89 (test)
38.45AP@1000RM3 ORACLE
Evaluation results
| Method | Links | ||
|---|---|---|---|
| RM3 ORACLEmode=oracle2026.01 | 38.45 | 56.69 | |
| MonoT5F + RM3 w/probfiltering=MonoT5F, feedback=RM3, use_next_token_probability=true2026.01 | 30.72 | 46.12 | |
| LLMF + RM3filtering=LLMF, feedback=RM32026.01 | 30.02 | 45.15 | |
| MonoT5F + RM3filtering=MonoT5F, feedback=RM32026.01 | 29.75 | 45.03 | |
| LLMF + RM3 w/probfiltering=LLMF, feedback=RM3, use_next_token_probability=true2026.01 | 29.62 | 44.93 | |
| RM3feedback_method=RM32026.01 | 29.2 | 44.19 | |
| MonoT5 rerankmode=re-ranking2026.01 | 24.74 | 40.16 | |
| QLD2026.01 | 22.13 | 37.74 |