Information Retrieval on QUEST N=1727 (test)
6.02Mean Recall@100Base + FT (Dr) (RVR)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Base + FT (Dr) (RVR)Base Retrieval Model=INF, Verifier Budget=1002026.02 | 6.02 | 30.53 | |
| Retrieve-Verify-Retrieve (Base + FT (Dr))Base Model=INF, Verifier Budget=502026.02 | 5.73 | 28.71 | |
| Base + Base (RVR)Base Retrieval Model=INF, Verifier Budget=1002026.02 | 4.81 | 27.21 | |
| BaseBase Retrieval Model=INF2026.02 | 4.75 | 26.6 | |
| FT (Di)Base Retrieval Model=INF2026.02 | 4.75 | 26.31 | |
| BaseBase Model=INF2026.02 | 4.75 | 26.6 | |
| FT (Di)Base Model=INF2026.02 | 4.75 | 26.31 | |
| Base + FT (Dr) (RVR)Base Retrieval Model=Contriever, Verifier Budget=1002026.02 | 4.52 | 26.01 | |
| Base + FT (Dr) (RVR)Base Retrieval Model=Qwen3, Verifier Budget=1002026.02 | 4.4 | 25.43 | |
| Retrieve-Verify-Retrieve (Base + Base)Base Model=INF, Verifier Budget=502026.02 | 4.11 | 24.47 | |
| Retrieve-Verify-Retrieve (Base + FT (Dr))Base Model=Qwen3, Verifier Budget=502026.02 | 4.05 | 23.88 | |
| Retrieve-Verify-Retrieve (Base + FT (Dr))Base Model=Contriever, Verifier Budget=502026.02 | 3.82 | 22.89 | |
| SearchR1Base Retrieval Model=INF2026.02 | 3.53 | 23.01 | |
| Base + Base (RVR)Base Retrieval Model=Contriever, Verifier Budget=1002026.02 | 3.42 | 24.85 | |
| TongyiBase Retrieval Model=INF2026.02 | 3.3 | 21.95 | |
| Base + Base (RVR)Base Retrieval Model=Qwen3, Verifier Budget=1002026.02 | 3.3 | 22.67 | |
| BaseBase Retrieval Model=Contriever2026.02 | 3.24 | 23.79 | |
| BaseBase Model=Contriever2026.02 | 3.24 | 23.79 | |
| SearchR1Base Retrieval Model=Qwen32026.02 | 3.19 | 20.83 | |
| BaseBase Retrieval Model=Qwen32026.02 | 3.13 | 21.38 | |
| FT (Di)Base Retrieval Model=Contriever2026.02 | 3.13 | 18.67 | |
| FT (Di)Base Model=Contriever2026.02 | 3.13 | 18.67 | |
| BaseBase Model=Qwen32026.02 | 3.13 | 21.38 | |
| Retrieve-Verify-Retrieve (Base + Base)Base Model=Qwen3, Verifier Budget=502026.02 | 2.95 | 20.21 | |
| Retrieve-Verify-Retrieve (Base + Base)Base Model=Contriever, Verifier Budget=502026.02 | 2.72 | 21.98 | |
| TongyiBase Retrieval Model=Qwen32026.02 | 2.49 | 19.52 | |
| FT (Di)Base Retrieval Model=Qwen32026.02 | 2.43 | 18.38 | |
| FT (Di)Base Model=Qwen32026.02 | 2.43 | 18.38 | |
| TongyiBase Retrieval Model=Contriever2026.02 | 0.93 | 10.51 | |
| SearchR1Base Retrieval Model=Contriever2026.02 | 0.81 | 9.54 |