Retrieval on QAMPARI N=1000 (test)
33.7MRecall@100Retrieve-Verify-Retrieve (FT (Di) + FT (Dr))
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Retrieve-Verify-Retrieve (FT (Di) + FT (Dr))Base Retriever Model=INF-Retriever-v1-1.5B2026.02 | 33.7 | 68.7 | |
| Retrieve-Verify-Retrieve (FT (Di + Dr) + FT (Di + Dr))Base Retriever Model=INF-Retriever-v1-1.5B2026.02 | 32.4 | 68.04 | |
| Retrieve-Verify-Retrieve (FT (Di + Dr) + FT (Di + Dr))Base Retriever Model=Contriever-MSMARCO2026.02 | 31.7 | 66.12 | |
| Retrieve-Verify-Retrieve (FT (Di) + FT (Dr))Base Retriever Model=Contriever-MSMARCO2026.02 | 31.6 | 66.83 | |
| Retrieve-Verify-Retrieve (FT (Di) + FT (Dr))Base Retriever Model=Qwen3-Embedding-0.6B2026.02 | 31.4 | 67.28 | |
| Retrieve-Verify-Retrieve (FT (Di) + FT (Di))Base Retriever Model=INF-Retriever-v1-1.5B2026.02 | 31.1 | 66.76 | |
| Retrieve-Verify-Retrieve (FT (Di) + FT (Di))Base Retriever Model=Qwen3-Embedding-0.6B2026.02 | 30.3 | 66.8 | |
| FT (Di)Base Retriever Model=INF-Retriever-v1-1.5B2026.02 | 29.3 | 65.99 | |
| Retrieve-Verify-Retrieve (FT (Di + Dr) + FT (Di + Dr))Base Retriever Model=Qwen3-Embedding-0.6B2026.02 | 29.2 | 65.73 | |
| Retrieve-Verify-Retrieve (FT (Di) + FT (Di))Base Retriever Model=Contriever-MSMARCO2026.02 | 28.8 | 63.59 | |
| FT (Di)Base Retriever Model=Contriever-MSMARCO2026.02 | 28.6 | 63.19 | |
| SearchR1Base Retriever Model=INF-Retriever-v1-1.5B, Retriever used=FT (Di)2026.02 | 27 | 60.96 | |
| FT (Di)Base Retriever Model=Qwen3-Embedding-0.6B2026.02 | 26.9 | 63.48 | |
| Base fiBase Retriever Model=INF-Retriever-v1-1.5B2026.02 | 26.1 | 62.34 | |
| SearchR1Base Retriever Model=Qwen3-Embedding-0.6B, Retriever used=FT (Di)2026.02 | 24.3 | 57.82 | |
| TongyiBase Retriever Model=Qwen3-Embedding-0.6B, Retriever used=FT (Di)2026.02 | 22 | 60.67 | |
| SearchR1Base Retriever Model=INF-Retriever-v1-1.5B, Retriever used=Base fi2026.02 | 21.4 | 57.72 | |
| TongyiBase Retriever Model=INF-Retriever-v1-1.5B, Retriever used=FT (Di)2026.02 | 21.3 | 58.13 | |
| TongyiBase Retriever Model=INF-Retriever-v1-1.5B, Retriever used=Base fi2026.02 | 20.4 | 57.03 | |
| Base fiBase Retriever Model=Contriever-MSMARCO2026.02 | 19 | 54.17 | |
| SearchR1Base Retriever Model=Qwen3-Embedding-0.6B, Retriever used=Base fi2026.02 | 17.6 | 53.39 | |
| Base fiBase Retriever Model=Qwen3-Embedding-0.6B2026.02 | 16.7 | 52.94 | |
| TongyiBase Retriever Model=Qwen3-Embedding-0.6B, Retriever used=Base fi2026.02 | 16.2 | 52.22 | |
| TongyiBase Retriever Model=Contriever-MSMARCO, Retriever used=FT (Di)2026.02 | 9.8 | 42.09 | |
| SearchR1Base Retriever Model=Contriever-MSMARCO, Retriever used=FT (Di)2026.02 | 9.6 | 40.83 | |
| SearchR1Base Retriever Model=Contriever-MSMARCO, Retriever used=Base fi2026.02 | 7.4 | 36.58 | |
| TongyiBase Retriever Model=Contriever-MSMARCO, Retriever used=Base fi2026.02 | 6.6 | 35.96 |