Information Retrieval on QAMPARI N=1000 (test)
16.42Number of CallsTongyi
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| TongyiBase Retriever Model=INF-Retriever-v1-1.5B2026.02 | 16.42 | 264.3 | 80.4 | 344.7 | |
| TongyiBase Retriever Model=Qwen3-Embedding-0.6B2026.02 | 15.85 | 232.79 | 83.6 | 316.39 | |
| TongyiBase Retriever Model=Contriever-MSMARCO2026.02 | 14.94 | 97.72 | 92.32 | 190.04 | |
| SearchR1Base Retriever Model=Qwen3-Embedding-0.6B2026.02 | 2.96 | 22.95 | 2.42 | 25.38 | |
| SearchR1Base Retriever Model=INF-Retriever-v1-1.5B2026.02 | 2.93 | 39.86 | 2.54 | 42.4 | |
| SearchR1Base Retriever Model=Contriever-MSMARCO2026.02 | 2.92 | 19.43 | 2.41 | 21.84 | |
| RVRBase Retriever Model=Contriever-MSMARCO, T=2, B=12026.02 | 2 | 3.8 | 0.07 | 3.87 | |
| RVRBase Retriever Model=Contriever-MSMARCO, T=2, B=502026.02 | 2 | 3.8 | 0.53 | 4.33 | |
| RVRBase Retriever Model=Contriever-MSMARCO, T=2, B=1002026.02 | 2 | 3.8 | 0.98 | 4.78 | |
| RVRBase Retriever Model=Qwen3-Embedding-0.6B, T=2, B=12026.02 | 2 | 5.05 | 0.06 | 5.11 | |
| RVRBase Retriever Model=Qwen3-Embedding-0.6B, T=2, B=502026.02 | 2 | 5.05 | 0.52 | 5.57 | |
| RVRBase Retriever Model=Qwen3-Embedding-0.6B, T=2, B=1002026.02 | 2 | 5.05 | 0.97 | 6.02 | |
| RVRBase Retriever Model=INF-Retriever-v1-1.5B, T=2, B=12026.02 | 2 | 7.55 | 0.07 | 7.62 | |
| RVRBase Retriever Model=INF-Retriever-v1-1.5B, T=2, B=502026.02 | 2 | 7.55 | 0.53 | 8.08 | |
| RVRBase Retriever Model=INF-Retriever-v1-1.5B, T=2, B=1002026.02 | 2 | 7.55 | 0.97 | 8.52 | |
| BaseBase Retriever Model=Contriever-MSMARCO2026.02 | 1 | 1.91 | — | 1.91 | |
| BaseBase Retriever Model=Qwen3-Embedding-0.6B2026.02 | 1 | 1.34 | — | 1.34 | |
| BaseBase Retriever Model=INF-Retriever-v1-1.5B2026.02 | 1 | 3.75 | — | 3.75 |