Information Retrieval on ArguAna BEIR (NDCG@10)
84.9NDCG@10inf-v1
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| inf-v1Model Size Category=<1B parameters2025.10 | 84.9 | — | — | |
| bge-en-iclModel Size Category=>=1B parameters2025.10 | 83.1 | — | — | |
| inf-v1-1.5bModel Size Category=>=1B parameters2025.10 | 81.5 | — | — | |
| LENS-d4KModel Size Category=>=1B parameters2025.10 | 77.3 | — | — | |
| Qwen3-8BModel Size Category=>=1B parameters2025.10 | 76.9 | — | — | |
| Qwen3-4BModel Size Category=>=1B parameters2025.10 | 75.6 | — | — | |
| Qwen3-0.6BModel Size Category=<1B parameters2025.10 | 71 | — | — | |
| j-v5-nano + SOFTCENTROIDModel=j-v5-nano, Program Strategy=SOFTCENTROID (default), K=3, α=0.5, τ=0.05, Cost=1×, Per-task tuning=No2026.05 | 68.82 | — | — | |
| j-v5-small + SOFTCENTROIDModel=j-v5-small, Program Strategy=SOFTCENTROID (default), K=3, α=0.5, τ=0.05, Cost=1×, Per-task tuning=No2026.05 | 67.51 | — | — | |
| j-v5-nanoModel=j-v5-nano2026.05 | 65.63 | — | — | |
| DIVEDimension=512d, Backbone=LLM2Vec-Mistral-7B2026.05 | 65.2 | — | — | |
| j-v5-smallModel=j-v5-small2026.05 | 64.71 | — | — | |
| bge-lg-v1.5Model Size Category=<1B parameters2025.10 | 64.5 | — | — | |
| bge-large-en-v1.5 (335M)Variant=base2026.05 | 64.46 | — | — | |
| gte-base-v1.5Model Size Category=<1B parameters2025.10 | 63.5 | — | — | |
| bge-largeModel Size Category=<1B parameters2025.10 | 62.5 | — | — | |
| MILCOModel Size Category=<1B parameters2025.10 | 61.8 | — | — | |
| SearchDimension=512d, Backbone=LLM2Vec-Mistral-7B2026.05 | 58.65 | — | — | |
| e5-large-instModel Size Category=>=1B parameters2025.10 | 58.5 | — | — | |
| gte-base-en-v1.5Variant=base2026.05 | 57.24 | — | — | |
| gte-largeModel Size Category=>=1B parameters2025.10 | 57.2 | — | — | |
| gte-baseModel Size Category=<1B parameters2025.10 | 57.1 | — | — | |
| SMECDimension=512d, Backbone=LLM2Vec-Mistral-7B2026.05 | 56.41 | — | — | |
| e5-base-v2 + SOFTCENTROIDModel=e5-base-v2, Program Strategy=SOFTCENTROID (default), K=3, α=0.5, τ=0.05, Cost=1×, Per-task tuning=No2026.05 | 54.95 | — | — | |
| e5-largeModel Size Category=<1B parameters2025.10 | 54.4 | — | — | |
| opensearch-gteModel Size Category=<1B parameters2025.10 | 52.1 | — | — | |
| Splade-V3Model Size Category=<1B parameters2025.10 | 50.9 | — | — | |
| e5-large-v2 (335M)Variant=base2026.05 | 46.38 | — | — | |
| e5-base-v2Model=e5-base-v22026.05 | 44.62 | — | — | |
| e5-base-v2Variant=base2026.05 | 44.62 | — | — | |
| e5-small-v2 (33M)Variant=base2026.05 | 41.94 | — | — | |
| MatryoshkaDimension=512d, Backbone=LLM2Vec-Mistral-7B2026.05 | 40.49 | — | — | |
| LLM2VecDimension=4096d, Backbone=LLM2Vec-Mistral-7B2026.05 | 36.8 | — | — | |
| rawEncoder=e5-small, Kcands=2002026.06 | 35.8 | — | — | |
| rawEncoder=e5-base, Kcands=2002026.06 | 34.6 | — | — | |
| SHARDEncoder=e5-base, config=d/4, Kcands=2002026.06 | — | 0.1 | 0.2 | |
| SHARDEncoder=e5-base, config=d/8, Kcands=2002026.06 | — | 0.5 | 0.8 | |
| SHARDEncoder=e5-small, config=d/4, Kcands=2002026.06 | — | 0.2 | 0.4 | |
| SHARDEncoder=e5-small, config=d/8, Kcands=2002026.06 | — | 1.3 | 1.7 | |
| SOFTCENTROIDBackbone=e5-base-v2, Variant=SC2026.05 | — | 10.38 | — | |
| SOFTCENTROIDBackbone=e5-base-v2, Variant=SCK102026.05 | — | 7.08 | — | |
| SOFTCENTROIDBackbone=e5-base-v2, Variant=SCK5,α.352026.05 | — | 7.75 | — | |
| SOFTCENTROIDBackbone=gte-base-en-v1.5, Variant=SC2026.05 | — | 2.87 | — | |
| SOFTCENTROIDBackbone=gte-base-en-v1.5, Variant=SCK102026.05 | — | 1.32 | — | |
| SOFTCENTROIDBackbone=gte-base-en-v1.5, Variant=SCK5,α.352026.05 | — | 1.77 | — | |
| SOFTCENTROIDBackbone=e5-small-v2 (33M), Variant=SC2026.05 | — | 8.13 | — | |
| SOFTCENTROIDBackbone=e5-small-v2 (33M), Variant=SCK102026.05 | — | 4.56 | — | |
| SOFTCENTROIDBackbone=e5-small-v2 (33M), Variant=SCK5,α.352026.05 | — | 5.92 | — | |
| SOFTCENTROIDBackbone=e5-large-v2 (335M), Variant=SC2026.05 | — | 8.81 | — | |
| SOFTCENTROIDBackbone=e5-large-v2 (335M), Variant=SCK102026.05 | — | 6.19 | — | |
| SOFTCENTROIDBackbone=e5-large-v2 (335M), Variant=SCK5,α.352026.05 | — | 7.18 | — | |
| SOFTCENTROIDBackbone=bge-large-en-v1.5 (335M), Variant=SC2026.05 | — | 3.87 | — | |
| SOFTCENTROIDBackbone=bge-large-en-v1.5 (335M), Variant=SCK102026.05 | — | 3.69 | — | |
| SOFTCENTROIDBackbone=bge-large-en-v1.5 (335M), Variant=SCK5,α.352026.05 | — | 3.32 | — | |
| SVDEncoder=e5-base, k=d/2, Kcands=2002026.06 | — | 8.2 | 9.1 | |
| SVDEncoder=e5-small, k=d/2, Kcands=2002026.06 | — | 6 | 6.9 |