Text Retrieval on BEIR-5 (test)
51.1Avg. NDCG@10CRISP-1024
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| CRISP-1024Initialization (Init)=Cluster IS, Train Dataset=BEIR-7, Dev Dataset=BEIR-1, Optimization Protocol=Individual optimization on development sets2026.01 | 51.1 | 24.8 | 62.9 | 31.8 | 52.6 | 83.3 | |
| Inf-DDSInitialization (Init)=tau = 1, Train Dataset=BEIR-7, Dev Dataset=BEIR-1, Optimization Protocol=Individual optimization on development sets2026.01 | 51 | 29.4 | 54.7 | 33.7 | 52.9 | 84.1 | |
| CRISP-32Initialization (Init)=Cluster IS, Train Dataset=BEIR-7, Dev Dataset=BEIR-1, Optimization Protocol=Individual optimization on development sets2026.01 | 50.8 | 27 | 59 | 31.3 | 52.9 | 83.6 | |
| DoGEInit=Proxy, Train Dataset=BEIR-7, Dev Dataset=BEIR-52026.01 | 50.4 | 26.7 | 61.3 | 30.4 | 51.4 | 82.2 | |
| MultiDDSInitialization (Init)=tau = 1, Train Dataset=BEIR-7, Dev Dataset=BEIR-1, Optimization Protocol=Individual optimization on development sets2026.01 | 50.4 | 27.4 | 53.9 | 33.3 | 53.8 | 83.7 | |
| Inf-DDSInit=τ = 0.3, Train Dataset=BEIR-7, Dev Dataset=BEIR-52026.01 | 50.3 | 27.7 | 69.2 | 23.6 | 48.6 | 82.3 | |
| Inf-DDSInitialization (Init)=tau = infinity, Train Dataset=BEIR-7, Dev Dataset=BEIR-1, Optimization Protocol=Individual optimization on development sets2026.01 | 50.3 | 26.7 | 57.5 | 32 | 52.6 | 82.7 | |
| Inf-DDSInit=τ = ∞, Train Dataset=BEIR-7, Dev Dataset=BEIR-52026.01 | 50.2 | 26.8 | 59.6 | 32.1 | 50.4 | 82.2 | |
| CRISP-32Init=Cluster IS, Train Dataset=BEIR-7, Dev Dataset=BEIR-52026.01 | 50 | 26.2 | 57.2 | 31 | 52.3 | 83.5 | |
| DoGEInitialization (Init)=Proxy, Train Dataset=BEIR-7, Dev Dataset=BEIR-1, Optimization Protocol=Individual optimization on development sets2026.01 | 50 | 25.1 | 54.7 | 32.4 | 54.8 | 82.8 | |
| MultiDDSInitialization (Init)=tau = infinity, Train Dataset=BEIR-7, Dev Dataset=BEIR-1, Optimization Protocol=Individual optimization on development sets2026.01 | 49.8 | 25.6 | 55.8 | 31.1 | 53.1 | 83.1 | |
| Inf-DDSInit=τ = 5, Train Dataset=BEIR-7, Dev Dataset=BEIR-52026.01 | 49.7 | 28.8 | 55 | 31.2 | 51.4 | 82.2 | |
| CRISP-1024Init=Cluster IS, Train Dataset=BEIR-7, Dev Dataset=BEIR-52026.01 | 49.4 | 23.6 | 56.1 | 31.2 | 52.5 | 83.3 | |
| MultiDDSInit=τ = 1, Train Dataset=BEIR-7, Dev Dataset=BEIR-52026.01 | 49.3 | 25.9 | 59 | 29 | 50.5 | 82 | |
| StaticInit=τ = 0.3, Train Dataset=BEIR-7, Dev Dataset=None2026.01 | 49.2 | 28.6 | 58.2 | 26.5 | 48.7 | 84 | |
| DoReMiInit=Proxy, Train Dataset=BEIR-7, Dev Dataset=None2026.01 | 49 | 27.5 | 48.6 | 32 | 53.7 | 83.1 | |
| DoReMiInitialization (Init)=Proxy, Train Dataset=BEIR-7, Dev Dataset=None, Optimization Protocol=Individual optimization on development sets2026.01 | 49 | 27.5 | 48.6 | 32 | 53.7 | 83.1 | |
| Inf-DDSInit=τ = 1, Train Dataset=BEIR-7, Dev Dataset=BEIR-52026.01 | 48.9 | 29.5 | 50 | 29.4 | 51.6 | 84.1 | |
| StaticInit=τ = 5, Train Dataset=BEIR-7, Dev Dataset=None2026.01 | 48.9 | 27.6 | 48.4 | 32.4 | 53.2 | 83 | |
| StaticInit=τ = ∞, Train Dataset=BEIR-7, Dev Dataset=None2026.01 | 48.9 | 27.2 | 50.1 | 31.7 | 52.8 | 82.8 | |
| StaticInitialization (Init)=tau = infinity, Train Dataset=BEIR-7, Dev Dataset=None, Optimization Protocol=Individual optimization on development sets2026.01 | 48.9 | 27.2 | 50.1 | 31.7 | 52.8 | 82.8 | |
| StaticInit=τ = 1, Train Dataset=BEIR-7, Dev Dataset=None2026.01 | 48.7 | 29.5 | 48.8 | 29 | 52.4 | 84 | |
| StaticInitialization (Init)=tau = 1, Train Dataset=BEIR-7, Dev Dataset=None, Optimization Protocol=Individual optimization on development sets2026.01 | 48.7 | 29.5 | 48.8 | 29 | 52.4 | 84 | |
| MultiDDSInit=τ = 0.3, Train Dataset=BEIR-7, Dev Dataset=BEIR-52026.01 | 48.2 | 25.2 | 58.6 | 23.3 | 54 | 80.1 | |
| MultiDDSInit=τ = 5, Train Dataset=BEIR-7, Dev Dataset=BEIR-52026.01 | 47.4 | 24.4 | 51 | 30.1 | 49.7 | 81.5 | |
| MultiDDSInit=τ = ∞, Train Dataset=BEIR-7, Dev Dataset=BEIR-52026.01 | 47.3 | 22.7 | 52.4 | 30.4 | 50.1 | 81.1 |