Text Retrieval on BEIR-5 (all-MiniLM-L6-v2, test)
52.3Average NDCG@10DoReMi
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| DoReMiSampling=DoReMi, Init.=Expert, Train Dataset=Sent-Trans, Dev Dataset=None2026.01 | 52.3 | 32.5 | 56.3 | 36.2 | 48.7 | 87.7 | |
| InfDDSSampling=InfDDS, Init.=Expert, Train Dataset=Sent-Trans, Dev Dataset=BEIR-52026.01 | 52 | 32.4 | 58.3 | 36.1 | 45.7 | 87.4 | |
| DoReMiSampling=DoReMi, Init.=Proxy, Train Dataset=Sent-Trans, Dev Dataset=None2026.01 | 51.4 | 31.7 | 52.3 | 36.2 | 49.1 | 87.6 | |
| Static (all-MiniLM-L6-v2)Sampling=Static, Init.=Expert, Train Dataset=Sent-Trans, Dev Dataset=None2026.01 | 51 | 32.3 | 51.9 | 36.9 | 46.5 | 87.6 | |
| InfDDSSampling=InfDDS, Init.=τ = ∞, Train Dataset=Sent-Trans, Dev Dataset=BEIR-52026.01 | 50.8 | 32 | 50.6 | 34.4 | 46.6 | 88 | |
| DoGESampling=DoGE, Init.=Expert, Train Dataset=Sent-Trans, Dev Dataset=BEIR-52026.01 | 50.5 | 30 | 59.6 | 33.3 | 43.1 | 86.4 | |
| DoGESampling=DoGE, Init.=Proxy, Train Dataset=Sent-Trans, Dev Dataset=BEIR-52026.01 | 49.5 | 29.9 | 57.4 | 31.2 | 42.6 | 86.3 | |
| StaticSampling=Static, Init.=τ = ∞, Train Dataset=Sent-Trans, Dev Dataset=None2026.01 | 49 | 31.7 | 49 | 31.8 | 44.6 | 49 | |
| CRISP (n=32^3)Sampling=CRISP (n=32^3), Init.=Cluster IS, Train Dataset=Sent-Trans, Dev Dataset=BEIR-52026.01 | 48.5 | 28.4 | 61.9 | 28.5 | 39.5 | 84.2 | |
| CooldownSampling=Cooldown, Init.=5 → 1, Train Dataset=Sent-Trans, Dev Dataset=None2026.01 | 47.6 | 28.6 | 49.9 | 33.7 | 38.1 | 87.6 | |
| CRISP (n=32)Sampling=CRISP (n=32), Init.=Cluster IS, Train Dataset=Sent-Trans, Dev Dataset=BEIR-52026.01 | 47.4 | 28.3 | 58.1 | 27.9 | 38 | 84.9 | |
| CRISP (n=32^2)Sampling=CRISP (n=32^2), Init.=Cluster IS, Train Dataset=Sent-Trans, Dev Dataset=BEIR-52026.01 | 45.6 | 26.8 | 54.8 | 26.4 | 35.5 | 84.7 | |
| MultiDDSSampling=MultiDDS, Init.=Expert, Train Dataset=Sent-Trans, Dev Dataset=BEIR-52026.01 | 42.5 | 22.8 | 37.2 | 29.2 | 28.3 | 86.3 | |
| MultiDDSSampling=MultiDDS, Init.=τ = ∞, Train Dataset=Sent-Trans, Dev Dataset=BEIR-52026.01 | 40.2 | 22.3 | 43.9 | 24.8 | 26.5 | 83.9 |