Information Retrieval on BEIR small
42.7NDCG@10 (Average)Sparton
Evaluation Results
| Method | Links | |
|---|---|---|
| SpartonHardware=NVIDIA H200, Batch=512, Steps=50646, Time (h)=12.24, Mem (GB)=128.632026.03 | 42.7 | |
| Splade-V3Hardware=NVIDIA H2002026.03 | 42.2 | |
| Compiled LMHardware=NVIDIA H200, Batch=384, Steps=67528, Time (h)=14.24, Mem (GB)=125.782026.03 | 42.1 | |
| SpartonHardware=NVIDIA H200, Batch=384, Steps=67528, Time (h)=12.38, Mem (GB)=96.832026.03 | 41.6 |