Logical Retrieval on SciFact BEIR v1 (test)
0.64nDCG@10ITLR
Evaluation Results
| Method | Links | |
|---|---|---|
| ITLRBackbone=NV-Embed-V12025.03 | 0.64 | |
| ITLRBackbone=text-embedding-v3-large2025.03 | 0.64 | |
| BRIGHTBackbone=text-embedding-v3-large2025.03 | 0.63 | |
| ITLRBackbone=nv-embedqa-mistral-7b-v22025.03 | 0.61 | |
| BRIGHTBackbone=NV-Embed-V12025.03 | 0.59 | |
| BaseBackbone=text-embedding-v3-large2025.03 | 0.59 | |
| BRIGHTBackbone=text-embedding-v3-small2025.03 | 0.59 | |
| ITLRBackbone=text-embedding-v3-small2025.03 | 0.54 | |
| BaselineBackbone=NV-Embed-V12025.03 | 0.51 | |
| BaseBackbone=text-embedding-v3-small2025.03 | 0.5 | |
| BaseBackbone=nv-embedqa-mistral-7b-v22025.03 | 0.5 | |
| BRIGHTBackbone=nv-embedqa-mistral-7b-v22025.03 | 0.39 |