Information Retrieval on TREC-COVID BEIR
95NDCG@10Qwen3-8B
Evaluation Results
| Method | Links | |
|---|---|---|
| Qwen3-8BModel Size Category=>=1B parameters2025.10 | 95 | |
| Qwen3-4BModel Size Category=>=1B parameters2025.10 | 92.9 | |
| Qwen3-0.6BModel Size Category=<1B parameters2025.10 | 90.5 | |
| e5-large-instModel Size Category=>=1B parameters2025.10 | 82.5 | |
| STORMBackbone=Qwen3-8B, Max tokens=642026.06 | 79.6 | |
| bge-en-iclModel Size Category=>=1B parameters2025.10 | 79.1 | |
| bge-largeModel Size Category=<1B parameters2025.10 | 75.4 | |
| GenQREBackbone=GPT-4.12026.06 | 75.3 | |
| inf-v1Model Size Category=<1B parameters2025.10 | 75.1 | |
| Splade-V3Model Size Category=<1B parameters2025.10 | 74.8 | |
| bge-lg-v1.5Model Size Category=<1B parameters2025.10 | 74.7 | |
| Q2DBackbone=GPT-4.1, Evaluation Protocol=Zero-shot2026.06 | 74.3 | |
| MILCOModel Size Category=<1B parameters2025.10 | 74 | |
| opensearch-gteModel Size Category=<1B parameters2025.10 | 73.3 | |
| gte-base-v1.5Model Size Category=<1B parameters2025.10 | 73.1 | |
| inf-v1-1.5bModel Size Category=>=1B parameters2025.10 | 72.4 | |
| Q2KBackbone=GPT-4.12026.06 | 71.5 | |
| MUGIBackbone=GPT-4.12026.06 | 71.4 | |
| e5-largeModel Size Category=<1B parameters2025.10 | 71.2 | |
| QA-ExpaBackbone=GPT-4.12026.06 | 70.7 | |
| gte-largeModel Size Category=>=1B parameters2025.10 | 70.2 | |
| LameRBackbone=GPT-4.12026.06 | 70.2 | |
| CSQEBackbone=GPT-4.12026.06 | 69.9 | |
| LENS-d4KModel Size Category=>=1B parameters2025.10 | 69.7 | |
| gte-baseModel Size Category=<1B parameters2025.10 | 68.8 | |
| GenQRBackbone=GPT-4.12026.06 | 68.7 | |
| RM3Backbone=GPT-4.12026.06 | 59.3 |