Information Retrieval on BrowseComp-Plus
13Recall@5GIRCSE (Qwen3-8B)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GIRCSE (Qwen3-8B)Size=8B2026.03 | 13 | 40.8 | 68.1 | |
| LaSER (Qwen3-8B)Size=8B2026.03 | 11.7 | 38.4 | 66.9 | |
| Fair Baseline (Qwen3-8B)Size=8B2026.03 | 11.3 | 37.4 | 63.2 | |
| Multilingual-E5-Large-InstructSize=0.6B2026.03 | 10.1 | 36.8 | 68.6 | |
| E5-Mistral-7B-InstructSize=7B2026.03 | 9.3 | 37.1 | 70.2 | |
| Qwen3-Embedding-0.6BSize=0.6B2026.03 | 8 | 29.1 | 64.8 | |
| Qwen3-Embedding-8BSize=8B2026.03 | 7.7 | 31.6 | 61.3 | |
| GIRCSE (Qwen3-0.6B)Size=0.6B2026.03 | 6.9 | 25.2 | 52.8 | |
| LaSER (Qwen3-0.6B)Size=0.6B2026.03 | 6.8 | 26.8 | 54.9 | |
| LaSER (LLaMA3.1-8B)Size=8B2026.03 | 6.8 | 25.7 | 52.9 | |
| GIRCSE (LLaMA3.1-8B)Size=8B2026.03 | 6.7 | 23.5 | 51 | |
| Fair Baseline (LLaMA3.1-8B)Size=8B2026.03 | 6.1 | 25.4 | 50.8 | |
| Qwen3-Embedding-4BSize=4B2026.03 | 5.9 | 18.1 | 39.4 | |
| BGE-M3Size=0.6B2026.03 | 4.1 | 21.7 | 47.2 | |
| Fair Baseline (Qwen3-0.6B)Size=0.6B2026.03 | 3.5 | 21.3 | 46.9 | |
| Inbedder (LLaMA2-7B)Size=7B2026.03 | 1.4 | 8.1 | 27.4 | |
| Search-R3 (Qwen2.5-1.5B)Size=1.5B2026.03 | 0 | 0.3 | 1.1 |