Retrieval on LazRetrieval
66.3BD Retrieval ScoreQWEN3-E-8B WITH LIRA-MAX
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| QWEN3-E-8B WITH LIRA-MAXYear=OURS, PARAMS=103B2025.10 | 66.3 | 78.53 | 81.54 | 68.53 | 83.12 | 87.44 | 78.48 | 77.71 | |
| QWEN3-E-8B WITH LIRA-LARGEYear=OURS, PARAMS=15.9B2025.10 | 57.7 | 77.33 | 77.93 | 56.67 | 78.52 | 86.03 | 75.86 | 72.86 | |
| QWEN3-E-4B WITH LIRA-LARGEYear=OURS, PARAMS=11.9B2025.10 | 56.24 | 75.29 | 77.03 | 55.69 | 77.72 | 84.81 | 74.92 | 71.67 | |
| QWEN3-E-8B WITH LIRA-BASEYear=OURS, PARAMS=14.4B2025.10 | 52.91 | 76.59 | 75.2 | 52.3 | 71.11 | 85.92 | 73.23 | 69.61 | |
| QWEN3-E-8BYear=2025, PARAMS=8B2025.10 | 50.59 | 76.01 | 73.36 | 50.37 | 69.67 | 84.78 | 71.56 | 68.05 | |
| QWEN3-E-4BYear=2025, PARAMS=4B2025.10 | 49.81 | 68.92 | 71.45 | 49.3 | 73.39 | 78.47 | 68.31 | 65.66 | |
| QWEN3-E-0.6B WITH LIRA-LARGEYear=OURS, PARAMS=8.5B2025.10 | 48.6 | 74.43 | 71.26 | 49.84 | 66.39 | 83.9 | 70.67 | 66.44 | |
| E5-MISTRAL-7BYear=2024, PARAMS=7.24B2025.10 | 48.27 | 75.43 | 71.01 | 53.62 | 61.75 | 83.18 | 65.44 | 64.51 | |
| BGE-EN-V1.5Year=2023, PARAMS=335M2025.10 | 41.06 | 78.78 | 53.28 | 37.52 | 18.35 | 88.18 | 68.72 | 54.09 | |
| E5-LARGE-V2Year=2024, PARAMS=335M2025.10 | 41.04 | 78.78 | 53.77 | 37.22 | 17.63 | 87.24 | 61.31 | 52.84 | |
| CONTRIEVERYear=2022, PARAMS=110M2025.10 | 39.95 | 74.95 | 48.9 | 35.71 | 15.43 | 83.74 | 64.75 | 51 | |
| GTE-LARGEYear=2023, PARAMS=335M2025.10 | 39.36 | 77.59 | 51.88 | 36.76 | 17.21 | 87.65 | 65.34 | 52.61 | |
| QWEN3-E-0.6BYear=2025, PARAMS=0.6B2025.10 | 38.36 | 63.95 | 62.37 | 40.73 | 55.28 | 74.38 | 59.46 | 56.31 | |
| GTR-XXLYear=2021, PARAMS=4.8B2025.10 | 34.85 | 75.92 | 49.36 | 30.39 | 22.94 | 84.94 | 46.15 | 48.17 | |
| SENTENCE-T5-XXLYear=2021, PARAMS=4.8B2025.10 | 34.11 | 71.77 | 49.19 | 27.84 | 23.58 | 84.2 | 28.61 | 44.56 | |
| SIMCSEYear=2021, PARAMS=330M2025.10 | 31.76 | 66.71 | 43.27 | 27.68 | 32.32 | 74 | 44.16 | 44.88 |