Text Ranking on BEIR (out-domain) Suite
56.8ArguanaTSARankLLM
Evaluation results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| TSARankLLMBase Model=Qwen-7B, Number of Parameters=7B2023.11 | 56.8 | 37.2 | 48.5 | 85.6 | 49.6 | 80.4 | 40.4 | 62.7 | 82.6 | 19.8 | 77.6 | 83.7 | 32.6 | 58.3 | |
| TSARankLLMBase Model=BLOOM-7B, Number of Parameters=7B2023.11 | 56.1 | 28.1 | 47.8 | 84.1 | 46.4 | 77.4 | 39.5 | 60.4 | 83.8 | 20.3 | 77.8 | 82.9 | 31 | 56.6 | |
| TSARankLLMBase Model=Baichuan-7B, Number of Parameters=7B2023.11 | 54.1 | 32.2 | 50 | 83 | 49.4 | 80 | 39.8 | 63.1 | 85 | 20 | 77.6 | 82.4 | 30.6 | 57.5 | |
| TSARankLLMBase Model=LLaMA-7B, Number of Parameters=7B2023.11 | 51.2 | 31.6 | 49.2 | 84.5 | 50.2 | 80.7 | 40.2 | 63.6 | 85.9 | 19.8 | 78.3 | 84 | 32 | 57.8 | |
| RankLLaMABase Model=LLaMA-7B, Number of Parameters=7B2023.11 | 47 | 19.1 | 48.6 | 74.5 | 42.2 | 75.2 | 35.8 | 62.1 | 80.5 | 19 | 70.1 | 77.4 | 31 | 52.5 |