LoRA Retrieval on CARLoS LoRA Retrieval Evaluation Set (test)
60.7Top-1 AccuracyCARLoS
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| CARLoSEvaluator=HPS2025.12 | 60.7 | 60.3 | 59.6 | 59.4 | 59.1 | 59 | 58.9 | |
| Qwen3Evaluator=HPS2025.12 | 59.9 | 59.3 | 59 | 58.7 | 58.5 | 58.3 | 58.2 | |
| E5Evaluator=HPS2025.12 | 57.5 | 57 | 56.5 | 56.2 | 56.1 | 55.9 | 55.8 | |
| GTEEvaluator=HPS2025.12 | 56.2 | 55.4 | 55.6 | 55.4 | 55.3 | 55.3 | 55.3 | |
| CARLoSEvaluator=Qwen2.52025.12 | 56.1 | 54.7 | 53.2 | 52.4 | 52 | 51.5 | 51.2 | |
| BGEEvaluator=HPS2025.12 | 55.3 | 54.4 | 54.3 | 54.3 | 54.2 | 54 | 53.8 | |
| CARLoSEvaluator=IR2025.12 | 53.1 | 52 | 50.5 | 49.8 | 49.3 | 48.8 | 48.7 | |
| Qwen3Evaluator=Qwen2.52025.12 | 52.1 | 50.5 | 49.5 | 48.8 | 48.4 | 48 | 47.7 | |
| Qwen3Evaluator=IR2025.12 | 50.9 | 49.9 | 49.1 | 48.4 | 47.9 | 47.6 | 47.3 | |
| E5Evaluator=Qwen2.52025.12 | 50.1 | 48.8 | 48 | 47.4 | 47 | 46.7 | 46.4 | |
| GTEEvaluator=Qwen2.52025.12 | 47 | 46.1 | 46.1 | 45.7 | 45.4 | 45.2 | 45.1 | |
| E5Evaluator=IR2025.12 | 46.8 | 45.8 | 44.9 | 44.3 | 43.9 | 43.5 | 43.2 | |
| GTEEvaluator=IR2025.12 | 45.1 | 43.8 | 44 | 43.5 | 43.3 | 43.2 | 43.3 | |
| BGEEvaluator=Qwen2.52025.12 | 45 | 43.4 | 42.9 | 42.5 | 42.1 | 41.9 | 41.7 | |
| BGEEvaluator=IR2025.12 | 40.8 | 39 | 38.7 | 38.7 | 38.4 | 38.1 | 37.8 | |
| CARLoSEvaluator=SigLIP22025.12 | 38.5 | 36.8 | 35 | 34.2 | 33.4 | 32.8 | 32.4 | |
| Qwen3Evaluator=SigLIP22025.12 | 34.3 | 32 | 30.7 | 29.8 | 29.1 | 28.4 | 27.8 | |
| E5Evaluator=SigLIP22025.12 | 31.7 | 29.7 | 28.9 | 27.9 | 27.1 | 26.7 | 26.3 | |
| GTEEvaluator=SigLIP22025.12 | 26.5 | 25.6 | 25.8 | 25.4 | 25 | 24.6 | 24.4 | |
| BGEEvaluator=SigLIP22025.12 | 21.8 | 20.6 | 19.9 | 19.4 | 19.1 | 18.9 | 18.7 |