Concept Retrieval on ELSST concept retrieval synthetic (test)
98.3MRROrthoGeoLoRA
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| OrthoGeoLoRABackbone=multilingual-e5-small, Rank=8, Optimizer=AdamW, Learning Rate=1e-4, Batch Size=1282026.01 | 98.3 | 32.1 | 93.9 | 97.8 | 96.4 | |
| DoRABackbone=multilingual-e5-small, Rank=8, Optimizer=AdamW, Learning Rate=1e-4, Batch Size=1282026.01 | 97.4 | 31.6 | 89.4 | 96.5 | 93.5 | |
| LoRABackbone=multilingual-e5-small, Rank=8, Optimizer=AdamW, Learning Rate=1e-4, Batch Size=1282026.01 | 97.3 | 31.5 | 89.8 | 96.3 | 93.6 | |
| LoHaBackbone=multilingual-e5-small, Rank=8, Optimizer=AdamW, Learning Rate=1e-4, Batch Size=1282026.01 | 96.1 | 30.8 | 84.6 | 94.7 | 89.7 | |
| LoKrBackbone=multilingual-e5-small, Rank=8, Optimizer=AdamW, Learning Rate=1e-4, Batch Size=1282026.01 | 95.5 | 30.4 | 85 | 93.7 | 89.8 | |
| BaseBackbone=multilingual-e5-small, Mode=Zero-Shot2026.01 | 95.4 | 30.4 | 83.1 | 93.9 | 88.9 | |
| AdaLoRABackbone=multilingual-e5-small, Rank=8, Optimizer=AdamW, Learning Rate=1e-4, Batch Size=1282026.01 | 94.8 | 29.9 | 83.3 | 92.3 | 88.2 |