Information Retrieval on Legal Dataset Average (JUÁ-Juris, JurisTCU, NormasTCU, BR-TaxQA-R)
0.434NDCG@10Qwen3-Embedding-4B (legal-only adapted)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Qwen3-Embedding-4B (legal-only adapted)Model size=4B, Adaptation strategy=legal-only adapted2026.05 | 0.434 | 0.531 | 0.319 | |
| Qwen3-Embedding-4B (mixed adapted)Model size=4B, Adaptation strategy=mixed adapted2026.05 | 0.434 | 0.536 | 0.321 | |
| Qwen3-Embedding-8B (base)Model size=8B, Adaptation strategy=base2026.05 | 0.407 | 0.509 | 0.304 | |
| Qwen3-Embedding-4B (base)Model size=4B, Adaptation strategy=base2026.05 | 0.397 | 0.511 | 0.295 | |
| BM25/anserini2026.05 | 0.35 | 0.444 | 0.243 | |
| text-embedding-3-small2026.05 | 0.329 | 0.429 | 0.245 | |
| KaLM Gemma3 12BModel size=12B2026.05 | 0.298 | 0.383 | 0.224 |