Statute Retrieval on STARD (test)
81.95Recall@10LegalMALR
Evaluation results
| Method | Links | ||
|---|---|---|---|
| LegalMALRCategory=Our2026.01 | 81.95 | 73.67 | |
| Qwen3-SFTCategory=RAG system2026.01 | 76.9 | 70.43 | |
| Qwen3-OriginalCategory=RAG system2026.01 | 75.79 | 67.36 | |
| Infly-HybridCategory=RAG system2026.01 | 72.33 | 63.06 | |
| Dense-STARDCategory=Fine-tuned PLM2026.01 | 60.61 | 47.24 | |
| Dense-GPT4Category=Fine-tuned PLM2026.01 | 51.74 | 41.06 | |
| QLCategory=Lexical Matching2026.01 | 40.2 | 33.04 | |
| BM25Category=Lexical Matching2026.01 | 39.43 | 33.69 | |
| RoBERTaCategory=Open-Domain PLM2026.01 | 39.08 | 30.1 | |
| SEEDCategory=Open-Domain PLM2026.01 | 35.55 | 28.16 | |
| SAILERCategory=Legal PLM2026.01 | 30.5 | 22.34 | |
| LawformerCategory=Legal PLM2026.01 | 29.89 | 24.12 | |
| LSI-STARDCategory=Fine-tuned PLM2026.01 | 20.69 | 21.56 | |
| coCondenserCategory=Open-Domain PLM2026.01 | 15.98 | 10.04 | |
| Dense-CAILCategory=Fine-tuned PLM2026.01 | 12.72 | 8.42 |