Legal Case Retrieval on Canadian Federal Court Dataset COLIEE Full-Scale 2025
20.19MRR@10Section-Aware
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Section-AwareScale=Full-Scale, Optimization=OPTIMIZED2026.06 | 20.19 | 20.19 | 20.19 | 8.41 | 6.49 | 14.17 | 20.33 | 35 | 10.56 | 9.84 | |
| QLModel Category=Traditional Retrieval Models2026.06 | 19.07 | 19.07 | 19.07 | 7.08 | 5.58 | 11.93 | 17.28 | 46.13 | 7.88 | 7.63 | |
| BM25Model Category=Traditional Retrieval Models2026.06 | 17.44 | 18.61 | 18.74 | 7.14 | 5.6 | 11.89 | 17.6 | 45.13 | 7.92 | 7.68 | |
| SAILERModel Category=Retrieval-oriented Pre-trained Models2026.06 | 11.79 | 11.79 | 11.79 | 6.97 | 6.97 | 11.93 | 17.28 | 46.03 | 6.97 | 6.97 | |
| CoT-MAEModel Category=Retrieval-oriented Pre-trained Models2026.06 | 8.21 | 9.29 | 9.44 | 4.71 | 3.85 | 7.92 | 12.2 | 35.34 | 5.25 | 5.27 | |
| LEGAL-BERTModel Category=Generic Pre-trained Models2026.06 | 7.51 | 8.72 | 8.86 | 4.31 | 3.63 | 7.23 | 11.56 | 35.25 | 4.78 | 4.99 | |
| coCondenserModel Category=Retrieval-oriented Pre-trained Models2026.06 | 7.15 | 8.21 | 8.41 | 3.83 | 3.12 | 6.48 | 9.61 | 31.41 | 4.22 | 4.24 | |
| CondenserModel Category=Retrieval-oriented Pre-trained Models2026.06 | 6.83 | 7.9 | 8.08 | 3.72 | 2.98 | 6.12 | 9.22 | 30.25 | 4.08 | 4.06 | |
| BERTModel Category=Generic Pre-trained Models2026.06 | 6.72 | 7.83 | 7.99 | 3.66 | 3.13 | 6.01 | 9.51 | 31.1 | 3.99 | 4.26 | |
| SEEDModel Category=Retrieval-oriented Pre-trained Models2026.06 | 6.72 | 7.83 | 7.99 | 3.66 | 3.13 | 6.01 | 9.51 | 31.1 | 3.99 | 4.26 | |
| RetroMAEModel Category=Retrieval-oriented Pre-trained Models2026.06 | 6.14 | 7.03 | 7.18 | 3.33 | 2.74 | 5.25 | 8.13 | 24.91 | 3.61 | 3.69 | |
| RoBERTaModel Category=Generic Pre-trained Models2026.06 | 5.38 | 6.32 | 6.47 | 2.83 | 2.46 | 4.31 | 7.57 | 23.6 | 3.02 | 3.34 |