Legal Case Retrieval on COLIEE Top-5 2022
43.7P@5LEXA
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| LEXAStage=One-stage, Architecture=Graph2024.05 | 43.7 | 51.9 | 47.5 | 52.4 | 77 | 74.7 | 79.3 | |
| CaseLinkStage=One-stage, Architecture=Graph2024.05 | 37 | 43.9 | 40.1 | 44.2 | 67.3 | 65 | 70.3 | |
| CaseGNNStage=One-stage, Architecture=Graph2024.05 | 35.5 | 42.1 | 38.4 | 42.4 | 66.8 | 64.4 | 69.3 | |
| LEXAStage=Two-stage, Architecture=Graph2024.05 | 25.4 | 30.2 | 27.6 | 30 | 59 | 58 | 61.2 | |
| CaseLinkStage=Two-stage, Architecture=Graph2024.05 | 24.7 | 29.1 | 26.8 | 29.2 | 56 | 55 | 58.6 | |
| SAILERStage=Two-stage, Architecture=LM2024.05 | 23.8 | 25.7 | 24.7 | 25.2 | 43.9 | 42.7 | 48.4 | |
| PromptCaseStage=Two-stage, Architecture=LM2024.05 | 23.5 | 25.3 | 24.4 | 30.3 | 41.2 | 39.6 | 45.1 | |
| CaseGNNStage=Two-stage, Architecture=Graph2024.05 | 22.9 | 27.2 | 24.9 | 27 | 54.9 | 54 | 57.3 | |
| Inf-Retriever-V1Stage=Two-stage, Architecture=LLM2024.05 | 22.2 | 26.4 | 24.1 | 26.1 | 45.5 | 44.5 | 49.6 | |
| E5-Mistral-7B-InstructStage=Two-stage, Architecture=LLM2024.05 | 22 | 26.2 | 24 | 25.8 | 48.4 | 46.8 | 51.5 | |
| Qwen3-Embedding-8BStage=Two-stage, Architecture=LLM2024.05 | 21.9 | 26 | 23.8 | 25.8 | 48.8 | 48 | 52.1 | |
| Qwen3-Embedding-8BStage=One-stage, Architecture=LLM2024.05 | 21.6 | 25.7 | 23.5 | 26 | 26.7 | 29 | 37.8 | |
| E5-Mistral-7B-InstructStage=One-stage, Architecture=LLM2024.05 | 21.4 | 25.4 | 23.2 | 25.7 | 26.8 | 28.5 | 38 | |
| Inf-Retriever-V1Stage=One-stage, Architecture=LLM2024.05 | 21.1 | 25.1 | 22.9 | 25.5 | 26.6 | 28.7 | 37.9 | |
| BM25Stage=One-stage, Architecture=Classical2024.05 | 17.9 | 21.2 | 19.4 | 21.4 | 23.6 | 25.4 | 33.6 | |
| PromptCaseStage=One-stage, Architecture=LM2024.05 | 17.1 | 20.3 | 18.5 | 20.5 | 35.1 | 33.9 | 38.7 | |
| SAILERStage=One-stage, Architecture=LM2024.05 | 16.6 | 15.2 | 14 | 16.8 | 17.2 | 18.5 | 25.1 | |
| LEGAL-BERTStage=One-stage, Architecture=LM2024.05 | 4.47 | 5.3 | 4.85 | 5.38 | 7.42 | 7.47 | 10.9 | |
| MonoT5Stage=One-stage, Architecture=LM2024.05 | 0.71 | 0.65 | 0.6 | 0.79 | 1.39 | 1.41 | 1.73 |