Retrieval-Augmented Generation on Legal Consultation (test)
78.02RecallLegal-DC
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Legal-DCModel=Qwen3-max2026.03 | 78.02 | 50.23 | 59.56 | 46.68 | 51.27 | 42.21 | 65.76 | 81.25 | |
| Legal-DCModel=Qwen3-8B2026.03 | 77.01 | 45.77 | 58.8 | 43.84 | 46.43 | 38.97 | 65.62 | 80.13 | |
| LightRAGModel=Qwen3-max2026.03 | 75.86 | 47.56 | 58.58 | 46.92 | 48.41 | 38.58 | 64.99 | 79.05 | |
| LightRAGModel=Qwen3-8B2026.03 | 75.62 | 46.5 | 56.93 | 46.34 | 50.47 | 38.99 | 65.86 | 78.81 | |
| LightRAGModel=DeepSeek-V3.22026.03 | 75.54 | 44.99 | 56.16 | 46.43 | 45.79 | 37.83 | 64.06 | 78.74 | |
| Legal-DCModel=DeepSeek-V3.22026.03 | 74.51 | 44.43 | 57.91 | 45.27 | 48.12 | 38.23 | 64.34 | 77.86 | |
| QAnythingModel=Qwen3-max2026.03 | 63.69 | 36.67 | 52.58 | 40.93 | 43.34 | 34.7 | 58.99 | 67.02 | |
| WeknoraModel=Qwen3-max2026.03 | 61.35 | 35.44 | 52.28 | 38.61 | 42.59 | 33.49 | 57.48 | 64.68 | |
| QAnythingModel=Qwen3-8B2026.03 | 59.78 | 34.01 | 51.21 | 36.67 | 44.15 | 31.69 | 55.05 | 63.15 | |
| WeknoraModel=Qwen3-8B2026.03 | 59.36 | 33.44 | 51.86 | 37.49 | 38.89 | 31.84 | 57.08 | 62.71 | |
| QAnythingModel=DeepSeek-V3.22026.03 | 58.61 | 32.33 | 50.19 | 36.18 | 42.78 | 30.46 | 55.43 | 62.03 | |
| WeknoraModel=DeepSeek-V3.22026.03 | 57.47 | 32.74 | 50.98 | 38.43 | 41.42 | 30.59 | 55.86 | 60.82 |