Legal Knowledge and Reasoning on LawBench
69.19Memorization ScoreDoubao-Seed-2.0-mini
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Doubao-Seed-2.0-miniParams=-, Local=No2026.04 | 69.19 | 48.73 | 58.31 | 54.61 | |
| PoliLegalLM-30B-A3BParams=30B/A3B, Local=Yes2026.04 | 68.56 | 54 | 67.73 | 60.95 | |
| Qwen3.5-35B-A3BParams=35B/A3B, Local=Yes2026.04 | 61.61 | 47.54 | 43.13 | 47.18 | |
| Qwen3-30B-A3BParams=30B/A3B, Local=Yes2026.04 | 55.53 | 46.33 | 63.18 | 53.99 | |
| PoliLegalLM-32BParams=32B, Local=Yes2026.04 | 48.82 | 50.85 | 64.87 | 56.26 | |
| Claude3.7Access=Closed-source2023.06 | 45.79 | 60.04 | 58.32 | 58.66 | |
| Qwen3-235B-A22BParameters=235B, Architecture=A22B, Access=Open-source2023.06 | 45.31 | 50.9 | 59.12 | 50.12 | |
| Hunyuan2.0-400BParameters=400B, Access=Closed-source2023.06 | 44.24 | 46.98 | 54.19 | 45.88 | |
| Qwen3-8BParameters=8B, Access=Open-source2023.06 | 43.9 | 41.93 | 58.45 | 48.74 | |
| Chatlaw-MoECategory=Legal LLMs2023.06 | 43.86 | 62.11 | 61.6 | 60.08 | |
| Chatlaw-MoEArchitecture=MoE2023.06 | 43.86 | 62.11 | 61.6 | 60.08 | |
| GLM-4.7-FlashXParams=30B/A3B, Local=Yes2026.04 | 41.77 | 41.9 | 56.28 | 47.64 | |
| GPT4.5Access=Closed-source2023.06 | 39.45 | 52.51 | 56.07 | 46.19 | |
| GPT-4Category=GPT Series2023.06 | 35.29 | 54.41 | 54.05 | 52.35 | |
| GPT-42023.06 | 35.29 | 54.41 | 54.05 | 52.35 | |
| Grok-4.1-FastParams=-, Local=No2026.04 | 34.94 | 47.39 | 56.21 | 49.67 | |
| GPT-5-MiniParams=-, Local=No2026.04 | 33.91 | 51.96 | 53.62 | 50.82 | |
| WisdomInterrogatoryParams=7B, Local=Yes2026.04 | 29.23 | 25.53 | 39.29 | 31.41 | |
| Qwen-7B-ChatCategory=General LLMs2023.06 | 28.99 | 32.8 | 36.31 | 33.82 | |
| Qwen-7B-ChatParameters=7B, Type=Chat2023.06 | 28.99 | 32.8 | 36.31 | 33.82 | |
| Baichuan2-7BCategory=General LLMs2023.06 | 27.3 | 32.42 | 47.84 | 38.08 | |
| Baichuan2-7BParameters=7B2023.06 | 27.3 | 32.42 | 47.84 | 38.08 | |
| GPT-3.5Category=GPT Series2023.06 | 25.93 | 43.31 | 44.74 | 42.15 | |
| GPT-3.52023.06 | 25.93 | 43.31 | 44.74 | 42.15 | |
| InternLM2-7BCategory=General LLMs2023.06 | 25.66 | 41.74 | 50.87 | 43.78 | |
| InternLM2-7BParameters=7B2023.06 | 25.66 | 41.74 | 50.87 | 43.78 | |
| ChatLaw-33BParams=33B, Local=Yes2026.04 | 20.17 | 22.55 | 32.14 | 26.14 | |
| Fuzi-MingchaCategory=Legal LLMs2023.06 | 20.04 | 30.25 | 37.39 | 32.08 | |
| ChatGLM2-6BCategory=General LLMs2023.06 | 15.54 | 23.45 | 41.5 | 29.88 | |
| ChatGLM2-6BParameters=6B2023.06 | 15.54 | 23.45 | 41.5 | 29.88 |