Information Extraction on Loong Legal
62.2Spotlight Locating AccuracyLLaMA-3.2-3B-Instruct (LITECOST)
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| LLaMA-3.2-3B-Instruct (LITECOST)Size=3B2026.03 | 62.2 | 30 | 45.2 | 2 | 45 | 9 | 36.55 | 2 | 45.45 | 9 | |
| Qwen2-7B-Instruct (LITECOST)Size=7B2026.03 | 52.85 | 12 | 31 | 0 | 60.37 | 22 | 37.88 | 6 | 44.94 | 10 | |
| GPT-4oSize=200B2026.03 | 50.05 | 6 | 27 | 1 | 61.16 | 14 | 33.11 | 3 | 42.06 | 6 | |
| Qwen2.5-14B-InstructSize=14B2026.03 | 48.45 | 8 | 21.9 | 1 | 57.31 | 16 | 26.74 | 2 | 37.51 | 6 | |
| GPT-4o-miniSize=8B2026.03 | 46.55 | 10 | 28.05 | 0 | 48.68 | 13 | 42.56 | 11 | 41.94 | 9 | |
| LLaMA-3.2-3B-Instruct (Base)Size=3B2026.03 | 41 | 8 | 25.1 | 1 | 31.74 | 2 | 27.29 | 1 | 30.67 | 3 | |
| Qwen2-7B-Instruct (Base)Size=7B2026.03 | 37.9 | 5 | 18.9 | 0 | 57.85 | 18 | 35.44 | 8 | 38.05 | 8 |