Structured Information Extraction on Loong Finance (test)
83.97Spotlight Locating (AS)LITECOST
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| LITECOSTBackbone=Qwen2-7B-Ins2026.03 | 83.97 | 62 | 81.55 | 59 | 81 | 43 | 67.98 | 18 | 79.93 | 48 | |
| ODIEBackbone=Qwen2-7B-Ins2026.03 | 82.13 | 59 | 73.85 | 48 | 73.54 | 32 | 55.3 | 12 | 72.86 | 40 | |
| Struc-benchBackbone=Qwen2-7B-Ins2026.03 | 81.6 | 63 | 74.9 | 53 | 73.4 | 36 | 60.35 | 19 | 73.72 | 44 | |
| LITECOSTBackbone=LLaMA-3.2-3B-Ins2026.03 | 81.27 | 53 | 78.08 | 49 | 78.34 | 36 | 64.75 | 16 | 76.95 | 40 | |
| IEpileBackbone=Qwen2-7B-Ins2026.03 | 71.83 | 45 | 72.6 | 46 | 70.86 | 29 | 54.2 | 11 | 69.19 | 35 | |
| ODIEBackbone=LLaMA-3.2-3B-Ins2026.03 | 68.89 | 39 | 61.3 | 30 | 61.11 | 15 | 49.75 | 7 | 61.21 | 23 | |
| IEpileBackbone=LLaMA-3.2-3B-Ins2026.03 | 62.9 | 37 | 65.1 | 30 | 63.12 | 14 | 50.95 | 2 | 61.9 | 22 | |
| Struc-benchBackbone=LLaMA-3.2-3B-Ins2026.03 | 55.13 | 15 | 51.05 | 15 | 48.16 | 6 | 44.1 | 8 | 49.9 | 11 | |
| StructRAGBackbone=Qwen2-7B-Ins2026.03 | 48.83 | 3 | 46.8 | 2 | 55.34 | 6 | 42.55 | 0 | 49.68 | 3 | |
| StructRAGBackbone=LLaMA-3.2-3B-Ins2026.03 | 39.5 | 1 | 39.7 | 2 | 31.08 | 0 | 35.95 | 0 | 36.04 | 1 |