Segmentation-based Grounding on ChartREG++ 1.0 (test)
64.26mIoU UnionOurs-SOM-QwenVL-8B (Oracle)
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Ours-SOM-QwenVL-8B (Oracle)Paradigm=Two-Stage Based, Candidate Generation=all gold-category segs, Oracle=true2026.05 | 64.26 | 75.85 | 66.85 | 67.86 | 76.35 | 68.14 | 68.38 | |
| Ours-SOM-QwenVL-32BParadigm=Two-Stage Based, Candidate Generation=all gold-category segs2026.05 | 52.42 | 59.65 | 57.46 | 56.77 | 59.78 | 58.34 | 56.73 | |
| Ours-SOM-QwenVL-8BParadigm=Two-Stage Based, Candidate Generation=all gold-category segs2026.05 | 45.06 | 56.57 | 49.19 | 50.08 | 57.33 | 49.63 | 50.3 | |
| Ours-SOM-QwenVL-32BParadigm=Two-Stage Based, Candidate Generation=all segs2026.05 | 42.93 | 44.64 | 52.55 | 43.82 | 43.75 | 49.85 | 43.79 | |
| Ours-SOM-InternVL3.5-8BParadigm=Two-Stage Based, Candidate Generation=all gold-category segs2026.05 | 36.63 | 43.54 | 35.76 | 37.07 | 48.94 | 41.52 | 42.07 | |
| Ours-SOM-InternVL3.5-30B-A3BParadigm=Two-Stage Based, Candidate Generation=all segs2026.05 | 34.7 | 34.6 | 35.58 | 34.25 | 41.81 | 40.88 | 37.29 | |
| Sa2VA-InternVL3-14BParadigm=E2E-Based2026.05 | 24 | — | — | — | — | — | — | |
| SAM3-SOM-QwenVL-32BParadigm=Two-Stage Based, Candidate Generation=SAM3-seg-everything2026.05 | 22.13 | 28.18 | 24.22 | 25.01 | 29.55 | 21.55 | 22.91 | |
| Sa2VA-Qwen2.5-VL-7BParadigm=E2E-Based2026.05 | 21 | — | — | — | — | — | — | |
| SAM3-SOM-InternVL3.5-30B-A3BParadigm=Two-Stage Based, Candidate Generation=SAM3-seg-everything2026.05 | 18.79 | 24.57 | 21.44 | 21.84 | 24.05 | 18.39 | 19.16 |