Reasoning-driven segmentation on SegEarth R2 (train)
2.12Faithfulness (Qwen-8B)LISA-7B
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| LISA-7BCategory=Reasoning segmentation2026.03 | 2.12 | 2.02 | 2.18 | 2.35 | 2 | 2.21 | 3.1 | 2.45 | 2.95 | |
| GeoSegCategory=Ours2026.03 | 1.78 | 1.71 | 1.81 | 1.94 | 1.69 | 1.82 | 2.65 | 2.8 | 2.5 | |
| CLIP SurgeryCategory=Generalist segmentation2026.03 | 1.57 | 1.52 | 1.61 | 1.74 | 1.54 | 1.66 | 2.35 | 2.05 | 2.25 | |
| Grounded SAMCategory=Generalist segmentation2026.03 | 1.42 | 1.39 | 1.44 | 1.55 | 1.41 | 1.5 | 2.05 | 1.88 | 2.03 | |
| SAM3Category=Generalist segmentation2026.03 | 1.39 | 1.36 | 1.4 | 1.5 | 1.37 | 1.46 | 2 | 1.87 | 1.99 | |
| BAGELCategory=Open-source MLLMs2026.03 | 1.26 | 1.23 | 1.28 | 1.4 | 1.25 | 1.33 | 2.1 | 1.85 | 2 | |
| GSVACategory=Reasoning segmentation2026.03 | 1.25 | 1.23 | 1.28 | 1.37 | 1.25 | 1.33 | 1.81 | 1.72 | 1.81 | |
| LISA++Category=Reasoning segmentation2026.03 | 1.16 | 1.15 | 1.16 | 1.18 | 1.14 | 1.16 | 1.64 | 1.53 | 1.57 | |
| UniWorldCategory=Open-source MLLMs2026.03 | 1.15 | 1.14 | 1.17 | 1.26 | 1.16 | 1.21 | 1.72 | 1.53 | 1.62 | |
| OmniGen2Category=Open-source MLLMs2026.03 | 1.14 | 1.13 | 1.16 | 1.22 | 1.14 | 1.19 | 1.62 | 1.52 | 1.65 | |
| Qwen-EditCategory=Open-source MLLMs2026.03 | 1.12 | 1.11 | 1.13 | 1.13 | 1.11 | 1.14 | 1.5 | 1.46 | 1.52 | |
| PixelLMCategory=Reasoning segmentation2026.03 | 1.1 | 1.09 | 1.11 | 1.13 | 1.09 | 1.11 | 1.53 | 1.49 | 1.45 | |
| HunyuanCategory=Open-source MLLMs2026.03 | 1.04 | 1.04 | 1.05 | 1.1 | 1.05 | 1.08 | 1.5 | 1.45 | 1.49 | |
| GLAMMCategory=Reasoning segmentation2026.03 | 1 | 1 | 1 | 1.01 | 1.01 | 1.01 | 1.38 | 1.35 | 1.33 |