Fine-grained Mask Generation on GeoHeight-Bench+
7.76mIoU (Obj-level IE)GeoHeightChat
Evaluation Results
| Method | Links | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| GeoHeightChat2026.03 | 7.76 | 14.59 | 27.56 | 30.93 | 54.08 | 53.94 | 30.63 | 6.57 | 28.26 | 9.37 | 16.44 | 40.66 | 52.59 | 58.76 | 75.6 | 28.71 | 6.4 | 36.07 | |
| LISA-7B (FT)Model Scale=7B, Evaluation Protocol=Fine-tuned (FT)2026.03 | 6.22 | 8.29 | 20.89 | 28.65 | 47.95 | 40.04 | 17.92 | 4.87 | 21.85 | 7.9 | 10.03 | 28.66 | 43.44 | 51.08 | 58.22 | 15.09 | 4.98 | 27.43 | |
| LISA-13BModel Scale=13B, Evaluation Protocol=Zero-shot2026.03 | 2.49 | 4.48 | 12.73 | 20.63 | 17.98 | 28.18 | 1.32 | 5.28 | 11.64 | 3.66 | 4.32 | 12.09 | 29.27 | 18.67 | 34.5 | 1.68 | 5.77 | 13.75 | |
| LISA-7BModel Scale=7B, Evaluation Protocol=Zero-shot2026.03 | 1.69 | 3.75 | 14.1 | 18.7 | 19.88 | 30.4 | 0.32 | 3.44 | 11.54 | 3.36 | 3.38 | 14.42 | 24.58 | 21.27 | 37.38 | 0.51 | 4.04 | 13.62 | |
| PixelLM-13BModel Scale=13B2026.03 | 1.64 | 3.63 | 12.84 | 20.16 | 18.51 | 25.58 | 8.55 | 0 | 11.36 | 1.58 | 1.49 | 12.91 | 30.94 | 19.19 | 27.38 | 10.43 | 0 | 12.99 | |
| PixelLM-7BModel Scale=7B2026.03 | 1.26 | 3.11 | 12.4 | 19.01 | 18.87 | 24.02 | 12.16 | 0.01 | 11.36 | 1.81 | 1.92 | 12.12 | 18.11 | 19.64 | 25.16 | 10.74 | 0.01 | 11.69 |