Reasoning Segmentation on MUSE (val)
48gIoU (overall)POPEN
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| POPENLLM Size=13B, preference-based ensemble=true2025.04 | 48 | 59.1 | 9.1 | 4.2 | 7.7 | |
| POPENLLM Size=13B, preference-based ensemble=false2025.04 | 46.9 | 57.7 | 11.9 | 5.6 | 7.3 | |
| POPENLLM Size=7B, preference-based ensemble=true2025.04 | 45.4 | 55.2 | 9.3 | 4.3 | 7.7 | |
| PixelLM-Llama2-13Bw/o SAM=true, TFLOPS=6.65, token fusion mechanism=true, target refinement loss=true2023.12 | 44.8 | 54.1 | — | — | — | |
| POPENLLM Size=7B, preference-based ensemble=false2025.04 | 44.1 | 53.8 | 12.1 | 5.6 | 7.2 | |
| PixelLMLLM Size=13B2025.04 | 44 | 52.9 | 21.1 | 9.4 | 6.4 | |
| LISA-Llama2-13Baugw/o SAM=false, TFLOPS=10.242023.12 | 43.6 | 50.2 | — | — | — | |
| PixelLM-Llama2-13B†w/o SAM=true, TFLOPS=6.65, token fusion mechanism=false, target refinement loss=false2023.12 | 43 | 51.7 | — | — | — | |
| PixelLM-7Bw/o SAM=true, TFLOPS=3.57, token fusion mechanism=true, target refinement loss=true2023.12 | 42.6 | 50.7 | — | — | — | |
| LISA-7Baugw/o SAM=false, TFLOPS=7.162023.12 | 42 | 46.1 | — | — | — | |
| PixelLMLLM Size=7B2025.04 | 41.9 | 48.9 | 22 | 9.8 | 6.2 | |
| GSVALLM Size=13B2025.04 | 41.7 | 50.3 | 20.6 | 9.3 | 6.4 | |
| GLaMMLLM Size=7B2025.04 | 41.5 | 48 | 20.8 | 9.5 | 6.1 | |
| PixelLM-7B†w/o SAM=true, TFLOPS=3.57, token fusion mechanism=false, target refinement loss=false2023.12 | 39.9 | 48 | — | — | — | |
| GSVALLM Size=7B2025.04 | 38.9 | 40.9 | 21.8 | 9.9 | 6.3 | |
| LISA-7Brecw/o SAM=false, TFLOPS=7.162023.12 | 24.5 | 31.1 | — | — | — | |
| LISA-Llama2-13Bw/o SAM=false, TFLOPS=10.242023.12 | 20.4 | 29.2 | — | — | — | |
| LISALLM Size=13B2025.04 | 20 | 28.9 | 22 | 10.5 | 5.9 | |
| LISA-7Bw/o SAM=false, TFLOPS=7.162023.12 | 18.8 | 29 | — | — | — | |
| LISALLM Size=7B2025.04 | 17.2 | 28.8 | 23.2 | 10.3 | 5.6 | |
| SEEMTFLOPS=0.432023.12 | 13.6 | 16.2 | — | — | — |