Reasoning Segmentation on ReasonSeg long (test)
0.733cIoUEVOL-SAM3
Evaluation results
| Method | Links | ||
|---|---|---|---|
| EVOL-SAM3Version=Qwen2.5-VL 7B, Training-RES=false, Training-ReasonSeg=false2025.12 | 0.733 | 0.743 | |
| SAM 3 AgentVersion=Qwen2.5-VL 72B, Training-RES=false, Training-ReasonSeg=false2025.12 | 0.663 | 0.71 | |
| RSVPVersion=Gemini1.5-Flash, Training-RES=false, Training-ReasonSeg=false2025.12 | 0.656 | 0.602 | |
| LISAVersion=LLaVA1.5 13B, Training-RES=true, Training-ReasonSeg=true2025.12 | 0.653 | 0.632 | |
| RSVPVersion=GPT-4o, Training-RES=false, Training-ReasonSeg=false2025.12 | 0.625 | 0.619 | |
| EVOL-SAM3Version=Qwen2.5-VL 3B, Training-RES=false, Training-ReasonSeg=false2025.12 | 0.625 | 0.671 | |
| RSVPModel Version=GPT-4o, RES Training=false, ReasonSeg Training=false2025.12 | 0.625 | 0.619 | |
| SAM 3 AgentVersion=Llama4 Maverick, Training-RES=false, Training-ReasonSeg=false2025.12 | 0.613 | 0.672 | |
| READVersion=LLaVA1.5 7B, Training-RES=true, Training-ReasonSeg=true2025.12 | 0.61 | 0.604 | |
| RSAgentModel Version=Qwen2.5-VL, Params=7B, RES Training=true, ReasonSeg Training=false2025.12 | 0.601 | 0.684 | |
| LISAVersion=LLaVA1.5 7B, Training-RES=true, Training-ReasonSeg=true2025.12 | 0.597 | 0.579 | |
| LISAModel Version=LLaVA1.5, Params=7B, RES Training=true, ReasonSeg Training=true2025.12 | 0.597 | 0.579 | |
| SAM3-AgentModel Version=Qwen2.5-VL, Params=7B, RES Training=false, ReasonSeg Training=false2025.12 | 0.578 | 0.637 | |
| HRSegVersion=LLaVA1.6 7B, Training-RES=true, Training-ReasonSeg=true2025.12 | 0.572 | 0.57 | |
| RSAgent-singleModel Version=Qwen2.5-VL, Params=7B, RES Training=true, ReasonSeg Training=false2025.12 | 0.563 | 0.621 | |
| SAM 3 AgentVersion=Qwen2.5-VL 7B, Training-RES=false, Training-ReasonSeg=false2025.12 | 0.562 | 0.641 | |
| LISAVersion=LLaVA 13B, Training-RES=true, Training-ReasonSeg=true2025.12 | 0.543 | 0.54 | |
| LISAVersion=Llama2 13B, Training-RES=true, Training-ReasonSeg=true2025.12 | 0.538 | 0.54 | |
| RSVPVersion=LLaVA1.6 7B, Training-RES=false, Training-ReasonSeg=false2025.12 | 0.53 | 0.584 | |
| RSVPVersion=Qwen2-VL 7B, Training-RES=false, Training-ReasonSeg=false2025.12 | 0.53 | 0.571 | |
| RSVPModel Version=LLaVA1.6, Params=7B, RES Training=false, ReasonSeg Training=false2025.12 | 0.53 | 0.584 | |
| Ref-DiffVersion=LLaVA1.5 13B, Training-RES=false, Training-ReasonSeg=false2025.12 | 0.51 | — | |
| LISAVersion=LLaVA 7B, Training-RES=true, Training-ReasonSeg=true2025.12 | 0.51 | 0.494 | |
| LISAVersion=LLaVA1.5 13B, Training-RES=false, Training-ReasonSeg=true2025.12 | 0.509 | 0.547 | |
| HRSegVersion=LLaVA1.1 7B, Training-RES=true, Training-ReasonSeg=true2025.12 | 0.505 | 0.516 | |
| Ref-DiffVersion=LLaVA1.5 7B, Training-RES=false, Training-ReasonSeg=false2025.12 | 0.491 | — | |
| LLM-SegVersion=LLaVA1.1 7B, Training-RES=true, Training-ReasonSeg=true2025.12 | 0.491 | 0.498 | |
| LISAVersion=LLaVA1.5 7B, Training-RES=true, Training-ReasonSeg=false2025.12 | 0.489 | 0.492 | |
| LISAModel Version=LLaVA1.5, Params=7B, RES Training=true, ReasonSeg Training=false2025.12 | 0.489 | 0.492 | |
| LISAVersion=LLaVA 13B, Training-RES=true, Training-ReasonSeg=false2025.12 | 0.465 | 0.464 | |
| X-SAMVersion=Phi3 3.8B, Training-RES=true, Training-ReasonSeg=true2025.12 | 0.408 | 0.56 | |
| X-SAMModel Version=Phi-3, Params=3.8B, RES Training=true, ReasonSeg Training=true2025.12 | 0.408 | 0.56 | |
| LISAVersion=LLaVA 7B, Training-RES=true, Training-ReasonSeg=false2025.12 | 0.347 | 0.366 | |
| OVSegVersion=–, Training-RES=false, Training-ReasonSeg=false2025.12 | 0.225 | 0.287 | |
| OVSegRES Training=false, ReasonSeg Training=false2025.12 | 0.225 | 0.287 | |
| SEEMVersion=–, Training-RES=false, Training-ReasonSeg=false2025.12 | 0.208 | 0.256 | |
| SEEMRES Training=false, ReasonSeg Training=false2025.12 | 0.208 | 0.256 | |
| Grounded SAMVersion=–, Training-RES=false, Training-ReasonSeg=false2025.12 | 0.186 | 0.224 | |
| Grounded-SAMRES Training=false, ReasonSeg Training=false2025.12 | 0.186 | 0.224 | |
| Gemini SegVersion=Gemini2.5 Flash, Training-RES=?, Training-ReasonSeg=?2025.12 | 0.095 | 0.35 |