Affordance reasoning on ReasonAff
67.41gIoUAffordance-R1
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Affordance-R1LLM=true, Reasoning=true2025.08 | 67.41 | 62.72 | 74.5 | 55.22 | |
| Vision ReasonerLLM=true, Reasoning=true2025.08 | 63.04 | 52.7 | 67.33 | 47.23 | |
| Affordance Agent HarnessTokens=5,247±109, Latency (s)=5.8±0.2, Cost ($)=2.62±0.052026.05 | 60.53 | 54.91 | — | — | |
| Seg-ZeroLLM=true, Reasoning=true2025.08 | 59.26 | 48.03 | 61.33 | 45.87 | |
| A4-Agent (GPT-4o)Tokens=6,978±124, Latency (s)=10.1±0.6, Cost ($)=3.88±0.112026.05 | 56.87 | 52.15 | — | — | |
| Full Fixed ChainTokens=9,578±141, Latency (s)=12.3±0.4, Cost ($)=4.79±0.092026.05 | 55.05 | 49.57 | — | — | |
| Det. & Seg.Tokens=3,842±96, Latency (s)=4.1±0.2, Cost ($)=1.92±0.052026.05 | 51.86 | 43.73 | — | — | |
| AffordanceLLMLLM=true, Reasoning=false2025.08 | 48.49 | 38.61 | 42.11 | 20.19 | |
| SAM4MLLMLLM=true, Reasoning=false2025.08 | 45.51 | 33.64 | 43.48 | 22.79 | |
| LISA-7BLLM=true, Reasoning=false2025.08 | 38.17 | 40.58 | 33.62 | 19.69 | |
| InternVL3-8BLLM=true, Reasoning=false2025.08 | 31.79 | 24.68 | 35.41 | 21.93 | |
| Qwen2.5VL-7BLLM=true, Reasoning=false2025.08 | 25.18 | 20.54 | 26 | 15.82 | |
| OVSegLLM=false, Reasoning=false2025.08 | 16.52 | 10.59 | 9.89 | 4.12 | |
| SANLLM=false, Reasoning=false2025.08 | 10.21 | 13.45 | 7.18 | 3.17 | |
| VLPartLLM=false, Reasoning=false2025.08 | 4.21 | 3.88 | 1.31 | 0.85 |