Affordance Reasoning on Affordance Dataset Setting D: U/U 1.0 (test)
83AccuracyGPT-5-nano
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-5-nanoPrompting Strategy=CoT, Latency (ms)=20,5002026.06 | 83 | |
| GPT-5.4Scale=medium, Latency (ms)=2,6462026.06 | 82.5 | |
| GPT-5-nanoPrompting Strategy=standard, Latency (ms)=4,1002026.06 | 82 | |
| GPT-5-miniLatency (ms)=3,9002026.06 | 81.5 | |
| GPT-5.4Scale=low, Latency (ms)=1,8712026.06 | 81.5 | |
| BLIPEvaluation Protocol=zero-shot, Latency (ms)=842026.06 | 69 | |
| A4DWeight Freezing Strategy=CLIP frozen-text, Latency (ms)=222026.06 | 66.5 | |
| A4DWeight Freezing Strategy=CLIP unfrozen, Latency (ms)=222026.06 | 60.5 | |
| A4DWeight Freezing Strategy=CLIP frozen-vision, Latency (ms)=222026.06 | 54 | |
| SigLIPEvaluation Protocol=zero-shot, Latency (ms)=202026.06 | 41.5 | |
| CLIPEvaluation Protocol=zero-shot, Latency (ms)=212026.06 | 40 | |
| ViLT-B32Evaluation Protocol=VQA, Latency (ms)=92026.06 | 22.8 |