Visual Question Answering on VQA 2.0
54.5AccuracyOctoTools
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| OctoToolsBackbone=gpt-4o-2024-08-06, Modality=Vision, Domain=General, Visual Understanding=true, Numerical Calculation=false, Knowledge Retrieval=false, Multi-step Reasoning=true2025.02 | 54.5 | 4.2 | 5.8 | |
| 0-shotBackbone=gpt-4o-2024-08-06, Modality=Vision, Domain=General, Visual Understanding=true, Numerical Calculation=false, Knowledge Retrieval=false, Multi-step Reasoning=true2025.02 | 50.3 | — | — | |
| CoTBackbone=gpt-4o-2024-08-06, Modality=Vision, Domain=General, Visual Understanding=true, Numerical Calculation=false, Knowledge Retrieval=false, Multi-step Reasoning=true2025.02 | 48.7 | — | — | |
| OctoToolsbaseBackbone=gpt-4o-2024-08-06, Modality=Vision, Domain=General, Visual Understanding=true, Numerical Calculation=false, Knowledge Retrieval=false, Multi-step Reasoning=true2025.02 | 47.2 | — | — |