Multimodal Question Answering on MultiModalQA (val)
65.1EMHPROPRO
Evaluation results
| Method | Links | ||
|---|---|---|---|
| HPROPROOracle Setting=true2024.02 | 65.1 | 73.1 | |
| MMHQA-ICLOracle Setting=true2024.02 | 65 | 75.9 | |
| SKURGFine-tuning=true, Oracle Setting=false2024.02 | 59.4 | 63.8 | |
| PReasM-LargeFine-tuning=true, Oracle Setting=false2024.02 | 59 | 65.5 | |
| HPROPROFine-tuning=false, Oracle Setting=false2024.02 | 59 | 66.7 | |
| BinderOracle Setting=true2024.02 | 58.1 | 64.5 | |
| MMHQA-ICLFine-tuning=false, Oracle Setting=false2024.02 | 54.8 | 65.8 | |
| BinderFine-tuning=false, Oracle Setting=false2024.02 | 51 | 57.1 | |
| Implicit-DecompFine-tuning=true, Oracle Setting=false2024.02 | 48.8 | 55.5 | |
| AutoRoutingFine-tuning=true, Oracle Setting=false2024.02 | 42.1 | 49.5 |