Multi-modal Question Answering on MultiModalQA (test)
44.7String Match AccuracyPost-hoc Selective Modality Escalation
Evaluation results
| Method | Links | |
|---|---|---|
| Post-hoc Selective Modality EscalationTarget budget=50%2026.07 | 44.7 | |
| Post-hoc Selective Modality EscalationTarget budget=45%2026.07 | 44.2 | |
| Post-hoc Selective Modality EscalationTarget budget=39%2026.07 | 43.5 | |
| Pre-retrievalTarget budget=45%2026.07 | 43.1 | |
| Pre-retrievalTarget budget=50%2026.07 | 43.1 | |
| Pre-retrievalTarget budget=39%2026.07 | 43 | |
| Pre-retrievalTarget budget=30%2026.07 | 42.4 | |
| Post-hoc Selective Modality EscalationTarget budget=30%2026.07 | 42.1 | |
| RandomTarget budget=45%2026.07 | 39.7 | |
| RandomTarget budget=50%2026.07 | 39.6 | |
| RandomTarget budget=39%2026.07 | 38.6 | |
| RandomTarget budget=30%2026.07 | 37.9 |