Speech-Visual Question Answering on VQA Speech-converted v2
32.95AccuracySingle-Modality-Expert-Task3
Evaluation Results
| Method | Links | |
|---|---|---|
| Single-Modality-Expert-Task3Evaluation Protocol=zero-shot2024.05 | 32.95 | |
| Single-Modality-Expert-Task1Evaluation Protocol=zero-shot2024.05 | 32.6 | |
| Uni-MoETraining Task=MoE-Task1-short-speech, Training Epochs=2 epoch2024.05 | 31.28 | |
| Uni-MoETraining Task=MoE-Task1-short-speech, Training Epochs=3 epoch2024.05 | 30.86 | |
| X-InstructBLIPEvaluation Protocol=zero-shot2024.05 | 26.47 | |
| Uni-MoETraining Task=MoE-Task1, Training Epochs=2 epoch2024.05 | 26.01 | |
| Single-Modality-Expert-Task6Evaluation Protocol=zero-shot2024.05 | 25.11 | |
| Single-Modality-Expert-Task4Evaluation Protocol=zero-shot2024.05 | 24.3 | |
| Uni-MoETraining Task=MoE-Task1, Training Epochs=3 epoch2024.05 | 20.14 | |
| Uni-MoETraining Task=MoE-Task2, Training Epochs=2 epoch2024.05 | 12.68 | |
| Single-Modality-Expert-Task5Evaluation Protocol=zero-shot2024.05 | 5.9 | |
| Macaw-LLMEvaluation Protocol=zero-shot2024.05 | 2.33 |