Long speech understanding and reasoning on MMBench Audio
0.4938AccuracyUni-MoE
Evaluation Results
| Method | Links | |
|---|---|---|
| Uni-MoETraining Task=MoE-Task2, Training Epochs=2 epoch2024.05 | 0.4938 | |
| Single-Modality-Expert-Task7Evaluation Protocol=zero-shot2024.05 | 0.4783 | |
| Single-Modality-Expert-Task6Evaluation Protocol=zero-shot2024.05 | 0.4752 | |
| Uni-MoETraining Task=MoE-Task1, Training Epochs=3 epoch2024.05 | 0.472 | |
| Single-Modality-Expert-Task4Evaluation Protocol=zero-shot2024.05 | 0.4596 | |
| Uni-MoETraining Task=MoE-Task1, Training Epochs=2 epoch2024.05 | 0.4441 | |
| Single-Modality-Expert-Task5Evaluation Protocol=zero-shot2024.05 | 0.413 | |
| Uni-MoETraining Task=MoE-Task1-short-speech, Training Epochs=2 epoch2024.05 | 0.3758 | |
| Uni-MoETraining Task=MoE-Task1-short-speech, Training Epochs=3 epoch2024.05 | 0.3478 | |
| X-InstructBLIPEvaluation Protocol=zero-shot2024.05 | 0.1123 | |
| Macaw-LLMEvaluation Protocol=zero-shot2024.05 | 0.0186 |