Long speech understanding and reasoning on RACE-Audio middle
50.77AccuracyUni-MoE
Evaluation results
| Method | Links | |
|---|---|---|
| Uni-MoETraining Task=MoE-Task1, Training Epochs=3 epoch2024.05 | 50.77 | |
| Uni-MoETraining Task=MoE-Task2, Training Epochs=2 epoch2024.05 | 49.65 | |
| Uni-MoETraining Task=MoE-Task1, Training Epochs=2 epoch2024.05 | 47.08 | |
| Single-Modality-Expert-Task7Evaluation Protocol=zero-shot2024.05 | 46.8 | |
| Single-Modality-Expert-Task6Evaluation Protocol=zero-shot2024.05 | 32.59 | |
| Single-Modality-Expert-Task5Evaluation Protocol=zero-shot2024.05 | 30.78 | |
| Single-Modality-Expert-Task4Evaluation Protocol=zero-shot2024.05 | 29.46 | |
| X-InstructBLIPEvaluation Protocol=zero-shot2024.05 | 16.33 | |
| Macaw-LLMEvaluation Protocol=zero-shot2024.05 | 4.04 |