Long speech understanding and reasoning on RACE-Audio high
49.37AccuracyUni-MoE
Evaluation results
| Method | Links | |
|---|---|---|
| Uni-MoETraining Task=MoE-Task2, Training Epochs=2 epoch2024.05 | 49.37 | |
| Uni-MoETraining Task=MoE-Task1, Training Epochs=3 epoch2024.05 | 48.94 | |
| Single-Modality-Expert-Task7Evaluation Protocol=zero-shot2024.05 | 48.74 | |
| Uni-MoETraining Task=MoE-Task1, Training Epochs=2 epoch2024.05 | 47.08 | |
| Single-Modality-Expert-Task6Evaluation Protocol=zero-shot2024.05 | 29.02 | |
| Single-Modality-Expert-Task4Evaluation Protocol=zero-shot2024.05 | 26.67 | |
| Single-Modality-Expert-Task5Evaluation Protocol=zero-shot2024.05 | 24.9 | |
| X-InstructBLIPEvaluation Protocol=zero-shot2024.05 | 18.88 | |
| Macaw-LLMEvaluation Protocol=zero-shot2024.05 | 3 |