Semantic Understanding on Topic-StoryCloze S→S
94.76Accuracy(ASR +) LLAMA 2
Evaluation results
| Method | Links | |
|---|---|---|
| (ASR +) LLAMA 2Modality direction=Speech to Speech, Setting=Zero-shot2024.02 | 94.76 | |
| SPIRIT LM BASEModality direction=Speech to Speech, Setting=Zero-shot2024.02 | 82.9 | |
| TWISTModality direction=Speech to Speech, Setting=Zero-shot2024.02 | 76.4 | |
| (ASR +) LLAMA 2Modality direction=Speech to Speech, Setting=Zero-shot2024.02 | 75.7 | |
| SPIRIT LM EXPRESSIVEModality direction=Speech to Speech, Setting=Zero-shot2024.02 | 75.4 | |
| GSLMModality direction=Speech to Speech, Setting=Zero-shot2024.02 | 66.6 | |
| SPIRIT LM BASEModality direction=Speech to Speech, Setting=Zero-shot2024.02 | 61 | |
| SPIRIT LM EXPRESSIVEModality direction=Speech to Speech, Setting=Zero-shot2024.02 | 56.9 | |
| TWISTModality direction=Speech to Speech, Setting=Zero-shot2024.02 | 55.4 | |
| GSLMModality direction=Speech to Speech, Setting=Zero-shot2024.02 | 53.3 |