Semantic understanding on Topic-StoryCloze S→T
94.76Accuracy(ASR +) LLAMA 2
Evaluation Results
| Method | Links | |
|---|---|---|
| (ASR +) LLAMA 2Modality direction=Speech to Text, Setting=Zero-shot2024.02 | 94.76 | |
| SPIRIT LM BASEModality direction=Speech to Text, Setting=Zero-shot2024.02 | 88.6 | |
| (ASR +) LLAMA 2Modality direction=Speech to Text, Setting=Zero-shot2024.02 | 75.7 | |
| SPIRIT LM EXPRESSIVEModality direction=Speech to Text, Setting=Zero-shot2024.02 | 73.2 | |
| SPIRIT LM BASEModality direction=Speech to Text, Setting=Zero-shot2024.02 | 64.6 | |
| SPIRIT LM EXPRESSIVEModality direction=Speech to Text, Setting=Zero-shot2024.02 | 58.8 |