Semantic Understanding on Topic-StoryCloze T→T
98.5Accuracy(ASR +) LLAMA 2
Evaluation results
| Method | Links | |
|---|---|---|
| (ASR +) LLAMA 2Modality direction=Text to Text, Setting=Zero-shot2024.02 | 98.5 | |
| SPIRIT LM BASEModality direction=Text to Text, Setting=Zero-shot2024.02 | 98 | |
| SPIRIT LM EXPRESSIVEModality direction=Text to Text, Setting=Zero-shot2024.02 | 97.9 | |
| (ASR +) LLAMA 2Modality direction=Text to Text, Setting=Zero-shot2024.02 | 81.9 | |
| SPIRIT LM BASEModality direction=Text to Text, Setting=Zero-shot2024.02 | 79.4 | |
| SPIRIT LM EXPRESSIVEModality direction=Text to Text, Setting=Zero-shot2024.02 | 78.9 |