Grammatical knowledge on sBLIMP Speech
71.6Accuracy(ASR +) LLAMA 2
Evaluation results
| Method | Links | |
|---|---|---|
| (ASR +) LLAMA 2Modality=Speech, Setting=Zero-shot2024.02 | 71.6 | |
| AudioLMModality=Speech, Setting=Zero-shot2024.02 | 64.7 | |
| TWISTModality=Speech, Setting=Zero-shot2024.02 | 59.2 | |
| SPIRIT LM BASEModality=Speech, Setting=Zero-shot2024.02 | 58.3 | |
| VoxtlmModality=Speech, Setting=Zero-shot2024.02 | 57.1 | |
| GSLMModality=Speech, Setting=Zero-shot2024.02 | 54.2 | |
| SPIRIT LM EXPRESSIVEModality=Speech, Setting=Zero-shot2024.02 | 54.2 |