Lexical knowledge on sWUGGY Speech (test)
79.2Accuracy(ASR +) LLAMA 2
Evaluation results
| Method | Links | |
|---|---|---|
| (ASR +) LLAMA 2Modality=Speech, Setting=Zero-shot2024.02 | 79.2 | |
| TWISTModality=Speech, Setting=Zero-shot2024.02 | 74.5 | |
| AudioLMModality=Speech, Setting=Zero-shot2024.02 | 71.5 | |
| SPIRIT LM BASEModality=Speech, Setting=Zero-shot2024.02 | 69 | |
| VoxtlmModality=Speech, Setting=Zero-shot2024.02 | 66.1 | |
| SPIRIT LM EXPRESSIVEModality=Speech, Setting=Zero-shot2024.02 | 65 | |
| GSLMModality=Speech, Setting=Zero-shot2024.02 | 64.8 |