Lexical knowledge on sWUGGY Text (test)
84.1Accuracy(ASR +) LLAMA 2
Evaluation Results
| Method | Links | |
|---|---|---|
| (ASR +) LLAMA 2Modality=Text, Setting=Zero-shot, Likelihood normalization=By number of tokens2024.02 | 84.1 | |
| VoxtlmModality=Text, Setting=Zero-shot, Likelihood normalization=By number of tokens2024.02 | 80.3 | |
| SPIRIT LM BASEModality=Text, Setting=Zero-shot, Likelihood normalization=By number of tokens2024.02 | 80.3 | |
| SPIRIT LM EXPRESSIVEModality=Text, Setting=Zero-shot, Likelihood normalization=By number of tokens2024.02 | 75.8 |