Lexical knowledge evaluation on sWUGGY ZeroResource Challenge 2021 (dev)
97.9Success Rate (All)Phone topline
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Phone toplineText Supervision=Yes, Causality=N/A2022.09 | 97.9 | — | |
| Forced alignment toplineText Supervision=Yes, Causality=N/A2022.09 | 92.2 | — | |
| AudioLMText Supervision=No, Causality=Causal2022.09 | 71.5 | 83.7 | |
| HuBERT-onlyText Supervision=No, Causality=Non-causal2022.09 | 70.9 | 79.8 | |
| BERT baselineText Supervision=No, Causality=Non-causal2022.09 | 67.7 | 75.6 | |
| Harwath et al.Text Supervision=No, Causality=Non-causal2022.09 | 67.6 | 75.4 | |
| van Niekerk et al.Text Supervision=No, Causality=Causal2022.09 | 64.3 | 72.3 | |
| CPC-BERTText Supervision=No, Causality=Non-causal2022.09 | — | 80 | |
| GSLMText Supervision=No, Causality=Causal2022.09 | — | 68.7 |