Syntactic knowledge evaluation on sBLIMP ZeroResource Challenge 2021 (dev)
66.8Success RatePhone topline
Evaluation Results
| Method | Links | |
|---|---|---|
| Phone toplineText Supervision=Yes, Causality=N/A2022.09 | 66.8 | |
| AudioLMText Supervision=No, Causality=Causal2022.09 | 64.7 | |
| Forced alignment toplineText Supervision=Yes, Causality=N/A2022.09 | 63.7 | |
| CPC-BERTText Supervision=No, Causality=Non-causal2022.09 | 59.9 | |
| HuBERT-onlyText Supervision=No, Causality=Non-causal2022.09 | 59.5 | |
| GSLMText Supervision=No, Causality=Causal2022.09 | 57.1 | |
| Harwath et al.Text Supervision=No, Causality=Non-causal2022.09 | 56.7 | |
| BERT baselineText Supervision=No, Causality=Non-causal2022.09 | 56.1 | |
| van Niekerk et al.Text Supervision=No, Causality=Causal2022.09 | 54 |