Automatic Speaking Assessment on TEEMI (test)
37.1Content AccuracyMA + MMO
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| MA + MMOFramework=Multi-aspect (MA), Loss=Multi-Margin Ordinal (MMO) loss2025.08 | 37.1 | 34.77 | 42.34 | 40.87 | 42.34 | 40.22 | 36.29 | 35.55 | |
| MAFramework=Multi-aspect (MA)2025.08 | 35.89 | 31.6 | 41.53 | 39.04 | 38.31 | 31.83 | 33.87 | 26.28 | |
| W2VModel Type=Speech-based SSL2025.08 | 35.08 | 29.55 | 39.92 | 37.11 | 36.29 | 31.53 | 34.67 | 30.17 | |
| W2V-BERTModel Type=Multimodal fusion SSL2025.08 | 35.08 | 27.83 | 38.31 | 31.46 | 41.13 | 35.15 | 38.71 | 30.35 | |
| BERTModel Type=Text-based SSL2025.08 | 33.47 | 28.31 | 37.9 | 31.19 | 36.29 | 31.66 | 35.48 | 31.19 | |
| W2V-PTModel Type=Prototypical SSL variant2025.08 | 30.24 | 24.23 | 38.71 | 34.33 | 42.74 | 36 | 34.68 | 29.87 | |
| BERT-PTModel Type=Prototypical SSL variant2025.08 | 29.44 | 27.25 | 40.73 | 37.22 | 35.08 | 33.9 | 33.87 | 32.49 |