Mispronunciation Detection on L2-ARCTIC (test)
71.77F1 ScoreCROTTC-IF
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| CROTTC-IFModel Category=Proposed Methods (LM & LLM)2026.04 | 71.77 | 76.94 | 67.24 | 3.39 | 32.76 | |
| PER-MDDModel Category=Frame-wise MDD Baselines2026.04 | 69.6 | 71.78 | 67.56 | 4.43 | 32.44 | |
| OTTCModel Category=Proposed Methods (AM)2026.04 | 63.18 | 66.36 | 60.29 | 5.14 | 39.71 | |
| Joint-alignModel Category=Frame-wise MDD Baselines2026.04 | 63.04 | 77.12 | 53.31 | — | — | |
| CROTTCModel Category=Proposed Methods (AM)2026.04 | 62.39 | 69.7 | 56.47 | 4.13 | 43.53 | |
| TG+Contrast.Model Category=Text-prompting-Style Baselines2026.04 | 61.75 | 62.12 | 61.38 | 6.19 | 38.62 | |
| Meta-LearnModel Category=Dictation-Style Baselines2026.04 | 61.45 | 91.6 | 46.24 | 29.75 | 8.4 | |
| w2v2-CTCModel Category=Dictation-Style Baselines2026.04 | 60.44 | 62.86 | 58.57 | 5.7 | 41.8 | |
| MV-w2v2Model Category=Dictation-Style Baselines2026.04 | 60.31 | 59.23 | 61.43 | — | — | |
| PG-MDDModel Category=Text-prompting-Style Baselines2026.04 | 60.1 | 60.06 | 60.15 | 6.65 | 39.94 | |
| RNN-TModel Category=Dictation-Style Baselines2026.04 | 59.1 | 63.4 | 55.3 | 5.3 | 44.7 | |
| CTC-IFModel Category=Proposed Methods (LM & LLM)2026.04 | 58.37 | 61.81 | 55.29 | 5.75 | 44.71 | |
| CROTTC-LLaMAModel Category=Proposed Methods (LM & LLM), Backbone=LLaMA-3.2-1B-Instruct2026.04 | 56.87 | 54.81 | 59.08 | 8.2 | 40.92 | |
| PeppanetModel Category=Text-prompting-Style Baselines2026.04 | 56.81 | 64.53 | 51.38 | 9.61 | 36.47 | |
| MDDGCNModel Category=Text-prompting-Style Baselines2026.04 | 56.49 | 51.9 | 61.97 | 9.18 | 38.03 | |
| AEL w/o Pos.Model Category=Text-prompting-Style Baselines2026.04 | 56.33 | 58.36 | 55 | 6.55 | 45 | |
| MPL-MDDModel Category=Dictation-Style Baselines2026.04 | 55.42 | 60.39 | 51.2 | 5.6 | 48.8 | |
| CROTTC-QwenModel Category=Proposed Methods (LM & LLM), Backbone=Qwen3-4B-Thinking 25072026.04 | 55.19 | 58 | 52.64 | 6.42 | 47.36 | |
| Qwen2-subModel Category=Text-prompting-Style Baselines2026.04 | 55 | 63.27 | 48.64 | — | — | |
| Qwen2Model Category=Text-prompting-Style Baselines2026.04 | 50.6 | 71.62 | 39.12 | — | — |