Chinese Spelling Check on SIGHAN13 (test)
85.4Detection F1REALISE
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| REALISEPost-processing=true2021.05 | 85.4 | 82.7 | 88.6 | 82.5 | 81.4 | 87.2 | 81.2 | 84.1 | — | — | — | |
| BERTStrategy=Pre-trained for CSC2021.05 | 84.9 | — | — | — | — | — | — | 84.4 | — | — | — | |
| Soft-masked BERTStrategy=Pre-trained for CSC2021.05 | 84.9 | — | — | — | — | — | — | 84.2 | — | — | — | |
| SpellGCNStrategy=Pre-trained for CSC2021.05 | 84.6 | — | — | — | — | — | — | 84 | — | — | — | |
| Soft-masked BERTStrategy=Adversarial training2021.05 | 84.1 | — | — | — | — | — | — | 83.3 | — | — | — | |
| BERTStrategy=Adversarial training2021.05 | 84 | — | — | — | — | — | — | 83.5 | — | — | — | |
| SpellGCNStrategy=Adversarial training2021.05 | 83.4 | — | — | — | — | — | — | 82.6 | — | — | — | |
| BERTStrategy=Baseline2021.05 | 82.9 | — | — | — | — | — | — | 82.1 | — | — | — | |
| SpellGCNImplementation Source=Our reimplementation2021.05 | 82.1 | 78.8 | 85.7 | 78.8 | 77.8 | 84.6 | 77.8 | 81 | — | — | — | |
| BERTPost-processing=true2021.05 | 80.8 | 77 | 85 | 77 | 75.2 | 83 | 75.2 | 78.9 | — | — | — | |
| SpellGCNStrategy=Baseline2021.05 | 80.8 | — | — | — | — | — | — | 80 | — | — | — | |
| Soft-masked BERTStrategy=Baseline2021.05 | 80.6 | — | — | — | — | — | — | 79.1 | — | — | — | |
| SpellGCNReference=Cheng et al., 20202021.05 | 77.2 | — | 80.1 | 74.4 | — | 78.3 | 72.7 | 75.4 | — | — | — | |
| BERTReference=Cheng et al., 20202021.05 | 75.8 | — | 79 | 72.8 | — | 77.7 | 71.6 | 74.6 | — | — | — | |
| FASpell2021.05 | 69.1 | 63.1 | 76.2 | 63.2 | 60.5 | 73.1 | 60.5 | 66.2 | — | — | — | |
| Sequence Labeling2021.05 | 60.7 | — | 54 | 69.3 | — | — | — | 52.1 | — | — | — | |
| BERTFine-tuned=true2023.05 | — | — | — | — | — | — | — | — | 85 | 77 | 80.8 | |
| BERTFine-tuned=true2023.05 | — | — | — | — | — | — | — | — | 83 | 75.2 | 78.9 | |
| DCN2023.05 | — | — | — | — | — | — | — | — | 86.8 | 79.6 | 83 | |
| DCN2023.05 | — | — | — | — | — | — | — | — | 84.7 | 77.7 | 81 | |
| DORM2023.05 | — | — | — | — | — | — | — | — | 87.9 | 83.7 | 85.8 | |
| DORM2023.05 | — | — | — | — | — | — | — | — | 86.8 | 82.7 | 84.7 | |
| LEAD2023.05 | — | — | — | — | — | — | — | — | 88.3 | 83.4 | 85.8 | |
| LEAD2023.05 | — | — | — | — | — | — | — | — | 87.2 | 82.4 | 84.7 | |
| MLM-phonetics2023.05 | — | — | — | — | — | — | — | — | 82 | 78.3 | 80.1 | |
| MLM-phonetics2023.05 | — | — | — | — | — | — | — | — | 79.5 | 77 | 78.2 | |
| REALISE2023.05 | — | — | — | — | — | — | — | — | 88.6 | 82.5 | 85.4 | |
| REALISE2023.05 | — | — | — | — | — | — | — | — | 87.2 | 81.2 | 84.1 | |
| SpellGCN2023.05 | — | — | — | — | — | — | — | — | 80.1 | 74.4 | 77.2 | |
| SpellGCN2023.05 | — | — | — | — | — | — | — | — | 78.3 | 72.7 | 75.4 |