Chinese Spelling Check on SIGHAN14 (test)
71.2Correction F1DORM
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| DORM2023.05 | 71.2 | — | — | — | — | — | 69.5 | 73.1 | — | — | — | |
| LEAD2023.05 | 70.8 | — | — | — | — | — | 70.7 | 71 | — | — | — | |
| DORM2023.05 | 70.1 | — | — | — | — | — | 68.4 | 71.9 | — | — | — | |
| MLM-phonetics2023.05 | 69.8 | — | — | — | — | — | 66.2 | 73.8 | — | — | — | |
| REALISE2023.05 | 69.6 | — | — | — | — | — | 67.8 | 71.5 | — | — | — | |
| LEAD2023.05 | 69.5 | — | — | — | — | — | 69.3 | 69.6 | — | — | — | |
| DCN2023.05 | 68.9 | — | — | — | — | — | 67.4 | 70.4 | — | — | — | |
| MLM-phonetics2023.05 | 68.7 | — | — | — | — | — | 64.2 | 73.8 | — | — | — | |
| BERTStrategy=Pre-trained for CSC2021.05 | 68.6 | — | — | — | 70.4 | — | — | — | — | — | — | |
| REALISE2021.05 | 68.1 | 78.4 | 67.8 | 71.5 | 69.6 | 77.7 | 66.3 | 70 | — | — | — | |
| REALISE2023.05 | 68.1 | — | — | — | — | — | 66.3 | 70 | — | — | — | |
| SpellGCN2023.05 | 67.2 | — | — | — | — | — | 65.1 | 69.5 | — | — | — | |
| DCN2023.05 | 67.2 | — | — | — | — | — | 65.8 | 68.7 | — | — | — | |
| BERTStrategy=Adversarial training2021.05 | 66.8 | — | — | — | 68.4 | — | — | — | — | — | — | |
| BERTFine-tuned=true2023.05 | 66.5 | — | — | — | — | — | 64.5 | 68.6 | — | — | — | |
| SpellGCNStrategy=Pre-trained for CSC2021.05 | 66.4 | — | — | — | 67.3 | — | — | — | — | — | — | |
| Soft-masked BERTStrategy=Pre-trained for CSC2021.05 | 65.6 | — | — | — | 67.2 | — | — | — | — | — | — | |
| SpellGCNStrategy=Adversarial training2021.05 | 65.4 | — | — | — | 66.4 | — | — | — | — | — | — | |
| SpellGCN2021.05 | 65.3 | — | 65.1 | 69.5 | 67.2 | — | 63.1 | 67.2 | — | — | — | |
| SpellGCN2023.05 | 65.3 | — | — | — | — | — | 63.1 | 67.2 | — | — | — | |
| BERTStrategy=Baseline2021.05 | 65 | — | — | — | 66.8 | — | — | — | — | — | — | |
| BERT2021.05 | 64.3 | 75.7 | 64.5 | 68.6 | 66.5 | 74.6 | 62.4 | 66.3 | — | — | — | |
| BERTFine-tuned=true2023.05 | 64.3 | — | — | — | — | — | 62.4 | 66.3 | — | — | — | |
| SpellGCNStrategy=Baseline2021.05 | 63.6 | — | — | — | 64.8 | — | — | — | — | — | — | |
| Soft-masked BERTStrategy=Adversarial training2021.05 | 62.7 | — | — | — | 65 | — | — | — | — | — | — | |
| Soft-masked BERTStrategy=Baseline2021.05 | 59.6 | — | — | — | 62.2 | — | — | — | — | — | — | |
| Sequence Labeling2021.05 | 56.1 | — | 51.9 | 66.2 | 58.2 | — | — | — | — | — | — | |
| FASpell2021.05 | 55.4 | 70 | 61 | 53.5 | 57 | 69.3 | 59.4 | 52 | — | — | — | |
| BERT2024.07 | — | — | — | — | — | — | — | — | 62.4 | 66.3 | 64.3 | |
| ChatGLMParadigm=Zero-shot2024.07 | — | — | — | — | — | — | — | — | 7.1 | 33.3 | 11.8 | |
| ChatGLM-FinetuneParadigm=Fine-tuned2024.07 | — | — | — | — | — | — | — | — | 45.2 | 63.8 | 52.9 | |
| ChatGPTParadigm=Zero-shot2024.07 | — | — | — | — | — | — | — | — | 48 | 75.1 | 58.4 | |
| Corpus Refining Strategy (Ours)Base Model=BERT2024.07 | — | — | — | — | — | — | — | — | 65.7 | 73.7 | 69.5 | |
| DCN2024.07 | — | — | — | — | — | — | — | — | 65.8 | 68.7 | 67.2 | |
| DORM2024.07 | — | — | — | — | — | — | — | — | 68.4 | 71.9 | 70.1 | |
| ECOPO2024.07 | — | — | — | — | — | — | — | — | 67.5 | 71 | 69.2 | |
| LEAD2024.07 | — | — | — | — | — | — | — | — | 69.3 | 69.6 | 69.5 | |
| PHMOSpell2024.07 | — | — | — | — | — | — | — | — | 81.8 | 63.6 | 71.6 | |
| SCOPE2024.07 | — | — | — | — | — | — | — | — | 68.6 | 71.5 | 70.1 | |
| SpellGCN2024.07 | — | — | — | — | — | — | — | — | 63.1 | 67.2 | 65.3 |