Chinese Word Segmentation on PKU (test)
97.16F1ChineseBERT
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| ChineseBERTModel size=Large, Pre-trained on extended data=false2021.06 | 97.16 | 98.01 | |
| ChineseBERTModel size=Base, Pre-trained on extended data=false2021.06 | 97.02 | 97.81 | |
| RoBERTaModel size=Large, Pre-trained on extended data=true2021.06 | 96.95 | 97.8 | |
| RoBERTaModel size=Base, Pre-trained on extended data=true2021.06 | 96.88 | 97.72 | |
| BABERT-LECategory=Supervised Lexicon Enhanced Model, External Knowledge=Yes2022.10 | 96.84 | — | |
| BERTModel size=Base, Pre-trained on extended data=true2021.06 | 96.82 | 97.7 | |
| BABERTCategory=Pre-Trained Language Model2022.10 | 96.7 | — | |
| BERT-LECategory=Supervised Lexicon Enhanced Model, External Knowledge=Yes, Reproduced=Yes2022.10 | 96.7 | — | |
| NEZHACategory=Pre-Trained Language Model2022.10 | 96.67 | — | |
| ZENCategory=Pre-Trained Language Model2022.10 | 96.55 | — | |
| MEM-ZENCategory=Supervised Lexicon Enhanced Model, External Knowledge=Yes2022.10 | 96.53 | — | |
| BERT-wwmCategory=Pre-Trained Language Model2022.10 | 96.51 | — | |
| MEM-BERTCategory=Supervised Lexicon Enhanced Model, External Knowledge=Yes2022.10 | 96.51 | — | |
| ERNIE-GramCategory=Pre-Trained Language Model2022.10 | 96.36 | — | |
| ERNIECategory=Pre-Trained Language Model2022.10 | 96.3 | — | |
| BERTCategory=Pre-Trained Language Model2022.10 | 96.26 | — | |
| LatticeCategory=Supervised Lexicon Enhanced Model, External Knowledge=Yes2022.10 | 95.8 | — | |
| LLACABackbone=Qwen1.5-14B2025.05 | 89.3 | — | |
| LLACABackbone=Qwen1.5-72B2025.05 | 88.7 | — | |
| LLACABackbone=Qwen1.5-7B2025.05 | 87.7 | — | |
| LLACABackbone=Qwen1.5-32B2025.05 | 87.6 | — | |
| UniBackbone=Qwen1.5-7B2025.05 | 87.5 | — | |
| LLM-WSBackbone=Qwen1.5-14B2025.05 | 87 | — | |
| LLM-WSBackbone=Qwen1.5-7B2025.05 | 86.7 | — | |
| LLM-WSBackbone=Qwen1.5-32B2025.05 | 86.3 | — | |
| PYHSMM2025.05 | 81.6 | — | |
| Joint2025.05 | 81.1 | — | |
| SLM-22025.05 | 80.2 | — | |
| nVBE2025.05 | 80 | — | |
| SGB-C-42025.05 | 80 | — | |
| SLM-32025.05 | 79.8 | — | |
| SGB-C-52025.05 | 78.4 | — |