Text Segmentation on arXiv
0.3733PkSemantic Shift Splitter
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Semantic Shift SplitterGranularity=≈3, avg_sents=3.041, var_sents=0.9772026.03 | 0.3733 | 0.3894 | 38.09 | 62.44 | 47.31 | |
| Semantic Shift SplitterGranularity=≈5, avg_sents=5.049, var_sents=1.4892026.03 | 0.3763 | 0.3827 | 34.52 | 34.06 | 34.29 | |
| Semantic SplitterGranularity=≈5, avg_sents=4.990, var_sents=16.3712026.03 | 0.3914 | 0.4074 | 15.55 | 15.53 | 15.54 | |
| Semantic SplitterGranularity=≈7, avg_sents=7.117, var_sents=41.0462026.03 | 0.3944 | 0.4007 | 13.84 | 9.68 | 11.39 | |
| Semantic Shift SplitterGranularity=≈7, avg_sents=7.134, var_sents=1.6002026.03 | 0.4051 | 0.4104 | 30.14 | 21.04 | 24.78 | |
| Semantic SplitterGranularity=≈3, avg_sents=3.123, var_sents=5.3952026.03 | 0.4088 | 0.4533 | 16.84 | 26.88 | 20.71 | |
| Fixed SplitterGranularity=≈7, avg_sents=7.000, var_sents=0.0002026.03 | 0.4352 | 0.4382 | 22.54 | 16.03 | 18.73 | |
| Fixed SplitterGranularity=≈5, avg_sents=4.998, var_sents=0.0022026.03 | 0.4854 | 0.4884 | 20.1 | 20.03 | 20.07 | |
| Fixed SplitterGranularity=≈3, avg_sents=2.998, var_sents=0.0042026.03 | 0.5353 | 0.541 | 19.98 | 33.22 | 24.95 | |
| Embed-KCPDEmbedding=sBERT, Kernel=Cosine kernel, Learning Strategy=Unsupervised2026.01 | 7.9 | 8.2 | — | — | — | |
| Embed-KCPDEmbedding=RoBERTa, Kernel=Cosine kernel, Learning Strategy=Unsupervised2026.01 | 8.3 | 8.8 | — | — | — | |
| Embed-KCPDEmbedding=MPNet, Kernel=Cosine kernel, Learning Strategy=Unsupervised2026.01 | 9.1 | 9.2 | — | — | — | |
| Embed-KCPDEmbedding=text-embedding-3-small, Kernel=Cosine kernel, Learning Strategy=Unsupervised2026.01 | 9.2 | 9.3 | — | — | — | |
| Embed-KCPDEmbedding=RoBERTa, Kernel=RBF kernel, Learning Strategy=Unsupervised2026.01 | 10.7 | 11.7 | — | — | — | |
| Embed-KCPDEmbedding=sBERT, Kernel=RBF kernel, Learning Strategy=Unsupervised2026.01 | 11.2 | 11.8 | — | — | — | |
| Embed-KCPDEmbedding=text-embedding-3-small, Kernel=RBF kernel, Learning Strategy=Unsupervised2026.01 | 11.3 | 11.7 | — | — | — | |
| Embed-KCPDEmbedding=MPNet, Kernel=RBF kernel, Learning Strategy=Unsupervised2026.01 | 14.7 | 15.7 | — | — | — | |
| TextTilingEmbedding=MPNet, Learning Strategy=Unsupervised2026.01 | 27.1 | 39.9 | — | — | — | |
| GraphSegLearning Strategy=Unsupervised2026.01 | 29 | 29.1 | — | — | — | |
| TextTilingEmbedding=sBERT, Learning Strategy=Unsupervised2026.01 | 34.8 | 73.7 | — | — | — | |
| CoherenceLearning Strategy=Unsupervised2026.01 | 43 | 45.4 | — | — | — | |
| TextTilingLearning Strategy=Unsupervised2026.01 | 47.9 | 40.1 | — | — | — |