Ontological tokenization of physical quantities on EngQuant
100Atomicity Score (H1)TOTEN
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| TOTEN2026.06 | 100 | 96.8 | 32.6 | 78 | |
| BPE o200k_baseTokenizer=BPE, Base=o200k2026.06 | 48.3 | — | 0 | 0 | |
| BPE cl100k_baseTokenizer=BPE, Base=cl100k2026.06 | 47.9 | — | 0 | 0 | |
| GLiNER2026.06 | 31.3 | — | 0 | 0 | |
| Quantulum32026.06 | 29.7 | — | 0 | 22 | |
| spaCy NER ptTask=NER, Language=Portuguese2026.06 | 25.7 | — | 0 | 0 | |
| CQE2026.06 | 22.5 | — | 0 | 34 | |
| Pint standaloneMode=standalone2026.06 | 0 | 98.5 | 29.5 | 22 | |
| udunits-22026.06 | 0 | 100 | 9.6 | 0 |