Token Efficiency Evaluation on 6 datasets aggregate (overall)
1RankJTON
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| JTONJSON-compat.=Yes, Tokenizer=o200k_base2026.04 | 1 | 144,159 | 20.2 | |
| TOONJSON-compat.=No, Tokenizer=o200k_base2026.04 | 2 | 146,113 | 19.2 | |
| JSON compactJSON-compat.=Yes, Tokenizer=o200k_base2026.04 | 3 | 180,725 | — | |
| YAMLJSON-compat.=No, Tokenizer=o200k_base2026.04 | 4 | 220,129 | 21.8 | |
| JSON prettyJSON-compat.=Yes, Tokenizer=o200k_base2026.04 | 5 | 282,332 | 56.2 | |
| XMLJSON-compat.=No, Tokenizer=o200k_base2026.04 | 6 | 332,171 | 83.8 |